-- Logs begin at Mon 2022-08-29 14:32:49 UTC, end at Mon 2022-08-29 17:02:32 UTC. -- Aug 29 15:15:03.031778 n-d-854882-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 15:15:03.040824 n-d-854882-3 devstack@n-api.service[114121]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:15:03 2022] *** Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: nodename: n-d-854882-3 Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: machine: x86_64 Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: clock source: unix Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: pcre jit disabled Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: detected number of CPU cores: 4 Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: current working directory: / Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: your processes number limit is 47680 Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: your memory page size is 4096 bytes Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: detected max file descriptor number: 2048 Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: lock engine: pthread robust mutexes Aug 29 15:15:03.043045 n-d-854882-3 devstack@n-api.service[114121]: thunder lock: enabled Aug 29 15:15:03.044006 n-d-854882-3 devstack@n-api.service[114121]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 15:15:03.044006 n-d-854882-3 devstack@n-api.service[114121]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:15:03.083759 n-d-854882-3 devstack@n-api.service[114121]: Python main interpreter initialized at 0x55a7b118a9c0 Aug 29 15:15:03.083759 n-d-854882-3 devstack@n-api.service[114121]: python threads support enabled Aug 29 15:15:03.083759 n-d-854882-3 devstack@n-api.service[114121]: your server socket listen backlog is limited to 100 connections Aug 29 15:15:03.083759 n-d-854882-3 devstack@n-api.service[114121]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:15:03.084206 n-d-854882-3 devstack@n-api.service[114121]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:15:03.084206 n-d-854882-3 devstack@n-api.service[114121]: *** Operational MODE: preforking *** Aug 29 15:15:03.084491 n-d-854882-3 devstack@n-api.service[114121]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:15:03.084491 n-d-854882-3 devstack@n-api.service[114121]: spawned uWSGI master process (pid: 114121) Aug 29 15:15:03.084703 n-d-854882-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 15:15:03.085282 n-d-854882-3 devstack@n-api.service[114121]: spawned uWSGI worker 1 (pid: 114122, cores: 1) Aug 29 15:15:03.085642 n-d-854882-3 devstack@n-api.service[114121]: spawned uWSGI worker 2 (pid: 114123, cores: 1) Aug 29 15:15:03.086631 n-d-854882-3 devstack@n-api.service[114121]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:15:03.748318 n-d-854882-3 devstack@n-api.service[114123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:15:03.748920 n-d-854882-3 devstack@n-api.service[114122]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:15:04.828892 n-d-854882-3 devstack@n-api.service[114123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:15:04.828892 n-d-854882-3 devstack@n-api.service[114123]: from cryptography.utils import int_from_bytes Aug 29 15:15:04.829528 n-d-854882-3 devstack@n-api.service[114122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:15:04.829528 n-d-854882-3 devstack@n-api.service[114122]: from cryptography.utils import int_from_bytes Aug 29 15:15:04.829909 n-d-854882-3 devstack@n-api.service[114123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:15:04.829909 n-d-854882-3 devstack@n-api.service[114123]: from cryptography.utils import int_from_bytes Aug 29 15:15:04.830055 n-d-854882-3 devstack@n-api.service[114122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:15:04.830055 n-d-854882-3 devstack@n-api.service[114122]: from cryptography.utils import int_from_bytes Aug 29 15:15:07.324285 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:15:07.324933 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:15:07.325065 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:15:07.325469 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:15:07.325754 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:15:07.326126 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.326453 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.326778 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.327101 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.327438 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.327540 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:15:07.327887 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.327978 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:15:07.328059 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.328313 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:15:07.328409 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.328677 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:15:07.328773 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.328933 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:15:07.329021 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.329298 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.329433 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.329654 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854882-3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.329751 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.329984 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.330071 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.330293 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.330389 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.330609 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.330697 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.330919 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.331011 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.331225 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.331319 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.331544 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.331646 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.331852 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.331938 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.332120 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.332359 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.333607 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.333607 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854882-3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.333850 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.333994 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.334123 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.334254 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.334384 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.334508 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.334644 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.334783 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.334910 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335040 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335172 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335297 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335421 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335569 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335702 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335702 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.335942 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336077 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336212 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336212 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336453 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854882-3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336586 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336719 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336840 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.336974 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337089 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337223 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337338 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337494 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337622 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337745 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337876 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.337996 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.338128 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.338243 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.338371 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.338545 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.338763 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854882-3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.338901 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.339036 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.339173 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.339346 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.339477 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.339657 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.339785 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.340069 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.340198 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.340376 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.340505 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.340682 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.340816 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.340990 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.341118 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.341311 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.341489 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.341642 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.341773 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.341949 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.342091 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.342216 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.342339 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.342501 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.342630 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.342826 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.342965 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.343149 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.343278 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.343463 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.343599 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.343717 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.343851 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.343976 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.344101 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.344259 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.344388 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.344581 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.344750 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.344915 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.345044 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.345223 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.345359 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.345571 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.345741 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.345891 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.346054 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.346211 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.346356 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.346483 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.346658 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.346787 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.346968 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.347104 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.347276 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.347406 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.347595 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.347736 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.347899 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.348027 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.348205 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.348341 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.348509 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.348644 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.348815 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.348957 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.349119 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.349255 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.349442 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.349574 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.349750 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.349890 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.350066 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.350206 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.350375 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.350503 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.350693 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.350837 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.350998 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.351136 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.351319 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.351496 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.351639 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.351812 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.351943 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.352122 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.352257 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.352389 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.352529 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.352657 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.352850 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.352980 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.353158 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.353288 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.353487 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.353616 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.353741 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.353864 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.354021 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.354159 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.354344 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.354475 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.354655 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.354791 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.354963 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.355092 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.355272 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.355403 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.355576 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.355706 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.355820 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.355960 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.356116 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.356254 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.356420 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.356549 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.356737 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.356879 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.357041 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.357169 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.357346 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.357612 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.357743 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.357881 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358009 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358133 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358264 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358389 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358544 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358683 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358850 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.358973 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.359155 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.359284 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.359461 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.359601 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.359764 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.359899 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.360068 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.360198 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.360895 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.361041 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.361202 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.361330 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.361545 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.361677 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.361866 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.362011 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.362178 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.362315 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.362481 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.362608 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.362789 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.362928 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.363093 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.363230 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.363399 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.363527 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.363703 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.363850 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.364008 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.364137 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.364317 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.364454 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.364653 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.364781 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.364918 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.365044 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.365208 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.365337 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.365536 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.365668 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.365842 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.365972 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.366150 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.366287 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.366446 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.366582 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.366749 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.366889 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.367054 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.367185 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.367354 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.367485 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.367656 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.367792 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.367957 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.368097 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.368259 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.368387 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.368560 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.368689 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.368863 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.369001 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.369163 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.369292 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.369487 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.369618 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.369785 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.369928 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.370099 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.370227 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.370417 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.370553 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.370723 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.370865 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.371026 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.371155 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.371328 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.371458 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.371649 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:15:07.371779 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.371980 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.372109 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.372308 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.372442 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.372644 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.372773 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.372958 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.373155 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.373291 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.373439 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.373602 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.373762 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.373909 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.374039 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.374231 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.374369 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.374545 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.374675 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.374859 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.374993 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.375167 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.375325 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.375470 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.375637 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.375762 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.375887 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.376621 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.376768 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.376942 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.377085 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.377275 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.377553 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.377873 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.378020 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.378374 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.378490 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.378698 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.379011 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.379126 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.379331 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.379551 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.379675 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.379974 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.380089 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.380719 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.380884 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381006 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381123 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381338 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381482 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381606 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381725 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381841 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.381999 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.382130 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.382321 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.382459 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.382649 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.382780 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.382967 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.383105 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.383290 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.383426 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.383605 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.383734 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.383920 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.384049 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.384236 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.384376 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.384548 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.384677 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.384859 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.384995 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.385199 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.385342 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.385532 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.385670 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.385842 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.385972 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.386157 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.386296 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.386469 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.386599 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.386866 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.387014 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.387151 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.387278 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.387456 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.387589 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.387714 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.387902 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.388041 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.388261 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.388389 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.388584 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.388712 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.388896 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.389108 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.389245 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.389380 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.389532 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.389657 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.389900 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.390035 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.390161 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.390285 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.390479 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.390611 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.390789 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.390986 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.391115 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.391323 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.391451 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.391735 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.391887 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.392047 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.392363 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.392499 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.392678 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.392897 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.393076 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.393300 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.393514 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.393645 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.393943 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.394088 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.394271 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.394581 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.394709 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.394893 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.395153 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.395293 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.395512 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.395712 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.395850 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.396127 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.396256 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.396442 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.396769 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.396917 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.397096 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.397348 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.397553 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.397747 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.397924 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.398079 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.398387 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.398525 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.398969 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.399304 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.399424 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.399625 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.399869 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.399998 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.400231 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.400439 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.400569 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.400830 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.400957 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.401135 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.401278 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.401469 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.401764 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.401894 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.402069 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.402196 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.402375 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.402507 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.402681 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.402810 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.402985 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.403123 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.403313 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.403452 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.403625 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.403755 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.403933 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.404071 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.404239 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.404369 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.404547 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.404677 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.404894 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.405032 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.405201 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.405449 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.405595 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.405790 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.405919 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.406115 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.406245 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.406426 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.406557 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.406743 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.406879 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.407053 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.407174 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.407404 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.407532 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.407715 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.407861 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.408029 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.408158 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.408337 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.408465 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.408644 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.408780 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.408952 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.409080 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.409264 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.409412 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.409594 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.409741 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.409928 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.410056 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.410239 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.410367 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.410547 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.410685 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.410854 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.410981 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.411158 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.411285 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.411502 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.411637 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.411807 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.411933 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.412143 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.412269 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.412469 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.412605 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.412782 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.412916 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.413098 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.413226 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.413454 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.413585 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.413746 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.413873 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.414058 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.414184 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.414370 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.414499 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.414681 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.414810 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.414992 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.415129 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.415312 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.415439 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.415621 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.415749 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.415939 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.416081 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.416253 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.416394 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.416574 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.416756 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.416886 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.417034 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.417184 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.417307 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.417513 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.417641 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.417835 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.417987 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.418162 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.418312 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.418476 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.418607 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.418800 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.418931 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.419124 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.419291 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.419450 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.419578 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.419713 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.419852 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.420026 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.420166 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.420335 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.420473 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.420680 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.420810 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.420934 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.421059 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.421246 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.421377 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.421592 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.421721 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.421879 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.422008 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.422195 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.422317 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.422505 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.422635 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.423314 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.423447 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.423630 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.423769 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.423946 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.424083 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.424268 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.424396 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.424579 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.424718 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.424902 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.425030 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.425232 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.425359 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.425518 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.425654 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.425829 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.425958 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.426140 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.426267 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.426452 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.426590 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.426757 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.426893 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.427060 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.427187 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.427368 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.427510 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.427679 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.427815 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.427993 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.428123 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.428303 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.428440 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.428614 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.428758 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.428918 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.429047 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.429231 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.429362 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.429564 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.429694 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.429875 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.430003 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.430179 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.430310 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.430490 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.430627 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.430802 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.430941 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.431111 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.431239 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.431422 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.431550 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.431737 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.431882 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.432039 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.432166 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.432343 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.432464 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.432667 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.432805 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.432976 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.433102 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.433283 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.433448 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.433613 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.433787 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.433914 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.434038 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.434217 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.434355 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.434536 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.434668 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.434838 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.435128 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.435258 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.435463 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.435601 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.435770 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.435898 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.436087 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.436218 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.436399 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.436545 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.436710 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.436840 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.437034 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.437173 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.437347 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.437525 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.437664 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.437790 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.437976 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.438112 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.438289 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.438427 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.439198 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.439355 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.439494 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.439634 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.439774 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.439909 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.440047 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.440180 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.440344 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.440475 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.440652 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.440795 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.440965 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.441094 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.441274 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.441606 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.441913 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.442221 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.442587 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.442749 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.442935 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.443138 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.443467 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.443771 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.443942 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.444127 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.444300 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.444468 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.444634 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.444817 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.445022 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.445199 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.445380 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.445649 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.445841 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.446031 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.446227 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.446406 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.446571 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.446699 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.446843 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447066 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447195 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447318 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447442 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447565 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447679 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447814 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.447940 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448073 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448206 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448341 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448466 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448597 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448723 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448846 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.448969 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.449091 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.449213 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.449349 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.449560 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.449723 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.449879 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450012 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450157 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450291 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450416 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450547 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450672 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450803 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.450941 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.451065 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.451189 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.451357 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.451487 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.451665 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.451803 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.451982 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.452111 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.452294 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.452422 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.452601 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.452733 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.452906 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.453032 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.453213 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.453339 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.453549 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.453678 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.453856 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.453986 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.454194 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.454321 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.454504 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.454633 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.454823 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.454953 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.455132 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.455259 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.455438 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.455568 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.455744 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.455863 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.456049 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.456179 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.456352 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.456481 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.456654 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.456780 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.456960 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.457097 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.457262 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.457412 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.457596 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.457725 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.457904 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.458041 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.458211 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.458339 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.458515 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.458641 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.458816 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.458951 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.459125 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.459253 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.459427 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.459555 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.459739 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.459876 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.460045 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.460174 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.460346 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.460474 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.460647 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.460775 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.460951 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.461081 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.461257 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.461419 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.461585 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.461715 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.461888 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.462014 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.462189 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.462324 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.462492 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.462620 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.462795 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.462922 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.463099 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.463225 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.463398 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.463533 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.463704 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.463832 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.464009 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.464144 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.464309 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.464436 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.464611 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.464738 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.464926 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.465061 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.465229 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.465356 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.465603 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.465736 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.465870 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.465993 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.466141 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.466269 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.466443 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.466572 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.466752 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.466889 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.467073 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.467207 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.467389 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.467526 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.467693 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.467830 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.468000 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.468130 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.468303 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.468431 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.468605 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.468733 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.468906 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.469034 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.469209 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.469336 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.469529 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.469656 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.469845 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.469973 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.470148 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.470275 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.470449 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.470578 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.470756 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.470884 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.471078 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.471214 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.471384 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.471511 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.471686 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.471822 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.472007 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.472145 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.472316 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.472444 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.472627 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.472756 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.472942 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.473071 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.473257 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.473417 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.473596 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.473737 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.473909 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.474048 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.474221 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.474348 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.474528 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.474662 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.474834 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.475044 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.475171 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.475292 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.475415 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.475537 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.475730 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.475866 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.476041 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.476169 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.476351 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.476476 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.476651 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.476786 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.476953 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.477090 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.477257 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.477429 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.477595 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.477725 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.477902 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.478032 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.478220 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.478347 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.478542 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.478685 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.478866 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.478993 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.479168 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.479309 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.479475 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.479603 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.479783 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.479918 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.480089 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.480226 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.480397 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.480533 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.480711 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.480840 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.481022 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.481164 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.481333 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.481494 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.481669 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.481798 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.481980 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.482116 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.482334 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.482461 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.482592 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.482726 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.482883 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.483026 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.483192 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.483330 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.483496 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.483631 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.483819 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.483949 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.484127 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.484555 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.484555 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.484781 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.484921 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.485047 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.485171 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.485855 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.486043 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.486181 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.486365 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.486541 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.486706 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.486875 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.487048 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.487232 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.487398 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.487562 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.487755 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.487924 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.488101 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.488254 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.488385 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.488516 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.488648 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.488778 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.488907 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.489050 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.489182 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.489312 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.489462 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.489617 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.489765 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.489911 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.490055 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.490187 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.490318 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.490457 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.490610 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.490740 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.490938 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.491077 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.491207 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.491337 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.491513 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.491649 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.491818 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.491969 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.492171 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.492356 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.492534 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.492714 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.492903 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.493082 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.493261 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.493492 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.493672 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.493836 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.493986 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.494164 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.494334 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.494484 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.494642 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.494774 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.494911 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495038 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495161 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495293 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495293 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495545 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495677 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495802 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.495926 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.496048 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.496201 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.496339 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.496515 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.496644 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.496826 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.496955 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.497133 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.497268 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.497460 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.497582 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.497790 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.497906 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.498098 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.498234 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.498412 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.498534 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.498718 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.498834 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.499043 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.499157 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.499363 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.499476 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.499671 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.499784 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.499992 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.500114 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.500301 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.500414 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.501624 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.501759 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.501850 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.501931 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.502009 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.502097 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.502169 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.502299 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.502430 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.502734 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.502874 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.503072 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.503346 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.503463 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.503659 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.503749 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.503965 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.504054 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.504272 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.504371 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.504597 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.504687 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.504909 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.504998 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.505223 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.505322 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.505560 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.505653 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.505872 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.505974 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.506178 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.506276 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.506483 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.506581 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.506787 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.506883 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.507095 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.507208 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.507409 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.507511 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.507714 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.507803 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.508020 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.508120 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.508325 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.508417 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.508635 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.508731 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.508943 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.509045 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.509258 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.509348 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.509592 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.509682 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.509898 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.509989 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.510205 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.510293 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.510513 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.510618 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.510913 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.511015 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.511150 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.511248 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.511480 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.511584 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.511793 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.511883 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.512103 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.512190 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.512430 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.512543 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.512747 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.512845 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.513064 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.513152 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.513380 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.513512 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.513720 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.513810 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.514022 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.514110 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.514327 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.514419 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.514669 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.514821 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.514936 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.515026 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.515239 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.515332 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.515542 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.515633 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.515849 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.516111 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.516211 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.516440 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.516578 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.516769 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.516859 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.517087 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.517176 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.517410 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.517543 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.517732 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.517832 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.518040 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.518129 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.518346 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.518436 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.518650 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.518748 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.518954 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.519045 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.519266 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.519356 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.519588 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.519684 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.519915 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.520013 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.520230 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.520319 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.520554 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.520653 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.520872 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.520983 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.521189 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.521308 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.521525 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.521644 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.521842 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.521930 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.522159 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.522248 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.522481 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.522638 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.522818 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.522948 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.523136 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.523250 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.523409 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.523602 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.523985 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.524119 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.524275 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.524409 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.524569 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.524829 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.524975 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.525160 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.525296 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.525512 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.525725 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.525817 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.526127 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.526221 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.526444 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.526544 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.526771 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.526863 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.527106 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.527206 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.527419 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.527517 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.527733 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.527824 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.528043 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.528131 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.528355 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.528456 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.528686 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.528880 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.529010 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.529197 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.529339 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.529565 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.529702 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.529895 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.530028 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.530224 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.530382 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.530545 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.530647 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.530871 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.531007 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.531199 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.531467 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.531586 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.531688 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.531795 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.531892 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.532100 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.532206 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.532437 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.532528 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.532971 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.533065 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.533268 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.533422 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.533538 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.533647 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.533753 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.536322 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.536455 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.536576 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.536686 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.536794 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.536794 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537039 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537151 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537258 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537364 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537495 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537615 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537741 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.537924 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.538114 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.538269 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.538380 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.538492 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.538609 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.538721 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539355 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539452 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539536 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539626 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539709 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539798 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539881 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.539881 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540045 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540128 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540198 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540285 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540368 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540455 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540545 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540627 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540706 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540789 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.540868 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541005 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541116 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541202 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541306 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541467 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541555 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541636 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541731 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541815 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541895 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.541975 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542054 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542143 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542225 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542304 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542384 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542463 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542543 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542672 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542764 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.542981 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.543324 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.543429 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.543589 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.543699 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.543898 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.543989 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.544201 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.544290 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.544513 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.544611 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.544818 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.544907 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.545129 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.545217 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.545475 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.545569 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.545784 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.545874 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.546090 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.546181 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.546405 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.546495 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.546713 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.546802 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.547019 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.547109 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.547322 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.547414 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.547630 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.547719 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.548879 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549026 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549166 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549267 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549351 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549520 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549623 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549717 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549806 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.549986 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.550125 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.550293 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.550450 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.550598 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.550789 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.550909 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.551122 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.551217 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.551437 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.551537 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.551747 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.551840 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.552055 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.552144 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.552378 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.552485 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.552679 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.552771 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.552987 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.553128 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.553290 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.553403 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.553626 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.553715 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.553927 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.554028 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.554234 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.554325 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.554545 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.554634 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.554858 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.554947 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.555169 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.555268 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.555481 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.555758 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.555903 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.556087 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.556179 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.556396 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.556486 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.556706 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.556795 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.557022 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.557127 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.557363 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.557642 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.557747 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.557832 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.558027 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.558119 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.558343 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.558570 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.558659 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.558904 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.559004 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.559223 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.559326 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.559548 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.559638 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.559857 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.559955 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.560172 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.560261 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.560478 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.560575 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.560782 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.560875 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.561098 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.561211 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.561430 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.561555 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.561746 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.561872 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.562056 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.562192 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.562367 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.562517 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.562678 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.562813 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.562985 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.563139 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.563294 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.563489 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.564141 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.564319 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.564452 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.564645 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.564761 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.564960 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.565063 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.565290 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.565404 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.565658 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.565765 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.565976 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.566066 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.566288 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.566378 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.566604 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.566702 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.566910 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.566999 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.567218 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.567308 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.567528 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.567630 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.567841 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.567930 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.568151 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.568240 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.568454 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.568543 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.568758 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.568848 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.569073 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.569175 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.569432 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.569535 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.569709 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.569800 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.570017 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.570106 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.570327 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.570426 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.570636 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.570749 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.570941 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.571062 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.571249 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.571380 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.571554 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.571701 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.571859 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.572010 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.572165 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.572332 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.572469 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.572730 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.572820 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.573062 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.573159 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.573377 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.573493 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.573681 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.573784 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.573978 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.574078 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.574281 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.574466 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.574613 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.574747 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.574948 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.575072 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.575265 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.575364 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.575590 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.575693 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.575904 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.575993 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.576229 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.576319 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.576541 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.576641 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.576854 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.576942 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.577165 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.577256 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.577494 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.577601 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.577804 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.577893 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.578106 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.578196 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.578407 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.578497 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.578711 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.578800 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.579018 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.579146 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.579347 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.579512 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.579649 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.579740 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.579951 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.580040 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.580251 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.580342 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.580549 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.580638 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.580850 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.580939 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.581152 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.581243 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.581488 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.581594 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.581794 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.581893 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.582096 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.582195 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.582396 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.582494 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.582697 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.582796 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.582996 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.583085 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.583326 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.583424 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.583659 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.583761 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.583970 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.584059 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.584282 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.584371 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.584589 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.584678 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.584903 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.584993 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.585207 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.585295 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.585550 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.585653 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.585868 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.585956 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.586182 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.586272 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.586489 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.586589 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.586812 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.586903 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.587117 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.587214 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.587428 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.587525 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.587737 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.587827 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.588047 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.588145 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.588356 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.588447 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.588667 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.588763 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.588991 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.589159 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.589313 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.589466 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.589646 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.589738 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.589896 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:15:07.590011 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.590276 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.590597 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.590912 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.591224 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.591554 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.591864 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.592175 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.592486 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.592796 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.593107 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.593441 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.593753 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.594063 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.594379 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.595193 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.595528 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.595899 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.596459 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.596807 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.597141 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.597516 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.597833 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.598178 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.598513 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.598830 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.599144 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.599448 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:15:07.599692 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:15:07.744062 n-d-854882-3 devstack@n-api.service[114122]: INFO dbcounter [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Registered counter for database nova_api Aug 29 15:15:07.755125 n-d-854882-3 devstack@n-api.service[114123]: INFO dbcounter [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Registered counter for database nova_api Aug 29 15:15:07.766058 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:07.773426 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writer thread running {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:07.775412 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_db.sqlalchemy.engines [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:07.782633 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writer thread running {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:07.831135 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.context [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=114122) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:15:07.834927 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:15:07.835409 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:15:07.837016 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:15:07.837780 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:15:07.838229 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:15:07.839131 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.context [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=114123) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:15:07.840240 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:15:07.842247 n-d-854882-3 devstack@n-api.service[114122]: INFO dbcounter [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Registered counter for database nova_cell0 Aug 29 15:15:07.842961 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:15:07.843433 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:15:07.845593 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:15:07.847074 n-d-854882-3 devstack@n-api.service[114122]: INFO dbcounter [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Registered counter for database nova_cell1 Aug 29 15:15:07.847191 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:15:07.847532 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:15:07.849565 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:15:07.851560 n-d-854882-3 devstack@n-api.service[114123]: INFO dbcounter [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Registered counter for database nova_cell0 Aug 29 15:15:07.855847 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:07.856018 n-d-854882-3 devstack@n-api.service[114123]: INFO dbcounter [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Registered counter for database nova_cell1 Aug 29 15:15:07.856600 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:07.861858 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writer thread running {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:07.863628 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_db.sqlalchemy.engines [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:07.868602 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writer thread running {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:07.869243 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_db.sqlalchemy.engines [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:07.998972 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writer thread running {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:08.008255 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writer thread running {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:08.008996 n-d-854882-3 devstack@n-api.service[114122]: INFO dbcounter [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Registered counter for database nova_cell0 Aug 29 15:15:08.017605 n-d-854882-3 devstack@n-api.service[114123]: INFO dbcounter [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Registered counter for database nova_cell0 Aug 29 15:15:08.018269 n-d-854882-3 devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:08.023227 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writer thread running {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:08.026678 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_db.sqlalchemy.engines [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:15:08.031372 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writer thread running {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:15:08.362831 n-d-854882-3 devstack@n-api.service[114123]: WARNING keystonemiddleware.auth_token [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:15:08.363616 n-d-854882-3 devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:15:08.370178 n-d-854882-3 devstack@n-api.service[114123]: WARNING keystonemiddleware.auth_token [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:15:08.370978 n-d-854882-3 devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:15:08.714049 n-d-854882-3 devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:15:08.715295 n-d-854882-3 devstack@n-api.service[114123]: WARNING keystonemiddleware.auth_token [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:15:08.720480 n-d-854882-3 devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:15:08.721828 n-d-854882-3 devstack@n-api.service[114123]: WARNING keystonemiddleware.auth_token [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:15:08.725815 n-d-854882-3 devstack@n-api.service[114122]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7b118a9c0 pid: 114122 (default app) Aug 29 15:15:08.727108 n-d-854882-3 devstack@n-api.service[114123]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7b118a9c0 pid: 114123 (default app) Aug 29 15:15:08.727877 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:15:08.729087 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-654f62ca-0a07-470d-af05-a526a3790c49 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Aug 29 15:15:08.729515 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Aug 29 15:15:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:28.822735 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:28.823947 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Aug 29 15:16:28.824541 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:28.836043 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writing DB stats nova_api:SELECT=3 {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:28.837168 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writing DB stats nova_cell1:SELECT=3 {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:28.838197 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writing DB stats nova_cell0:SELECT=3 {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:28.839393 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:29.733776 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-78619cf1-dc46-4486-af0f-bf537c856350 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:29.769742 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-78619cf1-dc46-4486-af0f-bf537c856350 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938822 Aug 29 15:16:29.770488 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:16:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:32.153314 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:32.153314 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-4e39373f-b529-4fd0-917b-4ab555cda245 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 29 15:16:32.153314 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:32.604954 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-46975a0b-741a-46e8-8fc6-cac5ed2e4cf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "ram": 256, "disk": 1, "vcpus": 1, "name": "cirros256"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:32.658365 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-46975a0b-741a-46e8-8fc6-cac5ed2e4cf7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498212 Aug 29 15:16:32.661444 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:32.672888 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writing DB stats nova_api:SELECT=3 {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:32.674013 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writing DB stats nova_cell0:SELECT=3 {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:32.675024 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writing DB stats nova_cell1:SELECT=3 {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:32.676050 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:32.882273 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d6fdce7a-b307-4d72-a7e8-f37aabc31ca3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:32.950028 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-d6fdce7a-b307-4d72-a7e8-f37aabc31ca3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282512 Aug 29 15:16:32.950607 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:35.377334 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-46975a0b-741a-46e8-8fc6-cac5ed2e4cf7 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:35.378374 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-46975a0b-741a-46e8-8fc6-cac5ed2e4cf7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001794 Aug 29 15:16:35.379291 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:36.126448 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-c0a953da-092e-44fd-bc2c-f36c9d58b613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "name": "ds512M", "id": "d1", "disk": 5}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:36.173239 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-c0a953da-092e-44fd-bc2c-f36c9d58b613 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.776789 Aug 29 15:16:36.174712 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:36.186058 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9e193ed1-6bd5-41e4-8472-d151c816e407 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:36.222049 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9e193ed1-6bd5-41e4-8472-d151c816e407 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040083 Aug 29 15:16:36.228099 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:38.887699 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-c0a953da-092e-44fd-bc2c-f36c9d58b613 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:38.889339 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-c0a953da-092e-44fd-bc2c-f36c9d58b613 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Aug 29 15:16:38.890089 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:39.347077 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-33ab0855-eed5-4daa-b916-cc1b9ec140f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:39.371781 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-33ab0855-eed5-4daa-b916-cc1b9ec140f9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474470 Aug 29 15:16:39.371781 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:16:39.384968 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-48a20b0b-aa3d-4531-9b97-7701666c14b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:39.415862 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-48a20b0b-aa3d-4531-9b97-7701666c14b8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034580 Aug 29 15:16:39.416678 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:42.105914 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-33ab0855-eed5-4daa-b916-cc1b9ec140f9 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:42.106853 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-33ab0855-eed5-4daa-b916-cc1b9ec140f9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 29 15:16:42.107263 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:42.633327 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-ed5373bb-6db2-45af-8d05-50897ccc8dba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G", "swap": 0}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:42.656990 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-ed5373bb-6db2-45af-8d05-50897ccc8dba admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.543421 Aug 29 15:16:42.660428 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:42.670673 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-7c48b190-3f8e-434a-ae7e-4244c89cd6dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:42.695584 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-7c48b190-3f8e-434a-ae7e-4244c89cd6dd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028953 Aug 29 15:16:42.696257 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:45.347618 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-ed5373bb-6db2-45af-8d05-50897ccc8dba admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:45.347618 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-ed5373bb-6db2-45af-8d05-50897ccc8dba admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 29 15:16:45.347618 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:45.834177 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-8ba714ad-5afa-4c19-8efa-d31899487d12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:45.869746 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-8ba714ad-5afa-4c19-8efa-d31899487d12 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514156 Aug 29 15:16:45.870915 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:45.884527 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-a68b01b5-1573-4e7a-a60e-8de380344af6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:45.931800 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-a68b01b5-1573-4e7a-a60e-8de380344af6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050855 Aug 29 15:16:45.933355 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:48.403247 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-8ba714ad-5afa-4c19-8efa-d31899487d12 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:48.404242 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-8ba714ad-5afa-4c19-8efa-d31899487d12 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 29 15:16:48.404872 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:48.866420 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-6aa54401-e1b1-43c8-94d8-b042c419d70f admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:48.899513 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-6aa54401-e1b1-43c8-94d8-b042c419d70f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.486825 Aug 29 15:16:48.900802 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:16:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:51.485353 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-8ba714ad-5afa-4c19-8efa-d31899487d12 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:51.485940 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-8ba714ad-5afa-4c19-8efa-d31899487d12 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 29 15:16:51.486185 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:51.914878 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-53ab38d8-46ef-42ea-9481-fbaa1de996ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "1"}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:51.934474 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-53ab38d8-46ef-42ea-9481-fbaa1de996ac admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.442131 Aug 29 15:16:51.935048 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:16:51.947560 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-ed5a62d3-8787-469e-8f9c-39742538f818 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:51.972379 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-ed5a62d3-8787-469e-8f9c-39742538f818 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028323 Aug 29 15:16:51.972972 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:54.662342 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-53ab38d8-46ef-42ea-9481-fbaa1de996ac admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:54.663418 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-53ab38d8-46ef-42ea-9481-fbaa1de996ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Aug 29 15:16:54.663831 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:55.074499 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-e3c704c2-0e50-43e2-9e32-5872336512ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "swap": 0, "disk": 20}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:55.094854 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-e3c704c2-0e50-43e2-9e32-5872336512ac admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424010 Aug 29 15:16:55.095323 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:16:55.109605 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-1cc9c73d-6cd6-4fab-87f6-bbba0a45a0bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:55.134393 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-1cc9c73d-6cd6-4fab-87f6-bbba0a45a0bf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028794 Aug 29 15:16:55.134987 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:16:57.503724 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-e3c704c2-0e50-43e2-9e32-5872336512ac admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:57.504898 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-e3c704c2-0e50-43e2-9e32-5872336512ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Aug 29 15:16:57.505309 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:16:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:57.980001 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-7a7f960e-380f-4004-a87d-03da8fef2e22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "id": "3"}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:57.999764 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-7a7f960e-380f-4004-a87d-03da8fef2e22 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.487886 Aug 29 15:16:58.000308 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:58.012661 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-b94f65fc-2fea-488d-8fe6-e8897082849a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:58.036613 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-b94f65fc-2fea-488d-8fe6-e8897082849a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027896 Aug 29 15:16:58.037177 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:17:00.433079 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-7a7f960e-380f-4004-a87d-03da8fef2e22 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:00.434982 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-7a7f960e-380f-4004-a87d-03da8fef2e22 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002392 Aug 29 15:17:00.435470 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:17:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:00.860634 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-187cf88d-7246-47a7-a589-9d38f84b979c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:00.866199 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:00.885240 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-187cf88d-7246-47a7-a589-9d38f84b979c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.441198 Aug 29 15:17:00.885958 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:17:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:17:00.898013 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-99b2d8b3-e80c-4adf-9c07-2702232cf9d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:00.995098 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-99b2d8b3-e80c-4adf-9c07-2702232cf9d2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100605 Aug 29 15:17:00.995941 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Aug 29 15:17:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:17:03.436449 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-187cf88d-7246-47a7-a589-9d38f84b979c admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:03.438254 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-187cf88d-7246-47a7-a589-9d38f84b979c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002838 Aug 29 15:17:03.438754 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:03.886535 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d3015e64-87b1-4d99-8a38-cf4e1a563c5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "id": "5", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:03.893553 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:03.909188 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-d3015e64-87b1-4d99-8a38-cf4e1a563c5d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463956 Aug 29 15:17:03.910007 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Aug 29 15:17:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:17:03.922120 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-61ac2c8f-94ec-4be1-879e-cb805b2a6fcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:03.947052 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-61ac2c8f-94ec-4be1-879e-cb805b2a6fcb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029063 Aug 29 15:17:03.947623 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Aug 29 15:17:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:17:26.668829 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d3015e64-87b1-4d99-8a38-cf4e1a563c5d admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:26.670348 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-d3015e64-87b1-4d99-8a38-cf4e1a563c5d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 29 15:17:26.670753 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:17:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:26.683768 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:27.070720 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-703efc4e-9c7f-48cb-9f29-a97b241b62bc admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:27.089170 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-703efc4e-9c7f-48cb-9f29-a97b241b62bc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.412295 Aug 29 15:17:27.089824 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:17:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:28.145660 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d3015e64-87b1-4d99-8a38-cf4e1a563c5d admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:28.146660 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-d3015e64-87b1-4d99-8a38-cf4e1a563c5d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 29 15:17:28.147083 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:28.704013 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-b5334722-785e-4464-9fe0-1d2b3f056556 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:28.710087 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.wsgi [None req-b5334722-785e-4464-9fe0-1d2b3f056556 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-b5334722-785e-4464-9fe0-1d2b3f056556 admin admin] Request method failure captured: Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: Accept: application/json Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: Accept-Encoding: gzip, deflate Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: Connection: keep-alive Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: Content-Length: 0 Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: Host: 10.222.0.16 Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: Openstack-Api-Version: compute 2.90 Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: Openstack-System-Scope: None Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: User-Agent: python-novaclient Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Auth-Token: gAAAAABjDNiIAz5gGyJ-Eq_aYrCuf43qv8Wa0fzdd50mXU6LdVgsOqxGGimHhDYF4OmvGneGsxa6J0v-4CBOEWYMPnpum-LD0oVubI1mWfaqkBzH-KmXsw5rCA8ZJa7Co95_pUbdphWWXYNBpa6TlyQl_kwuDyNuTm-tKXTpnlYo6GjS6BY5iUg Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Domain-Id: None Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Domain-Name: None Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Identity-Status: Confirmed Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Is-Admin-Project: True Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Domain-Id: default Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Domain-Name: Default Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Name: admin Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Role: member,admin,reader Aug 29 15:17:28.713285 n-d-854882-3 devstack@n-api.service[114122]: X-Roles: member,admin,reader Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_981474d13fc1406aa4961a388692a3c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}] Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant: admin Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant-Name: admin Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-User: admin Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-User-Domain-Id: default Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-User-Domain-Name: Default Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-User-Id: 2731c4a0421d4cc19a655aaf52f9a3b8 Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: X-User-Name: admin Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: method: > Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: exception: Flavor 42 could not be found. Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: action_args: {'id': '42'} Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:17:28.715026 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:28.716025 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.717976 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-b5334722-785e-4464-9fe0-1d2b3f056556 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:17:28.719228 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-b5334722-785e-4464-9fe0-1d2b3f056556 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405725 Aug 29 15:17:28.719228 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Aug 29 15:17:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:28.725567 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-fd73edf3-bd0a-44aa-a311-cc3cfc3db7b4 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:28.750105 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-fd73edf3-bd0a-44aa-a311-cc3cfc3db7b4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028961 Aug 29 15:17:28.750717 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Aug 29 15:17:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:28.764445 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-85ecab50-d736-4c72-a40f-ba59526defac admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:28.788226 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-85ecab50-d736-4c72-a40f-ba59526defac admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027912 Aug 29 15:17:28.788796 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Aug 29 15:17:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:28.798439 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-69d76734-8c30-4f5c-aba9-81da52ede345 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:28.804245 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.wsgi [None req-69d76734-8c30-4f5c-aba9-81da52ede345 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-69d76734-8c30-4f5c-aba9-81da52ede345 admin admin] Request method failure captured: Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: Accept: application/json Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: Accept-Encoding: gzip, deflate Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: Connection: keep-alive Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: Content-Length: 0 Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: Host: 10.222.0.16 Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: Openstack-Api-Version: compute 2.90 Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: Openstack-System-Scope: None Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: User-Agent: python-novaclient Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Auth-Token: gAAAAABjDNiIAz5gGyJ-Eq_aYrCuf43qv8Wa0fzdd50mXU6LdVgsOqxGGimHhDYF4OmvGneGsxa6J0v-4CBOEWYMPnpum-LD0oVubI1mWfaqkBzH-KmXsw5rCA8ZJa7Co95_pUbdphWWXYNBpa6TlyQl_kwuDyNuTm-tKXTpnlYo6GjS6BY5iUg Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Domain-Id: None Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Domain-Name: None Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Identity-Status: Confirmed Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Is-Admin-Project: True Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Domain-Id: default Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Domain-Name: Default Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Name: admin Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Role: member,admin,reader Aug 29 15:17:28.807562 n-d-854882-3 devstack@n-api.service[114123]: X-Roles: member,admin,reader Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_981474d13fc1406aa4961a388692a3c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}] Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant: admin Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant-Name: admin Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-User: admin Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-User-Domain-Id: default Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-User-Domain-Name: Default Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-User-Id: 2731c4a0421d4cc19a655aaf52f9a3b8 Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: X-User-Name: admin Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: method: > Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: exception: Flavor 42 could not be found. Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: action_args: {'id': '42'} Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:17:28.809252 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:28.810684 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:28.812286 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-69d76734-8c30-4f5c-aba9-81da52ede345 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:17:28.813570 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-69d76734-8c30-4f5c-aba9-81da52ede345 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014192 Aug 29 15:17:28.813570 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Aug 29 15:17:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:29.793987 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-85ecab50-d736-4c72-a40f-ba59526defac admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:29.794977 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-85ecab50-d736-4c72-a40f-ba59526defac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 29 15:17:29.795382 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:30.329156 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-c6e9cf55-3032-4073-a8dc-9c134d6470d5 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:30.335102 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.wsgi [None req-c6e9cf55-3032-4073-a8dc-9c134d6470d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-c6e9cf55-3032-4073-a8dc-9c134d6470d5 admin admin] Request method failure captured: Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: Accept: application/json Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: Accept-Encoding: gzip, deflate Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: Connection: keep-alive Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: Content-Length: 0 Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: Host: 10.222.0.16 Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: Openstack-Api-Version: compute 2.90 Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: Openstack-System-Scope: None Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: User-Agent: python-novaclient Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Auth-Token: gAAAAABjDNiJ0n8FlIWrm4Yio7NQYsCDR_g_OHpYWuwg5h8ip3MRq5DRgbK52iRLNGvy7dv3vL17UrQb8zlANC8nrSPqcFJKoUYahXYh2BvrtstXqhgjAkeJ392QIO0rp-SsqFp7xrjbN7cuOG29kezdBMkRg2hGddsky1ebQsV6tSyZVJExxCY Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Domain-Id: None Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Domain-Name: None Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Identity-Status: Confirmed Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Is-Admin-Project: True Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Domain-Id: default Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Domain-Name: Default Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Name: admin Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Role: member,admin,reader Aug 29 15:17:30.336638 n-d-854882-3 devstack@n-api.service[114123]: X-Roles: member,admin,reader Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_981474d13fc1406aa4961a388692a3c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}] Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant: admin Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant-Name: admin Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-User: admin Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-User-Domain-Id: default Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-User-Domain-Name: Default Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-User-Id: 2731c4a0421d4cc19a655aaf52f9a3b8 Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: X-User-Name: admin Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: method: > Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: exception: Flavor 84 could not be found. Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: action_args: {'id': '84'} Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:17:30.338234 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:30.339214 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.340536 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-c6e9cf55-3032-4073-a8dc-9c134d6470d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:17:30.342052 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-c6e9cf55-3032-4073-a8dc-9c134d6470d5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.403964 Aug 29 15:17:30.342052 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Aug 29 15:17:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:30.349076 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-68eb6ef1-b170-48cc-a80d-5b2105756139 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:30.373227 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-68eb6ef1-b170-48cc-a80d-5b2105756139 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028122 Aug 29 15:17:30.374251 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Aug 29 15:17:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:30.384102 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-fa64012c-d1f5-4383-80d9-5f7c95dc5fcc admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:30.400672 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-fa64012c-d1f5-4383-80d9-5f7c95dc5fcc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020196 Aug 29 15:17:30.401231 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Aug 29 15:17:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:30.410837 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4ac04347-6595-45ef-b5af-8f1f95c66afb admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:30.419883 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.wsgi [None req-4ac04347-6595-45ef-b5af-8f1f95c66afb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4ac04347-6595-45ef-b5af-8f1f95c66afb admin admin] Request method failure captured: Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: Accept: application/json Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: Accept-Encoding: gzip, deflate Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: Connection: keep-alive Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: Content-Length: 0 Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: Host: 10.222.0.16 Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: Openstack-Api-Version: compute 2.90 Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: Openstack-System-Scope: None Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: User-Agent: python-novaclient Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Auth-Token: gAAAAABjDNiJ0n8FlIWrm4Yio7NQYsCDR_g_OHpYWuwg5h8ip3MRq5DRgbK52iRLNGvy7dv3vL17UrQb8zlANC8nrSPqcFJKoUYahXYh2BvrtstXqhgjAkeJ392QIO0rp-SsqFp7xrjbN7cuOG29kezdBMkRg2hGddsky1ebQsV6tSyZVJExxCY Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Domain-Id: None Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Domain-Name: None Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Identity-Status: Confirmed Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Is-Admin-Project: True Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Domain-Id: default Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Domain-Name: Default Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Name: admin Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Role: member,admin,reader Aug 29 15:17:30.421410 n-d-854882-3 devstack@n-api.service[114122]: X-Roles: member,admin,reader Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_981474d13fc1406aa4961a388692a3c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}] Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant: admin Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant-Name: admin Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-User: admin Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-User-Domain-Id: default Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-User-Domain-Name: Default Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-User-Id: 2731c4a0421d4cc19a655aaf52f9a3b8 Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: X-User-Name: admin Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: method: > Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: exception: Flavor 84 could not be found. Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: action_args: {'id': '84'} Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:17:30.422850 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:30.424419 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:30.425585 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4ac04347-6595-45ef-b5af-8f1f95c66afb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:17:30.426597 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-4ac04347-6595-45ef-b5af-8f1f95c66afb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015585 Aug 29 15:17:30.426597 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Aug 29 15:17:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 15:17:31.427667 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-fa64012c-d1f5-4383-80d9-5f7c95dc5fcc admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:31.428718 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-fa64012c-d1f5-4383-80d9-5f7c95dc5fcc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 29 15:17:31.429127 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:31.970903 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4e0e7dab-917a-4197-ac2a-e7bef3f85639 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:31.976671 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.wsgi [None req-4e0e7dab-917a-4197-ac2a-e7bef3f85639 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4e0e7dab-917a-4197-ac2a-e7bef3f85639 admin admin] Request method failure captured: Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: Accept: application/json Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: Accept-Encoding: gzip, deflate Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: Connection: keep-alive Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: Content-Length: 0 Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: Host: 10.222.0.16 Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: Openstack-Api-Version: compute 2.90 Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: Openstack-System-Scope: None Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: User-Agent: python-novaclient Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Auth-Token: gAAAAABjDNiLzpOeOnyGcuaLatEF8sarwYVV3y-WXDHI0WzUw6DYgCUOKDmE5jFGO14_4S-Tvq7KRy0IPHLPGNwjZgyDtMMqg4CQuNaOB9iMDdBmbzTm1BgI7MCB9HBP5KElq8_n4fkfWyt0x3FSYApiRY7JoB-qsV0MspYKL91SnqZzvlerD_A Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Domain-Id: None Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Domain-Name: None Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Identity-Status: Confirmed Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Is-Admin-Project: True Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Domain-Id: default Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Domain-Name: Default Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Project-Name: admin Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Role: member,admin,reader Aug 29 15:17:31.978224 n-d-854882-3 devstack@n-api.service[114122]: X-Roles: member,admin,reader Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_981474d13fc1406aa4961a388692a3c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}] Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant: admin Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-Tenant-Name: admin Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-User: admin Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-User-Domain-Id: default Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-User-Domain-Name: Default Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-User-Id: 2731c4a0421d4cc19a655aaf52f9a3b8 Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: X-User-Name: admin Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: method: > Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: exception: Flavor 451 could not be found. Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: action_args: {'id': '451'} Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:17:31.979646 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:31.980534 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: ERROR nova.api.openstack.wsgi Aug 29 15:17:31.982412 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4e0e7dab-917a-4197-ac2a-e7bef3f85639 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:17:31.983661 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-4e0e7dab-917a-4197-ac2a-e7bef3f85639 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.406286 Aug 29 15:17:31.983661 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Aug 29 15:17:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:31.989774 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-6cf765ce-2432-4be1-aa53-e30c25e4b406 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:32.005346 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-6cf765ce-2432-4be1-aa53-e30c25e4b406 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019098 Aug 29 15:17:32.005915 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Aug 29 15:17:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:32.015608 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:32.031146 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019108 Aug 29 15:17:32.031700 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Aug 29 15:17:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:32.041515 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d7ae4a7d-ccec-4b48-a88b-dd702fd7911a admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:32.049639 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.wsgi [None req-d7ae4a7d-ccec-4b48-a88b-dd702fd7911a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d7ae4a7d-ccec-4b48-a88b-dd702fd7911a admin admin] Request method failure captured: Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: Accept: application/json Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: Accept-Encoding: gzip, deflate Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: Connection: keep-alive Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: Content-Length: 0 Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: Host: 10.222.0.16 Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: Openstack-Api-Version: compute 2.90 Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: Openstack-System-Scope: None Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: User-Agent: python-novaclient Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Auth-Token: gAAAAABjDNiLzpOeOnyGcuaLatEF8sarwYVV3y-WXDHI0WzUw6DYgCUOKDmE5jFGO14_4S-Tvq7KRy0IPHLPGNwjZgyDtMMqg4CQuNaOB9iMDdBmbzTm1BgI7MCB9HBP5KElq8_n4fkfWyt0x3FSYApiRY7JoB-qsV0MspYKL91SnqZzvlerD_A Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Domain-Id: None Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Domain-Name: None Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Identity-Status: Confirmed Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Is-Admin-Project: True Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Domain-Id: default Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Domain-Name: Default Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Project-Name: admin Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Role: member,admin,reader Aug 29 15:17:32.052515 n-d-854882-3 devstack@n-api.service[114123]: X-Roles: member,admin,reader Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/981474d13fc1406aa4961a388692a3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_981474d13fc1406aa4961a388692a3c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/981474d13fc1406aa4961a388692a3c0"}]}] Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant: admin Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant-Id: 981474d13fc1406aa4961a388692a3c0 Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-Tenant-Name: admin Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-User: admin Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-User-Domain-Id: default Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-User-Domain-Name: Default Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-User-Id: 2731c4a0421d4cc19a655aaf52f9a3b8 Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: X-User-Name: admin Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: method: > Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: exception: Flavor 451 could not be found. Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: action_args: {'id': '451'} Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:17:32.054202 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:32.055530 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: ERROR nova.api.openstack.wsgi Aug 29 15:17:32.057036 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d7ae4a7d-ccec-4b48-a88b-dd702fd7911a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:17:32.058401 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-d7ae4a7d-ccec-4b48-a88b-dd702fd7911a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016738 Aug 29 15:17:32.058401 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Aug 29 15:17:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:33.042969 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:33.044031 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 29 15:17:33.044924 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:33.584094 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-2c12435a-9365-449d-82a2-05f9c07c1c34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:33.603783 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-2c12435a-9365-449d-82a2-05f9c07c1c34 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.420386 Aug 29 15:17:33.604720 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Aug 29 15:17:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:17:34.602145 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:34.603159 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 29 15:17:34.603553 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:35.139706 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-8b1efb37-2cfa-4ae0-8505-c998fba37568 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:35.158658 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-8b1efb37-2cfa-4ae0-8505-c998fba37568 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.415273 Aug 29 15:17:35.159208 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Aug 29 15:17:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:17:36.160310 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:36.161319 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 29 15:17:36.161753 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:36.686114 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-c1f481a1-fd05-4d93-81ce-c7a837ef8890 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:36.705310 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-c1f481a1-fd05-4d93-81ce-c7a837ef8890 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407315 Aug 29 15:17:36.706037 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Aug 29 15:17:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:17:37.682953 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:37.683968 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 29 15:17:37.684371 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:38.215173 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-d10c61a9-5e7b-412b-80c8-af39319af84d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:17:38.233947 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-d10c61a9-5e7b-412b-80c8-af39319af84d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.410066 Aug 29 15:17:38.234584 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Aug 29 15:17:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:17:39.207130 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:39.208134 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 29 15:17:39.208538 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:17:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:39.736040 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-34db52db-0624-4a66-b5eb-85cedc4e5508 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:39.756989 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-34db52db-0624-4a66-b5eb-85cedc4e5508 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412585 Aug 29 15:17:39.757560 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Aug 29 15:17:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:18:33.504235 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:18:33.505904 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-f6f81fa1-222f-4ef6-9ac4-756d675a923d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001867 Aug 29 15:18:33.506616 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Mon Aug 29 15:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:18:33.517631 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:34.049923 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-51239f94-3af1-4845-9276-4ae5811b2be1 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:18:34.070172 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-51239f94-3af1-4845-9276-4ae5811b2be1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.557073 Aug 29 15:18:34.070712 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:18:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:18:34.092141 n-d-854882-3 devstack@n-api.service[114122]: DEBUG dbcounter [-] [114122] Writing DB stats nova_api:SELECT=14 {{(pid=114122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:34.096497 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9b2db092-3946-4223-9123-bae2d063fb55 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:18:34.104187 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9b2db092-3946-4223-9123-bae2d063fb55 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013638 Aug 29 15:18:34.105297 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Aug 29 15:18:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:18:34.116952 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-2044589c-39c5-4cf5-8476-df9a29074940 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:18:34.124623 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-2044589c-39c5-4cf5-8476-df9a29074940 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011242 Aug 29 15:18:34.125150 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Aug 29 15:18:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:18:34.136811 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-a6aafd6e-d374-4d53-99c9-100d28a608f3 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:18:34.144481 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-a6aafd6e-d374-4d53-99c9-100d28a608f3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011376 Aug 29 15:18:34.145020 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Aug 29 15:18:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:18:34.159887 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-8649465f-ca14-4532-9466-4ecbb61f96bf admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:18:34.168948 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-8649465f-ca14-4532-9466-4ecbb61f96bf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014814 Aug 29 15:18:34.169521 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Aug 29 15:18:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:24:11.748996 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-a6aafd6e-d374-4d53-99c9-100d28a608f3 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:11.750044 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-a6aafd6e-d374-4d53-99c9-100d28a608f3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 29 15:24:11.750448 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:24:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:11.892065 n-d-854882-3 devstack@n-api.service[114123]: DEBUG dbcounter [-] [114123] Writing DB stats nova_api:SELECT=6 {{(pid=114123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:12.036425 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:12.039972 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:12.040463 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:12.040900 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:12.041647 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:12.042099 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:12.042525 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:12.084203 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-2a8d89a7-bec7-4878-8717-4a9640fe5f54 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.193542 Aug 29 15:24:12.084786 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Aug 29 15:24:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:24:12.920350 n-d-854882-3 devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-a6aafd6e-d374-4d53-99c9-100d28a608f3 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:12.921368 n-d-854882-3 devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-a6aafd6e-d374-4d53-99c9-100d28a608f3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 29 15:24:12.924013 n-d-854882-3 devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Aug 29 15:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:13.120471 n-d-854882-3 devstack@n-api.service[114123]: DEBUG nova.api.openstack.wsgi [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] Calling method '>' {{(pid=114123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:13.123998 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:13.124685 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:13.125118 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:13.126736 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:13.127159 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:13.127592 n-d-854882-3 devstack@n-api.service[114123]: DEBUG oslo_concurrency.lockutils [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:13.151570 n-d-854882-3 devstack@n-api.service[114123]: INFO nova.api.openstack.requestlog [None req-36fe8d6a-8ed4-478d-9bdb-52379f2b86cb admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.087636 Aug 29 15:24:13.152136 n-d-854882-3 devstack@n-api.service[114123]: [pid: 114123|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Aug 29 15:24:13 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:24:57.626511 n-d-854882-3 devstack@n-api.service[114121]: Mon Aug 29 15:24:57 2022 - graceful shutdown triggered... Aug 29 15:24:57.626653 n-d-854882-3 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 15:24:57.627527 n-d-854882-3 devstack@n-api.service[114123]: Gracefully killing worker 2 (pid: 114123)... Aug 29 15:24:57.627926 n-d-854882-3 devstack@n-api.service[114122]: Gracefully killing worker 1 (pid: 114122)... Aug 29 15:24:58.628708 n-d-854882-3 devstack@n-api.service[114121]: worker 1 buried after 1 seconds Aug 29 15:24:58.628708 n-d-854882-3 devstack@n-api.service[114121]: worker 2 buried after 1 seconds Aug 29 15:24:58.628708 n-d-854882-3 devstack@n-api.service[114121]: goodbye to uWSGI. Aug 29 15:24:58.630254 n-d-854882-3 systemd[1]: devstack@n-api.service: Succeeded. Aug 29 15:24:58.630822 n-d-854882-3 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 15:24:58.633594 n-d-854882-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 15:24:58.650959 n-d-854882-3 devstack@n-api.service[129994]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:24:58 2022] *** Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: nodename: n-d-854882-3 Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: machine: x86_64 Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: clock source: unix Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: pcre jit disabled Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: detected number of CPU cores: 4 Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: current working directory: / Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: your processes number limit is 47680 Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: your memory page size is 4096 bytes Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: detected max file descriptor number: 2048 Aug 29 15:24:58.674913 n-d-854882-3 devstack@n-api.service[129994]: lock engine: pthread robust mutexes Aug 29 15:24:58.676076 n-d-854882-3 devstack@n-api.service[129994]: thunder lock: enabled Aug 29 15:24:58.676076 n-d-854882-3 devstack@n-api.service[129994]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 15:24:58.676076 n-d-854882-3 devstack@n-api.service[129994]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:24:58.715707 n-d-854882-3 devstack@n-api.service[129994]: Python main interpreter initialized at 0x55c8e41ef9c0 Aug 29 15:24:58.715707 n-d-854882-3 devstack@n-api.service[129994]: python threads support enabled Aug 29 15:24:58.715707 n-d-854882-3 devstack@n-api.service[129994]: your server socket listen backlog is limited to 100 connections Aug 29 15:24:58.715707 n-d-854882-3 devstack@n-api.service[129994]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:24:58.716157 n-d-854882-3 devstack@n-api.service[129994]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:24:58.716157 n-d-854882-3 devstack@n-api.service[129994]: *** Operational MODE: preforking *** Aug 29 15:24:58.716345 n-d-854882-3 devstack@n-api.service[129994]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:24:58.716345 n-d-854882-3 devstack@n-api.service[129994]: spawned uWSGI master process (pid: 129994) Aug 29 15:24:58.716549 n-d-854882-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 15:24:58.717177 n-d-854882-3 devstack@n-api.service[129994]: spawned uWSGI worker 1 (pid: 130001, cores: 1) Aug 29 15:24:58.717559 n-d-854882-3 devstack@n-api.service[129994]: spawned uWSGI worker 2 (pid: 130002, cores: 1) Aug 29 15:24:58.717722 n-d-854882-3 devstack@n-api.service[129994]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:24:59.384758 n-d-854882-3 devstack@n-api.service[130001]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:24:59.445230 n-d-854882-3 devstack@n-api.service[130002]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:25:00.570381 n-d-854882-3 devstack@n-api.service[130001]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:25:00.570381 n-d-854882-3 devstack@n-api.service[130001]: from cryptography.utils import int_from_bytes Aug 29 15:25:00.571126 n-d-854882-3 devstack@n-api.service[130001]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:25:00.571126 n-d-854882-3 devstack@n-api.service[130001]: from cryptography.utils import int_from_bytes Aug 29 15:25:00.664695 n-d-854882-3 devstack@n-api.service[130002]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:25:00.664695 n-d-854882-3 devstack@n-api.service[130002]: from cryptography.utils import int_from_bytes Aug 29 15:25:00.665909 n-d-854882-3 devstack@n-api.service[130002]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:25:00.665909 n-d-854882-3 devstack@n-api.service[130002]: from cryptography.utils import int_from_bytes Aug 29 15:25:03.056116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:25:03.056785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:25:03.056887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:25:03.057256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:25:03.057540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:25:03.057933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.058265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.058586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.058909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.059388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.059709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.060039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.060365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.060719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.060972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.061290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.061652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854882-3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.061981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.062296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.062607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.062929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.063238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.063562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.063871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.064377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.065051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.065361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.066269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.066622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.066938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.067250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.067575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.067902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.068216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.068533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.068935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854882-3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.069266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.069596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.069917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.070339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.070656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.070975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.071300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.071628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.071938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.072260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.072587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.072907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.073229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.073560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.073873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.074185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.074509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.074819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.075125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.075378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.075688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.076013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.076339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.076678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.076932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.077170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.077514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.077842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.078160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.078466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.078777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.079084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.079391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.079699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.080012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.080318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.080640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.080965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.081331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.081655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.081980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.082400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.082656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.082967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.083311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.083634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.083985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.084306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.084632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.084944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.085252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.085590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.085911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.086239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.086549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.086814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.087105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.087445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.087855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.088172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.088481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.088807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.089101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.089509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.089814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.090123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.090433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.090741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.091053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.091363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.091668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.091989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.092297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.092621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.092930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.093236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.093570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.093882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.094204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.094513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.094824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.095154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.097918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.098220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.098529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.098835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.099142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.099444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.099751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.100055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.100389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.100662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.100986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.101304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.101646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.101952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.102258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.102584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.102926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.103258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.103603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.103921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.104253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.104590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.104913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.105228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.105571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.105915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.106214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.106528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.106843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.107165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.107487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.107818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.108138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.108452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.108770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.109082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.109419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.109753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.110081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.110396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.110737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.111094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.111410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.111741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.112064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.113349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.113349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.113689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.113856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.114195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.114510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.114829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.115145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.115479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.115781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.116390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.116390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.116698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.116998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.117340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.117680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.118005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.118323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.118637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.118956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.119270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.119589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.119900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.120207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.120517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.120823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.121131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.121463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.121795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.122139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.122436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.122776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.123084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.123402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.123714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.124028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.124397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.124651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.124965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.125273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.125634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.125940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.126247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.126574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.126883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.127196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.127519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.127833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.128846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.129017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.129332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.129689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.130004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.130318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.130658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.130990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.131299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.131632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.131965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.132278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.132967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.132967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.133271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.133556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.133797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.134108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.134412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.134717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.135020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.135325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.135630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.135952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.136264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.136567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.136870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.137175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.137549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.137857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.138199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.138542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.138875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.139198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.139517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.139865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.140191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.140507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.140822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.141138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.141497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.141822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.142141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.142455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.142787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.143091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.143418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.143916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.144089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.144407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.144744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.145062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.145408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.146469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.146469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.146469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.146953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.146953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.147738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.147738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.148119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.148119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.148441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.148728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.149147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.149352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.149693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.150092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.150434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.150664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.151156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.151329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.151768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.151947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.152197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.152512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.152817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.153127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.153722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.154044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.154370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.154677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.154988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.155302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.155616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.155920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.156230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.156545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.156880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.157195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.157545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.157873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.158182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.158467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.158805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.159119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.159955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.160267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.160809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.160982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.161235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.161570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.161892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.162223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.162538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.162859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.163176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.163490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.163822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.164143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.164452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.164770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.165083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.165416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.165735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.166064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.166642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.166776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.166985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.167292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.167605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.167927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.168540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.168880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.169200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.169547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.169874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.170253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.170559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.170891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.171209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.171520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.171832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.172147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.172455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.172768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.173074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.173421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.173712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.174048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.174324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.174631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.175585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.175833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.176159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.176467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.176785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.177095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.177446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.177766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.178076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.178382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.178691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.179040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.179350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.179701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.180041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.180385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.180703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.181011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.181339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.181686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.182006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.182313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.182628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.182936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.183243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.183558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.183869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.184179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.184501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.184805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.185144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.185441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.185765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.186079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.186385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.186692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.187004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.187313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.187619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.187930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.188233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.188553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.188861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.189168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.189500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.189817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.190128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.190434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.190889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.191207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.191515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.191824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.192141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.192447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.192752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.193065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.193451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.193738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.194048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.194355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.194663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.194970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.195300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.195592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.195899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.196282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.196679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.196807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.197113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.197472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.197787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.198096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.198403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.198709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.199060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.199366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.199733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.200045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.200364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.200703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.201015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.201326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.201672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.201982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.202311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.202618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.202941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.203242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.203578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.203883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.204202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.204516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.204839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.205167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.205515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.205827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.206566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.206566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.206790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.207106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.207422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.207740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.208056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.208372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.208690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.209006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.209316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.209659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.209974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.210285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.210619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.210934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.211245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.211568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.211868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.212190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.212501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.212955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.213283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.213618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.213940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.214253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.214569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.214890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.215211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.215520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.215955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.216271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.216585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.216901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.217208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.217579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.217898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.218228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.218536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.218843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.219150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.219477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.219782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.220109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.220545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.220860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.221170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.221619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.222518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.222762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.223092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.223420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.223749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.224058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.224380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.224696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.225025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.225354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.225698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.226017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.226323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.226652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.226980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.227297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.227622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.228061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.228388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.228701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.229025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.229355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.230272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.230272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.230272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.230594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.230902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.231241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.231546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.231863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.232176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.232652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.232893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.233138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.233422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.233733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.234060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.234377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.234704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.235031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.235341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.235666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.235981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.236289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.236596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.236905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.237253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.237659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.237984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.238317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.238660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.238974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.239312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.239641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.239961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.240279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.240605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.240910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.241218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.241557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.241862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.242180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.242492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.242801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.243106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.243412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.243756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.244052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.244355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.244679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.244996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.245305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.245635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.245944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.246291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.246597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.246929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.247242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.247572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.247889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.248230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.248520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.248840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.249157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.249500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.249825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.250132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.250443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.250764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.251081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.251649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.251986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.252311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.252631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.252950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.253806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.254129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.254448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.254777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.255081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.255398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.255731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.256277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.256393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.256713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.257034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.257352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.258162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.258162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.258341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.258663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.258976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.259290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.259609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.259928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.260244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.260558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.260874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.261191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.261529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.261852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.262166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.262492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.262822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.263160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.263490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.263806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.264124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.264442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.264980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.265299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.265663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.265989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.266318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.266658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.266961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.267294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.267602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.267911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.268224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.268536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.269030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.269277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.269616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.269927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.270249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.270561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.271179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.271532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.271852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.272183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.272533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.272854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.273168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.273522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.273836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.274146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.274465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.274777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.275080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.275379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.275914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.276196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.276545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.276940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.277118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.277450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.277766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.278075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.278640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.278956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.279264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.279569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.279878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.280187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.280501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.280809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.281121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.281464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.281827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.282184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.282512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.282876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.283211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.283523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.283834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.284163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.285024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.285355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.285694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.286015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.286373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.286694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.286894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:25:03.287606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:25:03.287782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.287782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.288092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:25:03.288254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.288423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:25:03.288593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.288765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:25:03.288934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.289091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.289248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.289248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.289627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.289825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.289926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.290043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.290217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.290377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.290548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.290728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.290728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.291057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.291225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.291381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.291559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.291726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.291890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.292046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.292221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.292371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.292533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.292717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.292865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.292865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.293120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854882-3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.293257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.293548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.293695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.293833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.293989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.294138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.294294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.294439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.294580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.294722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.294872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.295003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.295215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.295354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.295496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.295496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.295880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.296054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.296194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.296334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.296480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.296622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.296820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.296973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.297108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.297302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.297475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.297620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.297754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.297899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.298053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.298196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.298350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.298511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.298678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.298850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.299019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.299189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.299364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854882-3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.299533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.299686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.299846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.300081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.300239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.300239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.300556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.300709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.300874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.301027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.301195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.301361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.301645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.301823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.301994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.302157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.302332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.302506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.302663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.302827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.302983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.303150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.303150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.303526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.303738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.303906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.304073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.304231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.304405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.304585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.304756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.304925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.305079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.305312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.305510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.305746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.305983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.306162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.306320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.306490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.306664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.307416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.307620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.307757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.307903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.308061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.308212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.308212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.308469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.308637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.308780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.308920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.309066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.309199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.309334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.309498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.309650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.309803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.309938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.310083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.310083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.310348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.310486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.310629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.310772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.310907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.311049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.311181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.311315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.311466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.311598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.311755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.311887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.312031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.312182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.312319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.312451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.312593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.312785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.312933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.313168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.313314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.313553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.313690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.313894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.314039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.314185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.314185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.314445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.314589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.314723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.314864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.315072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.315218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.315407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.315570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.315705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.315859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.316070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.316221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.316353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.316486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.316618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.316769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.316918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.317075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.317206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.317348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.317556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.317772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.317914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.318048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.318048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.318303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.318446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.318597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.318740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.318882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.319013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.319155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.319298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.319441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.319583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.319729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.319870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.320011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.320252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.320387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.320522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.320652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.320794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.320928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.321071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.321203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.321348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.321502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.321634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.321786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.321921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.322054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.322185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.322319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.322462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.322608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.322751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.322931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.322931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.323194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.323336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.323492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.323627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.323805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.323989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.324126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.324271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.324428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.324573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.324716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.324851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.324992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.325199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.325346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.325629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.325790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.325940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.326085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.326220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.326354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.326354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:25:03.326613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.326764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.326946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.327295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.327612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.327924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.328251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.328560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.328905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.329285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.329667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.330040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.330352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.330665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.330975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.331343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.331656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.331974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.332282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.332639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.332980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.333447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.333866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.334301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.334773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:25:03.335285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.335787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.336414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.336740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.337305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.337728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.338209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.338701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.339184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.339647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.339976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.340300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.340624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.341057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.341455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.341787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.342176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.342532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.342879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.343206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.343529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.343907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.344246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.344566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.344920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.345306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.345725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.346193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.346666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.347695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.348180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.348665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.349231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.349761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.350261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.350738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.351211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.351722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.352208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.352651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.352975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.353300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.353653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.354003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.354358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.354700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.355036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.355402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.355731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.356054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.356375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.356696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.357010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.357349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.357690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.358031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.358375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.358838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.359301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.359755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.360268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.360739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.361239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.361712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.362159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.362704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.363193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.363686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.364132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.364537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.364833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.365154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.365536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.366014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.366257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.366589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.366962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.367284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.367690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.367912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.368336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.369085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.370337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.370337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.370337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.371189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.371189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.371189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.371578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.371731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.371988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.372294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.372617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.372926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.373246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.373811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.374164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.374453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.374770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.375087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.375421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.375737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.376075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.376516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.376958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.377525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.378027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.378613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.379130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.379640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.380105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.380622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.381112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.381631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.382133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.382524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.382851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.383252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.383644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.383826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.384132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.384491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.384816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.385151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.385492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.385996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.386171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.386518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.386887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.387232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.387608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.387971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.388269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.388630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.388973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.389426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.389772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.390108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.390368 n-d-854882-3 devstack@n-api.service[130001]: INFO dbcounter [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Registered counter for database nova_api Aug 29 15:25:03.390539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.390826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.391189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.391535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.391884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.392202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.392578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.392941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.393300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.393674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.394380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.394380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.394749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.395021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.395340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.395678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.396024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.396367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.396714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.397060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.397432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.397783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.398129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.398465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.398783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.399088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.399462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.399835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.400179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.400530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.400956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.401295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.401691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.402029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.402375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.402732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.403067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.403659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.404065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.404406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.404722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.405072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.405536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.405780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.406201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.406529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.406849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.407249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.407498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.407878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.411375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.412265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.412265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.412265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.412566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.412884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.413232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.413344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_db.sqlalchemy.engines [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.413748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.413981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.414413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.414685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.415019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.415339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.415673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.415953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.416266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.416582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.416939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.417789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.417789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.418722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.418722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.418722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.419002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.419572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.419572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.419826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.420344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.420950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.420950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.421696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.421696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.422173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.422173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.422644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.422875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.423049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writer thread running {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:03.423213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.423684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.423853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.424176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.424454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.424785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.425756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.426088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.426452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.426786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.427133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.427488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.427866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.428259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.428629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.428975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.429318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.429657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.429974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.430286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.452233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.455607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.457131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.458111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.460242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.462307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.464360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.466011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.467266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.468871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.469236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.469449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.469768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.470098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.470422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.470885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.471216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.472320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.472641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.472969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.473294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.473657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.473979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.474298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.474735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.475060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.475381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.475703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.476019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.476366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.476686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.477055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.477349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.477672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.477996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.478344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.478859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.478961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.479425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.479746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.480087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.480618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.480902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.481277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.481737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.482074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.482429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.482780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.483159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.483514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.483846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.484180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.484502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.484823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.485136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.485492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.485826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.486150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.486481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.486916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.487278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.488185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.489584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.489584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.489584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.489584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.489845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.490054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.492865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.493140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.493526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.493846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.494178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.494508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.494821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.495127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.context [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=130001) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:25:03.495210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.495455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.495767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.496077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.496628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.496725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.497037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.497362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.497722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.498062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.498379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.498721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.499053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.499302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.499380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.499685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.499790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.500036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.500325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.500636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.500952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.501261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.501637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:03.501723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.503137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.503137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.503293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.503374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.503374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.503484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.503570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.503570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.503762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.504051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.504373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.504674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.504894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:03.505000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.505276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513732 n-d-854882-3 devstack@n-api.service[130001]: INFO dbcounter [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Registered counter for database nova_cell0 Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.513813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514552 n-d-854882-3 devstack@n-api.service[130001]: INFO dbcounter [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Registered counter for database nova_cell1 Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.514625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.515135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.515135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.515135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.515135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.515380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.516084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.516084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.516227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.516493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.516855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.517179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.517535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.517858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.518176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.518491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.519394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.519713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.520033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.520124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_db.sqlalchemy.engines [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.520409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.520713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.521044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.523854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.524909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.525037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_db.sqlalchemy.engines [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.525170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.525170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.525170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.525465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.525789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.525982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.526315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.526629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.526981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.527249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.527565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.527873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.528203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.528774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.529084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.529488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.529979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.530285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.530726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.530959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.531291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.531625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.531950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.532300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.532439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writer thread running {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:03.532590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.533424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.533424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.533659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.533961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.537959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.541545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.543728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.544593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.544593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.544804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.545113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.545459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.545806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.546146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.546455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.546769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.547075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.547403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.547721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.548035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.548349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.548664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.548977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.549291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.549627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.550549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.550786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.551099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.551412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.551938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.552092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.552348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.552655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.553007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.553333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.553744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.553990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.554308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.554624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.554937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.555251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.555603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.555892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.556208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.556523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.556836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.557644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.557940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.558268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.558595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.558911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.559242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.559571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.559888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.560213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.560715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.560853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.561193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.561560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.561902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.562280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.562504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.562813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.563134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.563461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.563929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.564119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.564370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.564682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.564991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.565299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.565700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.566013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.566374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.566618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.566928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.567237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.567545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.567858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.568145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.568456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.568764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.569070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.569425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.569709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.570009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.570349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.570862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.570992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.571325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.571640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.571960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.572355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.572592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.572921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.573249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.573594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.573931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.574238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.574552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.574866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.575180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.575498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.575811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.576140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.576510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.576772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.577106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.577451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.578035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.578252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.578378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.578713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.579026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.579340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.579655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.579972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.580284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.580602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.581017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.581775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.582102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.582528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.582748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.583080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.583407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.583729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.584070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.584471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.584742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.585096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.585476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.585770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.586086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.586397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:25:03.586657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:25:03.650717 n-d-854882-3 devstack@n-api.service[130002]: INFO dbcounter [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Registered counter for database nova_api Aug 29 15:25:03.671332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_db.sqlalchemy.engines [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.680640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writer thread running {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:03.709050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writer thread running {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:03.719938 n-d-854882-3 devstack@n-api.service[130001]: INFO dbcounter [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Registered counter for database nova_cell0 Aug 29 15:25:03.732329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_db.sqlalchemy.engines [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.734216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writer thread running {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:03.749993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.context [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=130002) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:25:03.756941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.757469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.759952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:03.760842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.761372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.763667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:03.765932 n-d-854882-3 devstack@n-api.service[130002]: INFO dbcounter [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Registered counter for database nova_cell0 Aug 29 15:25:03.769927 n-d-854882-3 devstack@n-api.service[130002]: INFO dbcounter [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Registered counter for database nova_cell1 Aug 29 15:25:03.777356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_db.sqlalchemy.engines [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.782584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writer thread running {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:03.784161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_db.sqlalchemy.engines [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.928967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writer thread running {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:03.939014 n-d-854882-3 devstack@n-api.service[130002]: INFO dbcounter [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Registered counter for database nova_cell0 Aug 29 15:25:03.945982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_db.sqlalchemy.engines [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:25:03.950817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writer thread running {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:25:04.076051 n-d-854882-3 devstack@n-api.service[130001]: WARNING keystonemiddleware.auth_token [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:25:04.084666 n-d-854882-3 devstack@n-api.service[130001]: WARNING keystonemiddleware.auth_token [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:25:04.276997 n-d-854882-3 devstack@n-api.service[130002]: WARNING keystonemiddleware.auth_token [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:25:04.285655 n-d-854882-3 devstack@n-api.service[130002]: WARNING keystonemiddleware.auth_token [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:25:04.432245 n-d-854882-3 devstack@n-api.service[130001]: WARNING keystonemiddleware.auth_token [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:25:04.438768 n-d-854882-3 devstack@n-api.service[130001]: WARNING keystonemiddleware.auth_token [None req-36dd7fae-0b8d-458a-a7b9-d0db8119e6bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:25:04.444659 n-d-854882-3 devstack@n-api.service[130001]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8e41ef9c0 pid: 130001 (default app) Aug 29 15:25:04.630402 n-d-854882-3 devstack@n-api.service[130002]: WARNING keystonemiddleware.auth_token [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:25:04.636488 n-d-854882-3 devstack@n-api.service[130002]: WARNING keystonemiddleware.auth_token [None req-c4935778-8c82-4931-baf9-6e9fbba427e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:25:04.641959 n-d-854882-3 devstack@n-api.service[130002]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8e41ef9c0 pid: 130002 (default app) Aug 29 15:25:45.015749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.016611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.017498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.019098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.429811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.430899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.431645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.432403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.864840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Calling method '.version_select at 0x7fb0e8e48e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:46.872001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=130001) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 15:25:46.872747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:46.873230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:46.873707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:46.902158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:46.902802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:46.903243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:46.921667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:46.922152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:46.922582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:46.930460 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76455a2c-433b-4b5e-a360-6a5fa34b8d3e tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.920191 Aug 29 15:25:46.931111 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:47.309573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:47.315767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:47.316252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:47.316690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:47.317436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:47.317889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:47.318367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:47.363562 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5dfe4fa-6ee9-470f-8a2a-7664f72f7594 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.431150 Aug 29 15:25:47.365340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:25:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:47.370301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Calling method '.version_select at 0x7fb0e8d37ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:47.373949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:47.374682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:47.375449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:47.395993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:47.396637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:47.397068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:47.443663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:47.444576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:47.445158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:47.452277 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-efdc52b5-2c8c-4464-8939-996ecf0a6f74 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-854882-3/servers" status: 200 len: 104 microversion: 2.1 time: 0.085565 Aug 29 15:25:47.462985 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3/3] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Aug 29 15:25:47 2022] GET /compute/v2.1/os-hypervisors/n-h1-854882-3/servers => generated 104 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:47.473144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-48c837e4-e68a-42ca-8a76-25c0dc2ef162 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-823305495"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:47.495317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-48c837e4-e68a-42ca-8a76-25c0dc2ef162 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 46e0b847-9d76-4ee2-b04a-df6dc887ca72 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:47.575579 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-48c837e4-e68a-42ca-8a76-25c0dc2ef162 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.110723 Aug 29 15:25:47.577157 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 4/4] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:48.011865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99a9ac42-0488-47cb-af64-f40a75808cbd tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1850547252", "ram": 512, "vcpus": 1, "disk": 10, "id": 1300483205, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:48.071087 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99a9ac42-0488-47cb-af64-f40a75808cbd tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.647969 Aug 29 15:25:48.071932 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1/5] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:46 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:48.082951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Calling method '.version_select at 0x7fb0e8c71700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:48.085492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Calling method '.version_select at 0x7fb0e8e49e50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:48.090771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.092156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.092893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.093749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=130002) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 15:25:48.094658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.095146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.095613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.119426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.120321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.120942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.126934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.128112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.128673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.134731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.135530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.136178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.143960 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da7ccd9d-a3ff-4b7b-9b4a-d8f49baa9a29 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.565291 Aug 29 15:25:48.144452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.144961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.145079 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 5/6] 10.222.0.16 () {60 vars in 1208 bytes} [Mon Aug 29 15:25:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:48.147559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.149748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4df91569-d603-4cb0-bcc0-878f9afa81e8 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:48.162581 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8af45ebd-5f5c-4411-9bb5-d36ae92a9cd3 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089297 Aug 29 15:25:48.163457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2/7] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:48.172940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4df91569-d603-4cb0-bcc0-878f9afa81e8 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.173610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4df91569-d603-4cb0-bcc0-878f9afa81e8 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.174810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4df91569-d603-4cb0-bcc0-878f9afa81e8 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.411726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:48.413406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.413899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.414389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.415098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.415586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.415949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.458944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-084e7d36-8943-422d-ae70-a9eb14b53316 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.293500 Aug 29 15:25:48.459691 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3/8] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Aug 29 15:25:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:48.581572 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4df91569-d603-4cb0-bcc0-878f9afa81e8 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.435179 Aug 29 15:25:48.582357 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 6/9] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:48.594702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e730658-ac84-4cb4-838a-849a6de97a2a tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:48.610244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '.version_select at 0x7fb0e8cd2160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:48.612332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.613661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.613661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.628552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.629026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.629671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.643279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.643751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.644184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.650785 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e730658-ac84-4cb4-838a-849a6de97a2a tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1300483205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067070 Aug 29 15:25:48.651464 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 7/10] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Aug 29 15:25:48 2022] POST /compute/v2.1/flavors/1300483205/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:48.652406 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e3c7c4d5-4bec-4588-b033-8a4f3c03a602 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.191687 Aug 29 15:25:48.653327 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 4/11] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:25:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:48.656679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Calling method '.version_select at 0x7fb0e840d5e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:48.659298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.659885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.660543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.674522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.675094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.675604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.682874 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6466a0f8-82df-4d50-9ad6-3412f5e090c1 tempest-HypervisorAdminUnderV252Test-505273630 tempest-HypervisorAdminUnderV252Test-505273630-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-854882-3/search" status: 200 len: 104 microversion: 2.1 time: 0.030192 Aug 29 15:25:48.689607 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 8/12] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:25:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-854882-3/search => generated 104 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:48.693537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:48.695357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.695840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.696267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.697025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.697503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.697921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.726863 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c454e062-084a-4d9a-925b-7414d1e31d77 tempest-AZAdminV2TestJSON-1738845878 tempest-AZAdminV2TestJSON-1738845878-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.041891 Aug 29 15:25:48.727466 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 9/13] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Aug 29 15:25:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:48.732051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:48.742507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.742997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.743458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.777540 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-854882-3. Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 39 Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:25:48.793847 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: {"add_host": {"host": "n-h1-854882-3"}} Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:48.795254 n-d-854882-3 devstack@n-api.service[130001]: exception: Aggregate 1 already has host n-h1-854882-3. Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-854882-3'}}} Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:25:48.799911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-854882-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:25:48.802416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:25:48.804659 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:25:48.806945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-854882-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 25, 48, 758339), 'updated_at': None, 'host': 'n-h1-854882-3', 'aggregate_id': 1}] Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:48.810183 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-854882-3. Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.812072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-854882-3. Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:48.814272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:48.816511 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-854882-3. Aug 29 15:25:48.816511 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:48.816511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-854882-3. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:48.816511 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c997b079-a9a7-4318-83d1-ed8d8630b430 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.067026 Aug 29 15:25:48.816511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 10/14] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 29 15:25:48.864136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9211c386-fac6-4d1b-a492-b4d817e1a188 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-714229462", "id": 1560752077, "os-flavor-access:is_public": "False"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:48.885423 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9211c386-fac6-4d1b-a492-b4d817e1a188 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.230666 Aug 29 15:25:48.886269 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 5/15] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:48 2022] POST /compute/v2.1/flavors => generated 430 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:48.894245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a1e75b19-913d-463f-91c2-f6e358b644d5 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:48.929458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e75b19-913d-463f-91c2-f6e358b644d5 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:48.930305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e75b19-913d-463f-91c2-f6e358b644d5 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:48.930885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e75b19-913d-463f-91c2-f6e358b644d5 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:49.114974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0f0383b-77b8-471f-ae96-c33fde9e8a62 tempest-FlavorsExtraSpecsTestJSON-1238479606 tempest-FlavorsExtraSpecsTestJSON-1238479606-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:49.136433 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f0f0383b-77b8-471f-ae96-c33fde9e8a62 tempest-FlavorsExtraSpecsTestJSON-1238479606 tempest-FlavorsExtraSpecsTestJSON-1238479606-project] 10.222.0.16 "GET /compute/v2.1/flavors/1300483205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.339034 Aug 29 15:25:49.143485 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 11/16] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:25:48 2022] GET /compute/v2.1/flavors/1300483205/os-extra_specs => generated 66 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:49.148401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c756629-5bb9-447c-bd9c-c32ef7a76c59 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cbba879822dc45248651e86cd13b3098"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:49.593950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c756629-5bb9-447c-bd9c-c32ef7a76c59 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1560752077/action" status: 200 len: 97 microversion: 2.1 time: 0.449058 Aug 29 15:25:49.595468 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 12/17] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Aug 29 15:25:49 2022] POST /compute/v2.1/flavors/1560752077/action => generated 97 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:49.601482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-056a1230-8d23-4d6e-8651-0737e892b0ad tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:49.635860 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-056a1230-8d23-4d6e-8651-0737e892b0ad tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1300483205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038820 Aug 29 15:25:49.642383 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 13/18] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Aug 29 15:25:49 2022] POST /compute/v2.1/flavors/1300483205/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:49.809844 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a1e75b19-913d-463f-91c2-f6e358b644d5 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.918441 Aug 29 15:25:49.811023 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 6/19] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:49.825709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75170f18-4beb-4a43-b721-fb778f931142 tempest-FlavorsExtraSpecsTestJSON-1238479606 tempest-FlavorsExtraSpecsTestJSON-1238479606-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:49.901935 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75170f18-4beb-4a43-b721-fb778f931142 tempest-FlavorsExtraSpecsTestJSON-1238479606 tempest-FlavorsExtraSpecsTestJSON-1238479606-project] 10.222.0.16 "GET /compute/v2.1/flavors/1300483205/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.089518 Aug 29 15:25:49.902404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e273726d-3fd1-4384-9348-81c9773c191a tempest-FlavorsAccessTestJSON-281810868 tempest-FlavorsAccessTestJSON-281810868-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:49.903404 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 7/20] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:25:49 2022] GET /compute/v2.1/flavors/1300483205/os-extra_specs/hw:numa_nodes => generated 22 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:49.909570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8f233116-1b1f-4766-b761-cb81108e84dd tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:49.950053 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8f233116-1b1f-4766-b761-cb81108e84dd tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.044574 Aug 29 15:25:49.956251 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 8/21] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:49 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:49.962102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b6dbf1b-e1b1-4ed3-b599-6372cdb1955b tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:49.967542 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e273726d-3fd1-4384-9348-81c9773c191a tempest-FlavorsAccessTestJSON-281810868 tempest-FlavorsAccessTestJSON-281810868-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.323723 Aug 29 15:25:49.968323 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 14/22] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:49 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:49.990510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f96a3be-98fb-48da-a756-f39e577e9c65 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-772500214"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:49.998671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-1f96a3be-98fb-48da-a756-f39e577e9c65 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 0f8ad771-d3e5-405d-8572-cfe166452d51 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:50.043302 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f96a3be-98fb-48da-a756-f39e577e9c65 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.064642 Aug 29 15:25:50.046772 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 15/23] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:50.057292 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b6dbf1b-e1b1-4ed3-b599-6372cdb1955b tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1300483205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.096030 Aug 29 15:25:50.059093 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 9/24] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Aug 29 15:25:49 2022] POST /compute/v2.1/flavors/1300483205/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:50.063203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a5ed7735-69fe-4f15-acd5-621b84b14d24 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cbba879822dc45248651e86cd13b3098"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.067307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e21650ea-fda0-4724-b90c-7021f701bead tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1579428711"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.072262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-e21650ea-fda0-4724-b90c-7021f701bead tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Generated uuid 4b3853a0-d068-46bb-b186-b151bd8688b2 for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:50.123806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e21650ea-fda0-4724-b90c-7021f701bead tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.063266 Aug 29 15:25:50.124870 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 10/25] 10.222.0.16 () {62 vars in 1205 bytes} [Mon Aug 29 15:25:50 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:50.465219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2437a7dc-2f3b-49ee-a19e-83f90ae844c6 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.468616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2437a7dc-2f3b-49ee-a19e-83f90ae844c6 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6b0f2619a2234473bda588435455014e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3022eb88dd4547738f95767a2bff60c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2437a7dc-2f3b-49ee-a19e-83f90ae844c6 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Request method failure captured: Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 39 Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNp3b8dsXSja7rArL6ddqL5ZIZ-I88Q9wts-ltAUKuVn4Hyv365PZEVRXobsvhWE2N-hGdcKCOL5Y8EbxawKtK5WKS4xcFeMo55bRTRq1PxgP5ezDx0xMVyotqvC-Xir9HRBTtNv2zjexABFtgGsQHXAVvSy9onY_eBIF514dZgllu4 Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:25:50.473547 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3022eb88dd4547738f95767a2bff60c8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}] Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 6b0f2619a2234473bda588435455014e Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: {"add_host": {"host": "n-h1-854882-3"}} Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:25:50.474786 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-854882-3'}}} Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:50.475651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:25:50.477082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.484724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2437a7dc-2f3b-49ee-a19e-83f90ae844c6 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:50.484724 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2437a7dc-2f3b-49ee-a19e-83f90ae844c6 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.347631 Aug 29 15:25:50.484724 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 11/26] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 350 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:50.484724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f804954-0960-450d-ba2c-23c2b04d683a tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:50.497114 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f804954-0960-450d-ba2c-23c2b04d683a tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1300483205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020413 Aug 29 15:25:50.502965 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 12/27] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:25:50 2022] GET /compute/v2.1/flavors/1300483205/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:50.510896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e49a8547-3bf1-448b-923c-b9ccb226f353 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-486342972"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.694542 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e49a8547-3bf1-448b-923c-b9ccb226f353 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.190086 Aug 29 15:25:50.695851 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 13/28] 10.222.0.16 () {62 vars in 1210 bytes} [Mon Aug 29 15:25:50 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:50.701552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29af88a9-3e85-428e-8e1e-2a2a60463ceb tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:50.731009 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29af88a9-3e85-428e-8e1e-2a2a60463ceb tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.033535 Aug 29 15:25:50.736946 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:50 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:50.744104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16bcef1a-8954-477f-b0d1-184944175738 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.762485 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a5ed7735-69fe-4f15-acd5-621b84b14d24 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1560752077/action" status: 200 len: 21 microversion: 2.1 time: 0.713827 Aug 29 15:25:50.763507 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 16/30] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Aug 29 15:25:50 2022] POST /compute/v2.1/flavors/1560752077/action => generated 21 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:50.781573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-776e5ef8-d6ef-480f-886e-ce8419ed996a tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:50.781895 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16bcef1a-8954-477f-b0d1-184944175738 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1300483205/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.046992 Aug 29 15:25:50.782517 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 15/31] 10.222.0.16 () {60 vars in 1265 bytes} [Mon Aug 29 15:25:50 2022] PUT /compute/v2.1/flavors/1300483205/os-extra_specs/hw:numa_nodes => generated 22 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:50.788646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4dfdd90e-2625-4897-b5dc-6f6d611e4819 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1226543317"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.792504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-4dfdd90e-2625-4897-b5dc-6f6d611e4819 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 7b45be12-ef40-4ae9-8068-5a7f97401d78 for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:50.816336 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4dfdd90e-2625-4897-b5dc-6f6d611e4819 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.031170 Aug 29 15:25:50.817982 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 16/32] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:50.825022 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-776e5ef8-d6ef-480f-886e-ce8419ed996a tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.059704 Aug 29 15:25:50.826623 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 17/33] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Aug 29 15:25:50 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:50.840213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-586de33b-e70b-42c3-a818-9ed3daa3bfb5 tempest-FlavorsAccessTestJSON-281810868 tempest-FlavorsAccessTestJSON-281810868-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:50.845257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ec37347f-d454-4427-bd71-9ce96af62d22 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:50.857638 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ec37347f-d454-4427-bd71-9ce96af62d22 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1300483205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029215 Aug 29 15:25:50.865931 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:25:50 2022] GET /compute/v2.1/flavors/1300483205/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:50.866223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2026667486"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.881342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:50.882180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:50.882624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:50.890467 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-586de33b-e70b-42c3-a818-9ed3daa3bfb5 tempest-FlavorsAccessTestJSON-281810868 tempest-FlavorsAccessTestJSON-281810868-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.070864 Aug 29 15:25:50.905366 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 17/35] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:50 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:50.911386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b37bba6-5d36-461f-9a15-d83489e767c9 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:50.914265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:50.915267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:50.916964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:50.922699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37bba6-5d36-461f-9a15-d83489e767c9 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:50.923967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37bba6-5d36-461f-9a15-d83489e767c9 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:50.924607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37bba6-5d36-461f-9a15-d83489e767c9 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:50.928604 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2026667486 could not be found. Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 58 Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:25:50.932459 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: {"add_host": {"host": "tempest-nonexist_host-2026667486"}} Aug 29 15:25:50.933607 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: exception: Compute host tempest-nonexist_host-2026667486 could not be found. Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-2026667486'}}} Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2026667486' is not mapped to any cell Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:50.934210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 29 15:25:50.935260 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2026667486 could not be found. Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2026667486 could not be found. Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:50.937838 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2026667486 could not be found. Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2026667486 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8f4e457-d9f4-434a-8765-e73b5268f987 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.074057 Aug 29 15:25:50.940050 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:50 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:50.944982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-90d5b943-e562-4de2-b12a-b014b5ac0e98 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:50.978312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:50.999093 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-90d5b943-e562-4de2-b12a-b014b5ac0e98 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1300483205/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.059054 Aug 29 15:25:51.000107 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:25:50 2022] DELETE /compute/v2.1/flavors/1300483205/os-extra_specs/hw:numa_nodes => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:51.005846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16f278d0-afb7-4020-96b3-6646a26b19b8 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.039443 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16f278d0-afb7-4020-96b3-6646a26b19b8 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1560752077" status: 202 len: 0 microversion: 2.1 time: 0.037213 Aug 29 15:25:51.041701 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 21/38] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/flavors/1560752077 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:51.050350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-def6f301-3f11-4bd0-a51d-314b91dc1930 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.098098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-def6f301-3f11-4bd0-a51d-314b91dc1930 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.054830 Aug 29 15:25:51.099562 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 22/39] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:51.107536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8d3236c8-79e8-4179-b7f2-15d97f739046 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.137708 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8d3236c8-79e8-4179-b7f2-15d97f739046 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1300483205/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036285 Aug 29 15:25:51.139052 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 23/40] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/flavors/1300483205/os-extra_specs/hw:cpu_policy => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:51.145124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc7c514b-de6a-4a69-8666-68917a84dacb tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.164374 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b37bba6-5d36-461f-9a15-d83489e767c9 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.257742 Aug 29 15:25:51.165466 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 18/41] 10.222.0.16 () {62 vars in 1232 bytes} [Mon Aug 29 15:25:50 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:51.203830 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cc7c514b-de6a-4a69-8666-68917a84dacb tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.062874 Aug 29 15:25:51.204512 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 24/42] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:51.227153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29400cac-5e0e-4f8b-b680-0c0c1868aec3 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29400cac-5e0e-4f8b-b680-0c0c1868aec3 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 283 Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:25:51.238368 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:51.240521 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:51.241579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:51.243679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.247011 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.253600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:51.253600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:51.253600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:51.253600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.253600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29400cac-5e0e-4f8b-b680-0c0c1868aec3 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:51.255851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29400cac-5e0e-4f8b-b680-0c0c1868aec3 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029537 Aug 29 15:25:51.255851 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 25/43] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:51.255851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b317b5d-9128-4f5d-8911-0d05571347b7 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.268570 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b317b5d-9128-4f5d-8911-0d05571347b7 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1300483205/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024578 Aug 29 15:25:51.269424 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 26/44] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/flavors/1300483205/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:51.288459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ec7ba8b-5dd8-4637-be0e-3cfc59b2cf75 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.306990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ec7ba8b-5dd8-4637-be0e-3cfc59b2cf75 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:51.308130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ec7ba8b-5dd8-4637-be0e-3cfc59b2cf75 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:51.309155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ec7ba8b-5dd8-4637-be0e-3cfc59b2cf75 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:51.504458 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ec7ba8b-5dd8-4637-be0e-3cfc59b2cf75 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.221497 Aug 29 15:25:51.506600 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 27/45] 10.222.0.16 () {62 vars in 1232 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:51.524119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-00232b5b-b00b-42c1-971c-a0157b1d71f8 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-51212352", "id": 612279884, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.567240 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-00232b5b-b00b-42c1-971c-a0157b1d71f8 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.058327 Aug 29 15:25:51.569410 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 28/46] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/flavors => generated 426 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:51.589505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-afba45c9-981c-4dac-978a-288f4e4468c8 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-518578394", "id": 1329740847, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.601183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d5fd23b-5995-4b8e-ace6-4663e31774e9 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d5fd23b-5995-4b8e-ace6-4663e31774e9 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 27 Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:25:51.605752 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: {"aggregate": {"name": ""}} Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:51.607320 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi '' Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:51.608164 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:25:51.614338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.615377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d5fd23b-5995-4b8e-ace6-4663e31774e9 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:51.615377 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d5fd23b-5995-4b8e-ace6-4663e31774e9 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.029236 Aug 29 15:25:51.615377 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 29/47] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:51.615377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6edf17b-25a6-422c-bd55-9c76bbd2c8d2 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.616580 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-afba45c9-981c-4dac-978a-288f4e4468c8 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.449850 Aug 29 15:25:51.617202 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 19/48] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/flavors => generated 470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:51.629889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ed88feb6-ff01-452a-9f01-01f1df2fb957 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.641038 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6edf17b-25a6-422c-bd55-9c76bbd2c8d2 tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1300483205" status: 202 len: 0 microversion: 2.1 time: 0.031272 Aug 29 15:25:51.641764 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 30/49] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/flavors/1300483205 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:51.647874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5e91ec06-5ccb-4519-9829-c6c707da6372 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.669147 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5e91ec06-5ccb-4519-9829-c6c707da6372 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/612279884/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.025421 Aug 29 15:25:51.675298 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 31/50] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/flavors/612279884/os-flavor-access => generated 21 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:51.677321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e29fc83f-bdc8-4bed-bef3-16d24cf3ceed tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-398566656"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.679615 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ed88feb6-ff01-452a-9f01-01f1df2fb957 tempest-AggregatesAdminTestV241-2089120688 tempest-AggregatesAdminTestV241-2089120688-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.060949 Aug 29 15:25:51.682373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e29fc83f-bdc8-4bed-bef3-16d24cf3ceed tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6b0f2619a2234473bda588435455014e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3022eb88dd4547738f95767a2bff60c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e29fc83f-bdc8-4bed-bef3-16d24cf3ceed tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Request method failure captured: Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 59 Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp3b8dsXSja7rArL6ddqL5ZIZ-I88Q9wts-ltAUKuVn4Hyv365PZEVRXobsvhWE2N-hGdcKCOL5Y8EbxawKtK5WKS4xcFeMo55bRTRq1PxgP5ezDx0xMVyotqvC-Xir9HRBTtNv2zjexABFtgGsQHXAVvSy9onY_eBIF514dZgllu4 Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:25:51.686170 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3022eb88dd4547738f95767a2bff60c8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}] Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 6b0f2619a2234473bda588435455014e Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: {"aggregate": {"name": "tempest-test_aggregate-398566656"}} Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:51.687315 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-398566656'}}} Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:51.688040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:51.688976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:25:51.691074 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.691381 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 20/51] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:51.692513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e29fc83f-bdc8-4bed-bef3-16d24cf3ceed tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:51.693607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e29fc83f-bdc8-4bed-bef3-16d24cf3ceed tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021850 Aug 29 15:25:51.693831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-226e9404-95d9-4375-8449-dc9356389aa7 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.695317 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 32/52] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:51.707792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8cec7399-4917-4cf5-b788-98daacaff65f tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.745685 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8cec7399-4917-4cf5-b788-98daacaff65f tempest-FlavorsExtraSpecsTestJSON-256098685 tempest-FlavorsExtraSpecsTestJSON-256098685-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.042795 Aug 29 15:25:51.746117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 33/53] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:51.761608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-95999e5b-7764-49ed-a33e-b55fec5160fc tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.781462 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-95999e5b-7764-49ed-a33e-b55fec5160fc tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/612279884" status: 202 len: 0 microversion: 2.1 time: 0.034228 Aug 29 15:25:51.782485 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 34/54] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/flavors/612279884 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:51.789235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-249e3e17-cd30-4704-bc65-a9222d229fd3 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-942481558"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.794513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-249e3e17-cd30-4704-bc65-a9222d229fd3 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid fded1950-256f-4f60-b99e-c26cc46ec149 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:51.822789 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-249e3e17-cd30-4704-bc65-a9222d229fd3 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038347 Aug 29 15:25:51.823980 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 35/55] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:51.829777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6ed310b9-6d2e-4a2a-a204-f0157f13d461 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1460581700", "name": "tempest-test_aggregate-1341777698"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.853916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-6ed310b9-6d2e-4a2a-a204-f0157f13d461 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid e416f68c-af3a-4a88-82b7-50662fa8a779 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:51.891187 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6ed310b9-6d2e-4a2a-a204-f0157f13d461 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.065725 Aug 29 15:25:51.893125 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 36/56] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:51.897444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-930e09b0-4ecc-4408-a301-beb5468cdc49 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.926030 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-930e09b0-4ecc-4408-a301-beb5468cdc49 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.031862 Aug 29 15:25:51.927051 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 37/57] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:51.930413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:51.931820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e9e08a0-4181-45f7-a4cd-eec261e884c4 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-942481558"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.935210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-8e9e08a0-4181-45f7-a4cd-eec261e884c4 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 751683cd-fecd-4d8f-b35f-13046ccf983d for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:51.945995 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-8e9e08a0-4181-45f7-a4cd-eec261e884c4 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-942481558 already exists. Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e9e08a0-4181-45f7-a4cd-eec261e884c4 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 59 Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:25:51.948455 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: {"aggregate": {"name": "tempest-test_aggregate-942481558"}} Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:51.950213 n-d-854882-3 devstack@n-api.service[130001]: exception: Aggregate tempest-test_aggregate-942481558 already exists. Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-942481558'}}} Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 29 15:25:51.950872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-942481558 already exists. Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:51.951800 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-942481558 already exists. Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-942481558 already exists. Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e9e08a0-4181-45f7-a4cd-eec261e884c4 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-942481558 already exists. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:51.952771 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e9e08a0-4181-45f7-a4cd-eec261e884c4 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.022438 Aug 29 15:25:51.953520 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 38/58] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 24 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:51.961096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d1d02a9-d6fb-453a-9ab9-98c42ff9576e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.961909 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-226e9404-95d9-4375-8449-dc9356389aa7 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1329740847/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.273332 Aug 29 15:25:51.963414 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 21/59] 10.222.0.16 () {62 vars in 1265 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/flavors/1329740847/os-extra_specs => generated 62 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:51.970361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-809529c3-553d-4d81-9948-56354ef5ff3a tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.974659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d1d02a9-d6fb-453a-9ab9-98c42ff9576e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.022043 Aug 29 15:25:51.975758 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 39/60] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:51.981587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a50ee065-b92d-4074-a32f-64fc40f6a008 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.006383 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a50ee065-b92d-4074-a32f-64fc40f6a008 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1329740847" status: 202 len: 0 microversion: 2.86 time: 0.029807 Aug 29 15:25:52.007287 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 40/61] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/flavors/1329740847 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:25:52.012630 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-809529c3-553d-4d81-9948-56354ef5ff3a tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.047189 Aug 29 15:25:52.013506 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 22/62] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:52.017268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f337e7f-4d5d-4c00-b08e-60f8cffa9e60 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:52.025774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1e8bad0b-12aa-4505-a3ee-c3dda50653a3 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.035095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f337e7f-4d5d-4c00-b08e-60f8cffa9e60 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:52.035836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f337e7f-4d5d-4c00-b08e-60f8cffa9e60 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:52.036420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f337e7f-4d5d-4c00-b08e-60f8cffa9e60 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:52.060565 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1e8bad0b-12aa-4505-a3ee-c3dda50653a3 tempest-FlavorMetadataValidation-1889271993 tempest-FlavorMetadataValidation-1889271993-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.043139 Aug 29 15:25:52.061782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 23/63] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:52.067268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d82be6bf-68fc-4b7c-9b63-d2073762e307 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1563497533"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:52.088513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-d82be6bf-68fc-4b7c-9b63-d2073762e307 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 033a2304-aedb-4137-8b76-e3c1a257aea5 for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:52.119081 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d82be6bf-68fc-4b7c-9b63-d2073762e307 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056007 Aug 29 15:25:52.120080 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 24/64] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:52.134587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-328c8bae-16a1-4c8d-88c4-34b4c4d7415b tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.137065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-328c8bae-16a1-4c8d-88c4-34b4c4d7415b tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6b0f2619a2234473bda588435455014e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3022eb88dd4547738f95767a2bff60c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-328c8bae-16a1-4c8d-88c4-34b4c4d7415b tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Request method failure captured: Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNp3b8dsXSja7rArL6ddqL5ZIZ-I88Q9wts-ltAUKuVn4Hyv365PZEVRXobsvhWE2N-hGdcKCOL5Y8EbxawKtK5WKS4xcFeMo55bRTRq1PxgP5ezDx0xMVyotqvC-Xir9HRBTtNv2zjexABFtgGsQHXAVvSy9onY_eBIF514dZgllu4 Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:25:52.139926 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3022eb88dd4547738f95767a2bff60c8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}] Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 6b0f2619a2234473bda588435455014e Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:25:52.141044 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '7'} Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:52.141691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:25:52.143239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.145177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-328c8bae-16a1-4c8d-88c4-34b4c4d7415b tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:52.146409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-328c8bae-16a1-4c8d-88c4-34b4c4d7415b tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.017358 Aug 29 15:25:52.147674 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 25/65] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:52 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:52.156561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6e9410e-bc68-484e-b42a-2fd068fabe30 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.206060 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6e9410e-bc68-484e-b42a-2fd068fabe30 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.052873 Aug 29 15:25:52.207393 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 26/66] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:52 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:52.216676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c760e41a-fab6-4110-8486-b840ef5c5a04 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.238800 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c760e41a-fab6-4110-8486-b840ef5c5a04 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c760e41a-fab6-4110-8486-b840ef5c5a04 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:25:52.247695 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: exception: Aggregate -1 could not be found. Aug 29 15:25:52.248971 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '-1'} Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:52.249872 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.250851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.251978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.251978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.251978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:52.251978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:52.251978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 15:25:52.251978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.253952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c760e41a-fab6-4110-8486-b840ef5c5a04 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:52.255075 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c760e41a-fab6-4110-8486-b840ef5c5a04 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042768 Aug 29 15:25:52.256062 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 27/67] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:52 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:25:52.261862 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f337e7f-4d5d-4c00-b08e-60f8cffa9e60 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.1 time: 0.251274 Aug 29 15:25:52.262445 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 41/68] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:52 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:52.278770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2731c720-7f63-4939-a878-725514ae1899 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-164020904"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:52.285033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-2731c720-7f63-4939-a878-725514ae1899 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 194361bd-18a8-42a5-bfc0-4b623f13679f for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:52.306119 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2731c720-7f63-4939-a878-725514ae1899 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.032070 Aug 29 15:25:52.306889 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 28/69] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:52 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:52.317832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6cb28361-48bf-46d3-ae25-5a3f999bb498 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.319345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6cb28361-48bf-46d3-ae25-5a3f999bb498 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6b0f2619a2234473bda588435455014e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3022eb88dd4547738f95767a2bff60c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6cb28361-48bf-46d3-ae25-5a3f999bb498 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Request method failure captured: Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp3b8dsXSja7rArL6ddqL5ZIZ-I88Q9wts-ltAUKuVn4Hyv365PZEVRXobsvhWE2N-hGdcKCOL5Y8EbxawKtK5WKS4xcFeMo55bRTRq1PxgP5ezDx0xMVyotqvC-Xir9HRBTtNv2zjexABFtgGsQHXAVvSy9onY_eBIF514dZgllu4 Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:25:52.320887 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3022eb88dd4547738f95767a2bff60c8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}] Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 6b0f2619a2234473bda588435455014e Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:25:52.323583 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '8'} Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:52.325147 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.327672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6cb28361-48bf-46d3-ae25-5a3f999bb498 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:52.331393 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6cb28361-48bf-46d3-ae25-5a3f999bb498 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.008304 Aug 29 15:25:52.331393 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 42/70] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:25:52 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:52.331542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da67fe8b-e3fb-4d3a-8e7e-f68ce97bae7c tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.358370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da67fe8b-e3fb-4d3a-8e7e-f68ce97bae7c tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.027810 Aug 29 15:25:52.366520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0640a9c7-f790-4e6a-8e0d-ed3cd228a37c tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.371089 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 29/71] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:52 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:52.374834 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-0640a9c7-f790-4e6a-8e0d-ed3cd228a37c tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0640a9c7-f790-4e6a-8e0d-ed3cd228a37c tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:25:52.376598 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: exception: Aggregate -1 could not be found. Aug 29 15:25:52.379063 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '-1'} Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.380439 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 15:25:52.383697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.385587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0640a9c7-f790-4e6a-8e0d-ed3cd228a37c tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:52.385587 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0640a9c7-f790-4e6a-8e0d-ed3cd228a37c tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015521 Aug 29 15:25:52.385587 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 43/72] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:52 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:52.391981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd6e7068-2085-4346-9b66-b06ad0c61e62 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.394175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fd6e7068-2085-4346-9b66-b06ad0c61e62 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6b0f2619a2234473bda588435455014e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3022eb88dd4547738f95767a2bff60c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd6e7068-2085-4346-9b66-b06ad0c61e62 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Request method failure captured: Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNp3b8dsXSja7rArL6ddqL5ZIZ-I88Q9wts-ltAUKuVn4Hyv365PZEVRXobsvhWE2N-hGdcKCOL5Y8EbxawKtK5WKS4xcFeMo55bRTRq1PxgP5ezDx0xMVyotqvC-Xir9HRBTtNv2zjexABFtgGsQHXAVvSy9onY_eBIF514dZgllu4 Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:25:52.395814 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3022eb88dd4547738f95767a2bff60c8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}] Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 6b0f2619a2234473bda588435455014e Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:25:52.397897 n-d-854882-3 devstack@n-api.service[130002]: action_args: {} Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:52.398510 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:52.400056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd6e7068-2085-4346-9b66-b06ad0c61e62 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:52.401755 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd6e7068-2085-4346-9b66-b06ad0c61e62 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009181 Aug 29 15:25:52.402274 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 30/73] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:25:52 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:53.126487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-495970958", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "availability_zone": "tempest-test_az-1460581700"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:53.141733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:53.142467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:53.143042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:53.143932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:53.144572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:53.145133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:53.165329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=16,nova_api:INSERT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:54.138408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:25:54.385256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:25:54.386047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:25:54.386934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:25:54.387558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:25:54.388175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:25:54.407095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:54.408484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:54.409139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:54.410050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:54.410917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:54.411540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:54.455564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Getting quotas for project ebba5db9c29a4e3f9886bcf67f676922. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:25:54.464664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Getting quotas for user 99004756e4fe4720b121bd4b03949f35 and project ebba5db9c29a4e3f9886bcf67f676922. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:25:54.478042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:25:54.481667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:25:54.539040 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fc79ed7f-df83-44af-b50b-143508a2cc5f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.898715 Aug 29 15:25:54.540122 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 44/74] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:25:54.554003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f54715d-67c9-4279-a924-0e43a55ce72d tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:54.556471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f54715d-67c9-4279-a924-0e43a55ce72d tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:56.123074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f54715d-67c9-4279-a924-0e43a55ce72d tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:56.139679 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f54715d-67c9-4279-a924-0e43a55ce72d tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1242 microversion: 2.1 time: 1.592162 Aug 29 15:25:56.140573 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 31/75] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:54 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1242 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:57.163242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:57.164013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:57.188975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:57.190345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:57.190781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:57.191484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:57.191928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:57.192344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:57.378412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:57.398844 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8ab73f6-59a8-4250-8856-dfbb16537e82 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1296 microversion: 2.1 time: 0.240707 Aug 29 15:25:57.399905 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 45/76] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:57 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1296 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:57.788955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4cee1b4c-7242-46ae-a7e4-30ab97de0807 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:57.792416 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4cee1b4c-7242-46ae-a7e4-30ab97de0807 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4cee1b4c-7242-46ae-a7e4-30ab97de0807 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731-project-admin] Request method failure captured: Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqFqoYcUt4QqRwo1NsHSdfnzlelDo0Y8i9N-2yjzGjv5vpeXZ9ks4KVRAPgRmGh_aHH6qbmS0k2vemT7J5uNU6HDzmjNnbcFP6l_R2_ce0clGsIuWwVWmUjtUboaN6S8C_waGmdYsjlpkUuKFRgL4LultChDS44t8LqbdRCjfWiKUo Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: e604744efbae4cfc907f31721303edf4 Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:25:57.804638 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e604744efbae4cfc907f31721303edf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e604744efbae4cfc907f31721303edf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e604744efbae4cfc907f31721303edf4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e604744efbae4cfc907f31721303edf4"}]}] Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: e604744efbae4cfc907f31721303edf4 Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-463610731-project-admin Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 586d62c680f1413989b5de1f48fb220c Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463610731-project-admin Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:25:57.806062 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid timestamp for date invalid_time Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'invalid_time'} Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:57.807163 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4cee1b4c-7242-46ae-a7e4-30ab97de0807 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:57.808431 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4cee1b4c-7242-46ae-a7e4-30ab97de0807 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731 tempest-InstanceUsageAuditLogNegativeTestJSON-463610731-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.496509 Aug 29 15:25:57.812255 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 32/77] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 503 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 29 15:25:57.903370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd48e9ac-1e6c-4cb0-b6e4-ea7be1c94ea9 tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-478747028", "id": 1908614972, "os-flavor-access:is_public": "True"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:57.929538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dd48e9ac-1e6c-4cb0-b6e4-ea7be1c94ea9 tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.350800 Aug 29 15:25:57.931135 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 46/78] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:25:57 2022] POST /compute/v2.1/flavors => generated 467 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:58.407905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-865289df-28c7-47e0-8a08-f1dfe011ff31 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:58.410425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-865289df-28c7-47e0-8a08-f1dfe011ff31 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd70255def58b4d4c8650db525a7b477e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86a4df4999c46ca9ec190e5c4336bca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-865289df-28c7-47e0-8a08-f1dfe011ff31 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Request method failure captured: Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqCsM09DGAdt8C9gIGgsxk1tJ15pnP79hqq5TQ0Aqng9X8dOp-yuwarR3WDhz3wobG12KwcHsbDOLForbchVPMMNbTvZfeoqCjg42Zj6EpQ8GrzR1xdVuThAuQf_0oaSnOSou8cr2IlyGCa8470J2nFQ-wc7YadpH_L0MpwLl-uWL0 Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: d86a4df4999c46ca9ec190e5c4336bca Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:25:58.418512 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86a4df4999c46ca9ec190e5c4336bca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86a4df4999c46ca9ec190e5c4336bca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86a4df4999c46ca9ec190e5c4336bca", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86a4df4999c46ca9ec190e5c4336bca"}]}] Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: d86a4df4999c46ca9ec190e5c4336bca Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d70255def58b4d4c8650db525a7b477e Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project Aug 29 15:25:58.419903 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: action_args: {} Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:58.420732 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:25:58.422015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:25:58.425944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-865289df-28c7-47e0-8a08-f1dfe011ff31 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:58.427718 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-865289df-28c7-47e0-8a08-f1dfe011ff31 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.614464 Aug 29 15:25:58.428271 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 33/79] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Aug 29 15:25:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 615 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:58.434002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:58.458334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:58.459355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:58.477710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:58.481044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:58.481727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:58.482917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:58.487865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:58.488857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:59.046573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe63edbf-b503-4974-91d2-ac9cb4a632c1 tempest-FlavorsV261TestJSON-1992979575 tempest-FlavorsV261TestJSON-1992979575-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:59.068789 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe63edbf-b503-4974-91d2-ac9cb4a632c1 tempest-FlavorsV261TestJSON-1992979575 tempest-FlavorsV261TestJSON-1992979575-project] 10.222.0.16 "GET /compute/v2.1/flavors/1908614972" status: 200 len: 467 microversion: 2.61 time: 1.127568 Aug 29 15:25:59.070403 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 47/80] 10.222.0.16 () {60 vars in 1199 bytes} [Mon Aug 29 15:25:57 2022] GET /compute/v2.1/flavors/1908614972 => generated 467 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:25:59.076480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b16e2c87-728c-4f9d-bac5-4b05f284fcb4 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:59.079127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b16e2c87-728c-4f9d-bac5-4b05f284fcb4 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd70255def58b4d4c8650db525a7b477e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86a4df4999c46ca9ec190e5c4336bca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b16e2c87-728c-4f9d-bac5-4b05f284fcb4 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Request method failure captured: Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015:25:58 HTTP/1.1 Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqCsM09DGAdt8C9gIGgsxk1tJ15pnP79hqq5TQ0Aqng9X8dOp-yuwarR3WDhz3wobG12KwcHsbDOLForbchVPMMNbTvZfeoqCjg42Zj6EpQ8GrzR1xdVuThAuQf_0oaSnOSou8cr2IlyGCa8470J2nFQ-wc7YadpH_L0MpwLl-uWL0 Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: d86a4df4999c46ca9ec190e5c4336bca Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:25:59.082255 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86a4df4999c46ca9ec190e5c4336bca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86a4df4999c46ca9ec190e5c4336bca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86a4df4999c46ca9ec190e5c4336bca", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86a4df4999c46ca9ec190e5c4336bca"}]}] Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: d86a4df4999c46ca9ec190e5c4336bca Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d70255def58b4d4c8650db525a7b477e Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project Aug 29 15:25:59.084683 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2022-08-29 15:25:58'} Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:59.085815 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:25:59.086961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:25:59.090875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b16e2c87-728c-4f9d-bac5-4b05f284fcb4 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:59.092604 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b16e2c87-728c-4f9d-bac5-4b05f284fcb4 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269 tempest-InstanceUsageAuditLogNegativeTestJSON-670418269-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 15:25:58" status: 403 len: 128 microversion: 2.1 time: 0.021018 Aug 29 15:25:59.093809 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 48/81] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:25:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015%3A25%3A58 => generated 128 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:59.101690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-954e002a-48ee-4a03-bc90-42178270e064 tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e92154c0>, body: {"flavor": {"description": "new"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:59.122401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:59.161019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95c367b3-57fb-4e66-b183-8c80417648ec tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.724734 Aug 29 15:25:59.187072 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 34/82] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:58 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:59.214942 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-954e002a-48ee-4a03-bc90-42178270e064 tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1908614972" status: 200 len: 468 microversion: 2.61 time: 0.115464 Aug 29 15:25:59.216374 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 49/83] 10.222.0.16 () {62 vars in 1219 bytes} [Mon Aug 29 15:25:59 2022] PUT /compute/v2.1/flavors/1908614972 => generated 468 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:59.236027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5633035a-135f-41fb-9884-ebf5de2e2c2e tempest-FlavorsV261TestJSON-1992979575 tempest-FlavorsV261TestJSON-1992979575-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:59.299705 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5633035a-135f-41fb-9884-ebf5de2e2c2e tempest-FlavorsV261TestJSON-1992979575 tempest-FlavorsV261TestJSON-1992979575-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.070171 Aug 29 15:25:59.301966 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 35/84] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:59 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:59.333759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b868855-4135-4021-ab69-0b1ead56e3bc tempest-FlavorsV261TestJSON-1992979575 tempest-FlavorsV261TestJSON-1992979575-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:59.365555 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b868855-4135-4021-ab69-0b1ead56e3bc tempest-FlavorsV261TestJSON-1992979575 tempest-FlavorsV261TestJSON-1992979575-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.040929 Aug 29 15:25:59.366862 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 50/85] 10.222.0.16 () {60 vars in 1166 bytes} [Mon Aug 29 15:25:59 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:59.390978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-28aab9ed-3700-42b0-a741-b208aeef3b95 tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:59.435620 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-28aab9ed-3700-42b0-a741-b208aeef3b95 tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1908614972" status: 202 len: 0 microversion: 2.61 time: 0.051305 Aug 29 15:25:59.438338 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 36/86] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Aug 29 15:25:59 2022] DELETE /compute/v2.1/flavors/1908614972 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:25:59.451792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4932ad60-dbdf-498a-b129-4b476541bb0b tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:59.489775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4932ad60-dbdf-498a-b129-4b476541bb0b tempest-FlavorsV261TestJSON-1317041219 tempest-FlavorsV261TestJSON-1317041219-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.045301 Aug 29 15:25:59.491097 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 51/87] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:59 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:00.184736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:00.186350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:00.194546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:00.195443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:00.196156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:00.196972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:00.197702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:00.198351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:00.382409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:00.397163 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da116cc5-92d5-4d91-a628-763cc1912e04 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.214405 Aug 29 15:26:00.405539 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 37/88] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:00 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:01.427393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:01.428151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:01.445906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:01.446826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:01.447551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:01.456500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:01.458289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:01.458888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:01.702971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:01.715919 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dbd465ae-b138-4178-b002-a209ab74502f tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.293611 Aug 29 15:26:01.717026 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 52/89] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:01 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:02.277711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e811d5e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:02.281859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.285591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.286448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.287266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.288832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.293627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.359520 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-140b87c1-973d-4805-9315-a3914403a029 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.603364 Aug 29 15:26:02.383478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e3e5d700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:02.393657 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 38/90] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:01 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:02.396765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.398727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.400961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.402259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.406341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.407791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.483766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a0499152-ce30-4a46-9d26-d9654e91a03a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.113203 Aug 29 15:26:02.492779 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 53/91] 10.222.0.16 () {58 vars in 1139 bytes} [Mon Aug 29 15:26:02 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:02.503975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e96ae3a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:02.512888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.513719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.514319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.515405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.516056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.516634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.561087 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-23559fe1-26f9-457b-97c9-ef463eeea6f7 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.067090 Aug 29 15:26:02.562076 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 54/92] 10.222.0.16 () {58 vars in 1145 bytes} [Mon Aug 29 15:26:02 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:02.738056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:02.747465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:02.762743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.765280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.774167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.775374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.776010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.778057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:03.041000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:03.057766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5744246-e4ee-45f1-bc87-e05794fe1f48 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.324819 Aug 29 15:26:03.059362 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 55/93] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:02 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:03.137276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ec8ba5f-1d93-47e5-abd8-99f60d2baeaa tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-544852039", "ram": 512, "vcpus": 1, "disk": 10, "id": 117462387, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:03.222941 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ec8ba5f-1d93-47e5-abd8-99f60d2baeaa tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.764132 Aug 29 15:26:03.225460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 39/94] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:02 2022] POST /compute/v2.1/flavors => generated 412 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:03.698892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Calling method '.version_select at 0x7fb0e3e4ddc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:03.703158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:03.716273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:03.716722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:03.738344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:03.739146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:03.739602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:03.770771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:03.771323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:03.771758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:03.785804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:03.786319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:03.786967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:03.809498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:03.810484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:03.811141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:03.819725 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-645b60af-d952-4b12-bc96-cb69497bd450 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.755553 Aug 29 15:26:03.821006 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 56/95] 10.222.0.16 () {60 vars in 1243 bytes} [Mon Aug 29 15:26:03 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:03.924989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e43e7161-a28a-4fa7-8a1d-9f6069d0f4eb tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:03.945978 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e43e7161-a28a-4fa7-8a1d-9f6069d0f4eb tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] HTTP exception thrown: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e43e7161-a28a-4fa7-8a1d-9f6069d0f4eb tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Request method failure captured: Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/flavors/117462387/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqH2UG2d7sUwOIal-sNe3EAH4RplVcNsaD4Cl0RYXfNDfGMMHQ8z09ZVTpD6dcI9YWOYGeZWAe35D_AdnvQ-rFE3P18Q5ALH_GyLxoE-R5VS3EC2V0ZFOfQOJJ4Fd9TuF6Eo2jMlUT2bSZ4pR5JsMNuinjK6fU8f-L4y4r_TN2I6nE Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:03.947800 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_812b3c0fb2fc44e59b62655e692efb6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}] Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 5c30f1197b2842b4898124fb3c6947a2 Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:03.950576 n-d-854882-3 devstack@n-api.service[130002]: exception: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'flavor_id': '117462387', 'id': 'hw:cpu_thread_policy'} Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:03.951664 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:03.955108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e43e7161-a28a-4fa7-8a1d-9f6069d0f4eb tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Returning 404 to user: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:03.956744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e43e7161-a28a-4fa7-8a1d-9f6069d0f4eb tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] 10.222.0.16 "GET /compute/v2.1/flavors/117462387/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.714619 Aug 29 15:26:03.957511 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 40/96] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:26:03 2022] GET /compute/v2.1/flavors/117462387/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 724 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:03.965516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Calling method '.version_select at 0x7fb0e812ef70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:03.969675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:03.971054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:03.971193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.014343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.015174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.015876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.081555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.082969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.083859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.110920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.112263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.113248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.128747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b9436f6d-86e8-4c7c-8f3e-7c283ae81b28 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1175382113", "id": 1917878178, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.162326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.162594 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b9436f6d-86e8-4c7c-8f3e-7c283ae81b28 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.340196 Aug 29 15:26:04.165069 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 57/97] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:03 2022] POST /compute/v2.1/flavors => generated 439 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:04.166403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.167892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.177130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e003c586-d567-484a-8fea-e97cd0205c45 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.185966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e003c586-d567-484a-8fea-e97cd0205c45 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5c30f1197b2842b4898124fb3c6947a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b3c0fb2fc44e59b62655e692efb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:04.188259 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-67edb221-d0ea-48b2-9b75-03748a3e5d48 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.229530 Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e003c586-d567-484a-8fea-e97cd0205c45 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Request method failure captured: Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/flavors/117462387/os-extra_specs HTTP/1.1 Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 66 Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqH2UG2d7sUwOIal-sNe3EAH4RplVcNsaD4Cl0RYXfNDfGMMHQ8z09ZVTpD6dcI9YWOYGeZWAe35D_AdnvQ-rFE3P18Q5ALH_GyLxoE-R5VS3EC2V0ZFOfQOJJ4Fd9TuF6Eo2jMlUT2bSZ4pR5JsMNuinjK6fU8f-L4y4r_TN2I6nE Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:04.191434 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_812b3c0fb2fc44e59b62655e692efb6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}] Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 5c30f1197b2842b4898124fb3c6947a2 Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 29 15:26:04.192606 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'flavor_id': '117462387', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:04.193246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:26:04.194263 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.196155 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 41/98] 10.222.0.16 () {60 vars in 1222 bytes} [Mon Aug 29 15:26:03 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:04.202078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e003c586-d567-484a-8fea-e97cd0205c45 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.205806 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e003c586-d567-484a-8fea-e97cd0205c45 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] 10.222.0.16 "POST /compute/v2.1/flavors/117462387/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.037207 Aug 29 15:26:04.211020 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 58/99] 10.222.0.16 () {60 vars in 1221 bytes} [Mon Aug 29 15:26:04 2022] POST /compute/v2.1/flavors/117462387/os-extra_specs => generated 124 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:04.215867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.218624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:04.223644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7baf136e-8aba-4208-a5e8-0d271ec59773 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.233052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.233824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.235129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.236357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.237788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.238366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.474183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:04.562878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:04.576044 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6e35decb-5e14-4e55-a918-be1d28dfaa0c tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.381085 Aug 29 15:26:04.581867 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 42/100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:04 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:04.591508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Calling method '.version_select at 0x7fb0e80fab80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.610540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.611368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.611771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.663569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.663569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.663569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.673143 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3bae18c7-d43b-4089-8594-8433c71f95b6 tempest-HypervisorAdminV253TestBase-698805295 tempest-HypervisorAdminV253TestBase-698805295-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/594672d5-0935-4e01-9ff9-b22a02e64bf3" status: 200 len: 792 microversion: 2.53 time: 0.093737 Aug 29 15:26:04.683528 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 43/101] 10.222.0.16 () {60 vars in 1298 bytes} [Mon Aug 29 15:26:04 2022] GET /compute/v2.1/os-hypervisors/594672d5-0935-4e01-9ff9-b22a02e64bf3 => generated 792 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:04.687510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7beb8808-16ea-49d0-ba30-67ca32194228 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.753023 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7beb8808-16ea-49d0-ba30-67ca32194228 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/117462387/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.075644 Aug 29 15:26:04.754188 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 44/102] 10.222.0.16 () {60 vars in 1221 bytes} [Mon Aug 29 15:26:04 2022] POST /compute/v2.1/flavors/117462387/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:04.766631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47a9d2b5-eb7a-4d27-9a03-09e95db9812d tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.773633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-47a9d2b5-eb7a-4d27-9a03-09e95db9812d tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5c30f1197b2842b4898124fb3c6947a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b3c0fb2fc44e59b62655e692efb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47a9d2b5-eb7a-4d27-9a03-09e95db9812d tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Request method failure captured: Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqH2UG2d7sUwOIal-sNe3EAH4RplVcNsaD4Cl0RYXfNDfGMMHQ8z09ZVTpD6dcI9YWOYGeZWAe35D_AdnvQ-rFE3P18Q5ALH_GyLxoE-R5VS3EC2V0ZFOfQOJJ4Fd9TuF6Eo2jMlUT2bSZ4pR5JsMNuinjK6fU8f-L4y4r_TN2I6nE Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:04.780822 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_812b3c0fb2fc44e59b62655e692efb6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}] Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 5c30f1197b2842b4898124fb3c6947a2 Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:04.782077 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'flavor_id': '117462387', 'id': 'hw:numa_nodes'} Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:04.783182 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:26:04.784243 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.786990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47a9d2b5-eb7a-4d27-9a03-09e95db9812d tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.789075 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-47a9d2b5-eb7a-4d27-9a03-09e95db9812d tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026699 Aug 29 15:26:04.793548 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 45/103] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:26:04 2022] DELETE /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:04.806180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1299ec96-ec42-44cd-8ec2-4dbb8075cd4b tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.856788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=72,nova_api:SAVEPOINT=6,nova_api:INSERT=7,nova_api:RELEASE=6,nova_api:DELETE=9 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:04.867774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1299ec96-ec42-44cd-8ec2-4dbb8075cd4b tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/117462387/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066836 Aug 29 15:26:04.871431 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 46/104] 10.222.0.16 () {60 vars in 1221 bytes} [Mon Aug 29 15:26:04 2022] POST /compute/v2.1/flavors/117462387/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:04.885202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d73842f2-1162-414e-9512-8db75710a0ee tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.889984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d73842f2-1162-414e-9512-8db75710a0ee tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5c30f1197b2842b4898124fb3c6947a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b3c0fb2fc44e59b62655e692efb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d73842f2-1162-414e-9512-8db75710a0ee tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Request method failure captured: Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 22 Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqH2UG2d7sUwOIal-sNe3EAH4RplVcNsaD4Cl0RYXfNDfGMMHQ8z09ZVTpD6dcI9YWOYGeZWAe35D_AdnvQ-rFE3P18Q5ALH_GyLxoE-R5VS3EC2V0ZFOfQOJJ4Fd9TuF6Eo2jMlUT2bSZ4pR5JsMNuinjK6fU8f-L4y4r_TN2I6nE Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:04.891518 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/812b3c0fb2fc44e59b62655e692efb6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_812b3c0fb2fc44e59b62655e692efb6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/812b3c0fb2fc44e59b62655e692efb6f"}]}] Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 812b3c0fb2fc44e59b62655e692efb6f Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 5c30f1197b2842b4898124fb3c6947a2 Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: {"hw:numa_nodes": "1"} Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:04.892686 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'flavor_id': '117462387', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:04.893649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:26:04.894625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.895608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d73842f2-1162-414e-9512-8db75710a0ee tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.895608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d73842f2-1162-414e-9512-8db75710a0ee tempest-FlavorsExtraSpecsNegativeTestJSON-624751555 tempest-FlavorsExtraSpecsNegativeTestJSON-624751555-project] 10.222.0.16 "PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012573 Aug 29 15:26:04.898630 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 47/105] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:26:04 2022] PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:04.905291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a609f05d-26dc-4495-9757-f76177c8afff tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.917982 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a609f05d-26dc-4495-9757-f76177c8afff tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] HTTP exception thrown: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a609f05d-26dc-4495-9757-f76177c8afff tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Request method failure captured: Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/flavors/117462387/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqKNo6jqYKXRZyjtUkI_UCPmDGv61CDlqoheHtdOxUNVC4aKYOWez37vy8GurgLj3InJjNLuWRhhck1hEs7kcRWKoWYTC679He59Bfl-xl0rN_jLukZ3FuBow55KaEVPxOpbL-z4OqjfWNg6-DLU-RjOBHNK6ZRc1zyKAq5DuLjAkI Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 1b76bd5f4e04427aa0bc741cfc53670d Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:04.920313 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b76bd5f4e04427aa0bc741cfc53670d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b76bd5f4e04427aa0bc741cfc53670d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b76bd5f4e04427aa0bc741cfc53670d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b76bd5f4e04427aa0bc741cfc53670d"}]}] Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 1b76bd5f4e04427aa0bc741cfc53670d Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 2cdc4712f93b4fa59f7f8e6a2e193a1b Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:04.921593 n-d-854882-3 devstack@n-api.service[130002]: exception: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'flavor_id': '117462387', 'id': 'hw:cpu_thread_policy'} Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.922195 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a609f05d-26dc-4495-9757-f76177c8afff tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Returning 404 to user: Flavor 117462387 has no extra specs with key hw:cpu_thread_policy. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.923347 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a609f05d-26dc-4495-9757-f76177c8afff tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/117462387/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.021725 Aug 29 15:26:04.928009 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 48/106] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:26:04 2022] DELETE /compute/v2.1/flavors/117462387/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:04.934577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c81f732-09dd-4505-a998-1d808c94591e tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.939476 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-7c81f732-09dd-4505-a998-1d808c94591e tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c81f732-09dd-4505-a998-1d808c94591e tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Request method failure captured: Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 27 Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqKNo6jqYKXRZyjtUkI_UCPmDGv61CDlqoheHtdOxUNVC4aKYOWez37vy8GurgLj3InJjNLuWRhhck1hEs7kcRWKoWYTC679He59Bfl-xl0rN_jLukZ3FuBow55KaEVPxOpbL-z4OqjfWNg6-DLU-RjOBHNK6ZRc1zyKAq5DuLjAkI Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 1b76bd5f4e04427aa0bc741cfc53670d Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:04.941996 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b76bd5f4e04427aa0bc741cfc53670d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b76bd5f4e04427aa0bc741cfc53670d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b76bd5f4e04427aa0bc741cfc53670d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b76bd5f4e04427aa0bc741cfc53670d"}]}] Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 1b76bd5f4e04427aa0bc741cfc53670d Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 2cdc4712f93b4fa59f7f8e6a2e193a1b Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: {"hw:cpu_policy": "shared"} Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:04.944163 n-d-854882-3 devstack@n-api.service[130002]: exception: Request body and URI mismatch Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'flavor_id': '117462387', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.945483 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.958588 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:04.958588 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:04.958588 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 29 15:26:04.958588 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.958588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c81f732-09dd-4505-a998-1d808c94591e tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.958588 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c81f732-09dd-4505-a998-1d808c94591e tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016328 Aug 29 15:26:04.958588 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 49/107] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:26:04 2022] PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:04.964558 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7baf136e-8aba-4208-a5e8-0d271ec59773 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1917878178/action" status: 200 len: 97 microversion: 2.1 time: 0.752024 Aug 29 15:26:04.965557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26426000-a895-455e-a14e-95a782007d51 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.980896 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 59/108] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Aug 29 15:26:04 2022] POST /compute/v2.1/flavors/1917878178/action => generated 97 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26426000-a895-455e-a14e-95a782007d51 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Request method failure captured: Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 49 Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqKNo6jqYKXRZyjtUkI_UCPmDGv61CDlqoheHtdOxUNVC4aKYOWez37vy8GurgLj3InJjNLuWRhhck1hEs7kcRWKoWYTC679He59Bfl-xl0rN_jLukZ3FuBow55KaEVPxOpbL-z4OqjfWNg6-DLU-RjOBHNK6ZRc1zyKAq5DuLjAkI Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 1b76bd5f4e04427aa0bc741cfc53670d Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:04.994654 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b76bd5f4e04427aa0bc741cfc53670d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b76bd5f4e04427aa0bc741cfc53670d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b76bd5f4e04427aa0bc741cfc53670d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b76bd5f4e04427aa0bc741cfc53670d"}]}] Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 1b76bd5f4e04427aa0bc741cfc53670d Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 2cdc4712f93b4fa59f7f8e6a2e193a1b Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 29 15:26:04.996774 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'flavor_id': '117462387', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 29 15:26:04.998131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.000313 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26426000-a895-455e-a14e-95a782007d51 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26426000-a895-455e-a14e-95a782007d51 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.037880 Aug 29 15:26:05.009819 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 50/109] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:26:04 2022] PUT /compute/v2.1/flavors/117462387/os-extra_specs/hw:numa_nodes => generated 117 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:05.012726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ae73268-3191-44e6-9def-8aa3f8669d30 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:05.014810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e8a28da-b73c-4ee4-ab62-8683e874a5d7 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:05.062460 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2e8a28da-b73c-4ee4-ab62-8683e874a5d7 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/117462387" status: 202 len: 0 microversion: 2.1 time: 0.053113 Aug 29 15:26:05.068345 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 51/110] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:26:05 2022] DELETE /compute/v2.1/flavors/117462387 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:05.085762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-995e952f-70c2-4b9e-a0de-fc02dcf25022 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:05.158275 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-995e952f-70c2-4b9e-a0de-fc02dcf25022 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323 tempest-FlavorsExtraSpecsNegativeTestJSON-548466323-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086644 Aug 29 15:26:05.160215 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 52/111] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:05.603064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:05.604714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:05.621867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:05.622799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:05.623383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:05.624169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:05.627064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:05.627528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:05.879890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:05.893475 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8228e398-207c-46aa-bc7a-8ff32e919e1e tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.298628 Aug 29 15:26:05.899216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 53/112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:05 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:05.950032 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-3ae73268-3191-44e6-9def-8aa3f8669d30 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project 031d3a19bd9b4f288395ce8732981dd5 combination. Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ae73268-3191-44e6-9def-8aa3f8669d30 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Request method failure captured: Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/flavors/1917878178/action HTTP/1.1 Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 67 Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqJKeZT8TbSUqytyd6Rwhsn8CZ8a6543miD9L8E-POPYG_rlTNY-Y81ouL23NMkF2iQelDIgT935I-logADWwx9oNwCbD9wuWVo0LgyODU5y_nNiHjim_62ImoFiyFzgIq6Tq9iiUQVI4PywDsgH7yjQ4bmGsu4nMfRBEQSgsS7Iyo Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: b6992920f4374a21b6b54fa8a8dd3b05 Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:05.964791 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6992920f4374a21b6b54fa8a8dd3b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6992920f4374a21b6b54fa8a8dd3b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6992920f4374a21b6b54fa8a8dd3b05", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6992920f4374a21b6b54fa8a8dd3b05"}]}] Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: b6992920f4374a21b6b54fa8a8dd3b05 Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: aa085de9b1f44b9397e0a3f37a688567 Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: {"addTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} Aug 29 15:26:05.968089 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: exception: Flavor access already exists for flavor 21 and project 031d3a19bd9b4f288395ce8732981dd5 combination. Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1917878178', 'body': {'addTenantAccess': {'tenant': '031d3a19bd9b4f288395ce8732981dd5'}}} Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:26:05.969720 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '21-031d3a19bd9b4f288395ce8732981dd5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:26:05.971851 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:26:05.973492 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:26:05.975918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '21-031d3a19bd9b4f288395ce8732981dd5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 26, 5, 943551), 'updated_at': None, 'flavor_id': 21, 'project_id': '031d3a19bd9b4f288395ce8732981dd5'}] Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:05.977216 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 21 and project 031d3a19bd9b4f288395ce8732981dd5 combination. Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:05.978459 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 21 and project 031d3a19bd9b4f288395ce8732981dd5 combination. Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:05.980981 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:05.983787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 21 and project 031d3a19bd9b4f288395ce8732981dd5 combination. Aug 29 15:26:05.983787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:05.983787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ae73268-3191-44e6-9def-8aa3f8669d30 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project 031d3a19bd9b4f288395ce8732981dd5 combination. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:05.983787 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ae73268-3191-44e6-9def-8aa3f8669d30 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1917878178/action" status: 409 len: 152 microversion: 2.1 time: 0.993591 Aug 29 15:26:05.985658 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 60/113] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Aug 29 15:26:04 2022] POST /compute/v2.1/flavors/1917878178/action => generated 152 bytes in 1004 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:05.995834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4628597b-6867-40f0-be80-fe0a1f86ecab tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:06.139396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:06.917788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:06.919771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:06.944751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:06.947937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:06.951512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:06.956165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:06.964569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:06.967317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:07.155598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4628597b-6867-40f0-be80-fe0a1f86ecab tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1917878178/action" status: 200 len: 21 microversion: 2.1 time: 1.166822 Aug 29 15:26:07.156990 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 54/114] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Aug 29 15:26:05 2022] POST /compute/v2.1/flavors/1917878178/action => generated 21 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:26:07.177170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9e50d3e-15b7-40f1-9379-3a2292f99339 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:07.246409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9e50d3e-15b7-40f1-9379-3a2292f99339 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1917878178" status: 202 len: 0 microversion: 2.1 time: 0.082619 Aug 29 15:26:07.249505 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 55/115] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:26:07 2022] DELETE /compute/v2.1/flavors/1917878178 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:07.261510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9797b115-26f7-4b8d-9e0d-b6f51a445905 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:07.324710 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9797b115-26f7-4b8d-9e0d-b6f51a445905 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070788 Aug 29 15:26:07.326509 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 56/116] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:07.351707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bdd20bbf-1ff4-490e-bc5c-bb37852f8a06 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-697739277", "id": 1423160633, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:07.394619 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bdd20bbf-1ff4-490e-bc5c-bb37852f8a06 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.050183 Aug 29 15:26:07.395822 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 57/117] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:07 2022] POST /compute/v2.1/flavors => generated 437 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:07.410690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c27abd9-4257-447c-9165-1d55d3c6cc6b tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:07.419398 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-6c27abd9-4257-447c-9165-1d55d3c6cc6b tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c27abd9-4257-447c-9165-1d55d3c6cc6b tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Request method failure captured: Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/flavors/1423160633/os-flavor-access HTTP/1.1 Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqJKeZT8TbSUqytyd6Rwhsn8CZ8a6543miD9L8E-POPYG_rlTNY-Y81ouL23NMkF2iQelDIgT935I-logADWwx9oNwCbD9wuWVo0LgyODU5y_nNiHjim_62ImoFiyFzgIq6Tq9iiUQVI4PywDsgH7yjQ4bmGsu4nMfRBEQSgsS7Iyo Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b6992920f4374a21b6b54fa8a8dd3b05 Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:07.421460 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6992920f4374a21b6b54fa8a8dd3b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6992920f4374a21b6b54fa8a8dd3b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6992920f4374a21b6b54fa8a8dd3b05", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6992920f4374a21b6b54fa8a8dd3b05"}]}] Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b6992920f4374a21b6b54fa8a8dd3b05 Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: aa085de9b1f44b9397e0a3f37a688567 Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: exception: Access list not available for public flavors. Aug 29 15:26:07.422705 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'flavor_id': '1423160633'} Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 29 15:26:07.423942 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.427218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c27abd9-4257-447c-9165-1d55d3c6cc6b tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:07.428977 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6c27abd9-4257-447c-9165-1d55d3c6cc6b tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1423160633/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022485 Aug 29 15:26:07.430133 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 58/118] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:26:07 2022] GET /compute/v2.1/flavors/1423160633/os-flavor-access => generated 91 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:07.441298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d40119de-9456-41c8-bfab-f3e020aedbb8 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:07.472720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d40119de-9456-41c8-bfab-f3e020aedbb8 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1423160633" status: 202 len: 0 microversion: 2.1 time: 0.036676 Aug 29 15:26:07.485509 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:26:07 2022] DELETE /compute/v2.1/flavors/1423160633 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:07.487219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:07.492651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ca2ef10-a3a8-4800-9246-a21737961912 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:07.495497 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-64364469-3220-4d8a-bd27-2c9c2208c4ca tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.583814 Aug 29 15:26:07.496089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 61/120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:06 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:07.535017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ca2ef10-a3a8-4800-9246-a21737961912 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047184 Aug 29 15:26:07.536353 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 60/121] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:07.555263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-567d2c76-5fc7-475a-a77b-e32d3279386d tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-32899741", "id": 102732952, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:07.578225 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-567d2c76-5fc7-475a-a77b-e32d3279386d tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.026497 Aug 29 15:26:07.580197 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 62/122] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:07 2022] POST /compute/v2.1/flavors => generated 434 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:08.033039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a970c07d-adcc-4d76-9c3e-d2e1a6edccce tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:08.037958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a970c07d-adcc-4d76-9c3e-d2e1a6edccce tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '4e0b4768f010461b8a0417f90e14b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d3a19bd9b4f288395ce8732981dd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a970c07d-adcc-4d76-9c3e-d2e1a6edccce tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Request method failure captured: Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/flavors/102732952/action HTTP/1.1 Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 67 Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqFtwNyI2kt6FTrUWv1Yr99OpN2ERXhA-76Xt6I1ZimFfHGfVAZcMzV2V83plsHyhMM7VddipTUnJuHzNFa6AeCcPaPS7ChyYBP1ftd0h8lKercbRuUkyNo72yv0X9aXjwiyjEketH_sNGK38uygwh16ABdzvbpkpUY5IlWywQkGqA Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 031d3a19bd9b4f288395ce8732981dd5 Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1048525866 Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:08.040142 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/031d3a19bd9b4f288395ce8732981dd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/031d3a19bd9b4f288395ce8732981dd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_031d3a19bd9b4f288395ce8732981dd5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/031d3a19bd9b4f288395ce8732981dd5"}]}] Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1048525866 Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 031d3a19bd9b4f288395ce8732981dd5 Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1048525866 Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsAccessNegativeTestJSON-1048525866-project Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 4e0b4768f010461b8a0417f90e14b01b Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1048525866-project Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: {"addTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} Aug 29 15:26:08.041659 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '102732952', 'body': {'addTenantAccess': {'tenant': '031d3a19bd9b4f288395ce8732981dd5'}}} Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:08.042619 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:26:08.043889 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:08.047904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a970c07d-adcc-4d76-9c3e-d2e1a6edccce tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:08.050300 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a970c07d-adcc-4d76-9c3e-d2e1a6edccce tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] 10.222.0.16 "POST /compute/v2.1/flavors/102732952/action" status: 403 len: 130 microversion: 2.1 time: 0.461438 Aug 29 15:26:08.051569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 61/123] 10.222.0.16 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:07 2022] POST /compute/v2.1/flavors/102732952/action => generated 130 bytes in 464 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:08.059102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76a531f4-48ee-4eb1-a0bc-f02cf61f3d5a tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:08.080328 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76a531f4-48ee-4eb1-a0bc-f02cf61f3d5a tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/102732952" status: 202 len: 0 microversion: 2.1 time: 0.023980 Aug 29 15:26:08.091653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f960e8b-8f9e-4e86-b22e-39bc71c0edd5 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:08.098150 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 63/124] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:26:08 2022] DELETE /compute/v2.1/flavors/102732952 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:08.119216 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f960e8b-8f9e-4e86-b22e-39bc71c0edd5 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032307 Aug 29 15:26:08.119905 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 62/125] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:08.140252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-09412a03-e370-4fdc-a4bb-1b5989e6f138 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-777439414", "id": 198745572, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:08.164254 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-09412a03-e370-4fdc-a4bb-1b5989e6f138 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.028363 Aug 29 15:26:08.170177 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 64/126] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:08 2022] POST /compute/v2.1/flavors => generated 435 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:08.178891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68491591-cf11-4191-89fe-0d78533ef16c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:08.605080 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-68491591-cf11-4191-89fe-0d78533ef16c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/198745572/action" status: 200 len: 96 microversion: 2.1 time: 0.430791 Aug 29 15:26:08.612314 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 63/127] 10.222.0.16 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:08 2022] POST /compute/v2.1/flavors/198745572/action => generated 96 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:08.619511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:08.620750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:08.630183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:08.631577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:08.632663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:08.633936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:08.634792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:08.635566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:08.780798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-14edace7-879a-4143-bb6c-f1d734531984 req-0f947ac7-a138-4d30-92ef-bba5fcf554c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6fc34ad-a042-4bb4-89ef-db59ec56f74a", "tag": "dbb52363-c889-42dc-9eb5-e310addd507b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:08.795245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14edace7-879a-4143-bb6c-f1d734531984 req-0f947ac7-a138-4d30-92ef-bba5fcf554c2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:08.795245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14edace7-879a-4143-bb6c-f1d734531984 req-0f947ac7-a138-4d30-92ef-bba5fcf554c2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:08.795680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14edace7-879a-4143-bb6c-f1d734531984 req-0f947ac7-a138-4d30-92ef-bba5fcf554c2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:08.817016 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-14edace7-879a-4143-bb6c-f1d734531984 req-0f947ac7-a138-4d30-92ef-bba5fcf554c2 service nova] Creating event network-changed:dbb52363-c889-42dc-9eb5-e310addd507b for instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a on n-h1-854882-3 Aug 29 15:26:08.817880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14edace7-879a-4143-bb6c-f1d734531984 req-0f947ac7-a138-4d30-92ef-bba5fcf554c2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:26:08.818475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14edace7-879a-4143-bb6c-f1d734531984 req-0f947ac7-a138-4d30-92ef-bba5fcf554c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:26:08.819756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:08.820699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:08.821675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:08.822810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:08.823465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:08.824072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:08.836134 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.compute.rpcapi [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 15:26:08.837931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] Releasing lock "compute-rpcapi-router" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:26:08.841814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:08.852911 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3a300878-013b-447a-b87a-eb16d27def81 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.239114 Aug 29 15:26:08.854178 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 64/128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:08 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:08.860389 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-99b5f9d4-940c-4f01-a4fa-c1183cb04b66 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436705 Aug 29 15:26:08.861583 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 65/129] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:08.870344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d8302b3-df40-4e02-8573-14db0077adbb tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:08.874041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6d8302b3-df40-4e02-8573-14db0077adbb tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '4e0b4768f010461b8a0417f90e14b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d3a19bd9b4f288395ce8732981dd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d8302b3-df40-4e02-8573-14db0077adbb tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Request method failure captured: Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/flavors/198745572/action HTTP/1.1 Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 70 Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqFtwNyI2kt6FTrUWv1Yr99OpN2ERXhA-76Xt6I1ZimFfHGfVAZcMzV2V83plsHyhMM7VddipTUnJuHzNFa6AeCcPaPS7ChyYBP1ftd0h8lKercbRuUkyNo72yv0X9aXjwiyjEketH_sNGK38uygwh16ABdzvbpkpUY5IlWywQkGqA Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 031d3a19bd9b4f288395ce8732981dd5 Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1048525866 Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:08.880115 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/031d3a19bd9b4f288395ce8732981dd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/031d3a19bd9b4f288395ce8732981dd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_031d3a19bd9b4f288395ce8732981dd5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/031d3a19bd9b4f288395ce8732981dd5"}]}] Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1048525866 Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 031d3a19bd9b4f288395ce8732981dd5 Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1048525866 Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FlavorsAccessNegativeTestJSON-1048525866-project Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 4e0b4768f010461b8a0417f90e14b01b Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1048525866-project Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: {"removeTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} Aug 29 15:26:08.881799 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '198745572', 'body': {'removeTenantAccess': {'tenant': '031d3a19bd9b4f288395ce8732981dd5'}}} Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can( Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:08.882602 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:26:08.883893 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:08.886337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d8302b3-df40-4e02-8573-14db0077adbb tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:08.886337 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d8302b3-df40-4e02-8573-14db0077adbb tempest-FlavorsAccessNegativeTestJSON-1048525866 tempest-FlavorsAccessNegativeTestJSON-1048525866-project] 10.222.0.16 "POST /compute/v2.1/flavors/198745572/action" status: 403 len: 133 microversion: 2.1 time: 0.029955 Aug 29 15:26:08.886965 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 65/130] 10.222.0.16 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:08 2022] POST /compute/v2.1/flavors/198745572/action => generated 133 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:08.896936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40098b7a-d527-4cbf-add8-4a75080b627a tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "031d3a19bd9b4f288395ce8732981dd5"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:09.423007 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40098b7a-d527-4cbf-add8-4a75080b627a tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/198745572/action" status: 200 len: 21 microversion: 2.1 time: 0.531602 Aug 29 15:26:09.429516 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 66/131] 10.222.0.16 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:08 2022] POST /compute/v2.1/flavors/198745572/action => generated 21 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:09.434895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0b0da6e6-78e9-4613-b166-324b032d833e tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:09.456881 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0b0da6e6-78e9-4613-b166-324b032d833e tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/198745572" status: 202 len: 0 microversion: 2.1 time: 0.026128 Aug 29 15:26:09.460975 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 67/132] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:26:09 2022] DELETE /compute/v2.1/flavors/198745572 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:09.466343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9afe72ec-aca4-4930-836b-28deb897f0ba tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:09.471872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.491773 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9afe72ec-aca4-4930-836b-28deb897f0ba tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029414 Aug 29 15:26:09.493539 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 68/133] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:09.510747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bdddc440-983e-44ae-92d2-6a04250703c3 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-751119947", "id": 154887393, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:09.534551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bdddc440-983e-44ae-92d2-6a04250703c3 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.027666 Aug 29 15:26:09.535620 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 69/134] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:09 2022] POST /compute/v2.1/flavors => generated 435 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:09.624564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2091590450", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:09.696857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:09.813493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Calling method '.version_select at 0x7fb0e3e1b550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:09.816302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:09.817185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:09.818060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:09.837658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:09.838471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:09.839372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:09.853208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:09.854129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:09.854888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:09.864208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eeb71f26-0978-4519-be3c-9785f753efe5 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.326372 Aug 29 15:26:09.866367 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 70/135] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:26:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:09.872410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da1cc276-a739-4eeb-b707-e629eb29c055 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc33c983f35c400ca58e6d981f26f924"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:10.144254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:10.144680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:10.145161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:10.145601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:10.146021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:10.162377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.163046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.163657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.164557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.165004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.165614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.202639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Getting quotas for project cacd3a8ccc674a0ab775b2aa20ec08ec. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:10.210828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Getting quotas for user 0e05f5de07aa4189bc933dd2a5fb0205 and project cacd3a8ccc674a0ab775b2aa20ec08ec. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:10.224483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:10.227333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:10.279516 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-da1cc276-a739-4eeb-b707-e629eb29c055 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] HTTP exception thrown: Flavor access not found for 25 / bc33c983f35c400ca58e6d981f26f924 combination. Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da1cc276-a739-4eeb-b707-e629eb29c055 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Request method failure captured: Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/flavors/154887393/action HTTP/1.1 Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 70 Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqJKeZT8TbSUqytyd6Rwhsn8CZ8a6543miD9L8E-POPYG_rlTNY-Y81ouL23NMkF2iQelDIgT935I-logADWwx9oNwCbD9wuWVo0LgyODU5y_nNiHjim_62ImoFiyFzgIq6Tq9iiUQVI4PywDsgH7yjQ4bmGsu4nMfRBEQSgsS7Iyo Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: b6992920f4374a21b6b54fa8a8dd3b05 Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:10.281313 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6992920f4374a21b6b54fa8a8dd3b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6992920f4374a21b6b54fa8a8dd3b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6992920f4374a21b6b54fa8a8dd3b05", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6992920f4374a21b6b54fa8a8dd3b05"}]}] Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: b6992920f4374a21b6b54fa8a8dd3b05 Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-947743849 Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: aa085de9b1f44b9397e0a3f37a688567 Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: {"removeTenantAccess": {"tenant": "bc33c983f35c400ca58e6d981f26f924"}} Aug 29 15:26:10.282798 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: exception: Flavor access not found for 25 / bc33c983f35c400ca58e6d981f26f924 combination. Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '154887393', 'body': {'removeTenantAccess': {'tenant': 'bc33c983f35c400ca58e6d981f26f924'}}} Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 29 15:26:10.283603 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / bc33c983f35c400ca58e6d981f26f924 combination. Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / bc33c983f35c400ca58e6d981f26f924 combination. Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:10.284797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / bc33c983f35c400ca58e6d981f26f924 combination. Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da1cc276-a739-4eeb-b707-e629eb29c055 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Returning 404 to user: Flavor access not found for 25 / bc33c983f35c400ca58e6d981f26f924 combination. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da1cc276-a739-4eeb-b707-e629eb29c055 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/154887393/action" status: 404 len: 124 microversion: 2.1 time: 0.414772 Aug 29 15:26:10.286019 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 71/136] 10.222.0.16 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:09 2022] POST /compute/v2.1/flavors/154887393/action => generated 124 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:10.296804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.297592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:10.308495 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-766c1d24-3497-44c6-8f18-b7c80fe54bf4 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896651 Aug 29 15:26:10.309182 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 66/137] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:10.315920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.319866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.320847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.324297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.326073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.326212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Calling method '.version_select at 0x7fb0e80fa940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.327589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.328228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.328725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.329171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.364103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.366105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.370398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.373351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.393301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b91182c-23a9-4f5c-be9f-a4b15149c318 tempest-HypervisorAdminV228Test-429772817 tempest-HypervisorAdminV228Test-429772817-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.082935 Aug 29 15:26:10.406542 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 67/138] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Aug 29 15:26:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:10.421055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c0ff165-f752-4651-8aee-9d2b95c833bf tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.458741 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c0ff165-f752-4651-8aee-9d2b95c833bf tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/154887393" status: 202 len: 0 microversion: 2.1 time: 0.050724 Aug 29 15:26:10.459632 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 68/139] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:26:10 2022] DELETE /compute/v2.1/flavors/154887393 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:10.472800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f08a7037-78cf-4b4f-9fdf-33f9b3321d51 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.473659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f08a7037-78cf-4b4f-9fdf-33f9b3321d51 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:10.580684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:10.591830 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-495a9f9c-40f5-43dc-9df5-ee69c8c96261 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.302558 Aug 29 15:26:10.606515 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 72/140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:10 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:10.612962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c31cb71b-855a-4792-ac5b-d75a22c9d8e8 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.619527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f08a7037-78cf-4b4f-9fdf-33f9b3321d51 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:10.631521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f08a7037-78cf-4b4f-9fdf-33f9b3321d51 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1219 microversion: 2.1 time: 0.169740 Aug 29 15:26:10.632792 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 69/141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:10 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:10.664929 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c31cb71b-855a-4792-ac5b-d75a22c9d8e8 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056973 Aug 29 15:26:10.666301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 73/142] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:11.614013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:11.615486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:11.623079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:11.623909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:11.624562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:11.625551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:11.641158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:11.643278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:11.654756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:11.655504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:11.666823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:11.667587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:11.673497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:11.674779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:11.675458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:11.676187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:11.880300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:11.898341 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-98c3cd98-00a5-4b03-bf48-d382edccd83a tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.288859 Aug 29 15:26:11.912937 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 70/143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:11 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:11.927751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:11.938839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e99f0b8-79fc-4002-a860-eaa8fad6aa93 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1271 microversion: 2.1 time: 0.288067 Aug 29 15:26:11.940550 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 74/144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:11 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:12.382851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0544c3b1-c3c2-4937-b9af-8e5e60e9c5f4 tempest-InstanceUsageAuditLogTestJSON-738375285 tempest-InstanceUsageAuditLogTestJSON-738375285-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:12.442904 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0544c3b1-c3c2-4937-b9af-8e5e60e9c5f4 tempest-InstanceUsageAuditLogTestJSON-738375285 tempest-InstanceUsageAuditLogTestJSON-738375285-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 15:26:11" status: 200 len: 318 microversion: 2.1 time: 0.526556 Aug 29 15:26:12.444221 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 71/145] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:26:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015%3A26%3A11 => generated 318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:12.457572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8a94583f-58e9-4eba-b593-04494aec5236 tempest-InstanceUsageAuditLogTestJSON-738375285 tempest-InstanceUsageAuditLogTestJSON-738375285-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:12.511924 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8a94583f-58e9-4eba-b593-04494aec5236 tempest-InstanceUsageAuditLogTestJSON-738375285 tempest-InstanceUsageAuditLogTestJSON-738375285-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.058572 Aug 29 15:26:12.524437 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 75/146] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Aug 29 15:26:12 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:12.921173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:12.921852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:12.935734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:12.947474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:12.950390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:12.951649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:12.952293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:12.953520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:12.962763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:12.963438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:12.983543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:12.987831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:12.992678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:12.995965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:12.999278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:13.001303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:13.223461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:13.239696 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13931541-f9db-4bbe-ad31-817536a5edbb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1277 microversion: 2.1 time: 0.279114 Aug 29 15:26:13.240811 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 76/147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:12 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:13.441531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:13.457759 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bacd59a4-389d-440f-8a4f-496b9b9efce7 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.541163 Aug 29 15:26:13.488139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 72/148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:12 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:14.088444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3e1bd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:14.273595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:14.275797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:14.284214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.284765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.285554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.286544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.287189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.288563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.484536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:14.500007 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c87c693a-7aff-413f-bbaa-414975ab9148 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.238163 Aug 29 15:26:14.514481 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 73/149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:14 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:14.527827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:14.529069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:14.538889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.539861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.540564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.541562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.542359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.543568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.749736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.750781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.752236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.753496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.754410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.755152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.885357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:14.885573 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8de5dea3-b3b4-4323-a546-ebf089e1de86 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573" status: 200 len: 148 microversion: 2.57 time: 1.324934 Aug 29 15:26:14.888834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.891594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 77/150] 10.222.0.16 () {62 vars in 1303 bytes} [Mon Aug 29 15:26:13 2022] PUT /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573 => generated 148 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:14.901288 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f28d94e3-81d0-47df-8b75-8f42eddeefd5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.374904 Aug 29 15:26:14.903455 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 74/151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:14 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:14.905881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Calling method '.version_select at 0x7fb0e3e1bc10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:15.331334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.332042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.333100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.334122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.334843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.335572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.352848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=19 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.375768 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-775f1b21-57a2-4fda-a402-64127df70740 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573/detail" status: 200 len: 463 microversion: 2.57 time: 0.482148 Aug 29 15:26:15.377954 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 78/152] 10.222.0.16 () {60 vars in 1304 bytes} [Mon Aug 29 15:26:14 2022] GET /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573/detail => generated 463 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:15.468527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-06a62f58-2f1a-4bf2-9a15-3f568b165988 req-e906f31c-4134-4061-98e2-933ea86227f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6fc34ad-a042-4bb4-89ef-db59ec56f74a", "name": "network-vif-plugged", "status": "completed", "tag": "dbb52363-c889-42dc-9eb5-e310addd507b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:15.524342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-06a62f58-2f1a-4bf2-9a15-3f568b165988 req-e906f31c-4134-4061-98e2-933ea86227f4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.544477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:15.545314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-06a62f58-2f1a-4bf2-9a15-3f568b165988 req-e906f31c-4134-4061-98e2-933ea86227f4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.546895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-06a62f58-2f1a-4bf2-9a15-3f568b165988 req-e906f31c-4134-4061-98e2-933ea86227f4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.550014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:15.561367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.562690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.563995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.565975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.567022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.568019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.578183 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-06a62f58-2f1a-4bf2-9a15-3f568b165988 req-e906f31c-4134-4061-98e2-933ea86227f4 service nova] Creating event network-vif-plugged:dbb52363-c889-42dc-9eb5-e310addd507b for instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a on n-h1-854882-3 Aug 29 15:26:15.578710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-06a62f58-2f1a-4bf2-9a15-3f568b165988 req-e906f31c-4134-4061-98e2-933ea86227f4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:26:15.579100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-06a62f58-2f1a-4bf2-9a15-3f568b165988 req-e906f31c-4134-4061-98e2-933ea86227f4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:26:15.580742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.581198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.582095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.582831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.583751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.584171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.599311 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.rpcapi [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 15:26:15.600565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] Releasing lock "compute-rpcapi-router" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:26:15.625662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb07ae4d-2fba-44c8-9187-654143cfaee7 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270507 Aug 29 15:26:15.627363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 75/153] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:15.787972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:15.802837 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fde25abd-a6ea-40d8-be88-fae1d3b0869d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.276042 Aug 29 15:26:15.810825 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 79/154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:15 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:15.927907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:15.928611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:15.936501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.937371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.937988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.939033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.939803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.940562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.164658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3d8b430>, body: {"quota_set": {"ram": "2048"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:16.179719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:16.197109 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-beefe16a-c0be-4e62-97e3-27f1d76f44b5 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.273935 Aug 29 15:26:16.199114 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 76/155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:15 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:16.541245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.542156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.542894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.544131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.544857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.545551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.604208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.604796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.605322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.606224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.606764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.607372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.726792 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-170eae3b-4aab-434d-9a1a-420cd54344d7 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573?user_id=776c76a74e5b428e81be7cb7ef9c039d" status: 200 len: 148 microversion: 2.57 time: 0.566809 Aug 29 15:26:16.727910 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 80/156] 10.222.0.16 () {62 vars in 1384 bytes} [Mon Aug 29 15:26:16 2022] PUT /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573?user_id=776c76a74e5b428e81be7cb7ef9c039d => generated 148 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:16.743484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-882248ff-6ec2-499a-8e36-b5a114004753 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Calling method '.version_select at 0x7fb0e3f9d940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:16.833875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:16.835745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:16.851380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.851380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.851380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.851380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.851728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.851728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.020293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:17.028892 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f1c7915-5dec-4e26-a1c5-5849e323eb86 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.200002 Aug 29 15:26:17.029850 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 81/157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:16 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:17.224744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=13,nova_api:INSERT=5 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:17.228395 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-882248ff-6ec2-499a-8e36-b5a114004753 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573?user_id=776c76a74e5b428e81be7cb7ef9c039d" status: 200 len: 190 microversion: 2.57 time: 0.491621 Aug 29 15:26:17.229229 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 77/158] 10.222.0.16 () {60 vars in 1364 bytes} [Mon Aug 29 15:26:16 2022] GET /compute/v2.1/os-quota-sets/05ad3b8b719c425998c6b118a1087573?user_id=776c76a74e5b428e81be7cb7ef9c039d => generated 190 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:17.239388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:17.240142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:17.246458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.247105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.247629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.248427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.248980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.249558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.428210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:17.438607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8c50969-9ff6-406f-b208-0c24ee9c4a52 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1338 microversion: 2.1 time: 0.203263 Aug 29 15:26:17.445453 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 82/159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:17 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:18.059049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.062928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:18.075424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.076263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.076879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.077915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.078528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.079102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.253014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:18.268167 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-92c8b174-b544-4bd3-bfd1-5915dba33e65 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.219834 Aug 29 15:26:18.269237 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:18.465775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.466568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:18.473662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.474388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.475007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.475873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.476495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.477071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.575960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Calling method '.version_select at 0x7fb0e3f62820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.577887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.578373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.580996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.620975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.622658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.625195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.643308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.644040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.644684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.656812 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a29a3b2-24a1-458a-bbb9-e55b939d073a tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.726962 Aug 29 15:26:18.658039 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 78/161] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:18.677622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:18.687772 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-02511c45-74b9-455f-bd36-eb257fe5a397 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1487 microversion: 2.1 time: 0.226606 Aug 29 15:26:18.703782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 84/162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1487 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:18.713043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.713788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:18.721995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.722210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.722462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.723343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.724015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.724651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.099964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d144d770-1c70-443f-b8fc-1e372bc1a5f8 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Calling method '.version_select at 0x7fb0e3f62790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.107453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d144d770-1c70-443f-b8fc-1e372bc1a5f8 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3033b6e4fef9421f9f353b54ad20f41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f582e6eda664071b9adc2862add206c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d144d770-1c70-443f-b8fc-1e372bc1a5f8 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Request method failure captured: Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-hypervisors/n-h1-854882-3/search HTTP/1.1 Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqYYDTwIuMSblGrOAIv04jgy268spK7zzUBxN7NIHB7t8QTT2VnIflaKMyKr-BBVJkMn5Vj76OacZr7-i6BQNYRBjkWfgxSrV8P-b8xffwDBSs0d-DOD4NQJNaEs6TYT40N8Rkq4-ZUa2I_qzgetUVi9WmglwSARbJQ5rsesBjkxjs Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6f582e6eda664071b9adc2862add206c Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-283427542 Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:19.112618 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f582e6eda664071b9adc2862add206c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f582e6eda664071b9adc2862add206c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f582e6eda664071b9adc2862add206c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f582e6eda664071b9adc2862add206c"}]}] Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-283427542 Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6f582e6eda664071b9adc2862add206c Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-283427542 Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-283427542-project Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3033b6e4fef9421f9f353b54ad20f41c Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-283427542-project Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:26:19.115308 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'n-h1-854882-3'} Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:19.116764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:26:19.119100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.123138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d144d770-1c70-443f-b8fc-1e372bc1a5f8 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:19.125042 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d144d770-1c70-443f-b8fc-1e372bc1a5f8 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-854882-3/search" status: 403 len: 117 microversion: 2.1 time: 0.457252 Aug 29 15:26:19.136208 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 79/163] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-854882-3/search => generated 117 bytes in 471 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:19.144825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Calling method '.version_select at 0x7fb0e3f9dee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.148844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.149760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.150553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.170217 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Request method failure captured: Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqZPg5GFjsZEspIL-J7ejetpB3uLjzaKkh1Ht1MWmvioX-0dmN4k-CVMNc47YGf3GtnAmlYnI3NtuepfGACwhp_2bEeB9NKMCYR_QTITaG9KJu_LsDlrci5C8jc0NNj-bQOAC5kfuw8GkgK4clDRssV5wyElhEPETlFTLE5xLSyTsw Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: cf5a5f0a0a7748b385887b8b3c71dfd4 Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-129406227 Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:19.175677 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf5a5f0a0a7748b385887b8b3c71dfd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf5a5f0a0a7748b385887b8b3c71dfd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf5a5f0a0a7748b385887b8b3c71dfd4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf5a5f0a0a7748b385887b8b3c71dfd4"}]}] Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-129406227 Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: cf5a5f0a0a7748b385887b8b3c71dfd4 Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-129406227 Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 5459e82a5d2049039bbaae9fe08d1397 Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:26:19.177144 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.178024 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.179342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.179342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:19.179342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:19.179342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:26:19.179342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.180764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:19.182368 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60ac870c-7339-4c23-b29a-5099931ae888 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.044377 Aug 29 15:26:19.198801 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 80/164] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:19.208916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Calling method '.version_select at 0x7fb0e804b820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.217012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.218117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.218930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.259492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.260612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.261541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.286429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.288148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.289012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.303086 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-695bc992-20b6-4cfe-91ab-ec9509e270ad tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1638 microversion: 2.1 time: 0.594675 Aug 29 15:26:19.310398 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-883e5506-01c5-4179-9185-630351317b6c tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.105299 Aug 29 15:26:19.323072 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 85/165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1638 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:19.323541 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 81/166] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:19.334677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8bddb97e-8778-4326-b073-2373fff4b793 req-ec8df278-db23-4437-84f7-17d965818138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bddff370-d4f6-46ff-817c-7fa6683f3e9d", "tag": "c8a1a0d7-7c42-4842-a1f0-12b511476d80"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:19.335184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.335828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:19.354435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.354934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.355372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.356087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.356547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.356968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.358904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bddb97e-8778-4326-b073-2373fff4b793 req-ec8df278-db23-4437-84f7-17d965818138 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.363773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bddb97e-8778-4326-b073-2373fff4b793 req-ec8df278-db23-4437-84f7-17d965818138 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.364472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bddb97e-8778-4326-b073-2373fff4b793 req-ec8df278-db23-4437-84f7-17d965818138 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.395342 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8bddb97e-8778-4326-b073-2373fff4b793 req-ec8df278-db23-4437-84f7-17d965818138 service nova] Creating event network-changed:c8a1a0d7-7c42-4842-a1f0-12b511476d80 for instance bddff370-d4f6-46ff-817c-7fa6683f3e9d on n-h2-854882-3 Aug 29 15:26:19.417414 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8bddb97e-8778-4326-b073-2373fff4b793 req-ec8df278-db23-4437-84f7-17d965818138 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092515 Aug 29 15:26:19.418194 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 86/167] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:19.435682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.436675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:19.452930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.453494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.455662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.456929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.458607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.459389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.518814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:26:19.802136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:19.823169 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f36982d8-5dd8-4803-955a-5b3aebc1f346 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.487174 Aug 29 15:26:19.823928 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 82/168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:19.833485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9139ad92-ad5c-4610-9791-8ab8a8129d17 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Calling method '.version_select at 0x7fb0e3fb1c10>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.836295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9139ad92-ad5c-4610-9791-8ab8a8129d17 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3033b6e4fef9421f9f353b54ad20f41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f582e6eda664071b9adc2862add206c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9139ad92-ad5c-4610-9791-8ab8a8129d17 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Request method failure captured: Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqYYDTwIuMSblGrOAIv04jgy268spK7zzUBxN7NIHB7t8QTT2VnIflaKMyKr-BBVJkMn5Vj76OacZr7-i6BQNYRBjkWfgxSrV8P-b8xffwDBSs0d-DOD4NQJNaEs6TYT40N8Rkq4-ZUa2I_qzgetUVi9WmglwSARbJQ5rsesBjkxjs Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6f582e6eda664071b9adc2862add206c Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-283427542 Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:19.838260 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f582e6eda664071b9adc2862add206c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f582e6eda664071b9adc2862add206c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f582e6eda664071b9adc2862add206c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f582e6eda664071b9adc2862add206c"}]}] Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-283427542 Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6f582e6eda664071b9adc2862add206c Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-283427542 Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-283427542-project Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3033b6e4fef9421f9f353b54ad20f41c Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-283427542-project Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:26:19.839630 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '1'} Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:19.840418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:26:19.841667 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.846045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9139ad92-ad5c-4610-9791-8ab8a8129d17 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:19.847564 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9139ad92-ad5c-4610-9791-8ab8a8129d17 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.022212 Aug 29 15:26:19.852963 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 83/169] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:19.854377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9139ad92-ad5c-4610-9791-8ab8a8129d17 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.856137 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9139ad92-ad5c-4610-9791-8ab8a8129d17 tempest-HypervisorAdminNegativeUnderV252Test-283427542 tempest-HypervisorAdminNegativeUnderV252Test-283427542-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002064 Aug 29 15:26:19.857785 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 84/170] 10.222.0.16 () {56 vars in 886 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:26:19.922041 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae9e167c-2ff3-4786-8d99-a14e4f38ad77 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 204 len: 0 microversion: 2.1 time: 0.498047 Aug 29 15:26:19.923854 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:19 2022] DELETE /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:19.928999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Calling method '.version_select at 0x7fb0e3e88790>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.931437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.931919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.932752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.941648 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] HTTP exception thrown: No hypervisor matching '34ebd7f4-1285-4964-8030-d5b0c7aebcab' could be found. Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Request method failure captured: Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hypervisors/34ebd7f4-1285-4964-8030-d5b0c7aebcab/servers HTTP/1.1 Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqZPg5GFjsZEspIL-J7ejetpB3uLjzaKkh1Ht1MWmvioX-0dmN4k-CVMNc47YGf3GtnAmlYnI3NtuepfGACwhp_2bEeB9NKMCYR_QTITaG9KJu_LsDlrci5C8jc0NNj-bQOAC5kfuw8GkgK4clDRssV5wyElhEPETlFTLE5xLSyTsw Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cf5a5f0a0a7748b385887b8b3c71dfd4 Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-129406227 Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:19.943827 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf5a5f0a0a7748b385887b8b3c71dfd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf5a5f0a0a7748b385887b8b3c71dfd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf5a5f0a0a7748b385887b8b3c71dfd4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf5a5f0a0a7748b385887b8b3c71dfd4"}]}] Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-129406227 Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cf5a5f0a0a7748b385887b8b3c71dfd4 Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-129406227 Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 5459e82a5d2049039bbaae9fe08d1397 Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: exception: No hypervisor matching '34ebd7f4-1285-4964-8030-d5b0c7aebcab' could be found. Aug 29 15:26:19.945225 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '34ebd7f4-1285-4964-8030-d5b0c7aebcab'} Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '34ebd7f4-1285-4964-8030-d5b0c7aebcab' could be found. Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.946926 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '34ebd7f4-1285-4964-8030-d5b0c7aebcab' could be found. Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] Returning 404 to user: No hypervisor matching '34ebd7f4-1285-4964-8030-d5b0c7aebcab' could be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be9004ce-d032-4558-afd1-2810fc412aa9 tempest-HypervisorAdminNegativeUnderV252Test-129406227 tempest-HypervisorAdminNegativeUnderV252Test-129406227-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/34ebd7f4-1285-4964-8030-d5b0c7aebcab/servers" status: 404 len: 123 microversion: 2.1 time: 0.020582 Aug 29 15:26:19.948908 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 88/172] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-hypervisors/34ebd7f4-1285-4964-8030-d5b0c7aebcab/servers => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:19.954317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.962426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:19.971735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.972933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.974216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.975294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.976684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.977419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:20.143245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:20.151268 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-792de273-5b00-40ce-8050-b286e7445696 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1493 microversion: 2.1 time: 0.204069 Aug 29 15:26:20.151996 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 89/173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1493 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:20.392193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5608b503-02f7-4d5f-ba2a-d4892099ea90 tempest-NetworksTest-1689314970 tempest-NetworksTest-1689314970-project-admin] Calling method '.version_select at 0x7fb0e3f1b5e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:20.630491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5608b503-02f7-4d5f-ba2a-d4892099ea90 tempest-NetworksTest-1689314970 tempest-NetworksTest-1689314970-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.771173 Aug 29 15:26:20.634454 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 85/174] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:20.644990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-870f35d7-a55f-44dd-85f3-557d503bafab tempest-NetworksTest-1689314970 tempest-NetworksTest-1689314970-project-admin] Calling method '.version_select at 0x7fb0e3ff4ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:20.849235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:20.850029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:20.857256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:20.857824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:20.858363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:20.859211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:20.859704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:20.860215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:20.997200 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-870f35d7-a55f-44dd-85f3-557d503bafab tempest-NetworksTest-1689314970 tempest-NetworksTest-1689314970-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/cf6ce835-de3e-45d5-8a65-f02532b22898" status: 200 len: 652 microversion: 2.1 time: 0.360665 Aug 29 15:26:20.998813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 90/175] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:26:20 2022] GET /compute/v2.1/os-networks/cf6ce835-de3e-45d5-8a65-f02532b22898 => generated 652 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:21.013155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19230183-fbc1-44c1-97dc-0de81fa30fe4 tempest-NetworksTest-1689314970 tempest-NetworksTest-1689314970-project-admin] Calling method '.version_select at 0x7fb0e3dac1f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:21.029515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:21.039285 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7d7af5a4-9428-4ba3-86ee-b745cbc640a8 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.194506 Aug 29 15:26:21.039880 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 86/176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:20 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:21.186642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:21.187175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:21.195132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:21.195713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:21.196063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:21.197775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:21.197775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:21.197775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:21.412068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:21.422593 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab66f410-84af-4afa-a5bb-7ec26111fb35 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1493 microversion: 2.1 time: 0.240062 Aug 29 15:26:21.424439 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 87/177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:21 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1493 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:21.491310 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19230183-fbc1-44c1-97dc-0de81fa30fe4 tempest-NetworksTest-1689314970 tempest-NetworksTest-1689314970-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.484354 Aug 29 15:26:21.492000 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 91/178] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:21 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:22.060991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:22.061711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:22.076205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:22.077142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:22.077992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.079661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:22.080827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:22.081592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.445996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:22.446808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:22.471185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:22.472199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:22.472859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.474052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:22.474830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:22.475607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.526947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:22.548127 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6baa4b5-052d-456b-a75e-1f95652ad06a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.491148 Aug 29 15:26:22.549088 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 88/179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:22 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:22.857596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-ebc3e003-dd7e-4a1d-922f-65412065641e req-41168e0f-aff0-491a-bfea-a1da82ee60e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6fc34ad-a042-4bb4-89ef-db59ec56f74a", "name": "network-vif-deleted", "tag": "dbb52363-c889-42dc-9eb5-e310addd507b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:22.869784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ebc3e003-dd7e-4a1d-922f-65412065641e req-41168e0f-aff0-491a-bfea-a1da82ee60e7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:22.870615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ebc3e003-dd7e-4a1d-922f-65412065641e req-41168e0f-aff0-491a-bfea-a1da82ee60e7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:22.871283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ebc3e003-dd7e-4a1d-922f-65412065641e req-41168e0f-aff0-491a-bfea-a1da82ee60e7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.889155 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-ebc3e003-dd7e-4a1d-922f-65412065641e req-41168e0f-aff0-491a-bfea-a1da82ee60e7 service nova] Creating event network-vif-deleted:dbb52363-c889-42dc-9eb5-e310addd507b for instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a on n-h1-854882-3 Aug 29 15:26:22.907008 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-ebc3e003-dd7e-4a1d-922f-65412065641e req-41168e0f-aff0-491a-bfea-a1da82ee60e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053303 Aug 29 15:26:22.909839 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 89/180] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:23.007520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99004756e4fe4720b121bd4b03949f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebba5db9c29a4e3f9886bcf67f676922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:23.026729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b7ab8171-a4d1-48d2-95ec-4ba78644f590 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 200 len: 1493 microversion: 2.1 time: 0.585420 Aug 29 15:26:23.034285 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 92/181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:22 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 1493 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:23.572660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:23.577828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:23.600274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:23.601054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:23.601763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:23.604046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:23.604636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:23.605011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:23.827601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:23.840813 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe27d977-a9e7-4164-9513-29bf0ecd583b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.268870 Aug 29 15:26:23.840813 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 90/182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:23 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:24.070909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.072000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:24.078685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.079661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.080092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.080780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.081286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.081740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.096254 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] HTTP exception thrown: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Request method failure captured: Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a HTTP/1.1 Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp4WkQTqVPEs84E6aPjNEkoeQHL7tNxyIl-TvGlYfHqoneC49gGZ9-N2lfIyZ0HePyzCpqNQFsTK4MS832nboVYyf01i21WE4W-6txmtYNA_c8A-ZF6pK2LS8tGdulp3d70pq3s0rUtFT43pqLVaGM56Xb_4dlWsK7dwfnLXoIVBco Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ebba5db9c29a4e3f9886bcf67f676922 Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:24.098900 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebba5db9c29a4e3f9886bcf67f676922"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ebba5db9c29a4e3f9886bcf67f676922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ebba5db9c29a4e3f9886bcf67f676922", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebba5db9c29a4e3f9886bcf67f676922"}]}] Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ebba5db9c29a4e3f9886bcf67f676922 Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminTestJSON-1076950751-project Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 99004756e4fe4720b121bd4b03949f35 Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminTestJSON-1076950751-project Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:24.100331 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd6fc34ad-a042-4bb4-89ef-db59ec56f74a'} Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:24.101145 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:24.102470 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.105060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Returning 404 to user: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:24.106313 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f63bb98b-ed0e-41b0-9399-cb1e458a61c9 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 404 len: 111 microversion: 2.1 time: 0.039375 Aug 29 15:26:24.110132 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 93/183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:24.115343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f942a822-4540-4dd9-9c2b-4050f0f7028e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:24.130524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f942a822-4540-4dd9-9c2b-4050f0f7028e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.131034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f942a822-4540-4dd9-9c2b-4050f0f7028e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.131457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f942a822-4540-4dd9-9c2b-4050f0f7028e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.305684 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f942a822-4540-4dd9-9c2b-4050f0f7028e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 300 microversion: 2.1 time: 0.193879 Aug 29 15:26:24.307118 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 91/184] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:26:24 2022] POST /compute/v2.1/os-aggregates/6/action => generated 300 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:24.320072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b7f4bac3-923e-4fde-b462-054e369b4f60 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.376970 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b7f4bac3-923e-4fde-b462-054e369b4f60 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.060625 Aug 29 15:26:24.385100 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 94/185] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:24 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:24.394185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e3f62a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.404740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.405741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.406825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.409278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.410095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.410683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.449339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5fa370bb-838c-45aa-b726-7beee18c1d0e tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.060285 Aug 29 15:26:24.450435 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 92/186] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:24.461682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e3cd6dc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.466080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.467606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.468703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.470299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.471022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.471837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.492822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.509869 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f322438e-eae4-4e8f-8943-bf1e1de0cc66 tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.052246 Aug 29 15:26:24.510926 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 95/187] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:24.522386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e3f62940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.526390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.528417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.529357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.532801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.534030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.534713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01cea7b3-778a-402c-8da1-dbdad0399e42 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-625442695"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:24.536488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.539899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-01cea7b3-778a-402c-8da1-dbdad0399e42 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 2386ef5d-6562-4f07-9af5-3312bf2bf956 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:24.593788 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-768e8f12-f651-474a-8538-ae684c7b3b4a tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.073810 Aug 29 15:26:24.599076 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 93/188] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:24.616484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e3fb1b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.646304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.647338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.648118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.655476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-01cea7b3-778a-402c-8da1-dbdad0399e42 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.129102 Aug 29 15:26:24.669658 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 96/189] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:24.684479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf2b0f5c-5f6b-498b-8e60-1c7d9c3a8d57 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:24.695752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.702932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.704559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.722836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b0f5c-5f6b-498b-8e60-1c7d9c3a8d57 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.723579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b0f5c-5f6b-498b-8e60-1c7d9c3a8d57 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.724216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b0f5c-5f6b-498b-8e60-1c7d9c3a8d57 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.731013 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70592936-7c18-49a6-abee-1ba5f3a529fe tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-854882-3" status: 200 len: 332 microversion: 2.1 time: 0.124419 Aug 29 15:26:24.733460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 94/190] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/os-hosts/n-h1-854882-3 => generated 332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:24.753228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Calling method '.version_select at 0x7fb0e3fb1670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.778670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.780556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.781050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.813521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.814032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.814474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.841191 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e9c9f2b-e99c-4b69-807b-2a8619a7b9ee tempest-HostsAdminTestJSON-314010062 tempest-HostsAdminTestJSON-314010062-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-854882-3" status: 200 len: 467 microversion: 2.1 time: 0.099337 Aug 29 15:26:24.842080 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 95/191] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/os-hosts/n-h2-854882-3 => generated 467 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:24.859970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.861142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:24.877708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.878297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.878743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.879798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.881093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.881850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.931752 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cf2b0f5c-5f6b-498b-8e60-1c7d9c3a8d57 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.251935 Aug 29 15:26:24.932778 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 97/192] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:26:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:24.960120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70642243-8ec5-4f5b-a185-851bea1b0fe1 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:24.967488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70642243-8ec5-4f5b-a185-851bea1b0fe1 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6b0f2619a2234473bda588435455014e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3022eb88dd4547738f95767a2bff60c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70642243-8ec5-4f5b-a185-851bea1b0fe1 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Request method failure captured: Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 42 Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp3b8dsXSja7rArL6ddqL5ZIZ-I88Q9wts-ltAUKuVn4Hyv365PZEVRXobsvhWE2N-hGdcKCOL5Y8EbxawKtK5WKS4xcFeMo55bRTRq1PxgP5ezDx0xMVyotqvC-Xir9HRBTtNv2zjexABFtgGsQHXAVvSy9onY_eBIF514dZgllu4 Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:24.972162 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3022eb88dd4547738f95767a2bff60c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3022eb88dd4547738f95767a2bff60c8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3022eb88dd4547738f95767a2bff60c8"}]}] Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 3022eb88dd4547738f95767a2bff60c8 Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-741513584 Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 6b0f2619a2234473bda588435455014e Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-741513584-project Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: {"remove_host": {"host": "n-h1-854882-3"}} Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:24.974837 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h1-854882-3'}}} Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:24.976450 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:26:24.978600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:24.983228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70642243-8ec5-4f5b-a185-851bea1b0fe1 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:24.985461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-70642243-8ec5-4f5b-a185-851bea1b0fe1 tempest-AggregatesAdminNegativeTestJSON-741513584 tempest-AggregatesAdminNegativeTestJSON-741513584-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.037800 Aug 29 15:26:24.992310 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 98/193] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:26:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:25.007461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3bc6574e-cc2d-4e7f-a09c-11436105d393 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.035760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bc6574e-cc2d-4e7f-a09c-11436105d393 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.037525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bc6574e-cc2d-4e7f-a09c-11436105d393 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.038643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bc6574e-cc2d-4e7f-a09c-11436105d393 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.045537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:25.102263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:25.112786 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14938dbc-ed4f-4cad-8487-a9fc4887262a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.257093 Aug 29 15:26:25.113596 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 96/194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:25.242039 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3bc6574e-cc2d-4e7f-a09c-11436105d393 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.246530 Aug 29 15:26:25.244674 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 99/195] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Aug 29 15:26:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:25.258535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59a47805-48c3-4be0-af45-7e366f23fafb tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:25.293113 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-59a47805-48c3-4be0-af45-7e366f23fafb tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.040509 Aug 29 15:26:25.294033 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 97/196] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:25 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:25.303966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2dfd0739-5331-4087-98d2-f4a086caaf03 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1791195533"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.307566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-2dfd0739-5331-4087-98d2-f4a086caaf03 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Generated uuid 69485aab-542b-43a6-af27-bee76836c5e9 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:25.339250 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2dfd0739-5331-4087-98d2-f4a086caaf03 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039312 Aug 29 15:26:25.340168 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 100/197] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:25.348999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9a69bfe-546d-41ef-8d48-acfbd0de2d5c tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-425941380"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.352541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-c9a69bfe-546d-41ef-8d48-acfbd0de2d5c tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid 17409280-1a8b-42ed-8e6c-91fdf1d5504c for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:25.389246 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9a69bfe-546d-41ef-8d48-acfbd0de2d5c tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047699 Aug 29 15:26:25.390006 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 101/198] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:25.396944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.410015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.410687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.411276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.419400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.420718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.421468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.438454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.compute.aggregates [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 15:26:25.438985 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Request method failure captured: Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 42 Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp6HLNYnX0TwqAbf7UqPai0vgTG1YjnaN_y64LPuqk1sE5sEGnIJJ5nadhmv1Obd1YmfxBIE9zDZDSrxjnVgjmd4ZQyeRexmV541Pxe_28f-Y7kJi6EnGG2xiB8tnsYYHChXEhMzqqYxM8LQMp_m7EWcy1hG7BsrRUapHxN1bM-iAs Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:25.440979 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cee3fc2e109248a6877f53eb1dd50efb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cee3fc2e109248a6877f53eb1dd50efb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cee3fc2e109248a6877f53eb1dd50efb"}]}] Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: cee3fc2e109248a6877f53eb1dd50efb Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268 Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8a914afbd07f466bba39dd15caeabf7e Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: {"remove_host": {"host": "nonexist_host"}} Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:25.442259 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot remove host nonexist_host in aggregate 10 Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 15:26:25.442971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 29 15:26:25.444033 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.445957 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f04a3229-53fa-4f04-a273-04ef969cbf0e tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.051144 Aug 29 15:26:25.449766 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 102/199] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:25 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:25.451299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d9fc0da-3fc0-4a10-a02c-ce88e01c975a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.460962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9fc0da-3fc0-4a10-a02c-ce88e01c975a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.461695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9fc0da-3fc0-4a10-a02c-ce88e01c975a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.462358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9fc0da-3fc0-4a10-a02c-ce88e01c975a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.628821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d9fc0da-3fc0-4a10-a02c-ce88e01c975a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.184258 Aug 29 15:26:25.629656 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 103/200] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:25.642278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6e43c0dc-c66e-4320-9c6c-b6d9cb088c24 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:25.678828 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6e43c0dc-c66e-4320-9c6c-b6d9cb088c24 tempest-AggregatesAdminNegativeTestJSON-1990663268 tempest-AggregatesAdminNegativeTestJSON-1990663268-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.046915 Aug 29 15:26:25.684172 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 104/201] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:25 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:25.688886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af42e662-6c58-4ce1-a0b7-2ce2ebbe1847 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:25.701821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-af42e662-6c58-4ce1-a0b7-2ce2ebbe1847 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 242 microversion: 2.1 time: 0.019964 Aug 29 15:26:25.702994 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 105/202] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:25 2022] GET /compute/v2.1/os-aggregates/11 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:25.715456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98da5669-b07b-4665-88a6-135a82abbb4a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.728579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98da5669-b07b-4665-88a6-135a82abbb4a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.729158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98da5669-b07b-4665-88a6-135a82abbb4a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.729647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98da5669-b07b-4665-88a6-135a82abbb4a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.850837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3f1b790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.855879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.858344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.858344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.866819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.867395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.867861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.883921 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] HTTP exception thrown: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Request method failure captured: Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499 HTTP/1.1 Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 56 Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqhzkKtzqAvP4ibmgsTJZ-iwIOCIMhWJ1TlZmT9rVGhBymQ46SvkD5IbfKbYrz1ypaSbigQEPfMYJOupPEbf7rBrP0i4aY7vCHRHUdPUexD9UPEQ0gJmVs5zj4eXClfVOJBC3WOaIt59AI-suvmVCjQemBO-551T15A-j7_oxlHn9Y Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 855cb3a6b214443aaa998c9b52a225c6 Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:25.885982 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/855cb3a6b214443aaa998c9b52a225c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/855cb3a6b214443aaa998c9b52a225c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_855cb3a6b214443aaa998c9b52a225c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/855cb3a6b214443aaa998c9b52a225c6"}]}] Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 855cb3a6b214443aaa998c9b52a225c6 Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: ebc22f4d52244ddd89f7a02a67f68a7f Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:25.889488 n-d-854882-3 devstack@n-api.service[130002]: exception: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c4c292ac-e94e-46b8-8a2b-c8f2210f0499', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.890930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.895586 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:25.897698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:25.897698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.897698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.897698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Returning 404 to user: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:25.897698 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-103b1a9b-9eb8-4b5d-ba87-7a62183a7dbc tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499" status: 404 len: 110 microversion: 2.53 time: 0.564875 Aug 29 15:26:25.897698 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 98/203] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Aug 29 15:26:25 2022] PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499 => generated 110 bytes in 566 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:25.898362 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-98da5669-b07b-4665-88a6-135a82abbb4a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.184049 Aug 29 15:26:25.898362 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 106/204] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:25.909679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36c88192-637b-4d15-803d-6b54f93996ce tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:25.910693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3f1b4c0>, body: {"status": "disabled"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.916281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.916951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.917660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.926536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.927410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.928172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.935802 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] HTTP exception thrown: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Request method failure captured: Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499 HTTP/1.1 Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 22 Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqhzkKtzqAvP4ibmgsTJZ-iwIOCIMhWJ1TlZmT9rVGhBymQ46SvkD5IbfKbYrz1ypaSbigQEPfMYJOupPEbf7rBrP0i4aY7vCHRHUdPUexD9UPEQ0gJmVs5zj4eXClfVOJBC3WOaIt59AI-suvmVCjQemBO-551T15A-j7_oxlHn9Y Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 855cb3a6b214443aaa998c9b52a225c6 Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:25.939228 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/855cb3a6b214443aaa998c9b52a225c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/855cb3a6b214443aaa998c9b52a225c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_855cb3a6b214443aaa998c9b52a225c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/855cb3a6b214443aaa998c9b52a225c6"}]}] Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 855cb3a6b214443aaa998c9b52a225c6 Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: ebc22f4d52244ddd89f7a02a67f68a7f Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: {"status": "disabled"} Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: exception: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.941336 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c4c292ac-e94e-46b8-8a2b-c8f2210f0499', 'body': {'status': 'disabled'}} Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.942346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:25.943682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:25.944938 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.944938 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.946024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Returning 404 to user: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:25.946171 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36c88192-637b-4d15-803d-6b54f93996ce tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.039726 Aug 29 15:26:25.947284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a207d89-1838-4eae-9d28-bf860c8863d3 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499" status: 404 len: 110 microversion: 2.53 time: 0.044163 Aug 29 15:26:25.953620 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 99/205] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Aug 29 15:26:25 2022] PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:25.956511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 107/206] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:25 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:25.959667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c854122-7a1c-440c-b089-b08fca84f4ed tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2122453359"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.962248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3cd6dc0>, body: {"status": "enabled"} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.964112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-3c854122-7a1c-440c-b089-b08fca84f4ed tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid 488cffcd-c427-4352-b63d-32c20f131fb2 for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:25.966970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.967451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.968515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.977699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.978175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.978602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.988112 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] HTTP exception thrown: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Request method failure captured: Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499 HTTP/1.1 Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 21 Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqhzkKtzqAvP4ibmgsTJZ-iwIOCIMhWJ1TlZmT9rVGhBymQ46SvkD5IbfKbYrz1ypaSbigQEPfMYJOupPEbf7rBrP0i4aY7vCHRHUdPUexD9UPEQ0gJmVs5zj4eXClfVOJBC3WOaIt59AI-suvmVCjQemBO-551T15A-j7_oxlHn9Y Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 855cb3a6b214443aaa998c9b52a225c6 Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:25.991045 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/855cb3a6b214443aaa998c9b52a225c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/855cb3a6b214443aaa998c9b52a225c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_855cb3a6b214443aaa998c9b52a225c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/855cb3a6b214443aaa998c9b52a225c6"}]}] Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 855cb3a6b214443aaa998c9b52a225c6 Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205 Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: ebc22f4d52244ddd89f7a02a67f68a7f Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: {"status": "enabled"} Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: exception: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.992369 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'c4c292ac-e94e-46b8-8a2b-c8f2210f0499', 'body': {'status': 'enabled'}} Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.993452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:25.994763 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:25.995845 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. Aug 29 15:26:25.995845 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.998544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Returning 404 to user: Service c4c292ac-e94e-46b8-8a2b-c8f2210f0499 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:26.003829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c854122-7a1c-440c-b089-b08fca84f4ed tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048194 Aug 29 15:26:26.006078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 100/207] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:26.014513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-196e08c1-e8b3-4c9c-8dd9-66a93de1e49b tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499" status: 404 len: 110 microversion: 2.53 time: 0.056405 Aug 29 15:26:26.015585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 108/208] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Aug 29 15:26:25 2022] PUT /compute/v2.1/os-services/c4c292ac-e94e-46b8-8a2b-c8f2210f0499 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:26.026242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.030805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d63e02c-20e4-481b-a21e-ea6129b41720 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:26.032470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.033075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.033590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.034413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.034929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.035462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.065758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d63e02c-20e4-481b-a21e-ea6129b41720 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.068980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d63e02c-20e4-481b-a21e-ea6129b41720 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.070271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d63e02c-20e4-481b-a21e-ea6129b41720 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.071420 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac891b5a-5c9b-4111-84c9-2c24e8ff75d0 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049889 Aug 29 15:26:26.072379 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 109/209] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:26.086321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.090536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.091112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.091649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.092664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.093182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.094468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.133082 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b9ab1dfe-01e3-41ee-8855-9d94570048f4 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.051526 Aug 29 15:26:26.134281 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 110/210] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:26.143445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.144375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:26.162254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.162939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.163519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.164441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.165189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.166031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.367399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d63e02c-20e4-481b-a21e-ea6129b41720 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.348579 Aug 29 15:26:26.368765 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 101/211] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:26 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:26.386142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.403426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.404912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.411842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.414287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.415889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.420353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.437771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:26.484393 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f540af7e-37f3-47af-899f-3fc00def6f87 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.348315 Aug 29 15:26:26.497782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 111/212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:26.505205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1afd53ee-094e-4097-b1ad-c20af3459297 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.515494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1afd53ee-094e-4097-b1ad-c20af3459297 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.015680 Aug 29 15:26:26.516412 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 112/213] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:26.519603 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a637bb94-3356-4590-bf95-8006acf894ab tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.148380 Aug 29 15:26:26.520909 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 102/214] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:26.550369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.551166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa1b48f2-00ad-49b0-8766-e4760b63896e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:26.559536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.561133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.561620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.562388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.562839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.563255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.584469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa1b48f2-00ad-49b0-8766-e4760b63896e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.589174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa1b48f2-00ad-49b0-8766-e4760b63896e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.592624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa1b48f2-00ad-49b0-8766-e4760b63896e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.623189 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd49d16f-dce6-4ae8-b07a-2fc63a2bc696 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-854882-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.083387 Aug 29 15:26:26.627838 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 113/215] 10.222.0.16 () {60 vars in 1235 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-services?host=n-d-854882-3&binary=xxx => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:26.648100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.656938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.662735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.664131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.666365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.667798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.671527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.718003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=26 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:26.745158 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc25dd8d-26fd-4839-a5c1-649a06cc4117 tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.100765 Aug 29 15:26:26.749461 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 114/216] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:26.778659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.790475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.792471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.793204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.799154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.800271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.800718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.845504 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae88bd12-3dcd-404e-ba23-5e6dfd569fac tempest-ServicesAdminNegativeV253TestJSON-146722205 tempest-ServicesAdminNegativeV253TestJSON-146722205-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.081614 Aug 29 15:26:26.846346 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 115/217] 10.222.0.16 () {60 vars in 1239 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:26.862301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa1b48f2-00ad-49b0-8766-e4760b63896e tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.316153 Aug 29 15:26:26.865608 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 103/218] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:26 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:26.883288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c3a15a5d-fe6a-4c1c-9932-0ddd25fdd94c tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.931107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c3a15a5d-fe6a-4c1c-9932-0ddd25fdd94c tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.054130 Aug 29 15:26:26.937762 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 104/219] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:26 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:26.948355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4e055230-0052-4b7f-af6d-073ec8523eca tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-996578784"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:26.955956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-4e055230-0052-4b7f-af6d-073ec8523eca tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid a89e10fb-245b-48fd-9617-187eaf07f745 for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:27.000397 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4e055230-0052-4b7f-af6d-073ec8523eca tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056227 Aug 29 15:26:27.006015 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 105/220] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:27.021426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-071d42ad-66c4-4209-ae14-1e88e09f6278 req-2d17f214-33b5-4d60-9128-cb14d085acba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bddff370-d4f6-46ff-817c-7fa6683f3e9d", "name": "network-vif-plugged", "status": "completed", "tag": "c8a1a0d7-7c42-4842-a1f0-12b511476d80"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:27.056119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-071d42ad-66c4-4209-ae14-1e88e09f6278 req-2d17f214-33b5-4d60-9128-cb14d085acba service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.057168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-071d42ad-66c4-4209-ae14-1e88e09f6278 req-2d17f214-33b5-4d60-9128-cb14d085acba service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.058238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-071d42ad-66c4-4209-ae14-1e88e09f6278 req-2d17f214-33b5-4d60-9128-cb14d085acba service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.086989 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-071d42ad-66c4-4209-ae14-1e88e09f6278 req-2d17f214-33b5-4d60-9128-cb14d085acba service nova] Creating event network-vif-plugged:c8a1a0d7-7c42-4842-a1f0-12b511476d80 for instance bddff370-d4f6-46ff-817c-7fa6683f3e9d on n-h2-854882-3 Aug 29 15:26:27.095253 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-071d42ad-66c4-4209-ae14-1e88e09f6278 req-2d17f214-33b5-4d60-9128-cb14d085acba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087472 Aug 29 15:26:27.097617 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 106/221] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:27.104707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b14af4d-c5c0-4835-873b-77ad23ef938a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:27.125295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b14af4d-c5c0-4835-873b-77ad23ef938a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.130589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b14af4d-c5c0-4835-873b-77ad23ef938a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.131405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b14af4d-c5c0-4835-873b-77ad23ef938a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.170791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.230829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=16 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.319924 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b14af4d-c5c0-4835-873b-77ad23ef938a tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.220841 Aug 29 15:26:27.320914 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 107/222] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:27 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:27.340288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8190f770-2205-4f2e-af88-779f4b68fb90 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:27.358038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8190f770-2205-4f2e-af88-779f4b68fb90 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.358438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8190f770-2205-4f2e-af88-779f4b68fb90 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.358980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8190f770-2205-4f2e-af88-779f4b68fb90 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.504107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5cad7846-2a29-4f42-b5fb-35a30fecf5cb tempest-ServicesAdminNegativeV253TestJSON-1644573491 tempest-ServicesAdminNegativeV253TestJSON-1644573491-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.507951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5cad7846-2a29-4f42-b5fb-35a30fecf5cb tempest-ServicesAdminNegativeV253TestJSON-1644573491 tempest-ServicesAdminNegativeV253TestJSON-1644573491-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'adde72d658d7450193ea70258415af7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d3ed53d944535894036dbfa11dd58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5cad7846-2a29-4f42-b5fb-35a30fecf5cb tempest-ServicesAdminNegativeV253TestJSON-1644573491 tempest-ServicesAdminNegativeV253TestJSON-1644573491-project] Request method failure captured: Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqfZSrYNUsyvWjxcrdGZkomS7YCuvFIqqhhIcuM-VhqQJgL4Dm55-MBZ2vSFo6Jlh3Yu3Jb03uUE3T7Jm2QEVUio6ONkeWA8Q3thHFUXIaVOeY6Azbyy72na8j33YldiN7EDJnHSMNQAuIwF7AXQPJG7x6tSIxb9DhfN1gzcS1XB7A Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: b07d3ed53d944535894036dbfa11dd58 Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1644573491 Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:27.509860 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b07d3ed53d944535894036dbfa11dd58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b07d3ed53d944535894036dbfa11dd58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b07d3ed53d944535894036dbfa11dd58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b07d3ed53d944535894036dbfa11dd58"}]}] Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1644573491 Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: b07d3ed53d944535894036dbfa11dd58 Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1644573491 Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1644573491-project Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: adde72d658d7450193ea70258415af7b Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1644573491-project Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:26:27.512268 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:27.514370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:26:27.517336 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.519674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5cad7846-2a29-4f42-b5fb-35a30fecf5cb tempest-ServicesAdminNegativeV253TestJSON-1644573491 tempest-ServicesAdminNegativeV253TestJSON-1644573491-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:27.519674 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5cad7846-2a29-4f42-b5fb-35a30fecf5cb tempest-ServicesAdminNegativeV253TestJSON-1644573491 tempest-ServicesAdminNegativeV253TestJSON-1644573491-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.654476 Aug 29 15:26:27.519674 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 116/223] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 662 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:27.534174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.545562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.549764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:27.568554 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8190f770-2205-4f2e-af88-779f4b68fb90 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.235533 Aug 29 15:26:27.570922 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 108/224] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:27 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:27.580504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.581057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.581529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.582543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.583203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.583817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.587958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c2df4dcc-2559-490b-b349-40d6a565792b tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.633167 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c2df4dcc-2559-490b-b349-40d6a565792b tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.054338 Aug 29 15:26:27.634212 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 109/225] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:27 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:27.645533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1dca2ce8-18f8-458a-a192-51de5bfd82d8 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-576277956"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:27.649609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-1dca2ce8-18f8-458a-a192-51de5bfd82d8 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid 189eb2a2-c8ec-4b31-b556-60b060b14cb9 for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:27.678797 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1dca2ce8-18f8-458a-a192-51de5bfd82d8 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038096 Aug 29 15:26:27.680343 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 110/226] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:27.700211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c4397361-94e0-411b-855b-c4bcc38d5198 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.745308 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c4397361-94e0-411b-855b-c4bcc38d5198 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.056491 Aug 29 15:26:27.752153 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 111/227] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 15:26:27.759037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8bc2a803-e291-4845-98dc-71b000eda94f tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.769040 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-8bc2a803-e291-4845-98dc-71b000eda94f tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8bc2a803-e291-4845-98dc-71b000eda94f tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Request method failure captured: Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNp73CZoS2_qyDEN4a6xUZXBgs0tyDDzQYpOJJDpYP84smlALRJ5M1aZpLbEHae4ffHSnXnSWmn-xUvC245JeWmBxDE-mmGCfdui_WJpkTwCHWHCuQ_tLFddCm68l8lH5YrKUiONVDGb2SaqEH7vODnii4H9w0wTVKtjGsVdyELYqbU Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:27.773100 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/560b137dccba444286393c266e4ac846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_560b137dccba444286393c266e4ac846", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}] Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: cd94d3ec96c74b309f3801527d7455ef Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: exception: Aggregate 14 could not be found. Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '14'} Aug 29 15:26:27.774397 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.775114 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 29 15:26:27.776133 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.777077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8bc2a803-e291-4845-98dc-71b000eda94f tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:27.777077 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8bc2a803-e291-4845-98dc-71b000eda94f tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.021309 Aug 29 15:26:27.781489 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 112/228] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:27 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:27.788015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5482d763-90f6-4772-bc6d-f789da20ba26 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.810277 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-5482d763-90f6-4772-bc6d-f789da20ba26 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5482d763-90f6-4772-bc6d-f789da20ba26 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Request method failure captured: Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNp73CZoS2_qyDEN4a6xUZXBgs0tyDDzQYpOJJDpYP84smlALRJ5M1aZpLbEHae4ffHSnXnSWmn-xUvC245JeWmBxDE-mmGCfdui_WJpkTwCHWHCuQ_tLFddCm68l8lH5YrKUiONVDGb2SaqEH7vODnii4H9w0wTVKtjGsVdyELYqbU Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:27.812528 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/560b137dccba444286393c266e4ac846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_560b137dccba444286393c266e4ac846", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}] Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: cd94d3ec96c74b309f3801527d7455ef Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: exception: Aggregate 14 could not be found. Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '14'} Aug 29 15:26:27.814839 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:27.815989 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.817061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.818307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.818307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:27.818307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:27.818307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 29 15:26:27.818307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.818307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5482d763-90f6-4772-bc6d-f789da20ba26 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:27.818646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5482d763-90f6-4772-bc6d-f789da20ba26 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.035847 Aug 29 15:26:27.824704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 113/229] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:27.830819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-34ba8219-2365-4682-9f63-418b602f7205 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-809871480", "name": "tempest-test_aggregate-402794409"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:27.853680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-34ba8219-2365-4682-9f63-418b602f7205 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid 2bc8b70c-158c-4f62-9dd3-4991c93cc01b for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:27.875649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:27.890224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e886dc71-fa3a-4cb6-a70d-266e3faf84ad tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.354121 Aug 29 15:26:27.891495 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 117/230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:27 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:27.897372 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-34ba8219-2365-4682-9f63-418b602f7205 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.070403 Aug 29 15:26:27.898032 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 114/231] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Aug 29 15:26:27 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:27.910933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8c6a69b1-a0b1-447a-9c2a-d52d3d503aab tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.939125 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8c6a69b1-a0b1-447a-9c2a-d52d3d503aab tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.032417 Aug 29 15:26:27.940448 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 118/232] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:27.948122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14639815-453b-4ef6-8a2a-ba34c5cf9191 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.957058 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-14639815-453b-4ef6-8a2a-ba34c5cf9191 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14639815-453b-4ef6-8a2a-ba34c5cf9191 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Request method failure captured: Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNp73CZoS2_qyDEN4a6xUZXBgs0tyDDzQYpOJJDpYP84smlALRJ5M1aZpLbEHae4ffHSnXnSWmn-xUvC245JeWmBxDE-mmGCfdui_WJpkTwCHWHCuQ_tLFddCm68l8lH5YrKUiONVDGb2SaqEH7vODnii4H9w0wTVKtjGsVdyELYqbU Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:27.959453 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/560b137dccba444286393c266e4ac846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_560b137dccba444286393c266e4ac846", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}] Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: cd94d3ec96c74b309f3801527d7455ef Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: exception: Aggregate 15 could not be found. Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '15'} Aug 29 15:26:27.960818 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.961650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Aug 29 15:26:27.962661 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.963632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14639815-453b-4ef6-8a2a-ba34c5cf9191 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:27.963632 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14639815-453b-4ef6-8a2a-ba34c5cf9191 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.016398 Aug 29 15:26:27.963632 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 115/233] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:27 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:27.970636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1171af2-7a0b-430b-8dc3-9c3ea9b720df tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.983715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f1171af2-7a0b-430b-8dc3-9c3ea9b720df tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1171af2-7a0b-430b-8dc3-9c3ea9b720df tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Request method failure captured: Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp73CZoS2_qyDEN4a6xUZXBgs0tyDDzQYpOJJDpYP84smlALRJ5M1aZpLbEHae4ffHSnXnSWmn-xUvC245JeWmBxDE-mmGCfdui_WJpkTwCHWHCuQ_tLFddCm68l8lH5YrKUiONVDGb2SaqEH7vODnii4H9w0wTVKtjGsVdyELYqbU Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:27.986439 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/560b137dccba444286393c266e4ac846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_560b137dccba444286393c266e4ac846", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/560b137dccba444286393c266e4ac846"}]}] Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 560b137dccba444286393c266e4ac846 Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1068510061 Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: cd94d3ec96c74b309f3801527d7455ef Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminTestJSON-1068510061-project-admin Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: exception: Aggregate 15 could not be found. Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '15'} Aug 29 15:26:27.988777 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:27.991105 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:27.993945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:27.998978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:27.998978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:27.998978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:27.998978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Aug 29 15:26:27.998978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:27.998978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1171af2-7a0b-430b-8dc3-9c3ea9b720df tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:27.998978 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1171af2-7a0b-430b-8dc3-9c3ea9b720df tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.023354 Aug 29 15:26:28.003741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cb23ee9-423e-4e55-aa44-bf74080c196d tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1102623741"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:28.010413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.aggregate [None req-0cb23ee9-423e-4e55-aa44-bf74080c196d tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid 16d338aa-9eb9-46b8-8fc8-ddfa2af1e4e6 for aggregate {{(pid=130002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:28.012621 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:28.056929 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0cb23ee9-423e-4e55-aa44-bf74080c196d tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.057617 Aug 29 15:26:28.067581 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 116/235] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.075780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b743d2bc-8837-44c8-8e46-705db4fc1ac8 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.086792 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b743d2bc-8837-44c8-8e46-705db4fc1ac8 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.015463 Aug 29 15:26:28.087380 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.100606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-49952140-f8f6-49f2-abfe-24efd4d60390 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:28.169000 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-49952140-f8f6-49f2-abfe-24efd4d60390 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.073291 Aug 29 15:26:28.189545 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 117/237] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 15:26:28 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.194733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0f89401-e6ac-42c0-8430-68b98de98a1c tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.208506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d0f89401-e6ac-42c0-8430-68b98de98a1c tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.017992 Aug 29 15:26:28.215585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:28.228569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b3e4b682-faa8-4aac-a9dc-fef198cf5886 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.295276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b3e4b682-faa8-4aac-a9dc-fef198cf5886 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.070893 Aug 29 15:26:28.299971 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 118/239] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:28 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:28.305299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-068c2dde-13ee-492a-b21d-d95a0e1154f9 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1411870305", "availability_zone": "tempest-test_az-1599186028"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:28.309688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-068c2dde-13ee-492a-b21d-d95a0e1154f9 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid 52e05f43-9b8d-4422-b690-16edb37dbc14 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:28.326834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:28.360258 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-068c2dde-13ee-492a-b21d-d95a0e1154f9 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.058316 Aug 29 15:26:28.367381 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 122/240] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Aug 29 15:26:28 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.372839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e01d4a5-eee3-4761-8f44-79ff1b9c14a1 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1411870305_new", "availability_zone": "tempest-test_az-1599186028_new"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:28.654436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e01d4a5-eee3-4761-8f44-79ff1b9c14a1 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:28.654872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e01d4a5-eee3-4761-8f44-79ff1b9c14a1 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:28.655267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e01d4a5-eee3-4761-8f44-79ff1b9c14a1 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:28.692034 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e01d4a5-eee3-4761-8f44-79ff1b9c14a1 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.322490 Aug 29 15:26:28.693422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 119/241] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Aug 29 15:26:28 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.708895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4ce5a108-89d7-45e2-9750-cc7e441ce3d4 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.728902 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4ce5a108-89d7-45e2-9750-cc7e441ce3d4 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.028150 Aug 29 15:26:28.730466 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 123/242] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:28.746034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86da8934-0cce-484a-99db-cff56effa8c3 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.788928 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86da8934-0cce-484a-99db-cff56effa8c3 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.046445 Aug 29 15:26:28.789876 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 120/243] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:28 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:28.800206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc0b769c-0b08-4435-95db-69e1e5d7a86d tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-292176289"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:28.803953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-bc0b769c-0b08-4435-95db-69e1e5d7a86d tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Generated uuid 4476ca71-a4d3-42c0-ad12-82fca4cbab64 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:26:28.856586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc0b769c-0b08-4435-95db-69e1e5d7a86d tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060388 Aug 29 15:26:28.858515 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 124/244] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 15:26:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.869255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5340d36-296a-450d-9866-3bb18281d1dd tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.882686 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c5340d36-296a-450d-9866-3bb18281d1dd tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.016765 Aug 29 15:26:28.884443 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 121/245] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.902006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbe1a393-b575-49e1-9d07-5309baacb692 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.916801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.918689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:28.931499 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cbe1a393-b575-49e1-9d07-5309baacb692 tempest-AggregatesAdminTestJSON-1068510061 tempest-AggregatesAdminTestJSON-1068510061-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.034594 Aug 29 15:26:28.932906 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 125/246] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:28 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:26:28.936975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:28.937494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:28.937931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:28.941295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:28.941858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:28.943725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.944444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:28.947153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:28.953813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:28.955691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:28.956299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:28.957290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:28.957966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:28.958544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:28.977249 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] HTTP exception thrown: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Request method failure captured: Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a HTTP/1.1 Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp4WkQTqVPEs84E6aPjNEkoeQHL7tNxyIl-TvGlYfHqoneC49gGZ9-N2lfIyZ0HePyzCpqNQFsTK4MS832nboVYyf01i21WE4W-6txmtYNA_c8A-ZF6pK2LS8tGdulp3d70pq3s0rUtFT43pqLVaGM56Xb_4dlWsK7dwfnLXoIVBco Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ebba5db9c29a4e3f9886bcf67f676922 Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:28.980477 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebba5db9c29a4e3f9886bcf67f676922"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ebba5db9c29a4e3f9886bcf67f676922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ebba5db9c29a4e3f9886bcf67f676922", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebba5db9c29a4e3f9886bcf67f676922"}]}] Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ebba5db9c29a4e3f9886bcf67f676922 Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminTestJSON-1076950751-project Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 99004756e4fe4720b121bd4b03949f35 Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminTestJSON-1076950751-project Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:28.981812 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd6fc34ad-a042-4bb4-89ef-db59ec56f74a'} Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:28.982725 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:28.984053 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.986427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Returning 404 to user: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:28.986427 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b808a692-160f-4a17-939a-cbfdb04a481b tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 404 len: 111 microversion: 2.1 time: 0.046467 Aug 29 15:26:28.989486 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 126/247] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:28 2022] DELETE /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:28.997917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.999965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] [instance: d6fc34ad-a042-4bb4-89ef-db59ec56f74a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:29.008788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.009679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.010501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:29.011530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.012142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.012765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:29.033929 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] HTTP exception thrown: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Request method failure captured: Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a HTTP/1.1 Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNp4WkQTqVPEs84E6aPjNEkoeQHL7tNxyIl-TvGlYfHqoneC49gGZ9-N2lfIyZ0HePyzCpqNQFsTK4MS832nboVYyf01i21WE4W-6txmtYNA_c8A-ZF6pK2LS8tGdulp3d70pq3s0rUtFT43pqLVaGM56Xb_4dlWsK7dwfnLXoIVBco Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ebba5db9c29a4e3f9886bcf67f676922 Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:29.035893 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebba5db9c29a4e3f9886bcf67f676922"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ebba5db9c29a4e3f9886bcf67f676922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ebba5db9c29a4e3f9886bcf67f676922", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ebba5db9c29a4e3f9886bcf67f676922"}]}] Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ebba5db9c29a4e3f9886bcf67f676922 Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1076950751 Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AggregatesAdminTestJSON-1076950751-project Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 99004756e4fe4720b121bd4b03949f35 Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AggregatesAdminTestJSON-1076950751-project Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:29.037293 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd6fc34ad-a042-4bb4-89ef-db59ec56f74a'} Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:29.038134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. Aug 29 15:26:29.039398 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.043184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] Returning 404 to user: Instance d6fc34ad-a042-4bb4-89ef-db59ec56f74a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:29.044566 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-92e7eb1b-f82f-4329-bd35-ce07d6c520d2 tempest-AggregatesAdminTestJSON-1076950751 tempest-AggregatesAdminTestJSON-1076950751-project] 10.222.0.16 "GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a" status: 404 len: 111 microversion: 2.1 time: 0.052527 Aug 29 15:26:29.045713 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 127/248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/servers/d6fc34ad-a042-4bb4-89ef-db59ec56f74a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:29.246312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:29.265640 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-64edf308-49e1-4196-9482-4ada0df11091 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1319 microversion: 2.1 time: 0.354944 Aug 29 15:26:29.279788 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 122/249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:30.288801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:30.289501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:30.305822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.306309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.307363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.308183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.308634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.309053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.514943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:30.525778 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16a17c19-0b9c-4ef5-8cf9-6df1a69e4555 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1469 microversion: 2.1 time: 0.240130 Aug 29 15:26:30.535266 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 128/250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:30 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:31.063610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-41979818", "block_migration": true, "disk_over_commit": false}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:31.067634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:31.074535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.075567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.076249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.077074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.077772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.078414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.338752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab27dfa1-65db-4208-b2c6-f31c2f938296 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Calling method '.version_select at 0x7fb0e3ca9310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:31.342434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab27dfa1-65db-4208-b2c6-f31c2f938296 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'fb70ae8b6c474cc28d74839927ec72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf3b494c9d84687b66c817df0fb173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab27dfa1-65db-4208-b2c6-f31c2f938296 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Request method failure captured: Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqiEB7FDs5yN7ogUeIfVdI5_80Or-ABbyUXwb6ggA5NQBkWb560VqF-G2GEluDEpGRjlpxuMZ70byu4jkp7nEBNolhujIPbX8L1ioIXuOfuW6t434beiKlbmYSn6XB73ud10ab76jACG2DsQV_qd_AOXBWESvMnH3AFoX6WkyX5Y8A Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:31.346050 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cf3b494c9d84687b66c817df0fb173d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}] Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: fb70ae8b6c474cc28d74839927ec72f3 Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:31.347560 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:31.348473 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:26:31.349768 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.352015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab27dfa1-65db-4208-b2c6-f31c2f938296 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:31.353171 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab27dfa1-65db-4208-b2c6-f31c2f938296 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.618217 Aug 29 15:26:31.355155 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 129/251] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:26:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 621 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:31.368554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb8fb100-969b-477f-ab3d-192aff2de2af tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Calling method '.version_select at 0x7fb0e3cd6430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:31.371944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb8fb100-969b-477f-ab3d-192aff2de2af tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'fb70ae8b6c474cc28d74839927ec72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf3b494c9d84687b66c817df0fb173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb8fb100-969b-477f-ab3d-192aff2de2af tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Request method failure captured: Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqiEB7FDs5yN7ogUeIfVdI5_80Or-ABbyUXwb6ggA5NQBkWb560VqF-G2GEluDEpGRjlpxuMZ70byu4jkp7nEBNolhujIPbX8L1ioIXuOfuW6t434beiKlbmYSn6XB73ud10ab76jACG2DsQV_qd_AOXBWESvMnH3AFoX6WkyX5Y8A Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:31.372890 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cf3b494c9d84687b66c817df0fb173d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}] Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: fb70ae8b6c474cc28d74839927ec72f3 Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:31.375356 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:31.377155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:26:31.379345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.384463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb8fb100-969b-477f-ab3d-192aff2de2af tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:31.384463 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb8fb100-969b-477f-ab3d-192aff2de2af tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.012006 Aug 29 15:26:31.384463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 130/252] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:31 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:31.395625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f130464f-a889-423c-853a-913ada3480f8 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Calling method '.version_select at 0x7fb0e3eb4700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:31.408526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f130464f-a889-423c-853a-913ada3480f8 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'fb70ae8b6c474cc28d74839927ec72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf3b494c9d84687b66c817df0fb173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f130464f-a889-423c-853a-913ada3480f8 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Request method failure captured: Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqiEB7FDs5yN7ogUeIfVdI5_80Or-ABbyUXwb6ggA5NQBkWb560VqF-G2GEluDEpGRjlpxuMZ70byu4jkp7nEBNolhujIPbX8L1ioIXuOfuW6t434beiKlbmYSn6XB73ud10ab76jACG2DsQV_qd_AOXBWESvMnH3AFoX6WkyX5Y8A Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:31.414320 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cf3b494c9d84687b66c817df0fb173d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}] Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: fb70ae8b6c474cc28d74839927ec72f3 Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:31.415756 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:31.416504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:26:31.418179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.419338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f130464f-a889-423c-853a-913ada3480f8 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:31.419338 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f130464f-a889-423c-853a-913ada3480f8 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.036412 Aug 29 15:26:31.424662 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 131/253] 10.222.0.16 () {58 vars in 1179 bytes} [Mon Aug 29 15:26:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:32.000212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Calling method '.version_select at 0x7fb0e3cbd430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:32.002691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.003429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.004033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.020399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.020888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.021550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.036062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.036787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.037417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.044700 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3376a57c-5efb-4699-a160-84f61624d530 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.618242 Aug 29 15:26:32.052786 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 132/254] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:32.177828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lazy-loading 'flavor' on Instance uuid bddff370-d4f6-46ff-817c-7fa6683f3e9d {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:32.225015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Going to try to live migrate instance to tempest-host-41979818 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:26:32.232632 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] HTTP exception thrown: Compute host tempest-host-41979818 could not be found. Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Request method failure captured: Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d/action HTTP/1.1 Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 105 Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqRiRg95aXXq4k0FJnr7mGv7LWeqFOFERXokug0TePtyo7XU57T7XonjhzIQ0vywyfXNEPWKfz_ABJIER_LwapFRx4K4FLtYRtSnCfD51jfk6WKIbKIT0BNTQWaK88GO5sBNQATmNZGW_LH1j8xfbyH8_aeXeJaDJufdStIHQZ6dHE Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 31f2208094e3493690a0cf3e6f17bf9c Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveMigrationNegativeTest-1830485061 Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:32.237474 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31f2208094e3493690a0cf3e6f17bf9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31f2208094e3493690a0cf3e6f17bf9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31f2208094e3493690a0cf3e6f17bf9c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31f2208094e3493690a0cf3e6f17bf9c"}]}] Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveMigrationNegativeTest-1830485061 Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 31f2208094e3493690a0cf3e6f17bf9c Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1830485061 Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveMigrationNegativeTest-1830485061-project-admin Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 926654a9e5524c8299925b6a648409a9 Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveMigrationNegativeTest-1830485061-project-admin Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: {"os-migrateLive": {"host": "tempest-host-41979818", "block_migration": true, "disk_over_commit": false}} Aug 29 15:26:32.238944 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: exception: Compute host tempest-host-41979818 could not be found. Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'bddff370-d4f6-46ff-817c-7fa6683f3e9d', 'body': {'os-migrateLive': {'host': 'tempest-host-41979818', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:26:32.239651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-41979818 could not be found. Aug 29 15:26:32.240875 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-41979818 could not be found. Aug 29 15:26:32.242225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-41979818 could not be found. Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Returning 400 to user: Compute host tempest-host-41979818 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4178a12d-aabc-4885-90f0-ca6e46d9f026 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d/action" status: 400 len: 98 microversion: 2.1 time: 1.691744 Aug 29 15:26:32.243534 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 123/255] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Aug 29 15:26:30 2022] POST /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d/action => generated 98 bytes in 1693 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:32.245355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2f9d8ac-3cd2-422d-9a06-bf62bb5603d3 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Calling method '.version_select at 0x7fb0e3ed7af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:32.247211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e2f9d8ac-3cd2-422d-9a06-bf62bb5603d3 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'fb70ae8b6c474cc28d74839927ec72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf3b494c9d84687b66c817df0fb173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2f9d8ac-3cd2-422d-9a06-bf62bb5603d3 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Request method failure captured: Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqiEB7FDs5yN7ogUeIfVdI5_80Or-ABbyUXwb6ggA5NQBkWb560VqF-G2GEluDEpGRjlpxuMZ70byu4jkp7nEBNolhujIPbX8L1ioIXuOfuW6t434beiKlbmYSn6XB73ud10ab76jACG2DsQV_qd_AOXBWESvMnH3AFoX6WkyX5Y8A Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:32.248797 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cf3b494c9d84687b66c817df0fb173d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}] Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: fb70ae8b6c474cc28d74839927ec72f3 Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '1'} Aug 29 15:26:32.250162 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:32.251567 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:26:32.253657 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.254592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2f9d8ac-3cd2-422d-9a06-bf62bb5603d3 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:32.254592 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e2f9d8ac-3cd2-422d-9a06-bf62bb5603d3 tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009036 Aug 29 15:26:32.256364 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 124/256] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Aug 29 15:26:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:32.262769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:32.263510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:32.270131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.270875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.271427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.272448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.272613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.273208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.435765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:32.443922 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56ae4f7c-09c1-42d9-b287-22d9363167fb tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1469 microversion: 2.1 time: 0.186167 Aug 29 15:26:32.445097 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 125/257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:32 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1469 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:32.449966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec75a986-1119-427b-bdab-d4b9820aaae3 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Calling method '.version_select at 0x7fb0e3f2a430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:32.451523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ec75a986-1119-427b-bdab-d4b9820aaae3 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] HTTP exception thrown: Hypervisor with ID 'b8f21fa6-6f88-4d32-ae69-515efc797298' could not be found. Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec75a986-1119-427b-bdab-d4b9820aaae3 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Request method failure captured: Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-hypervisors/b8f21fa6-6f88-4d32-ae69-515efc797298/uptime HTTP/1.1 Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqmLHXbJJJsKZoCX6FNFEmbEyAqtPDmjOtQTDHQ0mX5xYFmfKF43uApBi8-IAAzsV4wEhl-FWzqL1Ms2Fi-Bd4kzz2mIbJvMmhfzyuTwKb7A9FCyJ-ThrOld2x_KhQVgUsS0BElTsULR4kW5pGFrM-j5oNOFvEfqMZPOJZ5pbqOrWo Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 130f7d379e424f3c94400d03f12f11f9 Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-66035900 Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:32.457807 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/130f7d379e424f3c94400d03f12f11f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/130f7d379e424f3c94400d03f12f11f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_130f7d379e424f3c94400d03f12f11f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/130f7d379e424f3c94400d03f12f11f9"}]}] Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-66035900 Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 130f7d379e424f3c94400d03f12f11f9 Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-66035900 Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 5fb88976339a4a6b970c404a985817d9 Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: exception: Hypervisor with ID 'b8f21fa6-6f88-4d32-ae69-515efc797298' could not be found. Aug 29 15:26:32.459334 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b8f21fa6-6f88-4d32-ae69-515efc797298'} Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b8f21fa6-6f88-4d32-ae69-515efc797298' Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 15:26:32.460160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b8f21fa6-6f88-4d32-ae69-515efc797298' could not be found. Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:32.462022 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b8f21fa6-6f88-4d32-ae69-515efc797298' could not be found. Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec75a986-1119-427b-bdab-d4b9820aaae3 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Returning 404 to user: Hypervisor with ID 'b8f21fa6-6f88-4d32-ae69-515efc797298' could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:32.463632 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec75a986-1119-427b-bdab-d4b9820aaae3 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/b8f21fa6-6f88-4d32-ae69-515efc797298/uptime" status: 404 len: 123 microversion: 2.1 time: 0.013058 Aug 29 15:26:32.465694 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 126/258] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 15:26:32 2022] GET /compute/v2.1/os-hypervisors/b8f21fa6-6f88-4d32-ae69-515efc797298/uptime => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:32.472608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Calling method '.version_select at 0x7fb0e3d89280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:32.474427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.474911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.475348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.491104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.491586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.492028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.509101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.509668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.510061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.516119 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a72c8f4-bc4a-4c2e-bb60-8a9daaefce7d tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049404 Aug 29 15:26:32.516895 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 127/259] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:32.581277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3eb4160>, body: {"quota_set": {"ram": "5120"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:33.078444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-336736583", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:33.174472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:33.270969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.271426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.271843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.272778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.273474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.273969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.354920 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b749354-97f2-4f0c-a105-efbb8a35159a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024" status: 200 len: 240 microversion: 2.36 time: 1.300072 Aug 29 15:26:33.355992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 133/260] 10.222.0.16 () {62 vars in 1303 bytes} [Mon Aug 29 15:26:32 2022] PUT /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024 => generated 240 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:33.364667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-894e4b1e-c21a-4452-965e-e7e3cf79bace tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Calling method '.version_select at 0x7fb0e3cd6a60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:33.368887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-894e4b1e-c21a-4452-965e-e7e3cf79bace tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'fb70ae8b6c474cc28d74839927ec72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf3b494c9d84687b66c817df0fb173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-894e4b1e-c21a-4452-965e-e7e3cf79bace tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Request method failure captured: Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqiEB7FDs5yN7ogUeIfVdI5_80Or-ABbyUXwb6ggA5NQBkWb560VqF-G2GEluDEpGRjlpxuMZ70byu4jkp7nEBNolhujIPbX8L1ioIXuOfuW6t434beiKlbmYSn6XB73ud10ab76jACG2DsQV_qd_AOXBWESvMnH3AFoX6WkyX5Y8A Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:33.372300 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cf3b494c9d84687b66c817df0fb173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cf3b494c9d84687b66c817df0fb173d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf3b494c9d84687b66c817df0fb173d"}]}] Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0cf3b494c9d84687b66c817df0fb173d Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-286088439 Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: fb70ae8b6c474cc28d74839927ec72f3 Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-286088439-project Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1'} Aug 29 15:26:33.373935 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:33.374814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:26:33.377265 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:33.378997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-894e4b1e-c21a-4452-965e-e7e3cf79bace tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:33.378997 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-894e4b1e-c21a-4452-965e-e7e3cf79bace tempest-HypervisorAdminNegativeTestJSON-286088439 tempest-HypervisorAdminNegativeTestJSON-286088439-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017194 Aug 29 15:26:33.378997 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 134/261] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:33.388245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1656595175", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:33.466215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:33.466705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:33.466798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:33.467210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:33.467562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:33.478837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.479652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.480089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.480913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.481369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.481976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.483879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:33.491974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=17 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:33.505552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Getting quotas for project 8c8b592ba7bb42b0b875db6065b0929c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:33.511013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Getting quotas for user b15e02211d3e4253a2edba6e63425ca7 and project 8c8b592ba7bb42b0b875db6065b0929c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:33.531650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:33.535222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:33.598342 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a51c83c-7d45-49af-8441-becc3bf14834 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080130 Aug 29 15:26:33.599871 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 128/262] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:33.614767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Calling method '.version_select at 0x7fb0e3f62790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:33.931899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:33.933607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:33.934687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:33.935494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:33.936078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:33.952432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.953950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.955008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.956329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.957380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.958104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.993705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Getting quotas for project cacd3a8ccc674a0ab775b2aa20ec08ec. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:34.001908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Getting quotas for user 0e05f5de07aa4189bc933dd2a5fb0205 and project cacd3a8ccc674a0ab775b2aa20ec08ec. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:34.021972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:34.025765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:34.117715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a824af5c-a22a-46b3-b60d-525af9af7baf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739591 Aug 29 15:26:34.118847 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 135/263] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:34.129739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af024f6f-0d0f-449d-84fd-ce86d3788c53 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Calling method '.version_select at 0x7fb0e3c90430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:34.135326 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-af024f6f-0d0f-449d-84fd-ce86d3788c53 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] HTTP exception thrown: Hypervisor with ID 'b7dfee23-5b90-46c5-9481-ae35173c1f06' could not be found. Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af024f6f-0d0f-449d-84fd-ce86d3788c53 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Request method failure captured: Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hypervisors/b7dfee23-5b90-46c5-9481-ae35173c1f06 HTTP/1.1 Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqmLHXbJJJsKZoCX6FNFEmbEyAqtPDmjOtQTDHQ0mX5xYFmfKF43uApBi8-IAAzsV4wEhl-FWzqL1Ms2Fi-Bd4kzz2mIbJvMmhfzyuTwKb7A9FCyJ-ThrOld2x_KhQVgUsS0BElTsULR4kW5pGFrM-j5oNOFvEfqMZPOJZ5pbqOrWo Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 130f7d379e424f3c94400d03f12f11f9 Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-66035900 Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:34.141038 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/130f7d379e424f3c94400d03f12f11f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/130f7d379e424f3c94400d03f12f11f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_130f7d379e424f3c94400d03f12f11f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/130f7d379e424f3c94400d03f12f11f9"}]}] Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-66035900 Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 130f7d379e424f3c94400d03f12f11f9 Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-66035900 Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 5fb88976339a4a6b970c404a985817d9 Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: exception: Hypervisor with ID 'b7dfee23-5b90-46c5-9481-ae35173c1f06' could not be found. Aug 29 15:26:34.143057 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b7dfee23-5b90-46c5-9481-ae35173c1f06'} Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b7dfee23-5b90-46c5-9481-ae35173c1f06' Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 15:26:34.143814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:34.145420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b7dfee23-5b90-46c5-9481-ae35173c1f06' could not be found. Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b7dfee23-5b90-46c5-9481-ae35173c1f06' could not be found. Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af024f6f-0d0f-449d-84fd-ce86d3788c53 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] Returning 404 to user: Hypervisor with ID 'b7dfee23-5b90-46c5-9481-ae35173c1f06' could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:34.146683 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-af024f6f-0d0f-449d-84fd-ce86d3788c53 tempest-HypervisorAdminNegativeTestJSON-66035900 tempest-HypervisorAdminNegativeTestJSON-66035900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/b7dfee23-5b90-46c5-9481-ae35173c1f06" status: 404 len: 123 microversion: 2.1 time: 0.024372 Aug 29 15:26:34.166080 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 136/264] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:26:34 2022] GET /compute/v2.1/os-hypervisors/b7dfee23-5b90-46c5-9481-ae35173c1f06 => generated 123 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:34.189945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c498e29f-45bc-491b-9feb-ab12d4093be1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:34.191254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c498e29f-45bc-491b-9feb-ab12d4093be1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:34.348685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.349889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.352001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:34.357005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.362530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.365832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:34.389518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c498e29f-45bc-491b-9feb-ab12d4093be1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:34.421899 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c498e29f-45bc-491b-9feb-ab12d4093be1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1222 microversion: 2.1 time: 0.253715 Aug 29 15:26:34.424355 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 137/265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:34 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1222 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:34.433811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7b4eacaf-f750-4de4-8127-62d2d577cfb9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:34.435311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7b4eacaf-f750-4de4-8127-62d2d577cfb9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:34.443948 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8c69cf7-9a72-4a88-bb76-63c075b90fc2 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024/detail" status: 200 len: 672 microversion: 2.36 time: 0.842661 Aug 29 15:26:34.446551 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 129/266] 10.222.0.16 () {60 vars in 1304 bytes} [Mon Aug 29 15:26:33 2022] GET /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024/detail => generated 672 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:34.535929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7b4eacaf-f750-4de4-8127-62d2d577cfb9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:34.581835 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7b4eacaf-f750-4de4-8127-62d2d577cfb9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1219 microversion: 2.1 time: 0.155317 Aug 29 15:26:34.585550 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 138/267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:34 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:35.450207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:35.450207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:35.469242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.473505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.476244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.477926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.478496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.481105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.665254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.694187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8d76483-0a29-4959-a040-cccd828c0ba1 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1292 microversion: 2.1 time: 0.250160 Aug 29 15:26:35.694609 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 130/268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:35 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1292 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:35.703584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:35.704683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:35.724147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.728204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.729548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.732728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.736652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.737369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.941534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.949700 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d176b49d-f366-4f77-a9dd-a14f8276aa57 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1271 microversion: 2.1 time: 0.253307 Aug 29 15:26:35.956441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Calling method '.version_select at 0x7fb0e3c90670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:35.964206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.965099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.965597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.969169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.972449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.973668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.973811 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 131/269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:35 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:35.984640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3d89820>, body: {"quota_set": {"ram": "2048"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:36.053972 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7f05bf5-9e20-466c-89ed-25bcc13b7443 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.602050 Aug 29 15:26:36.056517 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 139/270] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:35 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:36.434263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dbc582bc-638e-4630-b2b3-34c6d7aeff1b tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Calling method '.version_select at 0x7fb0e3d714c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.437721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dbc582bc-638e-4630-b2b3-34c6d7aeff1b tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '2b8e1aa0f9034c38a5d99fd3aa70a758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce262e4887af455d9ad4c2a366e4d2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dbc582bc-638e-4630-b2b3-34c6d7aeff1b tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Request method failure captured: Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqoXJBJmQ00Y4UNHv2WTz2skn2VEfLz3BGetIVXkVFa-t96XVpfpnFHka8MC0ERllV4-4aq7S_4C852U5DQovgOQDmZ288h6GPmKw8CPtsssE1sI5-NMefCSetOjN8Cdt5yniEVi5CrnFrZgyvJQN7Ydye2DWfDaLeo8jH4CiNOyBY Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:36.440194 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce262e4887af455d9ad4c2a366e4d2e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}] Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 2b8e1aa0f9034c38a5d99fd3aa70a758 Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:36.441713 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:36.442557 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:26:36.444252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.447256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dbc582bc-638e-4630-b2b3-34c6d7aeff1b tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.448784 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dbc582bc-638e-4630-b2b3-34c6d7aeff1b tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.385724 Aug 29 15:26:36.449876 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 140/271] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 388 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:36.465930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd374a93-1371-4f8e-b4be-56211eb24a96 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Calling method '.version_select at 0x7fb0e3c90430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.471330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dd374a93-1371-4f8e-b4be-56211eb24a96 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '2b8e1aa0f9034c38a5d99fd3aa70a758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce262e4887af455d9ad4c2a366e4d2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd374a93-1371-4f8e-b4be-56211eb24a96 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Request method failure captured: Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts/n-d-854882-3/reboot HTTP/1.1 Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqoXJBJmQ00Y4UNHv2WTz2skn2VEfLz3BGetIVXkVFa-t96XVpfpnFHka8MC0ERllV4-4aq7S_4C852U5DQovgOQDmZ288h6GPmKw8CPtsssE1sI5-NMefCSetOjN8Cdt5yniEVi5CrnFrZgyvJQN7Ydye2DWfDaLeo8jH4CiNOyBY Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:36.473272 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce262e4887af455d9ad4c2a366e4d2e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}] Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 2b8e1aa0f9034c38a5d99fd3aa70a758 Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'n-d-854882-3'} Aug 29 15:26:36.474707 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:36.475420 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:26:36.476442 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.479321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd374a93-1371-4f8e-b4be-56211eb24a96 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.480595 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dd374a93-1371-4f8e-b4be-56211eb24a96 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-854882-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.023285 Aug 29 15:26:36.481952 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 141/272] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts/n-d-854882-3/reboot => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:36.492077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8d469e5-01ad-4bcc-b4ea-181b598f39a6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Calling method '.version_select at 0x7fb0e3c90c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.515673 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e8d469e5-01ad-4bcc-b4ea-181b598f39a6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8d469e5-01ad-4bcc-b4ea-181b598f39a6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:36.518813 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:26:36.520031 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:36.520762 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:26:36.522268 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8d469e5-01ad-4bcc-b4ea-181b598f39a6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.523311 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8d469e5-01ad-4bcc-b4ea-181b598f39a6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.033989 Aug 29 15:26:36.525961 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 142/273] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:26:36.539425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcd506a5-8364-4693-92fd-28225566610e tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Calling method '.version_select at 0x7fb0e3cd6ee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.544233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dcd506a5-8364-4693-92fd-28225566610e tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '2b8e1aa0f9034c38a5d99fd3aa70a758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce262e4887af455d9ad4c2a366e4d2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcd506a5-8364-4693-92fd-28225566610e tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Request method failure captured: Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts/n-d-854882-3 HTTP/1.1 Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqoXJBJmQ00Y4UNHv2WTz2skn2VEfLz3BGetIVXkVFa-t96XVpfpnFHka8MC0ERllV4-4aq7S_4C852U5DQovgOQDmZ288h6GPmKw8CPtsssE1sI5-NMefCSetOjN8Cdt5yniEVi5CrnFrZgyvJQN7Ydye2DWfDaLeo8jH4CiNOyBY Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:36.547296 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce262e4887af455d9ad4c2a366e4d2e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}] Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 2b8e1aa0f9034c38a5d99fd3aa70a758 Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'n-d-854882-3'} Aug 29 15:26:36.549133 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:36.549893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:26:36.550909 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.553185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcd506a5-8364-4693-92fd-28225566610e tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.553185 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dcd506a5-8364-4693-92fd-28225566610e tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-854882-3" status: 403 len: 109 microversion: 2.1 time: 0.021504 Aug 29 15:26:36.554853 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 143/274] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts/n-d-854882-3 => generated 109 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:36.562961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-47ddf622-e061-4359-9c63-264ae197b357 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Calling method '.version_select at 0x7fb0e3d719d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.572476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-47ddf622-e061-4359-9c63-264ae197b357 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-47ddf622-e061-4359-9c63-264ae197b357 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:36.574263 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:26:36.575788 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.576633 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.577840 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.580768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-47ddf622-e061-4359-9c63-264ae197b357 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.581970 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-47ddf622-e061-4359-9c63-264ae197b357 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024271 Aug 29 15:26:36.583215 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 144/275] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:36.594301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da25b2d8-aa90-463e-ac65-5216ebb34f57 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Calling method '.version_select at 0x7fb0e3cd60d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.596269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-da25b2d8-aa90-463e-ac65-5216ebb34f57 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '2b8e1aa0f9034c38a5d99fd3aa70a758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce262e4887af455d9ad4c2a366e4d2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da25b2d8-aa90-463e-ac65-5216ebb34f57 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Request method failure captured: Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts/n-d-854882-3/shutdown HTTP/1.1 Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqoXJBJmQ00Y4UNHv2WTz2skn2VEfLz3BGetIVXkVFa-t96XVpfpnFHka8MC0ERllV4-4aq7S_4C852U5DQovgOQDmZ288h6GPmKw8CPtsssE1sI5-NMefCSetOjN8Cdt5yniEVi5CrnFrZgyvJQN7Ydye2DWfDaLeo8jH4CiNOyBY Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:36.597963 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce262e4887af455d9ad4c2a366e4d2e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}] Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 2b8e1aa0f9034c38a5d99fd3aa70a758 Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'n-d-854882-3'} Aug 29 15:26:36.599432 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:36.600308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:26:36.601655 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.602739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da25b2d8-aa90-463e-ac65-5216ebb34f57 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.603216 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da25b2d8-aa90-463e-ac65-5216ebb34f57 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-854882-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.014485 Aug 29 15:26:36.603846 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 145/276] 10.222.0.16 () {58 vars in 1194 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts/n-d-854882-3/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:36.617469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7aa875ec-a229-4226-8c0a-c19a2e4416ee tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Calling method '.version_select at 0x7fb0e3c90550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.629282 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-7aa875ec-a229-4226-8c0a-c19a2e4416ee tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7aa875ec-a229-4226-8c0a-c19a2e4416ee tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:36.631964 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:26:36.633420 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:36.634353 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:26:36.635591 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7aa875ec-a229-4226-8c0a-c19a2e4416ee tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.637023 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7aa875ec-a229-4226-8c0a-c19a2e4416ee tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023016 Aug 29 15:26:36.637974 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 146/277] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:36.658710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=81,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:36.669240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.669943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.670469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.671313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.671870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.673203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.721923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.722951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.723771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.724770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.725680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.726368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.807025 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-660c7576-7992-4e0d-99fd-0bf2f223b78a tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024?user_id=fd2ea8d4f35344b1828f5b95534672c2" status: 200 len: 240 microversion: 2.36 time: 0.827788 Aug 29 15:26:36.815795 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 132/278] 10.222.0.16 () {62 vars in 1384 bytes} [Mon Aug 29 15:26:35 2022] PUT /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024?user_id=fd2ea8d4f35344b1828f5b95534672c2 => generated 240 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:36.821104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b3a9649-6ffd-4461-8242-af1c62c8f981 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Calling method '.version_select at 0x7fb0e3d89790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.823263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b3a9649-6ffd-4461-8242-af1c62c8f981 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '2b8e1aa0f9034c38a5d99fd3aa70a758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce262e4887af455d9ad4c2a366e4d2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b3a9649-6ffd-4461-8242-af1c62c8f981 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Request method failure captured: Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-hosts/n-d-854882-3/startup HTTP/1.1 Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqoXJBJmQ00Y4UNHv2WTz2skn2VEfLz3BGetIVXkVFa-t96XVpfpnFHka8MC0ERllV4-4aq7S_4C852U5DQovgOQDmZ288h6GPmKw8CPtsssE1sI5-NMefCSetOjN8Cdt5yniEVi5CrnFrZgyvJQN7Ydye2DWfDaLeo8jH4CiNOyBY Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:36.825259 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce262e4887af455d9ad4c2a366e4d2e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}] Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 2b8e1aa0f9034c38a5d99fd3aa70a758 Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'n-d-854882-3'} Aug 29 15:26:36.826735 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:36.827648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:26:36.830134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:36.831278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b3a9649-6ffd-4461-8242-af1c62c8f981 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:36.831278 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b3a9649-6ffd-4461-8242-af1c62c8f981 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-854882-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.009784 Aug 29 15:26:36.832290 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 133/279] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hosts/n-d-854882-3/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:36.837499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.838133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:36.845650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.846357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.846942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.847819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.848415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.848984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.997192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:37.011238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2dc6178-0a55-4f34-a44f-e6d11ef1bc9f tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1280 microversion: 2.1 time: 0.178024 Aug 29 15:26:37.011824 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 134/280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:37.025750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9537cd61-d152-45c2-bc25-cec637479045 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Calling method '.version_select at 0x7fb0e3d96dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.253324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3c90310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.256348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.257028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.257756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.278393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.279169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.281077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.297198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.298328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.299051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.316775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9f5d9e6f-5f6c-4422-971f-eb1df950a272 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.671955 Aug 29 15:26:37.319970 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 147/281] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:37.330627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-230f2271-8023-409b-a2de-5c876a80ca85 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Calling method '.version_select at 0x7fb0e3c90d30>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.352434 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-230f2271-8023-409b-a2de-5c876a80ca85 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-230f2271-8023-409b-a2de-5c876a80ca85 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:37.357101 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:26:37.360654 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:37.362056 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:26:37.365264 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-230f2271-8023-409b-a2de-5c876a80ca85 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-230f2271-8023-409b-a2de-5c876a80ca85 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.037137 Aug 29 15:26:37.367788 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 148/282] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Aug 29 15:26:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:37.396591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.400170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:37.432716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.433793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.435543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.436295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.436762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.439350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.955755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:37.965121 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-acc6b641-e85f-4b16-8882-c2e25b6d060a tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1319 microversion: 2.1 time: 0.594202 Aug 29 15:26:37.967557 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 149/283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:37 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:37.972597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3ca90d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.975158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.975828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.976471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.992792 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9537cd61-d152-45c2-bc25-cec637479045 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024?user_id=fd2ea8d4f35344b1828f5b95534672c2" status: 200 len: 282 microversion: 2.36 time: 0.979894 Aug 29 15:26:37.994709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.995763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.996432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.000217 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 135/284] 10.222.0.16 () {60 vars in 1364 bytes} [Mon Aug 29 15:26:37 2022] GET /compute/v2.1/os-quota-sets/53220f0bab9e40e9961eb1e1bd8ea024?user_id=fd2ea8d4f35344b1828f5b95534672c2 => generated 282 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:38.006935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c14d6a8-54e8-4f93-ac90-ca67cefd7e1b tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3d6b5e0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c14d6a8-54e8-4f93-ac90-ca67cefd7e1b tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/os-hosts/n-d-854882-3 HTTP/1.1 Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 51 Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:38.011676 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: {"status": "enable", "maintenance_mode": "invalid"} Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:38.012874 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'n-d-854882-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.013691 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.015174 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.016283 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.016283 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:26:38.016283 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:26:38.016283 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.016283 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.018667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c14d6a8-54e8-4f93-ac90-ca67cefd7e1b tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.019753 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c14d6a8-54e8-4f93-ac90-ca67cefd7e1b tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-854882-3" status: 400 len: 199 microversion: 2.1 time: 0.017768 Aug 29 15:26:38.020877 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 136/285] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:26:38 2022] PUT /compute/v2.1/os-hosts/n-d-854882-3 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:38.046081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.048592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.049634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.069136 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-705a6409-7ab3-4231-883f-8396ea8f5baa tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.100322 Aug 29 15:26:38.070143 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 150/286] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:26:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:38.356065 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21c180d9-e7d1-4c87-96c1-36233ae86889 tempest-TenantUsagesNegativeTestJSON-1582640182 tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T15%3A26%3A37.489360&end=2022-08-30T15%3A26%3A37.489360" status: 404 len: 112 microversion: - time: 0.333837 Aug 29 15:26:38.356628 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 137/287] 10.222.0.16 () {58 vars in 1316 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T15%3A26%3A37.489360&end=2022-08-30T15%3A26%3A37.489360 => generated 112 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:26:38.371793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-011244e2-f641-454d-9ac6-299fed4158e6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3d7d3a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-011244e2-f641-454d-9ac6-299fed4158e6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/os-hosts/n-d-854882-3 HTTP/1.1 Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 51 Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:38.377335 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: {"status": "invalid", "maintenance_mode": "enable"} Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:38.378894 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'n-d-854882-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.379668 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.381271 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.382571 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.382571 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:26:38.382571 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:26:38.382571 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:26:38.382571 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.392465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-011244e2-f641-454d-9ac6-299fed4158e6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.393869 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-011244e2-f641-454d-9ac6-299fed4158e6 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-854882-3" status: 400 len: 189 microversion: 2.1 time: 0.032851 Aug 29 15:26:38.394976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 138/288] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:26:38 2022] PUT /compute/v2.1/os-hosts/n-d-854882-3 => generated 189 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:38.402300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.404408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:38.420967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.421814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.422536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.423990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.424762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.425371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.559854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7cb1648f-c413-49eb-83ee-682657600489 tempest-AZAdminNegativeTestJSON-1938923682 tempest-AZAdminNegativeTestJSON-1938923682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.561532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7cb1648f-c413-49eb-83ee-682657600489 tempest-AZAdminNegativeTestJSON-1938923682 tempest-AZAdminNegativeTestJSON-1938923682-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3005cb51a7934df4aaa46614d89b248e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ee15fab1284e2c90c55aad176c6604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7cb1648f-c413-49eb-83ee-682657600489 tempest-AZAdminNegativeTestJSON-1938923682 tempest-AZAdminNegativeTestJSON-1938923682-project] Request method failure captured: Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqrNNdVbQUOvNkdEAnW4o5-wnsmeb6hnPnFK18ev7IWvpNKfZFzuNy6LzqEaWTVrBNoeFy-HOrrt169lGF-YWE9GsasWy_QuV51RrwXQ9__HVnA0D4aBvjO87LtkKqJBypZaenZSftESM4Q_-FfYTkapJZpPqMpjx8LRiHewu37MWU Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f3ee15fab1284e2c90c55aad176c6604 Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1938923682 Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:38.563495 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3ee15fab1284e2c90c55aad176c6604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3ee15fab1284e2c90c55aad176c6604"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3ee15fab1284e2c90c55aad176c6604", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3ee15fab1284e2c90c55aad176c6604"}]}] Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AZAdminNegativeTestJSON-1938923682 Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f3ee15fab1284e2c90c55aad176c6604 Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1938923682 Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AZAdminNegativeTestJSON-1938923682-project Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3005cb51a7934df4aaa46614d89b248e Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AZAdminNegativeTestJSON-1938923682-project Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:26:38.564862 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:38.565666 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.567903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7cb1648f-c413-49eb-83ee-682657600489 tempest-AZAdminNegativeTestJSON-1938923682 tempest-AZAdminNegativeTestJSON-1938923682-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.571509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7cb1648f-c413-49eb-83ee-682657600489 tempest-AZAdminNegativeTestJSON-1938923682 tempest-AZAdminNegativeTestJSON-1938923682-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.493675 Aug 29 15:26:38.571509 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 151/289] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 497 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:38.577203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3e32a60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.585947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.586524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.586968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.618483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.621115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.621606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.651202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.662927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.664781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.686316 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-54de2e92-d54e-4e9d-816a-913b050b2526 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.113885 Aug 29 15:26:38.687295 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 152/290] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:38.692511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb19fe9e-ceb6-44cf-a920-52b5ed89d258 tempest-TenantUsagesNegativeTestJSON-1582640182 tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin] Calling method '.version_select at 0x7fb0e3d71e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.701355 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cb19fe9e-ceb6-44cf-a920-52b5ed89d258 tempest-TenantUsagesNegativeTestJSON-1582640182 tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb19fe9e-ceb6-44cf-a920-52b5ed89d258 tempest-TenantUsagesNegativeTestJSON-1582640182 tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin] Request method failure captured: Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-simple-tenant-usage/44ce50453878420baa186ecda9e20aa7?start=2022-08-30T15%3A26%3A37.489360&end=2022-08-28T15%3A26%3A37.489360 HTTP/1.1 Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqtOwfa3ESZdIcR8fQJQF_nbU1lsb0s8oSZ1zEijJanhqRDmnEnPtDt0pSexseH654bDvoLzrDZ3_gceoz_WDq0ImbPlmoqIMvKNzAZAGjN28OKaboZ_sS1BmW1T15c4sM8cRaLOWRHDCEN5YbPUAtCeyyspz30M_FWr0sGznGw3pU Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 866a5b0d5b3542d88cc9300086da8d06 Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1582640182 Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:38.703855 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/866a5b0d5b3542d88cc9300086da8d06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/866a5b0d5b3542d88cc9300086da8d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_866a5b0d5b3542d88cc9300086da8d06", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/866a5b0d5b3542d88cc9300086da8d06"}]}] Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1582640182 Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 866a5b0d5b3542d88cc9300086da8d06 Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1582640182 Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b5ae7d5674674760911c699a4585c0eb Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid start time. The start time cannot occur after the end time. Aug 29 15:26:38.705127 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '44ce50453878420baa186ecda9e20aa7'} Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:26:38.705881 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 29 15:26:38.706961 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.709679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb19fe9e-ceb6-44cf-a920-52b5ed89d258 tempest-TenantUsagesNegativeTestJSON-1582640182 tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.711430 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb19fe9e-ceb6-44cf-a920-52b5ed89d258 tempest-TenantUsagesNegativeTestJSON-1582640182 tempest-TenantUsagesNegativeTestJSON-1582640182-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/44ce50453878420baa186ecda9e20aa7?start=2022-08-30T15%3A26%3A37.489360&end=2022-08-28T15%3A26%3A37.489360" status: 400 len: 111 microversion: 2.1 time: 0.022430 Aug 29 15:26:38.713841 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 153/291] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-simple-tenant-usage/44ce50453878420baa186ecda9e20aa7?start=2022-08-30T15%3A26%3A37.489360&end=2022-08-28T15%3A26%3A37.489360 => generated 111 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:38.723105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f9100d6-6ab9-4873-a44d-66d825890688 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Action: 'update', calling method: .version_select at 0x7fb0e3c349d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:38.729689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f9100d6-6ab9-4873-a44d-66d825890688 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '2b8e1aa0f9034c38a5d99fd3aa70a758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce262e4887af455d9ad4c2a366e4d2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f9100d6-6ab9-4873-a44d-66d825890688 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Request method failure captured: Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/os-hosts/n-d-854882-3 HTTP/1.1 Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 50 Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqoXJBJmQ00Y4UNHv2WTz2skn2VEfLz3BGetIVXkVFa-t96XVpfpnFHka8MC0ERllV4-4aq7S_4C852U5DQovgOQDmZ288h6GPmKw8CPtsssE1sI5-NMefCSetOjN8Cdt5yniEVi5CrnFrZgyvJQN7Ydye2DWfDaLeo8jH4CiNOyBY Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:38.732096 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce262e4887af455d9ad4c2a366e4d2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce262e4887af455d9ad4c2a366e4d2e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce262e4887af455d9ad4c2a366e4d2e3"}]}] Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ce262e4887af455d9ad4c2a366e4d2e3 Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390943538 Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 2b8e1aa0f9034c38a5d99fd3aa70a758 Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390943538-project Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:26:38.733352 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'n-d-854882-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:38.734304 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:26:38.736059 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.739847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f9100d6-6ab9-4873-a44d-66d825890688 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.741295 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f9100d6-6ab9-4873-a44d-66d825890688 tempest-HostsAdminNegativeTestJSON-1390943538 tempest-HostsAdminNegativeTestJSON-1390943538-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-854882-3" status: 403 len: 111 microversion: 2.1 time: 0.025576 Aug 29 15:26:38.748169 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 154/292] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:26:38 2022] PUT /compute/v2.1/os-hosts/n-d-854882-3 => generated 111 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:38.753684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3d719d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.756506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.757181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.757785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.783690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.784725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.785710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.794181 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-66e728d4-f290-4b45-8de1-b95ca1c7eba4 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.044654 Aug 29 15:26:38.805476 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 155/293] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:38.808236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:38.818622 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b37fdc9-7d0f-4f4e-b4f9-445df69d8bee tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.422423 Aug 29 15:26:38.819592 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 139/294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:38.824325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-694ec6b9-e8d7-40fa-9d0f-73f890e8ed87 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3d961f0>, body: {"status": null, "maintenance_mode": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-694ec6b9-e8d7-40fa-9d0f-73f890e8ed87 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/os-hosts/n-d-854882-3 HTTP/1.1 Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 42 Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:38.829767 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: {"status": null, "maintenance_mode": null} Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:26:38.831011 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'n-d-854882-3', 'body': {'status': None, 'maintenance_mode': None}} Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi None Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.831812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.834849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.839276 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:26:38.839276 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:26:38.839276 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:26:38.839276 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.839276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-694ec6b9-e8d7-40fa-9d0f-73f890e8ed87 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.839276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-694ec6b9-e8d7-40fa-9d0f-73f890e8ed87 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-854882-3" status: 400 len: 127 microversion: 2.1 time: 0.011184 Aug 29 15:26:38.839276 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 140/295] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:26:38 2022] PUT /compute/v2.1/os-hosts/n-d-854882-3 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:26:38.858477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d26545b2-e211-4857-87fb-c7f836272bd0 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3d6b280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.861158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d26545b2-e211-4857-87fb-c7f836272bd0 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.861885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d26545b2-e211-4857-87fb-c7f836272bd0 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.862996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d26545b2-e211-4857-87fb-c7f836272bd0 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.885449 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d26545b2-e211-4857-87fb-c7f836272bd0 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.043978 Aug 29 15:26:38.886656 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 141/296] 10.222.0.16 () {58 vars in 1179 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:38.894930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6dd40ad-5dfb-48fd-b7d5-08acccc5f704 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3d6b790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:38.899287 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.hosts [None req-f6dd40ad-5dfb-48fd-b7d5-08acccc5f704 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Enabling host nonexistent_hostname. Aug 29 15:26:38.913940 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f6dd40ad-5dfb-48fd-b7d5-08acccc5f704 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6dd40ad-5dfb-48fd-b7d5-08acccc5f704 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Request method failure captured: Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 50 Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqrETNYGsSeH74CQb8NChe5cc5FxnUhG_fJBSxDW4TwhZiey31U9XS_pFoBkpA0XHbclkSuQJK_JaVAcK-907MRgqJkXFRL5zOnc0CLddxzVA2h9GObf2BUID9G9dPu5KQoXB-mmG23CLV6gu_VBWtx_xA9aL6ZpLrPi_u-BAJf7Ao Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:26:38.917881 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fec309eded5a45209c21b015f17118ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fec309eded5a45209c21b015f17118ba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fec309eded5a45209c21b015f17118ba"}]}] Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fec309eded5a45209c21b015f17118ba Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-901045498 Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7224d95ff4c249a5bee937c2e805b5d2 Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-HostsAdminNegativeTestJSON-901045498-project-admin Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:38.919338 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:26:38.920210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:38.921160 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:26:38.922456 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.926587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6dd40ad-5dfb-48fd-b7d5-08acccc5f704 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.927936 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6dd40ad-5dfb-48fd-b7d5-08acccc5f704 tempest-HostsAdminNegativeTestJSON-901045498 tempest-HostsAdminNegativeTestJSON-901045498-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039527 Aug 29 15:26:38.934498 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 142/297] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Aug 29 15:26:38 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:38.940195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3d96af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.943837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.944519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.945137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.970541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.971967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.972761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.999802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.001643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.003808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.013030 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-53051ed0-9fa8-4e15-884c-4c15e6cb0e80 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.077063 Aug 29 15:26:39.023618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 143/298] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:39.029407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.032919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:39.052002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.052753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.053639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.054797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.055483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.056115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.384008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:39.419043 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c63c8e21-5780-405d-8729-97c37aa509bf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1319 microversion: 2.1 time: 0.393992 Aug 29 15:26:39.437000 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 144/299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:39 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:39.447089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3d72550>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.457937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.458672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.459557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.501653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.507720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.508435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.523138 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d64f741-7bc3-45a7-b828-0f23e1fff32e tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.083972 Aug 29 15:26:39.523770 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 145/300] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:39.536576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b064c158-4c0f-456a-afab-951fd3f79da5 req-59e3cb36-4c27-43db-a772-48e726e41753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d54e4a-0817-4af1-88b7-43e70fd9b411", "tag": "3c17d59f-dacb-4090-9c1e-6079d9a44e51"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:39.558367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b064c158-4c0f-456a-afab-951fd3f79da5 req-59e3cb36-4c27-43db-a772-48e726e41753 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.558754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b064c158-4c0f-456a-afab-951fd3f79da5 req-59e3cb36-4c27-43db-a772-48e726e41753 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.559191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b064c158-4c0f-456a-afab-951fd3f79da5 req-59e3cb36-4c27-43db-a772-48e726e41753 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.569886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f9963f7-2183-429c-a508-2073540689e8 tempest-TenantUsagesNegativeTestJSON-913717646 tempest-TenantUsagesNegativeTestJSON-913717646-project] Calling method '.version_select at 0x7fb0e3c34ee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.579720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b064c158-4c0f-456a-afab-951fd3f79da5 req-59e3cb36-4c27-43db-a772-48e726e41753 service nova] Creating event network-changed:3c17d59f-dacb-4090-9c1e-6079d9a44e51 for instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 on n-h1-854882-3 Aug 29 15:26:39.591552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f9963f7-2183-429c-a508-2073540689e8 tempest-TenantUsagesNegativeTestJSON-913717646 tempest-TenantUsagesNegativeTestJSON-913717646-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '32ae3b30b8274ef183d20f1631ab3322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ce50453878420baa186ecda9e20aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:39.594742 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b064c158-4c0f-456a-afab-951fd3f79da5 req-59e3cb36-4c27-43db-a772-48e726e41753 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067853 Aug 29 15:26:39.595664 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 146/301] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f9963f7-2183-429c-a508-2073540689e8 tempest-TenantUsagesNegativeTestJSON-913717646 tempest-TenantUsagesNegativeTestJSON-913717646-project] Request method failure captured: Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A26%3A37.489360&end=2022-08-30T15%3A26%3A37.489360&detailed=1 HTTP/1.1 Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqqqswOgTxmpyN0imBgEmQJMu_gNaNiOayCZjo1LQ3iX7v0ptFt3NuvVLmS2hzjqNJe8O8mQRTmWamTkNpjX-EG9Yyg7GRUvx4aAQT93bAq0is_dUxXKDouYYJddyu3sM-DP4IwBrCiviuQPhYiL5lGHqS1q4cOiyKiT-Kqfyr9yXs Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 44ce50453878420baa186ecda9e20aa7 Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-913717646 Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:39.596878 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44ce50453878420baa186ecda9e20aa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/44ce50453878420baa186ecda9e20aa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_44ce50453878420baa186ecda9e20aa7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44ce50453878420baa186ecda9e20aa7"}]}] Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-913717646 Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 44ce50453878420baa186ecda9e20aa7 Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-913717646 Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TenantUsagesNegativeTestJSON-913717646-project Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 32ae3b30b8274ef183d20f1631ab3322 Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-913717646-project Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:39.598425 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:39.599367 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:39.600656 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:39.601893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:26:39.601893 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:39.602039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3d96f70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.602464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.602949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.603387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.604226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f9963f7-2183-429c-a508-2073540689e8 tempest-TenantUsagesNegativeTestJSON-913717646 tempest-TenantUsagesNegativeTestJSON-913717646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:39.607077 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f9963f7-2183-429c-a508-2073540689e8 tempest-TenantUsagesNegativeTestJSON-913717646 tempest-TenantUsagesNegativeTestJSON-913717646-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A26%3A37.489360&end=2022-08-30T15%3A26%3A37.489360&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.811140 Aug 29 15:26:39.608812 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 156/302] 10.222.0.16 () {58 vars in 1335 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A26%3A37.489360&end=2022-08-30T15%3A26%3A37.489360&detailed=1 => generated 123 bytes in 813 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:39.639687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.640179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.640793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.655561 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-05c73d2b-bef2-499d-9431-17b14b1cf7f6 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.058667 Aug 29 15:26:39.656672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 147/303] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:26:39 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:39.671181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Calling method '.version_select at 0x7fb0e3bf4280>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.674324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.674959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.675476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.700982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.701616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.702310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.717754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.719314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.719981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.762166 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-708b8748-acec-4463-986d-c20305d4f873 tempest-HypervisorAdminTestJSON-114923579 tempest-HypervisorAdminTestJSON-114923579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.094303 Aug 29 15:26:39.770260 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 157/304] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Aug 29 15:26:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:39.843947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.845849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:39.858648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.859461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.860700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.861735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.862552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.862972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.098056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:40.108888 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-574d6a89-dec1-42f7-806e-6771aba344cf tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.272849 Aug 29 15:26:40.111641 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 148/305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:39 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:40.452191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:40.455390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:40.473296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:40.474919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:40.475367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.479769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:40.481186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:40.481687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.599031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7212065d-4037-4f22-9660-901bdf34f9b9 req-81df334f-3370-4767-8114-b4b78b40622f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b0137e-91a4-4e5f-84e0-8f3bcee728b5", "tag": "86d3ed7c-9027-4a33-9504-05f078b3bda7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:40.617083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7212065d-4037-4f22-9660-901bdf34f9b9 req-81df334f-3370-4767-8114-b4b78b40622f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:40.618675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7212065d-4037-4f22-9660-901bdf34f9b9 req-81df334f-3370-4767-8114-b4b78b40622f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:40.619429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7212065d-4037-4f22-9660-901bdf34f9b9 req-81df334f-3370-4767-8114-b4b78b40622f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.637695 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7212065d-4037-4f22-9660-901bdf34f9b9 req-81df334f-3370-4767-8114-b4b78b40622f service nova] Creating event network-changed:86d3ed7c-9027-4a33-9504-05f078b3bda7 for instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 on n-h1-854882-3 Aug 29 15:26:40.643956 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7212065d-4037-4f22-9660-901bdf34f9b9 req-81df334f-3370-4767-8114-b4b78b40622f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362596 Aug 29 15:26:40.645132 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 158/306] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:41.042956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:41.046570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:41.052296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7602aa5e-e308-4c2a-904e-d92e48ba0175 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1319 microversion: 2.1 time: 0.609936 Aug 29 15:26:41.053178 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 149/307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:40 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:41.139205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:41.145330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:41.176486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:41.176486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:41.176486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:41.176486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:41.177035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:41.177035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:41.631573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:41.645853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:41.652398 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-69a76804-3ac2-4f02-b35a-ed2f31840365 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.523573 Aug 29 15:26:41.657487 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 159/308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:41 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:42.082389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:42.083687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:42.093782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.095902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.097743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:42.100441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.101833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.102780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:42.678906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:42.679720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:42.682970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:42.698395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.700167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.700919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:42.706018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.707475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.708266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:42.833682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:42.864122 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-34d98272-263f-4072-8fec-88bad9c642a0 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1319 microversion: 2.1 time: 0.787123 Aug 29 15:26:42.883150 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 150/309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:42 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1319 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:43.226063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:43.240765 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f205f6c7-1167-4d5a-ae88-40729afde05a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.566260 Aug 29 15:26:43.241739 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 160/310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:42 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:43.908582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:43.909227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:43.916121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:43.916980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:43.917758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:43.918832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:43.919452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:43.920030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:44.112202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:44.121760 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6ec23e7e-1e13-4d97-a308-6be4d16ba595 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1319 microversion: 2.1 time: 0.218240 Aug 29 15:26:44.122872 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 151/311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:43 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:44.263608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:44.264480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:44.271929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:44.272497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:44.273091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:44.274047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:44.274677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:44.275289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:44.434169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:44.444149 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-318959e2-643b-4255-af08-8b576146109a tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.184473 Aug 29 15:26:44.444730 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 161/312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:44 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:44.931411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5df01836-b7a0-419a-ab49-7add237afb6a tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Action: 'create', calling method: .version_select at 0x7fb0e3d583a0>, body: {"keypair": {"name": "tempest-keypair-24633315", "type": "ssh", "user_id": "d82a2ce4c0e94e43b108755ebd7ccda0", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP++a7+ApwEVZ0ifiGUN9LFSFGSxtEYBIx3rNHvRn1gYhk1mswzXki8YA3nhnlJHSxxukMuZF49vyJoiQtD1CCX/U0wSahDSqEcgPdiB3KOuK020IE4ktemMp+r1gT8f/w=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:44.961925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5df01836-b7a0-419a-ab49-7add237afb6a tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Getting quotas for project 5c42d60b0db747d09e12fa554e0eb2e1. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:44.966625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5df01836-b7a0-419a-ab49-7add237afb6a tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Getting quotas for user f5757d8d8b35489984ab6cef2a165ce8 and project 5c42d60b0db747d09e12fa554e0eb2e1. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:45.003175 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5df01836-b7a0-419a-ab49-7add237afb6a tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.344141 Aug 29 15:26:45.004190 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 152/313] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:26:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 346 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:45.023064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-988a3743-2b30-4ac4-9738-80dc5d55bfa8 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Action: 'create', calling method: .version_select at 0x7fb0e3b9c790>, body: {"keypair": {"name": "tempest-keypair-1330781498", "type": "ssh", "user_id": "d82a2ce4c0e94e43b108755ebd7ccda0", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVV4iJS1ZHuX9TC6cQNDRbq/Nq3VhveJewt4VbGyeXc2rnkxkL6uNR4SW9xTg9HzDk8WMrG0I7fthpFT9tdBQpNxxGyeDlzD4Gtfex++4xyuvisO64j9XlTlpB6/MXg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:45.043869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=18 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:45.057101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8c6ed8f9-faec-479e-876b-aaa9e34759cd req-b9d3244f-bd4a-49fe-9515-9fd46e9db5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b0137e-91a4-4e5f-84e0-8f3bcee728b5", "name": "network-vif-plugged", "status": "completed", "tag": "86d3ed7c-9027-4a33-9504-05f078b3bda7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:45.079195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8c6ed8f9-faec-479e-876b-aaa9e34759cd req-b9d3244f-bd4a-49fe-9515-9fd46e9db5ff service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.079649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-988a3743-2b30-4ac4-9738-80dc5d55bfa8 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Getting quotas for project 5c42d60b0db747d09e12fa554e0eb2e1. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:45.081529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8c6ed8f9-faec-479e-876b-aaa9e34759cd req-b9d3244f-bd4a-49fe-9515-9fd46e9db5ff service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.082095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8c6ed8f9-faec-479e-876b-aaa9e34759cd req-b9d3244f-bd4a-49fe-9515-9fd46e9db5ff service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.092632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-988a3743-2b30-4ac4-9738-80dc5d55bfa8 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Getting quotas for user f5757d8d8b35489984ab6cef2a165ce8 and project 5c42d60b0db747d09e12fa554e0eb2e1. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:45.120129 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8c6ed8f9-faec-479e-876b-aaa9e34759cd req-b9d3244f-bd4a-49fe-9515-9fd46e9db5ff service nova] Creating event network-vif-plugged:86d3ed7c-9027-4a33-9504-05f078b3bda7 for instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 on n-h1-854882-3 Aug 29 15:26:45.144494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-988a3743-2b30-4ac4-9738-80dc5d55bfa8 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.130639 Aug 29 15:26:45.146625 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8c6ed8f9-faec-479e-876b-aaa9e34759cd req-b9d3244f-bd4a-49fe-9515-9fd46e9db5ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095017 Aug 29 15:26:45.147364 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 162/314] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:26:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:45.162259 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 153/315] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:45.168774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.169335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1dcd0033-51b1-464e-8f17-d6418b3c3037 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Calling method '.version_select at 0x7fb0e3d6bf70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.169566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:45.184829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1dcd0033-51b1-464e-8f17-d6418b3c3037 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-24633315?user_id=d82a2ce4c0e94e43b108755ebd7ccda0" status: 200 len: 510 microversion: 2.10 time: 0.020936 Aug 29 15:26:45.186282 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 154/316] 10.222.0.16 () {60 vars in 1334 bytes} [Mon Aug 29 15:26:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-24633315?user_id=d82a2ce4c0e94e43b108755ebd7ccda0 => generated 510 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:45.186765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.187258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.187695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.188478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.188926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.189351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.222967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55343e6f-7266-49a1-b64a-543ea1808012 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Action: 'create', calling method: .version_select at 0x7fb0e3d58ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1677689144", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN06UQtQ71vIpdO2Tdyv1DwKB3fCqvpnSbcfYLstvHWLjwbvYKklvUNdOjYMwCeJsCh+nqBr8hAZ20IAVvMREycGz4EqUMsXtsTuV1QTozwsn3nRgrJ7F7ojTv2SNQjk7A=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:45.255579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55343e6f-7266-49a1-b64a-543ea1808012 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Getting quotas for project 5c42d60b0db747d09e12fa554e0eb2e1. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:45.262267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55343e6f-7266-49a1-b64a-543ea1808012 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Getting quotas for user f5757d8d8b35489984ab6cef2a165ce8 and project 5c42d60b0db747d09e12fa554e0eb2e1. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:45.296780 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55343e6f-7266-49a1-b64a-543ea1808012 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.095877 Aug 29 15:26:45.305452 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 155/317] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:26:45 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:26:45.310582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-67afb4ae-c460-4c26-bde0-9846db9b800c tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Calling method '.version_select at 0x7fb0e3d72310>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.316346 n-d-854882-3 devstack@n-api.service[130002]: WARNING oslo_db.sqlalchemy.utils [None req-67afb4ae-c460-4c26-bde0-9846db9b800c tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:26:45.324363 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-67afb4ae-c460-4c26-bde0-9846db9b800c tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=d82a2ce4c0e94e43b108755ebd7ccda0" status: 200 len: 724 microversion: 2.10 time: 0.017313 Aug 29 15:26:45.325980 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 156/318] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Aug 29 15:26:45 2022] GET /compute/v2.1/os-keypairs?user_id=d82a2ce4c0e94e43b108755ebd7ccda0 => generated 724 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:45.341607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ab7d5db-ab23-40f6-8eef-ef8f9990f214 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Calling method '.version_select at 0x7fb0e3d96a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.381052 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ab7d5db-ab23-40f6-8eef-ef8f9990f214 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1677689144" status: 204 len: 0 microversion: 2.10 time: 0.046123 Aug 29 15:26:45.382329 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 157/319] 10.222.0.16 () {60 vars in 1325 bytes} [Mon Aug 29 15:26:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1677689144 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:26:45.392559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31be1c67-990c-47cf-8e5a-3db0fc39198c tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Calling method '.version_select at 0x7fb0e3d1b4c0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.421032 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-31be1c67-990c-47cf-8e5a-3db0fc39198c tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330781498?user_id=d82a2ce4c0e94e43b108755ebd7ccda0" status: 204 len: 0 microversion: 2.10 time: 0.033716 Aug 29 15:26:45.422364 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 158/320] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:26:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330781498?user_id=d82a2ce4c0e94e43b108755ebd7ccda0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:26:45.433517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dfac59d9-4f3c-4db7-9320-9abe0d77a759 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] Calling method '.version_select at 0x7fb0e3d1b160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.468588 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dfac59d9-4f3c-4db7-9320-9abe0d77a759 tempest-KeyPairsV210TestJSON-234781269 tempest-KeyPairsV210TestJSON-234781269-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24633315?user_id=d82a2ce4c0e94e43b108755ebd7ccda0" status: 204 len: 0 microversion: 2.10 time: 0.040643 Aug 29 15:26:45.469416 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 159/321] 10.222.0.16 () {60 vars in 1337 bytes} [Mon Aug 29 15:26:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24633315?user_id=d82a2ce4c0e94e43b108755ebd7ccda0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:26:45.475251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.476717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:45.479917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:45.484036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.485013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.485800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.487099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.488052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.488430 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-de3efe9b-9f33-4533-8fbe-5bab17245b97 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1319 microversion: 2.1 time: 0.339627 Aug 29 15:26:45.489010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.489144 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:45 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:45.665551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:45.677078 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e928599f-a148-4d92-a4e7-7a948408db82 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.206015 Aug 29 15:26:45.678388 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 160/323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:45 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:46.512439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:46.513306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:46.518493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=28 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:46.540745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.545310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.550192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.551783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.556437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.558412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.713712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:46.715123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:46.722579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:46.727795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.732437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.744358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.745135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.745656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.746094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.747207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:47.037437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:47.047930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3cd1a16d-0e66-494e-833f-392e80d6d08e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1469 microversion: 2.1 time: 0.541234 Aug 29 15:26:47.048799 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 164/324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:46 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1469 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:47.070954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:47.073792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:47.091973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:47.095542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:47.096263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:47.099157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:47.099972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:47.101349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:47.193679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:47.212454 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-162f6983-6d2d-4f2e-975d-2b41334d9693 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.499766 Aug 29 15:26:47.226977 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 161/325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:46 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:47.252166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lazy-loading 'flavor' on Instance uuid 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:47.492379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-02a2e550-8152-45ac-ad8b-f622ba9728f6 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5/action" status: 202 len: 0 microversion: 2.1 time: 0.426088 Aug 29 15:26:47.499697 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 165/326] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:26:47 2022] POST /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:47.512584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:47.516341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:47.536121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:47.536979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:47.537675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:47.538636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:47.544191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:47.545053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:47.772869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:47.783806 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6bd8e3f1-f75f-41a1-a9c0-273d64e7eb3e tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1477 microversion: 2.1 time: 0.282370 Aug 29 15:26:47.798554 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 166/327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:47 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:47.807004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-64bdae52-e45b-4aa6-abb8-93b2a23685ad req-57bb9579-72a4-4409-bd0f-0fc4c7f21443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d54e4a-0817-4af1-88b7-43e70fd9b411", "name": "network-vif-plugged", "status": "completed", "tag": "3c17d59f-dacb-4090-9c1e-6079d9a44e51"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:47.822430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-64bdae52-e45b-4aa6-abb8-93b2a23685ad req-57bb9579-72a4-4409-bd0f-0fc4c7f21443 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:47.823104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-64bdae52-e45b-4aa6-abb8-93b2a23685ad req-57bb9579-72a4-4409-bd0f-0fc4c7f21443 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:47.823773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-64bdae52-e45b-4aa6-abb8-93b2a23685ad req-57bb9579-72a4-4409-bd0f-0fc4c7f21443 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:47.842551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-64bdae52-e45b-4aa6-abb8-93b2a23685ad req-57bb9579-72a4-4409-bd0f-0fc4c7f21443 service nova] Creating event network-vif-plugged:3c17d59f-dacb-4090-9c1e-6079d9a44e51 for instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 on n-h1-854882-3 Aug 29 15:26:47.856451 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-64bdae52-e45b-4aa6-abb8-93b2a23685ad req-57bb9579-72a4-4409-bd0f-0fc4c7f21443 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054951 Aug 29 15:26:47.859637 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 167/328] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:48.150121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-caf57f69-30d7-47a1-8280-b63fb9ae6ac6 tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:48.169687 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-caf57f69-30d7-47a1-8280-b63fb9ae6ac6 tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.820006 Aug 29 15:26:48.176447 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 162/329] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:48.251294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:48.258393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:48.293611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.297306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.303889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.305746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.309675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.314051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.720140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:48.744154 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e662ba3a-dd84-47cd-8442-726fcc78e510 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1322 microversion: 2.1 time: 0.502563 Aug 29 15:26:48.746340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 168/330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:48 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:48.807643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:48.808770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:48.823184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.825065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.832361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.833638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.835173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.838072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.784931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:49.785589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:49.806044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.807138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.808049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.809095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.809820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.810512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.077840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.097006 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c2c190ac-98aa-4bd5-945c-4ccc5f5fb271 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1460 microversion: 2.1 time: 1.294622 Aug 29 15:26:50.097950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 163/331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:48 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1460 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:50.313777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:50.318136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.324069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.324923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.325953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.326695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.327378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.361500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.369119 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23c49490-42d9-4860-b6a3-804f6c616666 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.268661 Aug 29 15:26:50.377023 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 164/332] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:50 2022] GET /compute/v2.1/os-services => generated 944 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:50.377223 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8cf7843-6792-469f-a30e-7fce71f7a1c6 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1470 microversion: 2.1 time: 0.594266 Aug 29 15:26:50.377359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:50.377359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:50.392789 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 169/333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:49 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1470 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:50.394014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.394741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.395432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.396928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.397755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.398641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.401858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01e44969-a6d0-4ccf-a28a-ade7f8e9096a tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-669092663", "imageRef": "cf3acc38-758e-4ce1-998b-991b374cadce", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:50.520944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-01e44969-a6d0-4ccf-a28a-ade7f8e9096a tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:51.164575 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-01e44969-a6d0-4ccf-a28a-ade7f8e9096a tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01e44969-a6d0-4ccf-a28a-ade7f8e9096a tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] Request method failure captured: Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 142 Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNq33QUmjtmlTgAQibUjAYsgGOE2O9l9T3YKboSozt2ybcS6t3WS3HTaKlYQdloEaRLHncuKDdPFhBuZ-Gwrhc2T8ZgKTozNVCapH0ahVoPtG71F1ed4ERpDR2PHRjwM2-vGd3PzTKXSs2sfIiuV-nSdpjGPy-4t6AhqW0KsbVzJy1o Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: b38d842b03e34a2d915ec77e3143a45e Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FlavorsV2NegativeTest-305591152 Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:51.169044 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b38d842b03e34a2d915ec77e3143a45e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b38d842b03e34a2d915ec77e3143a45e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b38d842b03e34a2d915ec77e3143a45e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b38d842b03e34a2d915ec77e3143a45e"}]}] Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FlavorsV2NegativeTest-305591152 Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: b38d842b03e34a2d915ec77e3143a45e Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-305591152 Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FlavorsV2NegativeTest-305591152-project Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 379f5eb5bbd14591a1ea3c2126b13563 Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FlavorsV2NegativeTest-305591152-project Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-669092663", "imageRef": "cf3acc38-758e-4ce1-998b-991b374cadce", "flavorRef": "452"}} Aug 29 15:26:51.170552 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: exception: Flavor's memory is too small for requested image. Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-669092663', 'imageRef': 'cf3acc38-758e-4ce1-998b-991b374cadce', 'flavorRef': '452'}}} Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:51.171379 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.172671 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01e44969-a6d0-4ccf-a28a-ade7f8e9096a tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:51.174035 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-01e44969-a6d0-4ccf-a28a-ade7f8e9096a tempest-FlavorsV2NegativeTest-305591152 tempest-FlavorsV2NegativeTest-305591152-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.779619 Aug 29 15:26:51.176674 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 170/334] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:50 2022] POST /compute/v2.1/servers => generated 93 bytes in 783 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:51.196924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.205461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.207253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.220916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.223565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.225816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.233335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.361274 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-028571f5-e836-4b06-9469-c473ad23cf31 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.178217 Aug 29 15:26:51.363649 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 171/335] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:51.376197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.378419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:51.391554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.392436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.393212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.399318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.400093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.401900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.459655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Request method failure captured: Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411/diagnostics HTTP/1.1 Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqkKxli8xHSngI0j0pajym6LsQXf5NJZugSkOa-sj64kaJrWMcD9InDzpGn_T1CwInCBg6RdCi02r-jFpWA42-AeKbh8qku9edAHuy3bo_c0Fhli6QKPrUo8FbDF3_WtArwCVpzGnMZUTStJBqz_daUhjtxPgbD3OuvmwyUhrD0HFU Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8c8b592ba7bb42b0b875db6065b0929c Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1639625612 Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:51.463607 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c8b592ba7bb42b0b875db6065b0929c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c8b592ba7bb42b0b875db6065b0929c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c8b592ba7bb42b0b875db6065b0929c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c8b592ba7bb42b0b875db6065b0929c"}]}] Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1639625612 Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8c8b592ba7bb42b0b875db6065b0929c Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1639625612 Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiagnosticsNegativeTest-1639625612-project Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b15e02211d3e4253a2edba6e63425ca7 Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1639625612-project Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:51.464834 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': 'c1d54e4a-0817-4af1-88b7-43e70fd9b411'} Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:51.465646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:26:51.467191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:51.471302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:51.473905 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d1d9cd2-0fcb-4cd8-abf6-5dd6df8c815c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.107140 Aug 29 15:26:51.475954 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 172/336] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411/diagnostics => generated 117 bytes in 111 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:51.482815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.495264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.499417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.500847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.503663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.504286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.504888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.573093 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d7fed548-e51e-49ee-b897-6cf6585ecc48 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.095859 Aug 29 15:26:51.574384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 173/337] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:51.588578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.589073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:51.608371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.608860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.613516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.615263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.617737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.620293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.672981 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-07982272-7822-4f76-b755-fa93ff295d86 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1611 microversion: 2.1 time: 1.300929 Aug 29 15:26:51.673672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 165/338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:50 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1611 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:51.691888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.693527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:26:51.696792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.696792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.696792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.718003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.718500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.718971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.786100 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b74aa835-9aa8-4dd5-b869-28125d283058 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-854882-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.111401 Aug 29 15:26:51.803463 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 166/339] 10.222.0.16 () {58 vars in 1194 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/os-services?host=n-d-854882-3&binary=xxx => generated 16 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:51.808256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.822478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.822973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.823574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.824144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.824601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.825044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.880967 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6eca4d14-f2f4-455d-830d-b1e52b5aae5c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 204 len: 0 microversion: 2.1 time: 0.304041 Aug 29 15:26:51.885663 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 174/340] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:51 2022] DELETE /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:51.892465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.896958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.898058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.898696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.905678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.906949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.907614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.924439 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac4e412f-c1de-4d0e-a7fd-0c148756bc61 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.119543 Aug 29 15:26:51.928672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 167/341] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:51.938610 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef3b6703-55c7-4dda-92e5-d304f8749fdf tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050019 Aug 29 15:26:51.941213 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 175/342] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:51.941697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.943080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:51.947197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854882-3", "block_migration": true, "disk_over_commit": false}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:51.951341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.951748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:51.951943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.953684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.955060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.956636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.957448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.961157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.961799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.962455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.963435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.964533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.965252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.465653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Lazy-loading 'flavor' on Instance uuid 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:52.487967 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 while it is in vm_state suspended Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Request method failure captured: Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5/action HTTP/1.1 Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 97 Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqRiRg95aXXq4k0FJnr7mGv7LWeqFOFERXokug0TePtyo7XU57T7XonjhzIQ0vywyfXNEPWKfz_ABJIER_LwapFRx4K4FLtYRtSnCfD51jfk6WKIbKIT0BNTQWaK88GO5sBNQATmNZGW_LH1j8xfbyH8_aeXeJaDJufdStIHQZ6dHE Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 31f2208094e3493690a0cf3e6f17bf9c Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-LiveMigrationNegativeTest-1830485061 Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:26:52.493254 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31f2208094e3493690a0cf3e6f17bf9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31f2208094e3493690a0cf3e6f17bf9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31f2208094e3493690a0cf3e6f17bf9c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31f2208094e3493690a0cf3e6f17bf9c"}]}] Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-LiveMigrationNegativeTest-1830485061 Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 31f2208094e3493690a0cf3e6f17bf9c Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1830485061 Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-LiveMigrationNegativeTest-1830485061-project-admin Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 926654a9e5524c8299925b6a648409a9 Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-LiveMigrationNegativeTest-1830485061-project-admin Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: {"os-migrateLive": {"host": "n-h2-854882-3", "block_migration": true, "disk_over_commit": false}} Aug 29 15:26:52.494772 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot 'os-migrateLive' instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 while it is in vm_state suspended Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '67b0137e-91a4-4e5f-84e0-8f3bcee728b5', 'body': {'os-migrateLive': {'host': 'n-h2-854882-3', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:26:52.496007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:52.497939 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 while it is in vm_state suspended Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 while it is in vm_state suspended Aug 29 15:26:52.499038 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:52.500133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.503389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 while it is in vm_state suspended {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:52.504644 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a6aaece-7c42-481c-87f7-f2b452d6cf06 tempest-LiveMigrationNegativeTest-1830485061 tempest-LiveMigrationNegativeTest-1830485061-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5/action" status: 409 len: 155 microversion: 2.1 time: 0.561817 Aug 29 15:26:52.505729 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 176/343] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:26:51 2022] POST /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5/action => generated 155 bytes in 564 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:52.511662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:52.512126 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c119407c-18ac-427c-8d51-403cbf05575d tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1476 microversion: 2.1 time: 0.578947 Aug 29 15:26:52.512719 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 168/344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1476 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:52.518321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.519264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.519927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.521146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.521835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.523033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.524389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:52.528523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:52.543134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.543821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.544247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.554048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.554880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.558541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.608208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4128d402-d50b-4b53-b0ab-9777a0597803 tempest-ServicesAdminNegativeTestJSON-562899233 tempest-ServicesAdminNegativeTestJSON-562899233-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.100873 Aug 29 15:26:52.612119 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 177/345] 10.222.0.16 () {58 vars in 1198 bytes} [Mon Aug 29 15:26:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:52.622332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:26:52.942238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21baf8c6-53e4-4c19-877a-3891e9c1b4cd tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "DELETE /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 204 len: 0 microversion: 2.1 time: 0.428004 Aug 29 15:26:52.942707 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 169/346] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:52 2022] DELETE /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:52.953948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:52.955770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:52.962801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.964170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.964770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.965698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.966301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.966862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.001975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23c788ee-d273-4763-a1c6-acf4bcb60bba tempest-ServicesAdminNegativeTestJSON-1932043139 tempest-ServicesAdminNegativeTestJSON-1932043139-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:53.006268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-23c788ee-d273-4763-a1c6-acf4bcb60bba tempest-ServicesAdminNegativeTestJSON-1932043139 tempest-ServicesAdminNegativeTestJSON-1932043139-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '115d32baeb934185992b0753fbdd8e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708c977c6404a1b918d9029810f2e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23c788ee-d273-4763-a1c6-acf4bcb60bba tempest-ServicesAdminNegativeTestJSON-1932043139 tempest-ServicesAdminNegativeTestJSON-1932043139-project] Request method failure captured: Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNq25hwY3et3OxSyzIsuMYEjstZms_ntA9ZCfITWvUmsD4cMG1AQFtspMEgIbbUtP7t03hHsJX3InN6r-YgX7kT31Xd_UYT6iP8dMwFDwSaynaVvg070xhkXSl02WiQdrgt6oIi8mYz5eK2eecomEMIzdDII3agtDhLFPCjgqXfTIsg Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 1708c977c6404a1b918d9029810f2e5a Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1932043139 Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:53.012011 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1708c977c6404a1b918d9029810f2e5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1708c977c6404a1b918d9029810f2e5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1708c977c6404a1b918d9029810f2e5a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1708c977c6404a1b918d9029810f2e5a"}]}] Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1932043139 Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 1708c977c6404a1b918d9029810f2e5a Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1932043139 Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServicesAdminNegativeTestJSON-1932043139-project Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 115d32baeb934185992b0753fbdd8e8e Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1932043139-project Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:26:53.013835 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:53.015221 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:26:53.017122 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:53.023141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23c788ee-d273-4763-a1c6-acf4bcb60bba tempest-ServicesAdminNegativeTestJSON-1932043139 tempest-ServicesAdminNegativeTestJSON-1932043139-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:53.024308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-23c788ee-d273-4763-a1c6-acf4bcb60bba tempest-ServicesAdminNegativeTestJSON-1932043139 tempest-ServicesAdminNegativeTestJSON-1932043139-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.405649 Aug 29 15:26:53.027162 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 178/347] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 410 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:53.319192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:53.330912 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86d2a739-3a6a-45d3-b715-c384d7196fe7 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1466 microversion: 2.1 time: 0.381163 Aug 29 15:26:53.333573 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 170/348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:52 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1466 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:53.537753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:53.539099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:53.547763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.548558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.549197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.550129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.550940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.551560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:54.352367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:54.353768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:54.367032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:54.367787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:54.368489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:54.370184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:54.370962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:54.371555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:54.553748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:54.557459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:54.563576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bbc07f7a-3004-4161-9840-2bf149042aa8 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1476 microversion: 2.1 time: 1.029704 Aug 29 15:26:54.563989 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 179/349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:53 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1476 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:54.901119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:54.916622 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df0241bf-ef05-42a1-a106-6adca8fde1a5 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1466 microversion: 2.1 time: 0.568150 Aug 29 15:26:54.918380 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 171/350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:54 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1466 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:55.584993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:55.585555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:55.588802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:55.611943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.613036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.613738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.614703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.617049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.617746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.939993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:55.940615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:55.943364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=32 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:55.960872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.961720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.961881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.966826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.967429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.967899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.202631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.220335 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8f55f852-c10c-4aa7-b5c1-73e154ce14a9 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 200 len: 1424 microversion: 2.1 time: 0.281721 Aug 29 15:26:56.236492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 172/351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:55 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 1424 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:56.249180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-013a59dd-788d-4f4b-b140-4ba0750a6346 req-04f42842-d5b6-49af-8099-22d5bcb009e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b0137e-91a4-4e5f-84e0-8f3bcee728b5", "name": "network-vif-deleted", "tag": "86d3ed7c-9027-4a33-9504-05f078b3bda7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:56.290811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-013a59dd-788d-4f4b-b140-4ba0750a6346 req-04f42842-d5b6-49af-8099-22d5bcb009e4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.291307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-013a59dd-788d-4f4b-b140-4ba0750a6346 req-04f42842-d5b6-49af-8099-22d5bcb009e4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.291741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-013a59dd-788d-4f4b-b140-4ba0750a6346 req-04f42842-d5b6-49af-8099-22d5bcb009e4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.339689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-013a59dd-788d-4f4b-b140-4ba0750a6346 req-04f42842-d5b6-49af-8099-22d5bcb009e4 service nova] Creating event network-vif-deleted:86d3ed7c-9027-4a33-9504-05f078b3bda7 for instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 on n-h1-854882-3 Aug 29 15:26:56.362518 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-013a59dd-788d-4f4b-b140-4ba0750a6346 req-04f42842-d5b6-49af-8099-22d5bcb009e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123795 Aug 29 15:26:56.363070 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 173/352] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:57.115287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:57.157505 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5022cffc-2ea4-4e0c-add5-f9cf0d04fd2c tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1476 microversion: 2.1 time: 1.573195 Aug 29 15:26:57.160429 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 180/353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:55 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1476 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:57.243286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:57.244083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: 67b0137e-91a4-4e5f-84e0-8f3bcee728b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:57.267063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.267876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.268507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.274222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.275132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.275789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.354490 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] HTTP exception thrown: Instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 could not be found. Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Request method failure captured: Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 HTTP/1.1 Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqOXzoybDyL9K-X_YSeDYMiBj6L5y-fAN17ndj4N6Ylcu7PSzSAlYsvdNYtRTGXSNlCu65mLGrKs_T34omBE2MOXo-522p0mcNPAnWdnwKER9OIcUmjViovIGWKJm_PKyS_5Efbsxk4OLGFvF_tHsuYjVBf7FUsqO5ZQUFmRLh-guc Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: cacd3a8ccc674a0ab775b2aa20ec08ec Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveMigrationNegativeTest-1463741979 Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:26:57.357549 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cacd3a8ccc674a0ab775b2aa20ec08ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cacd3a8ccc674a0ab775b2aa20ec08ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cacd3a8ccc674a0ab775b2aa20ec08ec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cacd3a8ccc674a0ab775b2aa20ec08ec"}]}] Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveMigrationNegativeTest-1463741979 Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: cacd3a8ccc674a0ab775b2aa20ec08ec Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1463741979 Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveMigrationNegativeTest-1463741979-project Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0e05f5de07aa4189bc933dd2a5fb0205 Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveMigrationNegativeTest-1463741979-project Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 could not be found. Aug 29 15:26:57.358872 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '67b0137e-91a4-4e5f-84e0-8f3bcee728b5'} Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 could not be found. Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:57.359647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 could not be found. Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 could not be found. Aug 29 15:26:57.360876 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:26:57.364882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Returning 404 to user: Instance 67b0137e-91a4-4e5f-84e0-8f3bcee728b5 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:57.366251 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c7fe7536-ab76-4d04-b53c-7bd796a1efaf tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5" status: 404 len: 111 microversion: 2.1 time: 0.127998 Aug 29 15:26:57.373824 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 174/354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:57 2022] GET /compute/v2.1/servers/67b0137e-91a4-4e5f-84e0-8f3bcee728b5 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:57.380388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:57.380995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:57.394183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.395071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.396050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.397328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.398401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.399394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.511826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:26:57.712371 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7c49d5d-8c41-4f43-bf81-df71e8d6e143 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 204 len: 0 microversion: 2.1 time: 0.339109 Aug 29 15:26:57.713708 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 181/355] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:57 2022] DELETE /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:57.722956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:57.723955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:57.743285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.744354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.745010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.745989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.746699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.747345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.121448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5ce89c6f-f7d8-4ed0-ae18-90f18c9d26b6 req-d0172502-a719-433c-866b-dafe5305e212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d54e4a-0817-4af1-88b7-43e70fd9b411", "name": "network-vif-deleted", "tag": "3c17d59f-dacb-4090-9c1e-6079d9a44e51"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:58.150669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ce89c6f-f7d8-4ed0-ae18-90f18c9d26b6 req-d0172502-a719-433c-866b-dafe5305e212 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.151408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ce89c6f-f7d8-4ed0-ae18-90f18c9d26b6 req-d0172502-a719-433c-866b-dafe5305e212 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.151999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ce89c6f-f7d8-4ed0-ae18-90f18c9d26b6 req-d0172502-a719-433c-866b-dafe5305e212 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.172294 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5ce89c6f-f7d8-4ed0-ae18-90f18c9d26b6 req-d0172502-a719-433c-866b-dafe5305e212 service nova] Creating event network-vif-deleted:3c17d59f-dacb-4090-9c1e-6079d9a44e51 for instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 on n-h1-854882-3 Aug 29 15:26:58.199078 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5ce89c6f-f7d8-4ed0-ae18-90f18c9d26b6 req-d0172502-a719-433c-866b-dafe5305e212 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082142 Aug 29 15:26:58.204520 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 182/356] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:58.232818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:58.234331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:58.259711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.260580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.267519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.269087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.270050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.270803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.315060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:58.326362 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-607c1f51-d0c9-477f-9e98-e583b943805b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1475 microversion: 2.1 time: 0.608316 Aug 29 15:26:58.329740 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 175/357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:57 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1475 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:58.368241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.370379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.372514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.373533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lazy-loading 'fault' on Instance uuid c1d54e4a-0817-4af1-88b7-43e70fd9b411 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:58.661742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15e02211d3e4253a2edba6e63425ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8b592ba7bb42b0b875db6065b0929c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:58.679205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5abefde-08b9-4f09-89cb-27540ea37986 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 200 len: 1312 microversion: 2.1 time: 0.471126 Aug 29 15:26:58.704454 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 183/358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:58 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:59.354649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:59.357052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:59.368550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.370463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.371365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.372362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.373158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.375238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.722056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:59.723305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] [instance: c1d54e4a-0817-4af1-88b7-43e70fd9b411] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:59.748041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.753770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.756272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.758781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.759278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.762660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.810918 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] HTTP exception thrown: Instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 could not be found. Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Request method failure captured: Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 HTTP/1.1 Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNqkKxli8xHSngI0j0pajym6LsQXf5NJZugSkOa-sj64kaJrWMcD9InDzpGn_T1CwInCBg6RdCi02r-jFpWA42-AeKbh8qku9edAHuy3bo_c0Fhli6QKPrUo8FbDF3_WtArwCVpzGnMZUTStJBqz_daUhjtxPgbD3OuvmwyUhrD0HFU Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8c8b592ba7bb42b0b875db6065b0929c Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1639625612 Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:26:59.818153 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c8b592ba7bb42b0b875db6065b0929c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c8b592ba7bb42b0b875db6065b0929c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c8b592ba7bb42b0b875db6065b0929c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c8b592ba7bb42b0b875db6065b0929c"}]}] Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1639625612 Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8c8b592ba7bb42b0b875db6065b0929c Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1639625612 Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiagnosticsNegativeTest-1639625612-project Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b15e02211d3e4253a2edba6e63425ca7 Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1639625612-project Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 could not be found. Aug 29 15:26:59.819477 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'c1d54e4a-0817-4af1-88b7-43e70fd9b411'} Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 could not be found. Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:59.820176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 could not be found. Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 could not be found. Aug 29 15:26:59.821307 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:26:59.823869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] Returning 404 to user: Instance c1d54e4a-0817-4af1-88b7-43e70fd9b411 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:59.824973 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d4d1205c-ee80-4e8f-8567-4393f1ecd248 tempest-ServerDiagnosticsNegativeTest-1639625612 tempest-ServerDiagnosticsNegativeTest-1639625612-project] 10.222.0.16 "GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411" status: 404 len: 111 microversion: 2.1 time: 0.123124 Aug 29 15:26:59.829759 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 184/359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:59 2022] GET /compute/v2.1/servers/c1d54e4a-0817-4af1-88b7-43e70fd9b411 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:27:00.097796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:00.128037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:00.143624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-244f9a48-19dd-4968-b893-81033673fc7d tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1475 microversion: 2.1 time: 0.793229 Aug 29 15:27:00.145198 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 176/360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:59 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1475 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:01.170549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:01.172008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:01.186176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.189327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.190245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.191928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.196203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.196853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:02.147005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:02.166746 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be20ef82-beed-4a4d-985d-d9306e30bf26 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1475 microversion: 2.1 time: 1.001308 Aug 29 15:27:02.170913 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 185/361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:01 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1475 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:03.197360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:03.198671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:03.221126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:03.234801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.236505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.237926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.241835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.242884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.244313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.466407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e05f5de07aa4189bc933dd2a5fb0205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:03.484321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-aa4792b3-b2f1-4766-af48-d94438d07c4b req-b5105267-bdad-4606-b473-5ebd3a9452f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bddff370-d4f6-46ff-817c-7fa6683f3e9d", "name": "network-vif-deleted", "tag": "c8a1a0d7-7c42-4842-a1f0-12b511476d80"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:03.494491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e1643fa3-3207-4d88-b611-dba5b4dfb934 tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 200 len: 1433 microversion: 2.1 time: 0.301969 Aug 29 15:27:03.499541 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 177/362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:03 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 1433 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:03.505250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:03.508445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa4792b3-b2f1-4766-af48-d94438d07c4b req-b5105267-bdad-4606-b473-5ebd3a9452f2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.509102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa4792b3-b2f1-4766-af48-d94438d07c4b req-b5105267-bdad-4606-b473-5ebd3a9452f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.520763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa4792b3-b2f1-4766-af48-d94438d07c4b req-b5105267-bdad-4606-b473-5ebd3a9452f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.565814 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-aa4792b3-b2f1-4766-af48-d94438d07c4b req-b5105267-bdad-4606-b473-5ebd3a9452f2 service nova] Creating event network-vif-deleted:c8a1a0d7-7c42-4842-a1f0-12b511476d80 for instance bddff370-d4f6-46ff-817c-7fa6683f3e9d on n-h2-854882-3 Aug 29 15:27:03.581928 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-aa4792b3-b2f1-4766-af48-d94438d07c4b req-b5105267-bdad-4606-b473-5ebd3a9452f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100327 Aug 29 15:27:03.583780 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 186/363] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:27:04.520725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:04.521373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] [instance: bddff370-d4f6-46ff-817c-7fa6683f3e9d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:04.534943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.538589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.539248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.543035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.544889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.544889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.587366 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] HTTP exception thrown: Instance bddff370-d4f6-46ff-817c-7fa6683f3e9d could not be found. Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Request method failure captured: Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d HTTP/1.1 Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNqOXzoybDyL9K-X_YSeDYMiBj6L5y-fAN17ndj4N6Ylcu7PSzSAlYsvdNYtRTGXSNlCu65mLGrKs_T34omBE2MOXo-522p0mcNPAnWdnwKER9OIcUmjViovIGWKJm_PKyS_5Efbsxk4OLGFvF_tHsuYjVBf7FUsqO5ZQUFmRLh-guc Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: cacd3a8ccc674a0ab775b2aa20ec08ec Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveMigrationNegativeTest-1463741979 Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:27:04.594834 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cacd3a8ccc674a0ab775b2aa20ec08ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cacd3a8ccc674a0ab775b2aa20ec08ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cacd3a8ccc674a0ab775b2aa20ec08ec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cacd3a8ccc674a0ab775b2aa20ec08ec"}]}] Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveMigrationNegativeTest-1463741979 Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: cacd3a8ccc674a0ab775b2aa20ec08ec Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1463741979 Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveMigrationNegativeTest-1463741979-project Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0e05f5de07aa4189bc933dd2a5fb0205 Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveMigrationNegativeTest-1463741979-project Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance bddff370-d4f6-46ff-817c-7fa6683f3e9d could not be found. Aug 29 15:27:04.596338 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'bddff370-d4f6-46ff-817c-7fa6683f3e9d'} Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bddff370-d4f6-46ff-817c-7fa6683f3e9d could not be found. Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:04.597061 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bddff370-d4f6-46ff-817c-7fa6683f3e9d could not be found. Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bddff370-d4f6-46ff-817c-7fa6683f3e9d could not be found. Aug 29 15:27:04.598428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.601743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] Returning 404 to user: Instance bddff370-d4f6-46ff-817c-7fa6683f3e9d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:04.605317 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a98e2fa-354e-4fca-85b7-23037159618b tempest-LiveMigrationNegativeTest-1463741979 tempest-LiveMigrationNegativeTest-1463741979-project] 10.222.0.16 "GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d" status: 404 len: 111 microversion: 2.1 time: 0.087335 Aug 29 15:27:04.607789 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 178/364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:04 2022] GET /compute/v2.1/servers/bddff370-d4f6-46ff-817c-7fa6683f3e9d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:09.518768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9333f95f-0631-4188-9343-781f7f564e14 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.548230 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9333f95f-0631-4188-9343-781f7f564e14 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.360436 Aug 29 15:27:09.553443 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 187/365] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:09.567605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2bcb4649-79b8-4b7b-918c-03bf35889adb tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.607660 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2bcb4649-79b8-4b7b-918c-03bf35889adb tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.044558 Aug 29 15:27:09.609091 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 179/366] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:09.626175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-734f19c2-038e-468b-b4f0-8a458eb90934 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.651728 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-734f19c2-038e-468b-b4f0-8a458eb90934 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027580 Aug 29 15:27:09.652279 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 188/367] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:09.666626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dedf480a-dc32-40c3-84ed-7e862ba983e1 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.688795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dedf480a-dc32-40c3-84ed-7e862ba983e1 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026108 Aug 29 15:27:09.704722 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 180/368] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:09.733007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb060599-4c09-495d-88a0-f136acd23f87 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.832676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb060599-4c09-495d-88a0-f136acd23f87 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.109125 Aug 29 15:27:09.833585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 189/369] 10.222.0.16 () {58 vars in 1165 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:09.853850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-45387bce-9ffe-4e27-b2ec-bb0cf8cf2b0c tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.865804 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-45387bce-9ffe-4e27-b2ec-bb0cf8cf2b0c tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016119 Aug 29 15:27:09.873831 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 181/370] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:09.885348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3e48609-0d75-4a40-a79d-f1f19442d12b tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.948734 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3e48609-0d75-4a40-a79d-f1f19442d12b tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.067116 Aug 29 15:27:09.962189 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 190/371] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:09.978123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-226741a8-974b-4a7d-a09c-c97b91346e63 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.006525 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-226741a8-974b-4a7d-a09c-c97b91346e63 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032231 Aug 29 15:27:10.007583 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 182/372] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:10.022033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a4b104dd-5f93-48b7-864e-b4da3ed67fe5 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.040007 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a4b104dd-5f93-48b7-864e-b4da3ed67fe5 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021697 Aug 29 15:27:10.041813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 191/373] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:10.059370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0dd61399-b467-4784-9b7b-197dc0725bc5 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.150532 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0dd61399-b467-4784-9b7b-197dc0725bc5 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.095560 Aug 29 15:27:10.156864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 183/374] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:10.171320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5325a7a-8f48-4083-a3e1-86094d5e34c4 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.186985 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5325a7a-8f48-4083-a3e1-86094d5e34c4 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019988 Aug 29 15:27:10.204591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d37bd67-faac-4003-9402-f60570c932e7 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.210290 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 192/375] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:10.262061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d37bd67-faac-4003-9402-f60570c932e7 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.062011 Aug 29 15:27:10.274849 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 184/376] 10.222.0.16 () {58 vars in 1144 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:10.277702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b857f0f-38e7-4f50-b31c-66382ea948bc tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.292886 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b857f0f-38e7-4f50-b31c-66382ea948bc tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019701 Aug 29 15:27:10.297263 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 193/377] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:27:10.311229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56ea76a8-7211-444f-b9f1-030cef980035 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.379257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56ea76a8-7211-444f-b9f1-030cef980035 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.070640 Aug 29 15:27:10.379913 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 185/378] 10.222.0.16 () {58 vars in 1148 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:10.397165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b9d36f57-51cf-467d-b45d-fb3860050464 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.443187 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b9d36f57-51cf-467d-b45d-fb3860050464 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.051408 Aug 29 15:27:10.451070 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 194/379] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:10.459406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fadf5926-c8c5-4783-9fff-6bda03fadb6a tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.473336 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fadf5926-c8c5-4783-9fff-6bda03fadb6a tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021307 Aug 29 15:27:10.482248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 186/380] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:10.487908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bb5fccc8-381b-4949-a1a3-4d134821e449 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.502713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:10.619972 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bb5fccc8-381b-4949-a1a3-4d134821e449 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.135773 Aug 29 15:27:10.624611 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 195/381] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:10.637628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9439a4b2-46c8-4022-96b0-b0bd0ed8e272 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.727060 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9439a4b2-46c8-4022-96b0-b0bd0ed8e272 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093338 Aug 29 15:27:10.727666 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 187/382] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:10.747824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d16d3b1b-0cb8-4ae4-a385-dfdc1568dcb0 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.762332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d16d3b1b-0cb8-4ae4-a385-dfdc1568dcb0 tempest-FlavorsV2TestJSON-471610614 tempest-FlavorsV2TestJSON-471610614-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018405 Aug 29 15:27:10.764569 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 196/383] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:14.587274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=9 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:14.594398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0994e121-7e0e-4880-ba9e-637a397f2cb4 tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] Calling method '.version_select at 0x7fb0e83510d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:14.674122 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0994e121-7e0e-4880-ba9e-637a397f2cb4 tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.865535 Aug 29 15:27:14.688145 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 188/384] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Aug 29 15:27:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:14.688363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c492b74a-fdfc-4c4a-b0b5-76273e90a664 tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3a15d30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:14.739751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:15.506191 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c492b74a-fdfc-4c4a-b0b5-76273e90a664 tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.822354 Aug 29 15:27:15.530332 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 197/385] 10.222.0.16 () {60 vars in 1206 bytes} [Mon Aug 29 15:27:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:15.582716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a47677df-9787-4e12-a663-3225725e1854 tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] Calling method '.version_select at 0x7fb0e3d1b8b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:15.612157 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a47677df-9787-4e12-a663-3225725e1854 tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.053858 Aug 29 15:27:15.615265 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 189/386] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Aug 29 15:27:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:15.634641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfce4f9d-1315-4dfd-905d-5b5c9e62f8cc tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3c34af0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:16.026458 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cfce4f9d-1315-4dfd-905d-5b5c9e62f8cc tempest-QuotaClassesAdminTestJSON-652929461 tempest-QuotaClassesAdminTestJSON-652929461-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.397759 Aug 29 15:27:16.028165 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 198/387] 10.222.0.16 () {60 vars in 1206 bytes} [Mon Aug 29 15:27:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:25.591540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:25.607334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:25.934495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-717281038", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5bdccba5-6d96-4038-aca5-09236e5feac2"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:25.938220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:25.948494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:25.953916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:25.955773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:25.960729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:25.963523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:25.964173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:25.983603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=24,nova_api:INSERT=12 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:26.010425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=40,nova_cell0:UPDATE=12 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:26.052525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] validate_networks() for [('5bdccba5-6d96-4038-aca5-09236e5feac2', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:26.059780 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-94322766-6519-437a-bbff-c0afb7859c24 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.331237 Aug 29 15:27:26.069335 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 199/388] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:26.074572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:26.079922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.080420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.080857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.081788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.082252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.082676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.128986 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13bf9359-67e5-4516-b82f-74724a6ab109 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-854882-3" status: 200 len: 578 microversion: 2.1 time: 0.058264 Aug 29 15:27:26.139049 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 200/389] 10.222.0.16 () {58 vars in 1172 bytes} [Mon Aug 29 15:27:26 2022] GET /compute/v2.1/os-services?host=n-d-854882-3 => generated 578 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:26.145305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:26.150517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.151229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.151823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.152781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.153426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.154075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.192055 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75c69d30-eae1-4f9e-9d70-9fe7530f49ff tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050557 Aug 29 15:27:26.201140 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 201/390] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:27:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:26.207091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:26.214043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.214832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.215419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.216954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.217617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.218782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.254481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2eff42b-6dc1-44d7-b3ca-1710a8510e95 tempest-ServicesAdminTestJSON-1695467542 tempest-ServicesAdminTestJSON-1695467542-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051722 Aug 29 15:27:26.266314 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 202/391] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:29.634461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:29.635611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:29.638967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:29.639775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:29.641152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:29.660450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:29.661697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:29.662312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:29.664031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:29.664881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:29.665724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:29.697153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:29.707299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for user 7bd967d46f614bb4a187218498e934f3 and project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:29.728409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:29.732370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:29.839452 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ac5ca14-3b8a-4767-a694-c40da8c7d16f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.553091 Aug 29 15:27:29.846564 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 190/392] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:27:29.876068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fc41b384-9812-4cc8-a7ba-51be1461758d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:29.878385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fc41b384-9812-4cc8-a7ba-51be1461758d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:30.613745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fc41b384-9812-4cc8-a7ba-51be1461758d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:30.622449 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fc41b384-9812-4cc8-a7ba-51be1461758d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1224 microversion: 2.1 time: 0.766261 Aug 29 15:27:30.624880 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 203/393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:29 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1224 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:31.653328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:31.655405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:31.682387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:31.683196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:31.684912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:31.688346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:31.688854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:31.693833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:31.988882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4b703e9-dad2-4ac1-8cfb-b5fd68eaf87a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:32.031744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4b703e9-dad2-4ac1-8cfb-b5fd68eaf87a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.542693 Aug 29 15:27:32.036556 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 191/394] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:27:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:27:32.277144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e01d0c30-c9f4-47e8-bbce-c3925574d7bb tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-67629762", "id": 662348314, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:32.314485 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e01d0c30-c9f4-47e8-bbce-c3925574d7bb tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.266312 Aug 29 15:27:32.315703 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 192/395] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:32 2022] POST /compute/v2.1/flavors => generated 420 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:32.333953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdb7fb82-8724-4058-8f0c-d6ff117722aa tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:32.355391 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cdb7fb82-8724-4058-8f0c-d6ff117722aa tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030603 Aug 29 15:27:32.362101 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 193/396] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Aug 29 15:27:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:27:32.398211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31694970-098b-48b3-94fa-eaa87f78e23a tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1729583140", "id": 898622378, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:32.466978 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-31694970-098b-48b3-94fa-eaa87f78e23a tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.084555 Aug 29 15:27:32.469814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 194/397] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:32 2022] POST /compute/v2.1/flavors => generated 422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:32.481944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eed27232-fe86-459f-a965-ce1eb45d177e tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:32.525735 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eed27232-fe86-459f-a965-ce1eb45d177e tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.049952 Aug 29 15:27:32.544175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 195/398] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Aug 29 15:27:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:27:32.585006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96ab0285-0249-4f16-a24a-f73381e8b1a4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Action: 'create', calling method: .version_select at 0x7fb0e3b95820>, body: {"keypair": {"name": "tempest-keypair-85438069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcHPeuLn0eB714I9FWH9F2gLLggzA52XExjASLilC+2Zcs0pMYHqbfX2vmWCb38U1hgx3oZyT4QoEjN1n+2ytJbKTVshO6HkCP0hhiEJEqEWSQQR4gXjt8ktXeg0NPXVw=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:32.638859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-96ab0285-0249-4f16-a24a-f73381e8b1a4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Getting quotas for project 6e9ae755ad68447087da4df60c36c746. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:32.646075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:32.654154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-96ab0285-0249-4f16-a24a-f73381e8b1a4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Getting quotas for user 199c2a20a7e8425e8df281cfe251c880 and project 6e9ae755ad68447087da4df60c36c746. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:32.665689 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ba5083a-52d8-4249-bae6-b5600710c4de tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1276 microversion: 2.1 time: 1.020597 Aug 29 15:27:32.672267 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 204/399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:31 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1276 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:32.728379 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96ab0285-0249-4f16-a24a-f73381e8b1a4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.169125 Aug 29 15:27:32.729897 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 196/400] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:27:32 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:33.708569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:33.712522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:33.805019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:33.814035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:33.816135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:33.830833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:33.842615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:33.848211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:34.841742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:34.855774 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-38280eb8-0abe-4015-b2e4-c8c5f726fdb8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1282 microversion: 2.1 time: 1.161316 Aug 29 15:27:34.864823 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 205/401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:33 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1282 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:35.885839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:35.886558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:35.897301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.906710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.907884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.926421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.927506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.928219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.001501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:37.014420 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca3f69cc-2668-4383-b62d-f4acf264f5a9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1282 microversion: 2.1 time: 1.130898 Aug 29 15:27:37.019712 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 197/402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:35 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1282 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:37.772279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:38.040884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:38.042442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:38.057894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.062460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.065547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.071403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.071982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.076290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.097557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1815919651", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "00a380ce-71c2-4a78-a723-b1716b34e7c8"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:38.226195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] validate_networks() for [('00a380ce-71c2-4a78-a723-b1716b34e7c8', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:38.286052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:38.311041 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0cdeb4a2-84bd-44f9-8927-b5e851b8b445 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1282 microversion: 2.1 time: 0.275256 Aug 29 15:27:38.313160 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 198/403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:38 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:39.334360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:39.335067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:39.365027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.366441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.369273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.371598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.372421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.373138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.680854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:40.131264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:40.132417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:40.133066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:40.133671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:40.134308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:40.157135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.157654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.158098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.158865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.159330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.159754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.210615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Getting quotas for project f6f618c91ce540038aa1698ae84216d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:40.216612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Getting quotas for user ad54919d097f4a5eada522d696ced88b and project f6f618c91ce540038aa1698ae84216d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:40.272656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Going to run 3 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:40.275328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:40.349242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=40e7185f-0e71-4020-be99-78f0dd4069b6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:40.457584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=b741a8d1-dfab-4c4b-b3bb-8921608f0b92,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:40.634670 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-06da02a3-f5be-45c3-9987-2c0cf4a9fa18 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.888070 Aug 29 15:27:40.640966 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 206/404] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:27:40.641194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:40.652472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ed5037b-139d-4ec6-b66e-d90bb0a96fee tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 1.319900 Aug 29 15:27:40.653557 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 199/405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:39 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:40.667606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:40.687778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:40.690358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:27:40.759148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.759921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.760373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.761130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.767546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.768125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.800768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1578217876", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5ab8f307-77e2-4e82-973f-058294ab71aa"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:40.925823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] validate_networks() for [('5ab8f307-77e2-4e82-973f-058294ab71aa', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:40.957691 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-82463421-6ed0-47ed-bcfc-2d38ca17a78b tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.302481 Aug 29 15:27:40.959258 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 200/406] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:27:40 2022] GET /compute/v2.1/servers => generated 1018 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:40.973226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3801caaf-7712-4aca-af62-33fd34bcad53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:40.974215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3801caaf-7712-4aca-af62-33fd34bcad53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:41.211691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3801caaf-7712-4aca-af62-33fd34bcad53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:41.227148 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3801caaf-7712-4aca-af62-33fd34bcad53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1223 microversion: 2.1 time: 0.257664 Aug 29 15:27:41.229332 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 201/407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:40 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1223 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:41.701851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:41.703133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:41.733998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.736541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.741359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.742902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.745981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.747886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.463254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:42.478206 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b58e3e7b-10e3-4fa3-aaaf-1990fe9f10ad tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 0.786685 Aug 29 15:27:42.478805 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 202/408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:41 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:42.496071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e41fbd9-cdef-4b91-8c53-aa917f314dd9 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.496729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8e41fbd9-cdef-4b91-8c53-aa917f314dd9 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:42.720406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e41fbd9-cdef-4b91-8c53-aa917f314dd9 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:42.737658 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e41fbd9-cdef-4b91-8c53-aa917f314dd9 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1223 microversion: 2.1 time: 0.257521 Aug 29 15:27:42.742651 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 203/409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:42 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1223 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:43.519780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:43.520466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:43.545057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.548573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.552162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.556897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.561170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.565317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.856980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:43.858229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:43.858946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:43.859535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:43.860119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:43.896963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.899208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.902866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.908517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.913972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.914786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:44.028527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:44.043096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for user f331c1e3ee1442ad863d8909ca76020b and project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:44.083081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:44.090455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:44.230436 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-628b217e-e132-4a0e-acfd-eaab7f60b383 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.592555 Aug 29 15:27:44.232670 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 207/410] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:27:44.243407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:44.245482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:44.268932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.269946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.271023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:44.277605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.278758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.280641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.313291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:45.326286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97291c1f-a2f5-4703-abb9-38bfe9379f7d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1283 microversion: 2.1 time: 1.087606 Aug 29 15:27:45.326951 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 208/411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:44 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1283 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:45.344534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1254509114", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "898622378", "adminPass": "***", "networks": [{"uuid": "4172a6c2-ee06-4374-b572-6ae7a18ac735"}], "security_groups": [{"name": "tempest-securitygroup--1430668484"}], "key_name": "tempest-keypair-85438069", "user_data": "}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:46.710408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:46.727114 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7b7df903-22cc-4f83-b294-a7e07724c71a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 3.227198 Aug 29 15:27:46.727787 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 204/412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:43 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 3231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:46.758185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:46.759310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:46.776122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:46.776622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:46.777059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:46.777820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:46.781965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:46.782497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:46.925562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] validate_networks() for [('4172a6c2-ee06-4374-b572-6ae7a18ac735', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:47.278564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:47.293418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:47.296807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:47.306236 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2124268a-5ec2-4c71-b316-7a3fd7f809b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1320 microversion: 2.25 time: 0.560301 Aug 29 15:27:47.313165 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 205/413] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:46 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:47.336402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-41535673-ebf1-4495-8701-5c1f62afdd1f req-bb514d30-a859-4a79-abf7-1f815c4d7ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea96d7b0-2728-4dec-b28d-a85089376221", "tag": "64cc3a9c-9e24-469a-a6c2-0b9d9fcc0c4e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:47.360574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-41535673-ebf1-4495-8701-5c1f62afdd1f req-bb514d30-a859-4a79-abf7-1f815c4d7ee3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.361245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-41535673-ebf1-4495-8701-5c1f62afdd1f req-bb514d30-a859-4a79-abf7-1f815c4d7ee3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.361958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-41535673-ebf1-4495-8701-5c1f62afdd1f req-bb514d30-a859-4a79-abf7-1f815c4d7ee3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.391929 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-41535673-ebf1-4495-8701-5c1f62afdd1f req-bb514d30-a859-4a79-abf7-1f815c4d7ee3 service nova] Creating event network-changed:64cc3a9c-9e24-469a-a6c2-0b9d9fcc0c4e for instance ea96d7b0-2728-4dec-b28d-a85089376221 on n-h1-854882-3 Aug 29 15:27:47.400787 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-41535673-ebf1-4495-8701-5c1f62afdd1f req-bb514d30-a859-4a79-abf7-1f815c4d7ee3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086058 Aug 29 15:27:47.403782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 206/414] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:47.417569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:47.421564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:47.440653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.441484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.442194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.443592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.444248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.444884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.723843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:47.735734 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-352e6e24-2979-4cc2-8bae-7541fc03353c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1281 microversion: 2.1 time: 0.329487 Aug 29 15:27:47.738685 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 207/415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:47 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1281 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:47.756169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:47.759267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:47.778298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.783354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.786441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.787455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.788088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.790731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.656529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:48.668166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7b6de067-c799-4ff2-b2d0-2e9e091d8284 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 0.921913 Aug 29 15:27:48.692477 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 208/416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:47 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:48.704933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:48.705692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:48.720611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.721334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.721833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.725673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.726278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.726616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.929372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:48.938142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:48.940383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:48.941788 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f9eb532-643c-40a8-b61e-0ec27d14c257 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1320 microversion: 2.25 time: 0.246716 Aug 29 15:27:48.953873 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 209/417] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:48 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:48.963310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:48.964188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:48.971270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.972063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.972657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.973589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.974203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.974789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.070334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:49.078487 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9ea84dd-31aa-49d1-a8c9-71436a5e36d6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1281 microversion: 2.1 time: 0.119359 Aug 29 15:27:49.094717 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:48 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:49.689112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:49.689765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:49.717116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.717673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.718115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.718835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.721968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.722659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.909255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:49.910041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:49.910959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:49.912263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:49.912823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:49.937004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.943244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.944784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.946789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.949435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.950044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.015483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Getting quotas for project 6e9ae755ad68447087da4df60c36c746. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:50.029077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Getting quotas for user 199c2a20a7e8425e8df281cfe251c880 and project 6e9ae755ad68447087da4df60c36c746. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:50.063759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:50.070605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:50.193682 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2dbd29e8-d673-4628-a383-8d98a91ca1b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.865298 Aug 29 15:27:50.199918 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 209/419] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 4867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:27:50.418541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-733055dd-21a3-4843-9d50-f0d3249a918b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Action: 'create', calling method: .version_select at 0x7fb0e39644c0>, body: {"keypair": {"name": "tempest-keypair-826578100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdihcV8XPl7VBOUkw7V+gLiwZMcCqc0auanFP0OGGWdTKLXFSMrlqYgdzqMGcynrMikMMMZG9K4j+JXaqzkxf68GuhcCnsb0EuKbCa+fq962UiOFNVZUYcYmgyjGtzpWw=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:50.482006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-733055dd-21a3-4843-9d50-f0d3249a918b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Getting quotas for project 879d436e9d1a43ee8df0e652dbb6307a. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:50.493898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-733055dd-21a3-4843-9d50-f0d3249a918b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Getting quotas for user 1ff9744258414abeb64b442b0d295c1c and project 879d436e9d1a43ee8df0e652dbb6307a. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:50.556969 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-733055dd-21a3-4843-9d50-f0d3249a918b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.360929 Aug 29 15:27:50.558008 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 210/420] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:27:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:50.566533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:50.567416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:50.579203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.579839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.580423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.582262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.583537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.584182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.868610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:50.889265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:50.891858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:50.893565 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3228d663-f41e-4e62-a0cb-333d3987460b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1320 microversion: 2.25 time: 0.334227 Aug 29 15:27:50.894661 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 211/421] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:50 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:50.895119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:50.901114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:50.902317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:50.913505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:50.931504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.932054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.932561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.933474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.934006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.934521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.125552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:51.166154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7114faf8-1e8e-4692-8492-1d994d7a3766 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 1.481313 Aug 29 15:27:51.177095 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 211/422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:49 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:51.182236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:51.183018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:51.192953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.193911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.194644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.195718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.196450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.197227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.413014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:51.470736 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8970b669-c05b-4bae-b356-656350b1216d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1265 microversion: 2.1 time: 0.291980 Aug 29 15:27:51.476978 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 212/423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:51 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:51.534858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:51.547998 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a3166b0b-cad8-4899-aa87-5374a40a3efc tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1323 microversion: 2.1 time: 0.651265 Aug 29 15:27:51.549236 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 212/424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:50 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1323 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:51.924408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:51.925173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:51.967321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.979100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.979847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.980807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.981481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.982074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.208680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:52.218582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:52.231496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:52.284764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.285500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:52.289519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:52.291601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.293676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.296310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.299859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.305028 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c5e81cf-f657-45dd-b741-99a98d286cf1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1320 microversion: 2.25 time: 0.387722 Aug 29 15:27:52.305987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.307018 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 213/425] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:51 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:52.499638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:52.503088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:52.541004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.545040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.566832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.569145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.572041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.574239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.729988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:52.885682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:52.905872 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8f26fe1-7fba-4c1b-a873-7d53d94f5d08 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1331 microversion: 2.1 time: 0.411531 Aug 29 15:27:52.906923 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 214/426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:52 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1331 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:52.926629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:52.927878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:52.965488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.966637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.967355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.976331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.977158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.977859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:54.151596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:54.164305 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5463ea80-325e-405f-b8ce-66dce4d4c5ba tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1323 microversion: 2.1 time: 1.255472 Aug 29 15:27:54.165168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 215/427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:52 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1323 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:54.166265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:54.175660 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f9872a23-356c-45c2-99b0-1806df6d569e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 1.976751 Aug 29 15:27:54.184566 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 213/428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:52 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:54.198718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:54.200303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:54.228065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:54.229041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:54.229744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:54.230885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:54.235383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:54.236828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:54.279291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1854999790", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "1edccff3-384b-4b0d-b706-83561d318ba9"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:54.412892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] validate_networks() for [('1edccff3-384b-4b0d-b706-83561d318ba9', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:55.244438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:55.274187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:55.283131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:55.284544 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a0b340b-3d51-4b76-bbbe-a1b6621f0977 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 1.098836 Aug 29 15:27:55.287523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 214/429] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:54 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:55.298582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:55.310400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:55.317882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:55.318601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:55.319217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.320262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:55.320865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:55.321459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.523369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:55.546752 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-85da1671-3204-4ae8-a23b-3bbf7db0b1e4 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1319 microversion: 2.1 time: 0.257070 Aug 29 15:27:55.548394 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 215/430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:55 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:55.569132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-509c35bd-ac19-4505-8c1f-0c7727a0726a req-c233ced2-3ffe-48fb-ab48-b42069bc6bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b741a8d1-dfab-4c4b-b3bb-8921608f0b92", "tag": "07c9ebd3-8017-4745-91ff-5d0ad9065b40"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:55.588827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-509c35bd-ac19-4505-8c1f-0c7727a0726a req-c233ced2-3ffe-48fb-ab48-b42069bc6bcb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:55.596063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-509c35bd-ac19-4505-8c1f-0c7727a0726a req-c233ced2-3ffe-48fb-ab48-b42069bc6bcb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:55.596754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-509c35bd-ac19-4505-8c1f-0c7727a0726a req-c233ced2-3ffe-48fb-ab48-b42069bc6bcb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.615855 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-509c35bd-ac19-4505-8c1f-0c7727a0726a req-c233ced2-3ffe-48fb-ab48-b42069bc6bcb service nova] Creating event network-changed:07c9ebd3-8017-4745-91ff-5d0ad9065b40 for instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 on n-h1-854882-3 Aug 29 15:27:55.631007 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-509c35bd-ac19-4505-8c1f-0c7727a0726a req-c233ced2-3ffe-48fb-ab48-b42069bc6bcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080540 Aug 29 15:27:55.632260 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 216/431] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:55.637839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:55.643646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:55.673269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:55.673913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:55.675115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.676327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:55.677549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:55.678200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.799317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=67 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:57.198049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:57.213369 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e94da097-2949-4de5-9ef1-0dda8daacbd8 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1323 microversion: 2.1 time: 1.579419 Aug 29 15:27:57.229436 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 217/432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:55 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1323 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:57.237576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:57.238551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:57.259667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.267931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.268973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:57.277097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.277629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.278055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:58.446563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.512987 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-43169214-6f98-41e1-81f8-3be7e9dcc08f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 1.277760 Aug 29 15:27:58.514996 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 218/433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:57 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:58.548734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:58.550002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:58.567195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:58.568033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:58.568704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:58.569895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:58.570530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:58.571147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.353438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:59.354247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:59.355209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:59.355736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:59.356261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:59.359837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:59.384578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.385189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.386674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.387780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.390057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.390808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.420366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:59.447788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:59.461867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for user e7e71fcf6711470db5a71ddc74ff709c and project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:59.492502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:59.498864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:59.607232 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-544a1b52-ddbd-4fba-9525-841b9c70077e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.440777 Aug 29 15:27:59.608966 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 216/434] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 5443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:27:59.618420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:59.622266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:59.646548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.648378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.649903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.655322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.656050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.656627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.983805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:00.297023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.321613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.326532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.331075 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b23ff6e-54ed-4ce2-a336-0200337a8573 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 1.813913 Aug 29 15:28:00.333352 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 219/435] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:58 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:00.344272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-cd42c12b-4140-45b7-9e6a-323ef7b4c0ae req-1317af6c-3395-492e-96a9-0930b40b15ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6ff27d-4c6e-4dd5-889a-90b75dd4d388", "tag": "8a8272b8-9eda-4e14-9620-772885850fee"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:00.368743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cd42c12b-4140-45b7-9e6a-323ef7b4c0ae req-1317af6c-3395-492e-96a9-0930b40b15ae service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.370458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cd42c12b-4140-45b7-9e6a-323ef7b4c0ae req-1317af6c-3395-492e-96a9-0930b40b15ae service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.372045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cd42c12b-4140-45b7-9e6a-323ef7b4c0ae req-1317af6c-3395-492e-96a9-0930b40b15ae service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.394248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.400265 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-cd42c12b-4140-45b7-9e6a-323ef7b4c0ae req-1317af6c-3395-492e-96a9-0930b40b15ae service nova] Creating event network-changed:8a8272b8-9eda-4e14-9620-772885850fee for instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 on n-h2-854882-3 Aug 29 15:28:00.404314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-008753cd-9f19-4f96-ad3e-4d7d3d1d62b9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.789778 Aug 29 15:28:00.408957 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 217/436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:59 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:00.430706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fef4be94-5ea8-44e0-ad19-dc08fd888869 req-2003c309-0995-4417-b687-357adc12a552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea96d7b0-2728-4dec-b28d-a85089376221", "name": "network-vif-plugged", "status": "completed", "tag": "64cc3a9c-9e24-469a-a6c2-0b9d9fcc0c4e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:00.444863 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-cd42c12b-4140-45b7-9e6a-323ef7b4c0ae req-1317af6c-3395-492e-96a9-0930b40b15ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108222 Aug 29 15:28:00.447138 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 220/437] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:00.458943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:00.460452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:00.470555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fef4be94-5ea8-44e0-ad19-dc08fd888869 req-2003c309-0995-4417-b687-357adc12a552 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.476368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fef4be94-5ea8-44e0-ad19-dc08fd888869 req-2003c309-0995-4417-b687-357adc12a552 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.476537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.477403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.478124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fef4be94-5ea8-44e0-ad19-dc08fd888869 req-2003c309-0995-4417-b687-357adc12a552 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.478812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.480123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.481262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.484189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.522786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=24 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:00.537084 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fef4be94-5ea8-44e0-ad19-dc08fd888869 req-2003c309-0995-4417-b687-357adc12a552 service nova] Creating event network-vif-plugged:64cc3a9c-9e24-469a-a6c2-0b9d9fcc0c4e for instance ea96d7b0-2728-4dec-b28d-a85089376221 on n-h1-854882-3 Aug 29 15:28:00.568185 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fef4be94-5ea8-44e0-ad19-dc08fd888869 req-2003c309-0995-4417-b687-357adc12a552 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151614 Aug 29 15:28:00.570091 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 218/438] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:00.597794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8669aa9f-32a0-4190-8224-291f9002cefe req-41854676-0364-4def-9230-f901eabbcd43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5131cda1-4999-4c3e-b1dc-88a941e779f2", "tag": "7c99c417-1046-45bc-92f5-5793a47e0139"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:00.625439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8669aa9f-32a0-4190-8224-291f9002cefe req-41854676-0364-4def-9230-f901eabbcd43 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.629265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8669aa9f-32a0-4190-8224-291f9002cefe req-41854676-0364-4def-9230-f901eabbcd43 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.630657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8669aa9f-32a0-4190-8224-291f9002cefe req-41854676-0364-4def-9230-f901eabbcd43 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.660918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8669aa9f-32a0-4190-8224-291f9002cefe req-41854676-0364-4def-9230-f901eabbcd43 service nova] Creating event network-changed:7c99c417-1046-45bc-92f5-5793a47e0139 for instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 on n-h1-854882-3 Aug 29 15:28:00.673812 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8669aa9f-32a0-4190-8224-291f9002cefe req-41854676-0364-4def-9230-f901eabbcd43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099910 Aug 29 15:28:00.679075 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 219/439] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:00.692847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:00.693900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:00.706983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.707752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.708398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.710844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.711894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.712507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.686417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:01.705286 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d523f9dc-ddd8-4bc0-abf3-6db064bf294d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 1.023937 Aug 29 15:28:01.708832 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:00 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:01.716779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:01.736583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:01.764888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.768021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.769952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.770882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.772302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.773853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.843482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:01.856894 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b395d5dd-1e68-47bc-82ba-8ce82b6d2564 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1323 microversion: 2.1 time: 1.407291 Aug 29 15:28:01.860203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 221/441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:00 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1323 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:01.872369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:01.876817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:01.902017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.903101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.904860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.910342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.911125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.912476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:02.078731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:02.089170 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-42f97fdd-2a33-4315-8979-7f6d04a58a0c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1263 microversion: 2.1 time: 0.378919 Aug 29 15:28:02.096551 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 221/442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:01 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1263 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:02.102163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:02.111482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:02.120985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:02.123990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:02.127015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:02.129200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:02.129995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:02.133024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.134689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.162382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.164455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.167481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e06ffb0d-853a-45ed-a56a-73eb1d071815 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 1.303698 Aug 29 15:28:03.169067 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 222/443] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:01 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:03.176963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-57fa2b03-1896-445f-8150-30ace63b9305 req-ed595e21-7263-4904-9870-9a43f476ba09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e7185f-0e71-4020-be99-78f0dd4069b6", "tag": "f3fa7af7-2867-4a66-bb0a-dd3d2b726d80"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:03.205888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-57fa2b03-1896-445f-8150-30ace63b9305 req-ed595e21-7263-4904-9870-9a43f476ba09 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.212062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-57fa2b03-1896-445f-8150-30ace63b9305 req-ed595e21-7263-4904-9870-9a43f476ba09 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.212677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-57fa2b03-1896-445f-8150-30ace63b9305 req-ed595e21-7263-4904-9870-9a43f476ba09 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.268746 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-57fa2b03-1896-445f-8150-30ace63b9305 req-ed595e21-7263-4904-9870-9a43f476ba09 service nova] Creating event network-changed:f3fa7af7-2867-4a66-bb0a-dd3d2b726d80 for instance 40e7185f-0e71-4020-be99-78f0dd4069b6 on n-h2-854882-3 Aug 29 15:28:03.276903 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-57fa2b03-1896-445f-8150-30ace63b9305 req-ed595e21-7263-4904-9870-9a43f476ba09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105476 Aug 29 15:28:03.278985 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 223/444] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:03.299140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.321954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:03.324783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:03.329129 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f9307b8-5471-4f39-9e58-bb2775c0bda0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 1.230968 Aug 29 15:28:03.329771 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 222/445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:02 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:03.335119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.335829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.336431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.337280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.338601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.339176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.360362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:03.360905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:03.374087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.374597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.375037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.375883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.376347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.376778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.716679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.725335 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-111dd8e9-d403-4be4-9a28-3b8b0e5c98ec tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1323 microversion: 2.1 time: 0.378062 Aug 29 15:28:03.738074 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 223/446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:03 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:03.748195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:03.749181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:03.765352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.770265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.771894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.772953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.773935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.774574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.888270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.903332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aaedea2e-645f-4ce2-a706-575b64077c72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1324 microversion: 2.1 time: 0.622623 Aug 29 15:28:03.904746 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 224/447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:03 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1324 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:03.912121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.915851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9709752d-8a17-4c21-8975-3558f0313168 req-204c5ee6-b299-49ff-a224-47fd5299d941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfefb0af-3933-4c2b-9c7a-38e4e6ae9445", "tag": "1a84eb00-1b8d-4d5a-bd50-14a00bf99e99"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:03.920633 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f58301ca-fd66-4de8-b4f8-f1b492a54112 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1269 microversion: 2.1 time: 0.181062 Aug 29 15:28:03.921158 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 224/448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:03 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:03.942402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9709752d-8a17-4c21-8975-3558f0313168 req-204c5ee6-b299-49ff-a224-47fd5299d941 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.943366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9709752d-8a17-4c21-8975-3558f0313168 req-204c5ee6-b299-49ff-a224-47fd5299d941 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.944010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9709752d-8a17-4c21-8975-3558f0313168 req-204c5ee6-b299-49ff-a224-47fd5299d941 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.980243 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9709752d-8a17-4c21-8975-3558f0313168 req-204c5ee6-b299-49ff-a224-47fd5299d941 service nova] Creating event network-changed:1a84eb00-1b8d-4d5a-bd50-14a00bf99e99 for instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 on n-h2-854882-3 Aug 29 15:28:03.991811 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9709752d-8a17-4c21-8975-3558f0313168 req-204c5ee6-b299-49ff-a224-47fd5299d941 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081780 Aug 29 15:28:03.993175 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 225/449] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:04.156615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-421657593", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "d3655e24-4eff-4e75-a204-3f8187e99186"}], "security_groups": [{"name": "tempest-securitygroup--2064993106"}], "key_name": "tempest-keypair-826578100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:04.198657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:04.199460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:04.214722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:04.215225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:04.215664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:04.216657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:04.217435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:04.217868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.207822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] validate_networks() for [('d3655e24-4eff-4e75-a204-3f8187e99186', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:05.250202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:05.261301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:05.275223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:05.277316 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d140acfa-8cfc-4cc2-b27e-481807cc16b3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 1.084937 Aug 29 15:28:05.278481 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 226/450] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:04 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:05.284134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:05.289124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:05.303171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.307797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.308640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.310062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.312890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.313573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.898382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:05.908780 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a184b52-97fe-428a-b68c-5152b7f7ff1b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.628995 Aug 29 15:28:05.909945 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 227/451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:05 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:05.927679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:05.928597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:05.937693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.940092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.940645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.942792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.943470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.944082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:06.764889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.778086 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83ca9f85-1954-4621-a589-ae1003ba7f88 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1323 microversion: 2.1 time: 0.866734 Aug 29 15:28:06.780698 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 228/452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:05 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1323 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:06.795546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:06.797302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:06.809734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:06.814572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:06.815280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:06.817493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:06.819052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:06.824444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.139046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:07.141114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:07.141811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:07.142594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:07.143565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:07.161119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.161636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.162251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.163359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.164349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.164961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.192442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Getting quotas for project 879d436e9d1a43ee8df0e652dbb6307a. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:07.210391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Getting quotas for user 1ff9744258414abeb64b442b0d295c1c and project 879d436e9d1a43ee8df0e652dbb6307a. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:07.229962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:07.233748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:07.355751 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-894d6105-a196-461c-be7f-7a71bae99dc5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.202898 Aug 29 15:28:07.360255 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 225/453] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 3209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:28:07.380661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:07.381644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:07.403726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.404234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.405936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.406881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.407488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.407930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.454484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:07.488409 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-819aabec-9dc7-43b3-966d-b36ba116bfb4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.704112 Aug 29 15:28:07.503472 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 229/454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:06 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:07.523549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:07.540254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:07.562926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.565136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.567482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.569927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.571244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.572309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.903544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:07.919017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fbb42f2d-99ca-4eae-90e0-899d1eaf2b61 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.554327 Aug 29 15:28:07.935477 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 226/455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:07 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:07.966271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:07.967110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:07.973767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.974473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.975075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.975966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.976613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.977208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.354799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.367797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.379065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.380756 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d634ebee-1608-41dc-8ff9-a3dab2209fa2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 0.875690 Aug 29 15:28:08.399697 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 230/456] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:07 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:08.408006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c3890271-ee4c-4351-8093-1f125b7ae4e0 req-4cf4504d-f081-4f26-818e-ea03c9dfdb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6ff27d-4c6e-4dd5-889a-90b75dd4d388", "name": "network-vif-plugged", "status": "completed", "tag": "8a8272b8-9eda-4e14-9620-772885850fee"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:08.436484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c3890271-ee4c-4351-8093-1f125b7ae4e0 req-4cf4504d-f081-4f26-818e-ea03c9dfdb63 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.437300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c3890271-ee4c-4351-8093-1f125b7ae4e0 req-4cf4504d-f081-4f26-818e-ea03c9dfdb63 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.438098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c3890271-ee4c-4351-8093-1f125b7ae4e0 req-4cf4504d-f081-4f26-818e-ea03c9dfdb63 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.453574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.459546 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c3890271-ee4c-4351-8093-1f125b7ae4e0 req-4cf4504d-f081-4f26-818e-ea03c9dfdb63 service nova] Creating event network-vif-plugged:8a8272b8-9eda-4e14-9620-772885850fee for instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 on n-h2-854882-3 Aug 29 15:28:08.465129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c3890271-ee4c-4351-8093-1f125b7ae4e0 req-4cf4504d-f081-4f26-818e-ea03c9dfdb63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063841 Aug 29 15:28:08.466551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 231/457] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:08.469503 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24286d45-cf1c-43fd-8615-9e312fabd9b5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.522092 Aug 29 15:28:08.473835 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 227/458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:07 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:08.475347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:08.476590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:08.484667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.485603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.486303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.487593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.488479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.489131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.491958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:08.492582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:08.525057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.528195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.531867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.548555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.552742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.553910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.671844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.683704 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6fbbbbe7-4738-434a-82bc-a34679c3e371 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1236 microversion: 2.1 time: 0.214854 Aug 29 15:28:08.687589 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 232/459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:08 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1236 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:08.699243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:08.704553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:08.725475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.726346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.728337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.730294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.732089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.735070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.183595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.208360 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cd5a6d31-6f90-4d33-a144-345a9bddd414 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.731567 Aug 29 15:28:09.210480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 228/460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:08 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:09.219384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:09.220003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:09.227548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.228481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.229520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.230672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.231283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.232294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.586732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.603468 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e72ecbd4-1c78-4037-ab0d-85e73909e6c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.390340 Aug 29 15:28:09.608636 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 229/461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:09 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:09.614929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dded534f-8d75-4781-91ca-8e1fe21d44c3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-975670748", "metadata": {"": ""}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dded534f-8d75-4781-91ca-8e1fe21d44c3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action HTTP/1.1 Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 106 Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:09.627320 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-975670748", "metadata": {"": ""}}} Aug 29 15:28:09.629191 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ea96d7b0-2728-4dec-b28d-a85089376221', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-975670748', 'metadata': {'': ''}}}} Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'': ''} Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:09.630358 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:09.632059 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:09.633738 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:09.633738 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:09.633738 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:28:09.633738 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:28:09.633738 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:09.633738 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:09.642741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.662208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-410e6782-0e7e-4d1e-bcf0-1d0f46ac302c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1323 microversion: 2.1 time: 0.972753 Aug 29 15:28:09.664730 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 233/462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:08 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1323 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:09.678012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dded534f-8d75-4781-91ca-8e1fe21d44c3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:09.678012 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dded534f-8d75-4781-91ca-8e1fe21d44c3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action" status: 400 len: 170 microversion: 2.1 time: 0.063276 Aug 29 15:28:09.680304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 230/463] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Aug 29 15:28:09 2022] POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action => generated 170 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:28:09.686541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:09.692692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:09.697872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:09.699494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:09.707610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.708112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.708778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.710536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.716637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.717153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.727810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.734526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.738071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.739305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.749732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.752584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.086398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.110030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.115683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.118615 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-057b9b6a-d526-4b9c-9307-a5eee1aa9195 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 0.436528 Aug 29 15:28:10.120696 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 231/464] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:09 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:10.136252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:10.138404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:10.188708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.190839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.191929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.196159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.197738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.205699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.233429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.266590 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-187de8de-c2f5-49d7-882d-030bd767f95f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.579096 Aug 29 15:28:10.270863 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 234/465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:09 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:10.284255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:10.286894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:10.302038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.302606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.303289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.304244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.304923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.305622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.492567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.504931 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9677f09f-cd77-40e0-975a-c6c31b586d44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.381163 Aug 29 15:28:10.514366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.521285 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 232/466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:10 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:10.550018 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3b2d0c04-895f-4494-ae6c-4636c9ad946a tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1298 microversion: 2.1 time: 0.276198 Aug 29 15:28:10.550610 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 235/467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:10 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:10.563806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:10.570445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:10.588814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.589308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.589777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.590590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.591043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.591683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.684350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-64da9057-ca79-4f9f-9e14-3aa5948fdc71 tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Calling method '.version_select at 0x7fb0e3ce5040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:10.751660 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-64da9057-ca79-4f9f-9e14-3aa5948fdc71 tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.228687 Aug 29 15:28:10.752589 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 233/468] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:28:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:28:10.758202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4632cda3-3c10-42e2-af10-eb5c6c024834 req-51fa86e0-a880-4ad1-bfea-78f764382c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b741a8d1-dfab-4c4b-b3bb-8921608f0b92", "name": "network-vif-plugged", "status": "completed", "tag": "07c9ebd3-8017-4745-91ff-5d0ad9065b40"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:10.774488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4632cda3-3c10-42e2-af10-eb5c6c024834 req-51fa86e0-a880-4ad1-bfea-78f764382c0a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.782360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4632cda3-3c10-42e2-af10-eb5c6c024834 req-51fa86e0-a880-4ad1-bfea-78f764382c0a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.782810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4632cda3-3c10-42e2-af10-eb5c6c024834 req-51fa86e0-a880-4ad1-bfea-78f764382c0a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.797500 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4632cda3-3c10-42e2-af10-eb5c6c024834 req-51fa86e0-a880-4ad1-bfea-78f764382c0a service nova] Creating event network-vif-plugged:07c9ebd3-8017-4745-91ff-5d0ad9065b40 for instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 on n-h1-854882-3 Aug 29 15:28:10.803870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4632cda3-3c10-42e2-af10-eb5c6c024834 req-51fa86e0-a880-4ad1-bfea-78f764382c0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049760 Aug 29 15:28:10.812361 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 234/469] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:10.822493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:10.823526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:10.841271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.841814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.842820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.843547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.843993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.844421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.029113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.032764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:11.040680 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8906ad8-c253-4507-975f-22aa8b896362 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.483689 Aug 29 15:28:11.042130 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 236/470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:10 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:11.046955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5d1bb130-c929-4929-89ae-fca052202fcf req-4ebee852-1cf4-4295-b5e1-0255f8a75a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ea2f92-896a-47a6-b083-80d43213b701", "tag": "d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:11.056768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5d1bb130-c929-4929-89ae-fca052202fcf req-4ebee852-1cf4-4295-b5e1-0255f8a75a91 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.057647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5d1bb130-c929-4929-89ae-fca052202fcf req-4ebee852-1cf4-4295-b5e1-0255f8a75a91 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.058307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5d1bb130-c929-4929-89ae-fca052202fcf req-4ebee852-1cf4-4295-b5e1-0255f8a75a91 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.072167 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5d1bb130-c929-4929-89ae-fca052202fcf req-4ebee852-1cf4-4295-b5e1-0255f8a75a91 service nova] Creating event network-changed:d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6 for instance e4ea2f92-896a-47a6-b083-80d43213b701 on n-h1-854882-3 Aug 29 15:28:11.078846 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5d1bb130-c929-4929-89ae-fca052202fcf req-4ebee852-1cf4-4295-b5e1-0255f8a75a91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035165 Aug 29 15:28:11.080331 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 237/471] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:11.087015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:11.087978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:11.095722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.098162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.099215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.104537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.105478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.106236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.540910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.555418 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0e9f6dc1-df3b-4a4d-84cb-93bdccc27788 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 200 len: 1516 microversion: 2.1 time: 0.472949 Aug 29 15:28:11.566376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.569935 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 238/472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:11 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 1516 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:11.578138 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6ac1c8a8-aba4-4aeb-a416-ff0d2d53be45 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.764201 Aug 29 15:28:11.583334 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 235/473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:10 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:11.584425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03dd3a4b-d113-4388-860f-6ebeb2777873 tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Action: 'create', calling method: .version_select at 0x7fb0e39cc160>, body: {"pool": "non_exist_pool"} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:11.602575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b454330-ff2a-4f54-a37f-eeb648acac68 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1171017024", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b454330-ff2a-4f54-a37f-eeb648acac68 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action HTTP/1.1 Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 619 Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:11.610781 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:11.612590 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:28:11.613331 n-d-854882-3 devstack@n-api.service[130002]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1171017024", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 29 15:28:11.613331 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:11.613331 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ea96d7b0-2728-4dec-b28d-a85089376221', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1171017024', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 15:28:11.613635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:11.614854 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.617346 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:11.618616 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:11.618616 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:11.618616 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:28:11.618616 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:28:11.618616 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:28:11.618616 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.619287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b454330-ff2a-4f54-a37f-eeb648acac68 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:11.619287 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b454330-ff2a-4f54-a37f-eeb648acac68 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action" status: 400 len: 938 microversion: 2.1 time: 0.030995 Aug 29 15:28:11.621244 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 236/474] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Aug 29 15:28:11 2022] POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action => generated 938 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:28:11.627351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:11.628284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:11.637025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.638740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.639976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.640983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.641716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.642507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.706933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-03dd3a4b-d113-4388-860f-6ebeb2777873 tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] HTTP exception thrown: Floating IP pool not found. Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03dd3a4b-d113-4388-860f-6ebeb2777873 tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Request method failure captured: Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 26 Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNsJ7crJB9x5iYMH9gY3ppzpi6hffAOcwgG7g8gKlwbyNB6hKngnnxz7bADBSLUuSlCeoqoHJCcHmyYTQCpZAB3W3bAC0mdV8lle5DDAuYpLkM0j0Xit4JGS_6cNZBBkOXRZe99YRne9gQ7em46bAqHvmSA0SSOdX3l53Ywp715P3EM Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 12c3f0d480234309a58bfa1e1d1d2bb7 Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1486193708 Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:28:11.710276 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12c3f0d480234309a58bfa1e1d1d2bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12c3f0d480234309a58bfa1e1d1d2bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12c3f0d480234309a58bfa1e1d1d2bb7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12c3f0d480234309a58bfa1e1d1d2bb7"}]}] Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1486193708 Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 12c3f0d480234309a58bfa1e1d1d2bb7 Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1486193708 Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FloatingIPsNegativeTestJSON-1486193708-project Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: bbd52ee53a8d46cdafe1e1da95f9cd6f Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1486193708-project Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: {"pool": "non_exist_pool"} Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: exception: Floating IP pool not found. Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 29 15:28:11.711625 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:11.712606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 29 15:28:11.713887 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:11.716235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03dd3a4b-d113-4388-860f-6ebeb2777873 tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Returning 404 to user: Floating IP pool not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:11.717306 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03dd3a4b-d113-4388-860f-6ebeb2777873 tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.146077 Aug 29 15:28:11.718377 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 239/475] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:28:11 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:28:11.723430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:11.724373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:11.731684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.732308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.732880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.733717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.734279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.734804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.874574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.885294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.887346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.888832 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5521fbe7-f870-4803-ad01-dfbf284e6565 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 0.266014 Aug 29 15:28:11.904062 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 237/476] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:11 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:11.904062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:11.904062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:11.909640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.910927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.911619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.912410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.912878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.913309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.103978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:12.117486 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88c8c148-c30f-4105-94b6-9a16c90d3f9a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.393610 Aug 29 15:28:12.118223 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 240/477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:11 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:12.135488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:12.136132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:12.143733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.144232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.147499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.148776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.150532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.154142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.272861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:12.285991 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6ec7ad59-0840-49e3-a55f-3598ef82b426 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1366 microversion: 2.1 time: 0.389885 Aug 29 15:28:12.286897 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 238/478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:11 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:12.293674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:12.295877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:12.304607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.305494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.306706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.307678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.308353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.309476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.314961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:12.531838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:12.535726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:12.541923 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d32d675d-83a1-4b5b-bce4-7d70e81370d3 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.252407 Aug 29 15:28:12.542708 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 239/479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:12 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:12.549496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2284ef67-7b5d-44f7-a2f3-3f4437edf7aa tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Calling method '.version_select at 0x7fb0e3a94a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:12.563355 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fdb489b7-568f-4076-8647-98dd6b3fe255 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 200 len: 1323 microversion: 2.1 time: 0.443818 Aug 29 15:28:12.578877 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 241/480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:12 2022] GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:12.584680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:12.586279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:12.596203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.597041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.599435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.601878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.602632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.603253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.626579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-2284ef67-7b5d-44f7-a2f3-3f4437edf7aa tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 246dcab3-5117-4358-b882-f9b473d33b60 could not be found", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:28:12.627289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-2284ef67-7b5d-44f7-a2f3-3f4437edf7aa tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] HTTP exception thrown: Floating IP not found for ID 246dcab3-5117-4358-b882-f9b473d33b60 Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2284ef67-7b5d-44f7-a2f3-3f4437edf7aa tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Request method failure captured: Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-floating-ips/246dcab3-5117-4358-b882-f9b473d33b60 HTTP/1.1 Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNsJ7crJB9x5iYMH9gY3ppzpi6hffAOcwgG7g8gKlwbyNB6hKngnnxz7bADBSLUuSlCeoqoHJCcHmyYTQCpZAB3W3bAC0mdV8lle5DDAuYpLkM0j0Xit4JGS_6cNZBBkOXRZe99YRne9gQ7em46bAqHvmSA0SSOdX3l53Ywp715P3EM Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 12c3f0d480234309a58bfa1e1d1d2bb7 Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1486193708 Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:12.641948 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12c3f0d480234309a58bfa1e1d1d2bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12c3f0d480234309a58bfa1e1d1d2bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12c3f0d480234309a58bfa1e1d1d2bb7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12c3f0d480234309a58bfa1e1d1d2bb7"}]}] Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1486193708 Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 12c3f0d480234309a58bfa1e1d1d2bb7 Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1486193708 Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsNegativeTestJSON-1486193708-project Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: bbd52ee53a8d46cdafe1e1da95f9cd6f Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1486193708-project Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: exception: Floating IP not found for ID 246dcab3-5117-4358-b882-f9b473d33b60 Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '246dcab3-5117-4358-b882-f9b473d33b60'} Aug 29 15:28:12.643329 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:28:12.644106 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 246dcab3-5117-4358-b882-f9b473d33b60 could not be found Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1325ca8-4add-41ab-9e27-e5024d6c85a4'] Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 246dcab3-5117-4358-b882-f9b473d33b60. Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:12.645240 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 246dcab3-5117-4358-b882-f9b473d33b60 Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:12.647533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:12.648757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 246dcab3-5117-4358-b882-f9b473d33b60 Aug 29 15:28:12.648757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:12.650362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2284ef67-7b5d-44f7-a2f3-3f4437edf7aa tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] Returning 404 to user: Floating IP not found for ID 246dcab3-5117-4358-b882-f9b473d33b60 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:12.651430 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2284ef67-7b5d-44f7-a2f3-3f4437edf7aa tempest-FloatingIPsNegativeTestJSON-1486193708 tempest-FloatingIPsNegativeTestJSON-1486193708-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/246dcab3-5117-4358-b882-f9b473d33b60" status: 404 len: 111 microversion: 2.1 time: 0.107613 Aug 29 15:28:12.652195 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 240/481] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:28:12 2022] DELETE /compute/v2.1/os-floating-ips/246dcab3-5117-4358-b882-f9b473d33b60 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:12.657766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:12.658465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:12.666365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.666965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.667625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.668462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.668980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.669563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.976983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.002786 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-04640dc3-ef0f-474b-9f97-3659fb5ec7e6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.422314 Aug 29 15:28:13.004290 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 242/482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:12 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:13.014666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-626e7ee9-9347-41c6-8656-1fe0266106d0 req-018a7f0c-237e-4d60-ba16-e82b1b567328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e7185f-0e71-4020-be99-78f0dd4069b6", "name": "network-vif-plugged", "status": "completed", "tag": "f3fa7af7-2867-4a66-bb0a-dd3d2b726d80"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:13.039254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-626e7ee9-9347-41c6-8656-1fe0266106d0 req-018a7f0c-237e-4d60-ba16-e82b1b567328 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.042096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-626e7ee9-9347-41c6-8656-1fe0266106d0 req-018a7f0c-237e-4d60-ba16-e82b1b567328 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.042933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-626e7ee9-9347-41c6-8656-1fe0266106d0 req-018a7f0c-237e-4d60-ba16-e82b1b567328 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.072729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-626e7ee9-9347-41c6-8656-1fe0266106d0 req-018a7f0c-237e-4d60-ba16-e82b1b567328 service nova] Creating event network-vif-plugged:f3fa7af7-2867-4a66-bb0a-dd3d2b726d80 for instance 40e7185f-0e71-4020-be99-78f0dd4069b6 on n-h2-854882-3 Aug 29 15:28:13.084069 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-626e7ee9-9347-41c6-8656-1fe0266106d0 req-018a7f0c-237e-4d60-ba16-e82b1b567328 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078465 Aug 29 15:28:13.086834 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 243/483] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:13.110759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:13.113042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:13.127846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.134572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.135325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.136043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.139652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.140539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.141704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.151583 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7858339e-0f02-4f09-9d45-47b6e85c5993 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.497651 Aug 29 15:28:13.155370 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 241/484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:12 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:13.166106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f1dad2a-0d03-4028-a6a9-395f81d3bdf6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f1dad2a-0d03-4028-a6a9-395f81d3bdf6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action HTTP/1.1 Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 285 Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:13.183159 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:28:13.185858 n-d-854882-3 devstack@n-api.service[130002]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ea96d7b0-2728-4dec-b28d-a85089376221', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:28:13.187172 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:28:13.188613 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:28:13.192040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:28:13.198511 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:28:13.198511 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:13.198511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f1dad2a-0d03-4028-a6a9-395f81d3bdf6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:13.199250 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f1dad2a-0d03-4028-a6a9-395f81d3bdf6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action" status: 400 len: 619 microversion: 2.1 time: 0.040450 Aug 29 15:28:13.200814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 242/485] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Aug 29 15:28:13 2022] POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action => generated 619 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:28:13.219098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:13.220552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:13.249253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.250105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.250867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.258183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.258955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.259602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.597499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.628452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.630969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.632645 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-68641ea2-b68e-4dfe-b3bd-24873f3c29a7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 0.543060 Aug 29 15:28:13.633733 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 244/486] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:13 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:13.645062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:13.647059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:13.658291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.659136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.659798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.660840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.661616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.662633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.676467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.689125 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-386ac7b5-8cd2-4e21-9938-b928fa1154f6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.486271 Aug 29 15:28:13.691796 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 243/487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:13 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:13.699572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:13.700979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:13.711651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.712271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.712697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.713630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:13.714246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:13.714825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.996972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.026177 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9791173e-f67e-4240-ba7c-c0c71a1264e6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1366 microversion: 2.1 time: 0.332250 Aug 29 15:28:14.028186 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 244/488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:13 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:14.038246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:14.039866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:14.053687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.054479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.056007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.056958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.057625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.058523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.316370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.343777 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13796cb6-9699-4bd3-883f-4d3b2073ee97 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 200 len: 1517 microversion: 2.1 time: 0.312591 Aug 29 15:28:14.345519 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:14 2022] GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 1517 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:14.353138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:14.354205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:14.364224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.364637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.365609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.367603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.368175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.368682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.449060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.462403 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-17197c31-5d25-4a04-8ee0-cbbdef71cbb5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.826913 Aug 29 15:28:14.465462 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 245/490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:13 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:14.475620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2c8aac77-3109-41c6-a1a3-fbda6cd633e0 req-8e52072a-8f72-4749-b63b-a786cb215b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf291a9-4160-4710-97ef-4067a3e5bf59", "tag": "bd9dd69b-de59-4ca1-9f54-7c18cef0070b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:14.507352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2c8aac77-3109-41c6-a1a3-fbda6cd633e0 req-8e52072a-8f72-4749-b63b-a786cb215b54 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.508062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2c8aac77-3109-41c6-a1a3-fbda6cd633e0 req-8e52072a-8f72-4749-b63b-a786cb215b54 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.508644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2c8aac77-3109-41c6-a1a3-fbda6cd633e0 req-8e52072a-8f72-4749-b63b-a786cb215b54 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.529098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2c8aac77-3109-41c6-a1a3-fbda6cd633e0 req-8e52072a-8f72-4749-b63b-a786cb215b54 service nova] Creating event network-changed:bd9dd69b-de59-4ca1-9f54-7c18cef0070b for instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 on n-h2-854882-3 Aug 29 15:28:14.541079 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2c8aac77-3109-41c6-a1a3-fbda6cd633e0 req-8e52072a-8f72-4749-b63b-a786cb215b54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073933 Aug 29 15:28:14.542634 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 246/491] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:14.553784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:14.555543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:14.584097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.585055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.585729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.599843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.600627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.601301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.919789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.932183 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d14f589-c725-4a6a-9f5d-f90683a7afa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.584902 Aug 29 15:28:14.933637 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 246/492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:14 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:14.940994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:14.941944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:14.955128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.960826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.963145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.967785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.968593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.970587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.088754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.101949 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e4ef9e9e-84a6-4f33-b57c-df834e700c89 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 200 len: 1323 microversion: 2.1 time: 0.554584 Aug 29 15:28:15.103207 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 247/493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:14 2022] GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 1323 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:15.121850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:15.124264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:15.142642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.143293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.143835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.146896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.147645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.148188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.652309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.680289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-49ff342f-8455-46cc-b841-25f18cf3e05c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.743231 Aug 29 15:28:15.682813 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 247/494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:14 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:15.693122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:15.693776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:15.724643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.725142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.725620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.726353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.726819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.727248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.740008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.755953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.760399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.768248 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16f15061-f4f1-443d-aa4d-631d884adaac tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 0.663477 Aug 29 15:28:15.769139 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 248/495] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:15 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:15.777955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:15.779059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:15.793620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.794120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.795710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.796345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.797185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.797983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.019456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:16.034137 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-efb067cc-74e1-4e16-a978-3857c9ef61f7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.350163 Aug 29 15:28:16.034752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 248/496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:15 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:16.040831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:16.052542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4d7e6c3d-7d0b-4a61-8a7e-c545bbadf0be req-13f52e06-dccd-4270-b36c-9a68263a9829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5131cda1-4999-4c3e-b1dc-88a941e779f2", "name": "network-vif-plugged", "status": "completed", "tag": "7c99c417-1046-45bc-92f5-5793a47e0139"}, {"server_uuid": "dfefb0af-3933-4c2b-9c7a-38e4e6ae9445", "name": "network-vif-plugged", "status": "completed", "tag": "1a84eb00-1b8d-4d5a-bd50-14a00bf99e99"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:16.054050 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3c007919-49f6-4ab1-a33c-7a554e245b00 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1366 microversion: 2.1 time: 0.283648 Aug 29 15:28:16.064217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d7e6c3d-7d0b-4a61-8a7e-c545bbadf0be req-13f52e06-dccd-4270-b36c-9a68263a9829 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.064701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d7e6c3d-7d0b-4a61-8a7e-c545bbadf0be req-13f52e06-dccd-4270-b36c-9a68263a9829 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.065114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d7e6c3d-7d0b-4a61-8a7e-c545bbadf0be req-13f52e06-dccd-4270-b36c-9a68263a9829 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.065860 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 249/497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:15 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:16.072814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1744500858"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:16.076112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:16.081910 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4d7e6c3d-7d0b-4a61-8a7e-c545bbadf0be req-13f52e06-dccd-4270-b36c-9a68263a9829 service nova] Creating event network-vif-plugged:7c99c417-1046-45bc-92f5-5793a47e0139 for instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 on n-h1-854882-3 Aug 29 15:28:16.082733 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4d7e6c3d-7d0b-4a61-8a7e-c545bbadf0be req-13f52e06-dccd-4270-b36c-9a68263a9829 service nova] Creating event network-vif-plugged:1a84eb00-1b8d-4d5a-bd50-14a00bf99e99 for instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 on n-h2-854882-3 Aug 29 15:28:16.084027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.084711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.085215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.086090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.086615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.087106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.096556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4d7e6c3d-7d0b-4a61-8a7e-c545bbadf0be req-13f52e06-dccd-4270-b36c-9a68263a9829 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047616 Aug 29 15:28:16.097764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 249/498] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:16.119564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:16.121199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:16.164149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.164890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.165540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.166471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.172486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.173537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.468080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9863d95-c34e-4910-8501-8c53bb6e3b49 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action" status: 202 len: 0 microversion: 2.1 time: 0.397614 Aug 29 15:28:16.469614 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 250/499] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:16 2022] POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:28:16.486000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:16.487032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:16.488899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:16.495168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.496049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.496688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.497759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.498484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.499234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.505369 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1357ce4d-506b-4373-a7e9-c06323064553 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.404966 Aug 29 15:28:16.506018 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 250/500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:16 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:16.528268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1880150288"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:16.532264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:16.552462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.553097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.553578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.556863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:16.559584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:16.560127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:16.642708 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Cannot 'createImage' instance ea96d7b0-2728-4dec-b28d-a85089376221 while it is in task_state image_snapshot_pending Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action HTTP/1.1 Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 85 Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:16.647929 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1880150288"}} Aug 29 15:28:16.649633 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'createImage' instance ea96d7b0-2728-4dec-b28d-a85089376221 while it is in task_state image_snapshot_pending Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ea96d7b0-2728-4dec-b28d-a85089376221', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1880150288'}}} Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea96d7b0-2728-4dec-b28d-a85089376221 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:16.650672 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance ea96d7b0-2728-4dec-b28d-a85089376221 while it is in task_state image_snapshot_pending Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance ea96d7b0-2728-4dec-b28d-a85089376221 while it is in task_state image_snapshot_pending Aug 29 15:28:16.652215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:16.654301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 409 to user: Cannot 'createImage' instance ea96d7b0-2728-4dec-b28d-a85089376221 while it is in task_state image_snapshot_pending {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:16.654301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e2c4a9e-e327-4109-a09f-7cb9454b0b45 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action" status: 409 len: 167 microversion: 2.1 time: 0.134133 Aug 29 15:28:16.654301 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 251/501] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:16 2022] POST /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221/action => generated 167 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:28:16.677985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eedae0bb-39ef-46f3-8b2b-0519487f0995 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '.version_select at 0x7fb0e39fbf70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:16.988778 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eedae0bb-39ef-46f3-8b2b-0519487f0995 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/images/51f99502-ade9-4786-8c7b-694a4c980a0c" status: 204 len: 0 microversion: 2.1 time: 0.329019 Aug 29 15:28:16.992994 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 252/502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:16 2022] DELETE /compute/v2.1/images/51f99502-ade9-4786-8c7b-694a4c980a0c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:16.994425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:16.995061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:17.011379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.011379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.011812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.012598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.013061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.027861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.179895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:17.224104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:17.255438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.268658 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6490dc4e-8e1f-4aeb-b6fb-b6a9136da254 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 200 len: 1517 microversion: 2.1 time: 0.789030 Aug 29 15:28:17.269276 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 251/503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:16 2022] GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 1517 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:17.290247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:17.291454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:17.300580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.301782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.302905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.304094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.305368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.306028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.746119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.757506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.760831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.768744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a5afff8-81bd-4945-b233-3d9f2d8c5f5d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1362 microversion: 2.25 time: 0.777991 Aug 29 15:28:17.779333 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 253/504] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:16 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1362 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:17.779333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:17.779333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:17.787581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.788226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.788736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.789833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.790576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.791632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.846723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.861851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d4b5f0ac-d444-452d-99e0-a5810e249075 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1531 microversion: 2.1 time: 0.575400 Aug 29 15:28:17.863024 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 252/505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:17 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1531 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:17.897240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:17.898398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:17.916505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.917896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.919139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.928483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.929463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.930372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.007833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:18.017906 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-659678be-21cd-44dd-99cb-01fce695ae4b tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.246653 Aug 29 15:28:18.019991 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 254/506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:17 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:18.039062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:18.039616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:18.055135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.055630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.056068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.056778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.057230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.057687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.104117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:28:18.218584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:18.228880 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8b7fd11f-9cb5-4dca-a5c7-e9e80bb984ae tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 204 len: 0 microversion: 2.1 time: 0.193394 Aug 29 15:28:18.231505 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 255/507] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:28:18 2022] DELETE /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:18.237945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:18.238918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:18.248888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.250279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.250793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.251647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.252231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.252759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.261295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:18.277117 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e95db880-1be9-4fe7-baaf-66362ad9a708 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1366 microversion: 2.1 time: 0.397728 Aug 29 15:28:18.278701 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 253/508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:17 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:18.429281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:18.443598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ebfe477f-b6f4-41dc-92ec-10764702dc36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.209677 Aug 29 15:28:18.444284 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 256/509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:18 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:18.449695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5286d265-cc05-4a10-8ecf-f69018bec6eb req-fde7147c-9481-4119-a2f7-3e20cb5f14ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ea2f92-896a-47a6-b083-80d43213b701", "name": "network-vif-plugged", "status": "completed", "tag": "d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:18.462191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5286d265-cc05-4a10-8ecf-f69018bec6eb req-fde7147c-9481-4119-a2f7-3e20cb5f14ac service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.462973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5286d265-cc05-4a10-8ecf-f69018bec6eb req-fde7147c-9481-4119-a2f7-3e20cb5f14ac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.463771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5286d265-cc05-4a10-8ecf-f69018bec6eb req-fde7147c-9481-4119-a2f7-3e20cb5f14ac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.476900 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5286d265-cc05-4a10-8ecf-f69018bec6eb req-fde7147c-9481-4119-a2f7-3e20cb5f14ac service nova] Creating event network-vif-plugged:d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6 for instance e4ea2f92-896a-47a6-b083-80d43213b701 on n-h1-854882-3 Aug 29 15:28:18.485484 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5286d265-cc05-4a10-8ecf-f69018bec6eb req-fde7147c-9481-4119-a2f7-3e20cb5f14ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037226 Aug 29 15:28:18.487010 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 257/510] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:18.513460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:18.516675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:18.531569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.539764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.541220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.551836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.552761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.553724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.557969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1809069538", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:18.610086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:18.671501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:18.767928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:18.777150 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc62a012-1cf5-47ee-81c2-c45d359933c7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 200 len: 1523 microversion: 2.1 time: 0.287335 Aug 29 15:28:18.778863 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 258/511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:18 2022] GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:18.802915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:18.803546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:18.810562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.811704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.812135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.813024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.813686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.815175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.087796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:19.088468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:19.089897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:19.090993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:19.091835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:19.109177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.110217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.110816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.111854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.113104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.114302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.150317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:19.156532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.171838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for user 1869270af6874c4db42112d4aa9417a6 and project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:19.174252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.178168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.180372 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70214b2d-2f06-4d25-9d39-7f5825ba4e5b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1558 microversion: 2.25 time: 0.380979 Aug 29 15:28:19.193424 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 259/512] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:18 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1558 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:19.199485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:19.203661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:19.204938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.207535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:19.220431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.220973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.221739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.222735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.226238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.228525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.262968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5432de62-61e2-4285-8ff6-87add1d4a976 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982392 Aug 29 15:28:19.265620 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 254/513] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:28:19.270828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.271865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:19.281099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.281786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.282581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.283489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.284108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.285047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.447574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.458648 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb1755ac-8498-44b1-9fa0-bba53a3f0700 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1537 microversion: 2.1 time: 0.269294 Aug 29 15:28:19.475151 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 260/514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1537 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:19.634464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.637296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:19.656005 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-18439a9e-e161-4127-bdde-ed0fe7dd5a30 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1387 microversion: 2.1 time: 0.387559 Aug 29 15:28:19.656729 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 255/515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1387 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:19.674479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-09f12e6e-b18d-4678-bf54-05174232a7bc tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.675408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-09f12e6e-b18d-4678-bf54-05174232a7bc tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:19.679334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:19.735420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.736057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:19.744285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.744783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.745569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.746471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.747089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.747760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.798266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-09f12e6e-b18d-4678-bf54-05174232a7bc tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.806119 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-09f12e6e-b18d-4678-bf54-05174232a7bc tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1213 microversion: 2.1 time: 0.148280 Aug 29 15:28:19.806727 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 256/516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:19.821962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.821962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:19.834872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.835367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.835805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.838172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.838172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.838172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.964051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 5131cda1-4999-4c3e-b1dc-88a941e779f2 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:20.053279 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8585cd3b-2f05-4027-af99-817144451664 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 2051 microversion: 2.25 time: 0.576638 Aug 29 15:28:20.054262 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 261/517] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 2051 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:20.061333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:20.063515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:20.082718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.083535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.085735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.087477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.088443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.089113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.440787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.459110 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1551b936-90c1-4da4-97fb-13fe86b83d17 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1311 microversion: 2.1 time: 0.403131 Aug 29 15:28:20.465997 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 262/518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:20 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:20.480322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:20.484084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:20.506412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.507291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.509590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.510653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.512987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.516336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.526238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.554153 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0fbaab0-0084-467f-bc7f-c534c2fe62a3 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1366 microversion: 2.1 time: 0.744559 Aug 29 15:28:20.557571 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 257/519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1366 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:20.580134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:20.581097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:20.600747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.601688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.602490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.605632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.606333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.609126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.958419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.981007 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec0b937d-3adb-437e-a0a2-094a76ffb09d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 200 len: 1523 microversion: 2.1 time: 0.510689 Aug 29 15:28:20.981647 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 263/520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:20 2022] GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:20.997028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:20.999433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.030131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.030500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.030958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.031703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.032157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.032718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.136367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 5131cda1-4999-4c3e-b1dc-88a941e779f2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:21.204469 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4c1ea738-e40b-49e2-bdb7-70a997164def tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 2051 microversion: 2.25 time: 0.644236 Aug 29 15:28:21.217968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 258/521] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:20 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 2051 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:21.227318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.227952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.234902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.235408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.235848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.236574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.237171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.237652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.366370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:21.376493 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94c530d4-d5ef-447a-95d3-9b2580b9d2ff tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1519 microversion: 2.1 time: 0.393749 Aug 29 15:28:21.377271 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 264/522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:20 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:21.443694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.444421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.471600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.472149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.472719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.478708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.481616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.482124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.643450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:21.655371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e26335fa-01ab-4834-a4a6-da9beb8d8965 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1273 microversion: 2.1 time: 0.250767 Aug 29 15:28:21.659186 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 265/523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:21.665424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.670028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.670866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.671563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.672535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.673238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.675717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.728380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:21.746408 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f889c9af-060c-4d77-9820-d80e4e0806b0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1586 microversion: 2.1 time: 0.527059 Aug 29 15:28:21.762409 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 259/524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1586 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:21.781895 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7b4e60c4-45fb-45ac-b95d-5782df606c76 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.120851 Aug 29 15:28:21.785205 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 266/525] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:28:21.792753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.793467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.805644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.813957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.815897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.816796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.818549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.819767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.821864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.822386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.837290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.839860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.839860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.840462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.841052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.841607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.884696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:28:22.026995 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d3dce3c-4a3a-4ec2-bbbc-71de3bdad356 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 204 len: 0 microversion: 2.1 time: 0.262610 Aug 29 15:28:22.028346 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 260/526] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:28:21 2022] DELETE /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:22.037822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0da5cab6-b52f-412c-8f94-441392f72e5a req-10684dd1-3d6f-4e41-b680-e300458a4302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e7185f-0e71-4020-be99-78f0dd4069b6", "name": "network-vif-deleted", "tag": "f3fa7af7-2867-4a66-bb0a-dd3d2b726d80"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:22.052811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0da5cab6-b52f-412c-8f94-441392f72e5a req-10684dd1-3d6f-4e41-b680-e300458a4302 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.054744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0da5cab6-b52f-412c-8f94-441392f72e5a req-10684dd1-3d6f-4e41-b680-e300458a4302 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.056112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0da5cab6-b52f-412c-8f94-441392f72e5a req-10684dd1-3d6f-4e41-b680-e300458a4302 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.075069 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0da5cab6-b52f-412c-8f94-441392f72e5a req-10684dd1-3d6f-4e41-b680-e300458a4302 service nova] Creating event network-vif-deleted:f3fa7af7-2867-4a66-bb0a-dd3d2b726d80 for instance 40e7185f-0e71-4020-be99-78f0dd4069b6 on n-h2-854882-3 Aug 29 15:28:22.083360 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0da5cab6-b52f-412c-8f94-441392f72e5a req-10684dd1-3d6f-4e41-b680-e300458a4302 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051936 Aug 29 15:28:22.086528 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 261/527] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:22.088825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.099317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.100427 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-de747ec4-4924-4edc-8875-a769949c1356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1494 microversion: 2.1 time: 0.312810 Aug 29 15:28:22.101564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.102911 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 267/528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1494 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:22.110437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.110614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.111128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.111484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.112132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.113611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.114228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.114812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.118756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.119274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.119743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.121622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.121622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.121622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.242516 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0be867f2-43e2-4e0b-8dda-e61b92963ff6 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138047 Aug 29 15:28:22.244859 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 268/529] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:22.251556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854882-3", "block_migration": "auto"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:22.259871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.274086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.277918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.282016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.283440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.284061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.285065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.307581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.320870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a3b5ca83-7719-4a7b-8c19-d41dd03d2cb7 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1366 microversion: 2.1 time: 0.232882 Aug 29 15:28:22.322154 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 262/530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:22.328043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.328911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.335942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.337114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.337755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.338655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.339275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.339865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.357953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'flavor' on Instance uuid 5131cda1-4999-4c3e-b1dc-88a941e779f2 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:22.376230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Going to try to live migrate instance to n-h2-854882-3 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:28:22.406966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.407916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.409186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.409677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lazy-loading 'fault' on Instance uuid 40e7185f-0e71-4020-be99-78f0dd4069b6 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:22.507475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.520278 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-81cbc0e6-7439-47b9-a5b5-4552ba1540e7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 200 len: 1313 microversion: 2.1 time: 0.194560 Aug 29 15:28:22.520920 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 263/531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:22.551887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.552543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.570068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.570566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.571005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.576478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.584140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.586133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.791289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.804721 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cc64aa09-549d-4c4c-8432-5682b500ce72 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1525 microversion: 2.1 time: 0.262739 Aug 29 15:28:22.805861 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 264/532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1525 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:23.198787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:23.199432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:23.213377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.214289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.214732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:23.215501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.219734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.220181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:23.438251 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3c0d235d-b356-4886-8b80-dfc782fa1781 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1645 microversion: 2.1 time: 0.630983 Aug 29 15:28:23.442962 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 265/533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1645 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:23.453981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b698c1fe-f5a5-4f08-9fff-f0fc788dc8a7 req-34204682-b603-47c8-ad1d-93b25489b137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf291a9-4160-4710-97ef-4067a3e5bf59", "name": "network-vif-plugged", "status": "completed", "tag": "bd9dd69b-de59-4ca1-9f54-7c18cef0070b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:23.492947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b698c1fe-f5a5-4f08-9fff-f0fc788dc8a7 req-34204682-b603-47c8-ad1d-93b25489b137 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.492947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b698c1fe-f5a5-4f08-9fff-f0fc788dc8a7 req-34204682-b603-47c8-ad1d-93b25489b137 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.492947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b698c1fe-f5a5-4f08-9fff-f0fc788dc8a7 req-34204682-b603-47c8-ad1d-93b25489b137 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:23.523761 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b698c1fe-f5a5-4f08-9fff-f0fc788dc8a7 req-34204682-b603-47c8-ad1d-93b25489b137 service nova] Creating event network-vif-plugged:bd9dd69b-de59-4ca1-9f54-7c18cef0070b for instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 on n-h2-854882-3 Aug 29 15:28:23.578895 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b698c1fe-f5a5-4f08-9fff-f0fc788dc8a7 req-34204682-b603-47c8-ad1d-93b25489b137 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133112 Aug 29 15:28:23.592798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 266/534] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:23.617825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:23.618552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:23.657751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.658368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.658821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:23.666253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.666747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.667184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:23.837572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:23.855380 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e5987666-b382-45d7-b794-862fdf060bb8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1271 microversion: 2.1 time: 0.260962 Aug 29 15:28:23.858837 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 267/535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:23 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:23.866892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:23.868167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:23.878395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.879058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.879745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:23.880626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.882053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.882606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.321482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.340337 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b9b422b-e5fd-49e0-a897-2de18d12dbc4 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1366 microversion: 2.1 time: 0.479476 Aug 29 15:28:24.343361 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 268/536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:23 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:24.350174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.350944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.362415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.363158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.363604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.364723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.365307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.365768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.626144 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a77719a1-2936-427b-9b02-d5d21b7d1117 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1645 microversion: 2.1 time: 0.281374 Aug 29 15:28:24.644324 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 269/537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1645 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:24.650457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.651251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.671925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.672421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.672854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.673624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.697102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.699527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.773700 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] HTTP exception thrown: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 HTTP/1.1 Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:28:24.781465 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:24.783056 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '40e7185f-0e71-4020-be99-78f0dd4069b6'} Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:24.783959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:24.785501 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.786811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 404 to user: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:24.787580 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da77cc13-fc8a-44ca-86e8-881e3714e344 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 404 len: 111 microversion: 2.1 time: 0.141977 Aug 29 15:28:24.792547 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 270/538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:24.882569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1416181655", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:24.979741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:25.549686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:25.550186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:25.550744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:25.551202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:25.552012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:25.564881 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3132c3c1-df0f-4739-bc51-db40640a9352 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2/action" status: 202 len: 0 microversion: 2.25 time: 3.320529 Aug 29 15:28:25.565761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.566106 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 269/539] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:28:22 2022] POST /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2/action => generated 0 bytes in 3322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:25.566248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.566873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.568397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.568999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.569958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.570846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.571454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:25.583105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.583590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.584023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.585266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.585266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.587541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.593339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Getting quotas for project 03575bcf80404b0994fc8d967804b6df. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:25.599988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Getting quotas for user 7ead06f178974869a251628cca018175 and project 03575bcf80404b0994fc8d967804b6df. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:25.616008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:25.620101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:25.626572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.627026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.627463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.633735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lazy-loading 'fault' on Instance uuid ea96d7b0-2728-4dec-b28d-a85089376221 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:25.678507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a5cc09c6-a82d-48c2-98c4-7fad88ae295d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884666 Aug 29 15:28:25.685195 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 271/540] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:28:25.692026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.696420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.697198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.697678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.698413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.698856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.699273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.713076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.724651 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fdca2cec-374a-475d-9bba-935da623020c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 200 len: 1314 microversion: 2.1 time: 0.157086 Aug 29 15:28:25.727943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c65e008-b708-4191-bf26-3a1c3e9ee342 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043738 Aug 29 15:28:25.734449 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 270/541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:25.736813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 272/542] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:25.744154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.744661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:25.753417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-377591c1-f641-4fe1-aea5-74d8c7b7179d req-39f10ce5-216a-4450-8112-e334f940d7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfefb0af-3933-4c2b-9c7a-38e4e6ae9445", "tag": "1a84eb00-1b8d-4d5a-bd50-14a00bf99e99"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:25.754594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.755180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.755900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.756767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.757311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.757913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.785674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-377591c1-f641-4fe1-aea5-74d8c7b7179d req-39f10ce5-216a-4450-8112-e334f940d7e3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.786163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-377591c1-f641-4fe1-aea5-74d8c7b7179d req-39f10ce5-216a-4450-8112-e334f940d7e3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.786591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-377591c1-f641-4fe1-aea5-74d8c7b7179d req-39f10ce5-216a-4450-8112-e334f940d7e3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.811017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-377591c1-f641-4fe1-aea5-74d8c7b7179d req-39f10ce5-216a-4450-8112-e334f940d7e3 service nova] Creating event network-changed:1a84eb00-1b8d-4d5a-bd50-14a00bf99e99 for instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 on n-h2-854882-3 Aug 29 15:28:25.821242 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-377591c1-f641-4fe1-aea5-74d8c7b7179d req-39f10ce5-216a-4450-8112-e334f940d7e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081337 Aug 29 15:28:25.822399 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 271/543] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:25.834267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.843189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.847154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:25.855174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.856626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.857177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.858812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.859560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.860643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.001835 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9c347b37-c748-4cb4-81b7-8b251f070510 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.177630 Aug 29 15:28:26.010494 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 272/544] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:28:26.018278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.019231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.025824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.026542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.027139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.029108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.036449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.036901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.298151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.308503 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3815e966-d8f3-4189-8987-0f6965330d64 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1313 microversion: 2.1 time: 0.296636 Aug 29 15:28:26.314896 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 273/545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:26.330537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.331221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.346763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.347654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.348769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.349973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.354118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.354863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.358897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.376493 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ed71790-404a-4b86-a73a-4357fdc8041e tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 200 len: 1586 microversion: 2.1 time: 0.636551 Aug 29 15:28:26.377077 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 273/546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 1586 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:26.387239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.387904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.405868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.406426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.406884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.407735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.408168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.408597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.458503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:26.720838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.741278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.743776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.745644 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-286b7bee-aedd-49d6-8079-456dcf7a5b3b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.367389 Aug 29 15:28:26.747926 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 274/547] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:26.758865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.762582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.792824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.793325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.793791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.808134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.812658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.813380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.813848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.814847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:26.833647 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-628b7724-2434-4799-9d89-bd82a5f6d2a0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1556 microversion: 2.1 time: 0.507460 Aug 29 15:28:26.834598 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 274/548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1556 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:26.839546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854882-3", "block_migration": true, "disk_over_commit": false}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:26.843335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.853759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.854241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.854848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.855712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.856319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.856888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.918506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lazy-loading 'flavor' on Instance uuid e4ea2f92-896a-47a6-b083-80d43213b701 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:26.945628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Going to try to live migrate instance to n-h2-854882-3 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:28:26.989446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.002523 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a929b946-19bf-4555-a489-8afab0412a3f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1213 microversion: 2.1 time: 0.252319 Aug 29 15:28:27.003233 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 275/549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1213 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:27.018366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0e1f13d-d2cb-4f67-aaa6-283c566035b6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0e1f13d-d2cb-4f67-aaa6-283c566035b6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:28:27.022596 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 15:28:27.024020 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:27.028994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:27.032150 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:27.033754 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:28:27.033754 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:28:27.033754 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 15:28:27.033754 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.033754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0e1f13d-d2cb-4f67-aaa6-283c566035b6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:27.033754 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d0e1f13d-d2cb-4f67-aaa6-283c566035b6 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.019102 Aug 29 15:28:27.033754 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 276/550] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:28:27.043390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.044019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:27.052960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.054346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.055110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.055821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.056566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.057456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.074422 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 HTTP/1.1 Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:28:27.077515 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:28:27.079149 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ea96d7b0-2728-4dec-b28d-a85089376221'} Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:27.080018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:28:27.081378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.084925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:27.086025 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcff9a39-9bb6-4f14-9c0e-6724588d3742 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 404 len: 111 microversion: 2.1 time: 0.056597 Aug 29 15:28:27.086965 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 277/551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:27.093825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.094713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:27.103079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.103871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.104462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.105419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.106213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.107133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.554513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-de92117f-835d-4376-a8d2-7753dc829f50 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.465623 Aug 29 15:28:27.556172 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 278/552] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-interface => generated 284 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:27.569098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e784fc62-ab1e-49a5-b488-ed91d3f79a88 req-cccc1428-0f0a-48ca-a5eb-85c840f56332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37169b83-efb2-4cd0-a106-c388cfdd59b5", "tag": "38298e49-8d6b-4848-b75a-a48df8ce6169"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:27.589222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e784fc62-ab1e-49a5-b488-ed91d3f79a88 req-cccc1428-0f0a-48ca-a5eb-85c840f56332 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.590084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e784fc62-ab1e-49a5-b488-ed91d3f79a88 req-cccc1428-0f0a-48ca-a5eb-85c840f56332 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.590869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e784fc62-ab1e-49a5-b488-ed91d3f79a88 req-cccc1428-0f0a-48ca-a5eb-85c840f56332 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.608048 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e784fc62-ab1e-49a5-b488-ed91d3f79a88 req-cccc1428-0f0a-48ca-a5eb-85c840f56332 service nova] Creating event network-changed:38298e49-8d6b-4848-b75a-a48df8ce6169 for instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 on n-h1-854882-3 Aug 29 15:28:27.615267 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e784fc62-ab1e-49a5-b488-ed91d3f79a88 req-cccc1428-0f0a-48ca-a5eb-85c840f56332 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056319 Aug 29 15:28:27.616699 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 279/553] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:27.625250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.631447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.633354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:27.644139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.645688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.647460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.649232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.650246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.651660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.771922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:28:27.894760 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9edeb090-749e-4efd-a9e4-c5f551f1f247 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.275892 Aug 29 15:28:27.896543 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 280/554] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers => generated 683 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:27.912602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-28ce384e-9eab-4eda-b2eb-ef5e30c29cd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'create', calling method: .version_select at 0x7fb0e38909d0>, body: {"keypair": {"name": "tempest-keypair-1046640130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrAchB0CiFpyOkii2dtBNm7JmVCV29LV4eIVnJKsbpypkhB/w8XqfMbCIZj4qbr4nJs4oTVpiub/T1lDEUNRSMO/3Qqk/68WCl78lcbMSonQ3wJ4qUvBp38Wk32lMKFmw=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:27.933793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-28ce384e-9eab-4eda-b2eb-ef5e30c29cd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:27.939772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-28ce384e-9eab-4eda-b2eb-ef5e30c29cd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for user 7bd967d46f614bb4a187218498e934f3 and project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:27.969072 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-28ce384e-9eab-4eda-b2eb-ef5e30c29cd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070927 Aug 29 15:28:27.970558 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 281/555] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:28:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:27.980466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.981599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:27.990702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.991555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.992247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.993156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.994103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.994719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.364586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.377545 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-72bbc161-2d4f-4402-a8a5-3f2704f055e2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1313 microversion: 2.1 time: 0.404680 Aug 29 15:28:28.383890 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 282/556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:28.391949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.393092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:28.402510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.403693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.405317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.406298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.406492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.407006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.747405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.760497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.762320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.765332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8955470-e07d-4616-9c59-be8f59df8767 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.385503 Aug 29 15:28:28.766144 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 283/557] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:28.771801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-943b765d-d5ff-4c67-9a2f-54b45e0fe9ad req-9bf6902b-1f83-4594-95e1-8cf81ae1fcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea96d7b0-2728-4dec-b28d-a85089376221", "name": "network-vif-deleted", "tag": "64cc3a9c-9e24-469a-a6c2-0b9d9fcc0c4e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:28.783513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-943b765d-d5ff-4c67-9a2f-54b45e0fe9ad req-9bf6902b-1f83-4594-95e1-8cf81ae1fcd0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.783983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-943b765d-d5ff-4c67-9a2f-54b45e0fe9ad req-9bf6902b-1f83-4594-95e1-8cf81ae1fcd0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.784398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-943b765d-d5ff-4c67-9a2f-54b45e0fe9ad req-9bf6902b-1f83-4594-95e1-8cf81ae1fcd0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.797758 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-943b765d-d5ff-4c67-9a2f-54b45e0fe9ad req-9bf6902b-1f83-4594-95e1-8cf81ae1fcd0 service nova] Creating event network-vif-deleted:64cc3a9c-9e24-469a-a6c2-0b9d9fcc0c4e for instance ea96d7b0-2728-4dec-b28d-a85089376221 on n-h1-854882-3 Aug 29 15:28:28.802119 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-943b765d-d5ff-4c67-9a2f-54b45e0fe9ad req-9bf6902b-1f83-4594-95e1-8cf81ae1fcd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034278 Aug 29 15:28:28.803151 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 284/558] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:28.810148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.815599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.816062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.servers [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Removing options 'limit' from query {{(pid=130001) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:28:28.816983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:28.822477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.823136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.823563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.824617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.825427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.825916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.853717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:28:28.898020 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dd84d800-f4a2-43c2-8164-2f0eaffa2806 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.092828 Aug 29 15:28:28.898888 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 285/559] 10.222.0.16 () {58 vars in 1144 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:28.913703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.914615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:28.926749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.927403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.927955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.929676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.930632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.931209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.001586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c22ffc08-3de5-445e-9fbf-f3e56d17d2c7 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701/action" status: 202 len: 0 microversion: 2.1 time: 2.163453 Aug 29 15:28:29.004903 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 275/560] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:26 2022] POST /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701/action => generated 0 bytes in 2169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:29.015146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a79e3004-ed7d-4e6a-9e15-d794a75f9a1f tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a79e3004-ed7d-4e6a-9e15-d794a75f9a1f tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:29.041682 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 15:28:29.043182 n-d-854882-3 devstack@n-api.service[130002]: action_args: {} Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi '-1' Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:29.043930 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.046436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a79e3004-ed7d-4e6a-9e15-d794a75f9a1f tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:29.047925 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a79e3004-ed7d-4e6a-9e15-d794a75f9a1f tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.036494 Aug 29 15:28:29.050304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 276/561] 10.222.0.16 () {58 vars in 1142 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:28:29.056516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.057486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:29.066662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.067162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.067607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.068340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.068997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.069635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.119612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.135744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aea63b5b-d3e2-4bbd-aecd-564139346668 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1275 microversion: 2.1 time: 0.235258 Aug 29 15:28:29.155622 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 286/562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:29.167533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e91f1f3b-3070-4a6b-8cfd-ddc5967a2980 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e91f1f3b-3070-4a6b-8cfd-ddc5967a2980 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:28:29.179330 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 15:28:29.182295 n-d-854882-3 devstack@n-api.service[130001]: action_args: {} Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'testing' Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:29.190806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.192478 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e91f1f3b-3070-4a6b-8cfd-ddc5967a2980 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e91f1f3b-3070-4a6b-8cfd-ddc5967a2980 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023350 Aug 29 15:28:29.194652 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 287/563] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:28:29.210786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4c18737-c7ce-4208-90b9-ced633c45ffd tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.223840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4c18737-c7ce-4208-90b9-ced633c45ffd tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.225007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4c18737-c7ce-4208-90b9-ced633c45ffd tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:29.237253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.servers [None req-f4c18737-c7ce-4208-90b9-ced633c45ffd tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Flavor 'non_existing_flavor' could not be found {{(pid=130001) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 29 15:28:29.238495 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4c18737-c7ce-4208-90b9-ced633c45ffd tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039183 Aug 29 15:28:29.239540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 288/564] 10.222.0.16 () {58 vars in 1178 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:28:29.251955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.257138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.257950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:29.265206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.266430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.267839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.269076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.269619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.270049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.389432 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2127435-87ea-4ed5-85dc-f8c1d64caa56 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.140726 Aug 29 15:28:29.389953 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 289/565] 10.222.0.16 () {58 vars in 1174 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:28:29.405071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.405718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:29.420513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:29.422838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.423961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.425213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.426681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.427039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.427951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.488327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.520994 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85e05be8-2106-4b11-91bc-8e95ac52dae5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.469228 Aug 29 15:28:29.528482 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 277/566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:29.542004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.557008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.559794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:29.575410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.577805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.578460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.580063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.580709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.581673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.751382 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6890bce5-0c14-49b4-82ed-baa02548a22d tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.220396 Aug 29 15:28:29.752336 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 278/567] 10.222.0.16 () {58 vars in 1184 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:28:29.762924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-29a86ac0-e4df-4bb3-b7f6-9facf2a3acf4 req-0b9f7229-3d3d-49d3-90bf-87eba2526c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5131cda1-4999-4c3e-b1dc-88a941e779f2", "name": "network-vif-unplugged", "status": "completed", "tag": "7c99c417-1046-45bc-92f5-5793a47e0139"}, {"name": "network-changed", "server_uuid": "5131cda1-4999-4c3e-b1dc-88a941e779f2", "tag": "7c99c417-1046-45bc-92f5-5793a47e0139"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:29.763509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.773818 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0865024c-2f47-4728-a4f6-28a26e30f4af tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1313 microversion: 2.1 time: 0.378261 Aug 29 15:28:29.775462 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 290/568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:29.784338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.791465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.792618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:29.798181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-29a86ac0-e4df-4bb3-b7f6-9facf2a3acf4 req-0b9f7229-3d3d-49d3-90bf-87eba2526c16 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.800114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-29a86ac0-e4df-4bb3-b7f6-9facf2a3acf4 req-0b9f7229-3d3d-49d3-90bf-87eba2526c16 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.800830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-29a86ac0-e4df-4bb3-b7f6-9facf2a3acf4 req-0b9f7229-3d3d-49d3-90bf-87eba2526c16 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.816689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.818690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.819340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.820689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.821302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.821903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.828079 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-29a86ac0-e4df-4bb3-b7f6-9facf2a3acf4 req-0b9f7229-3d3d-49d3-90bf-87eba2526c16 service nova] Creating event network-vif-unplugged:7c99c417-1046-45bc-92f5-5793a47e0139 for instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 on n-h1-854882-3 Aug 29 15:28:29.828678 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-29a86ac0-e4df-4bb3-b7f6-9facf2a3acf4 req-0b9f7229-3d3d-49d3-90bf-87eba2526c16 service nova] Creating event network-changed:7c99c417-1046-45bc-92f5-5793a47e0139 for instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 on n-h1-854882-3 Aug 29 15:28:29.835409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-29a86ac0-e4df-4bb3-b7f6-9facf2a3acf4 req-0b9f7229-3d3d-49d3-90bf-87eba2526c16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.081518 Aug 29 15:28:29.836634 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 279/569] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:29.843518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.847517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:29.859275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.860187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.860840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.861824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.862482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.863136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.951851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:28:30.032376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.050297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.050790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.051224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.190739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.201084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.207336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.214093 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5352b2e5-72e9-42ec-ab7c-9b9ad46e1149 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.376016 Aug 29 15:28:30.215142 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 280/570] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:30.229333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.233195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:30.249651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.252957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.253712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.259965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.260810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.261560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.736033 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0667a178-700e-4e6e-aaa9-6523261872b3 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.959107 Aug 29 15:28:30.737030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 291/571] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:30.756822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.762164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:30.771435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.772661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.773370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.774655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.775395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.776267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.808073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.823436 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0014ac71-b30b-47f1-833d-d36dc9326560 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.605171 Aug 29 15:28:30.827783 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 281/572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:30 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:30.835836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8e07f48-640d-4168-bac8-e4faea912ef7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.845624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8e07f48-640d-4168-bac8-e4faea912ef7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.847005 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8e07f48-640d-4168-bac8-e4faea912ef7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.017492 Aug 29 15:28:30.847764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 282/573] 10.222.0.16 () {58 vars in 1178 bytes} [Mon Aug 29 15:28:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:28:30.861091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.867294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:30.875383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.876487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.877194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.878116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.878732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.879319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.263661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:31.284290 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4da29b22-dc8f-4c3f-b45d-b4a3a2f55699 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1313 microversion: 2.1 time: 0.426686 Aug 29 15:28:31.286526 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 283/574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:30 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:31.313319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d3c9411b-6557-4f3f-82e7-fd38d38cd83a req-003b74b6-5b22-4cd3-ab00-64a196189b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf291a9-4160-4710-97ef-4067a3e5bf59", "tag": "bd9dd69b-de59-4ca1-9f54-7c18cef0070b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:31.350598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d3c9411b-6557-4f3f-82e7-fd38d38cd83a req-003b74b6-5b22-4cd3-ab00-64a196189b59 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.351094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d3c9411b-6557-4f3f-82e7-fd38d38cd83a req-003b74b6-5b22-4cd3-ab00-64a196189b59 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.356022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d3c9411b-6557-4f3f-82e7-fd38d38cd83a req-003b74b6-5b22-4cd3-ab00-64a196189b59 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.388429 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d3c9411b-6557-4f3f-82e7-fd38d38cd83a req-003b74b6-5b22-4cd3-ab00-64a196189b59 service nova] Creating event network-changed:bd9dd69b-de59-4ca1-9f54-7c18cef0070b for instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 on n-h2-854882-3 Aug 29 15:28:31.398032 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d3c9411b-6557-4f3f-82e7-fd38d38cd83a req-003b74b6-5b22-4cd3-ab00-64a196189b59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109391 Aug 29 15:28:31.399053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 284/575] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:31.404581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:31.424299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:31.425113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Searching by: {'deleted': False, 'project_id': 'f6f618c91ce540038aa1698ae84216d2'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:31.441901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.445126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.445859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.447017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.450636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.451844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.477954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:31.509371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:28:31.523824 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-05a19b0c-6873-4029-acdd-c15fd8e94c34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.785524 Aug 29 15:28:31.532482 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 292/576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:30 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:31.565076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:31.566191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:31.583356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.584262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.584795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.585571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.586428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.586854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.690236 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8b57752a-a38b-4f85-a148-c4f0ce6b17d5 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.289697 Aug 29 15:28:31.690840 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 285/577] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:28:31 2022] GET /compute/v2.1/servers => generated 683 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:31.709551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:31.710186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:31.738772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.739539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.740187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.741095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.744603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.745065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.760252 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] HTTP exception thrown: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 HTTP/1.1 Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:31.762348 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:31.764042 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '40e7185f-0e71-4020-be99-78f0dd4069b6'} Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:31.764929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:31.766365 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:31.770238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 404 to user: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:31.771561 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d6b5bcb-a003-4ce4-99b0-833a4f9b5171 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 404 len: 111 microversion: 2.1 time: 0.066062 Aug 29 15:28:31.776868 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 286/578] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:28:31 2022] DELETE /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:31.785803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:31.786381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:31.793086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.794226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.795629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.796628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.797175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.797874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.848655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:28:32.013293 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-025c5408-67d3-4d33-9bad-0156a37923d0 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 204 len: 0 microversion: 2.1 time: 0.234159 Aug 29 15:28:32.015002 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 287/579] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:28:31 2022] DELETE /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:32.020621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.025876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.034855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.035883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.037055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.037990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.038651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.039229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.157807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.166855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.168310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.169811 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-43fea7d7-5c1f-4f32-9339-216db764f211 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.636209 Aug 29 15:28:32.170389 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 293/580] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:31 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:32.175563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.176282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.184126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.185312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.186168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.187605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.188152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.188663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.220288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:28:32.299670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.311317 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e509504-2bb2-4cfd-9c42-3396d9919ffb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.294296 Aug 29 15:28:32.311534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67b06ae3-2692-470b-9af9-bffc3d1baff2 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 204 len: 0 microversion: 2.1 time: 0.138920 Aug 29 15:28:32.312544 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 288/582] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:32.312664 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 294/582] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:28:32 2022] DELETE /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:32.319583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.320462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.325268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.328038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 40e7185f-0e71-4020-be99-78f0dd4069b6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.330129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.330764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.331227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.331942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.333646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.334123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.336711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.337651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.338422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.338683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:32.339723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.340570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.341295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.375727 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] HTTP exception thrown: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 HTTP/1.1 Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:32.377764 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:32.379143 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '40e7185f-0e71-4020-be99-78f0dd4069b6'} Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:32.379966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. Aug 29 15:28:32.381579 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:32.383459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 404 to user: Instance 40e7185f-0e71-4020-be99-78f0dd4069b6 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:32.384614 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea071868-1190-4ee1-84c3-4a5efcc8bd53 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6" status: 404 len: 111 microversion: 2.1 time: 0.067473 Aug 29 15:28:32.385458 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 289/583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/40e7185f-0e71-4020-be99-78f0dd4069b6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:32.394766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.395553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.402748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.403448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.404165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.405705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.406279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.407020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.549354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.557289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a36b420b-20ae-4ebe-b92d-9275b8e9878c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 200 len: 1523 microversion: 2.1 time: 0.166449 Aug 29 15:28:32.558005 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 290/584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:32.563393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.564070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.570211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.570778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.571279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.572272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.572813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.573302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.590289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.600241 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4ebf51f1-c171-4aa0-9608-013053264726 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1313 microversion: 2.1 time: 0.286082 Aug 29 15:28:32.600828 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 295/585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:32.700329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-148725823", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:32.726835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.736266 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-752f16c6-f35f-43de-8d98-b120e8cf4191 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.176893 Aug 29 15:28:32.736976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 291/586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:32.756770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] validate_networks() for [('5bdccba5-6d96-4038-aca5-09236e5feac2', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:33.166570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:33.167187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:33.167483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:33.167903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:33.168659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:33.178781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.179389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.179827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.180595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.181083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.181585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.194220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.194829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.200337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:33.202812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.203301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.203731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.204551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.204947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.205307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.207055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for user 7bd967d46f614bb4a187218498e934f3 and project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:33.222256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:33.224643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:33.276653 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8a5d7734-076a-4a42-8112-e73eb95d7446 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.580860 Aug 29 15:28:33.277601 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 296/587] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:28:33.289553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ff5b964c-6eac-47f0-bc77-1ee8a204903a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.290328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ff5b964c-6eac-47f0-bc77-1ee8a204903a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.350666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.353225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:33.360677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ff5b964c-6eac-47f0-bc77-1ee8a204903a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.364413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.367022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.368420 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-472b37b0-915c-4d94-a542-7f7a9a8d3ffb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.178666 Aug 29 15:28:33.368673 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ff5b964c-6eac-47f0-bc77-1ee8a204903a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1224 microversion: 2.1 time: 0.083027 Aug 29 15:28:33.381497 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 297/588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:33.381497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.381497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.384114 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 292/589] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:33.399097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.399998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.405357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.406560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.407094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.407498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.431852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-24f344a3-50df-45fb-8066-480a8de4558b req-8aec73ee-8b03-4433-b2e9-7e246f33bf93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a507afd7-0e79-497f-b26d-65fbeef242e3", "tag": "e9c1a183-45af-4136-a73f-ccf56c310916"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:33.446900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-24f344a3-50df-45fb-8066-480a8de4558b req-8aec73ee-8b03-4433-b2e9-7e246f33bf93 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.447592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-24f344a3-50df-45fb-8066-480a8de4558b req-8aec73ee-8b03-4433-b2e9-7e246f33bf93 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.448181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-24f344a3-50df-45fb-8066-480a8de4558b req-8aec73ee-8b03-4433-b2e9-7e246f33bf93 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.464420 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-24f344a3-50df-45fb-8066-480a8de4558b req-8aec73ee-8b03-4433-b2e9-7e246f33bf93 service nova] Creating event network-changed:e9c1a183-45af-4136-a73f-ccf56c310916 for instance a507afd7-0e79-497f-b26d-65fbeef242e3 on n-h2-854882-3 Aug 29 15:28:33.472187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-24f344a3-50df-45fb-8066-480a8de4558b req-8aec73ee-8b03-4433-b2e9-7e246f33bf93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043888 Aug 29 15:28:33.473425 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 293/590] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:28:33.580627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.582650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.596655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.597705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.599519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.601278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.603369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.604055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.613664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.644205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ce0bb75-0081-4bf1-97de-611c50141280 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.273279 Aug 29 15:28:33.645549 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 298/591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:33.650527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-06e9dfce-2266-4c99-ad7b-ef40f5691b3e req-dc3a9867-95ec-4147-941b-e2d7c4b27069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37169b83-efb2-4cd0-a106-c388cfdd59b5", "name": "network-vif-plugged", "status": "completed", "tag": "38298e49-8d6b-4848-b75a-a48df8ce6169"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:33.662172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-06e9dfce-2266-4c99-ad7b-ef40f5691b3e req-dc3a9867-95ec-4147-941b-e2d7c4b27069 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.663049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-06e9dfce-2266-4c99-ad7b-ef40f5691b3e req-dc3a9867-95ec-4147-941b-e2d7c4b27069 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.663691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-06e9dfce-2266-4c99-ad7b-ef40f5691b3e req-dc3a9867-95ec-4147-941b-e2d7c4b27069 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.679579 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-06e9dfce-2266-4c99-ad7b-ef40f5691b3e req-dc3a9867-95ec-4147-941b-e2d7c4b27069 service nova] Creating event network-vif-plugged:38298e49-8d6b-4848-b75a-a48df8ce6169 for instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 on n-h1-854882-3 Aug 29 15:28:33.684861 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-06e9dfce-2266-4c99-ad7b-ef40f5691b3e req-dc3a9867-95ec-4147-941b-e2d7c4b27069 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037757 Aug 29 15:28:33.686457 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 299/592] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:33.692459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.693225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.702005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.703228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.703228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.703609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.704095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.704473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.915529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.928380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e1cbbad1-2592-490b-bb04-ea978ff293d7 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 200 len: 1523 microversion: 2.1 time: 0.352620 Aug 29 15:28:33.944307 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 294/593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:33.950254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.951769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.959646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.960148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.960585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.962495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.963080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.963518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.140656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.155259 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cbfd6b20-a731-40c8-8484-ab506be76009 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1313 microversion: 2.1 time: 0.466650 Aug 29 15:28:34.162174 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 300/594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:34.334169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.366798 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1cdc50fe-a3fa-483d-bd0e-36cfce462a44 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.420995 Aug 29 15:28:34.367418 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 295/595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:34.399643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.400357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.405601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.407967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.411588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.412313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.413007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.413930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.414576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.415164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.423435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.424663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.426338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.426663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.427470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.428260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.584916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.599403 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8422fb29-d1ba-4781-b297-ad9a02488cbe tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1220 microversion: 2.1 time: 0.206046 Aug 29 15:28:34.601131 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 301/596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:34.675926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.678074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.685828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.686619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.687520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.688715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.689573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.690298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.908859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.922261 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee5ff63f-4a60-476f-86bc-1bb1735788dd tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.252427 Aug 29 15:28:34.922853 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 302/597] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:34.953627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.955052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.967881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.969781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.970433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.974134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.974802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.975386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.982667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.991864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.993327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.994632 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-72f25588-ed50-47b2-b50f-be3dc128eac0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.602488 Aug 29 15:28:34.995202 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 296/598] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:35.004586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-04066757-7074-4ec2-a77b-5dd4e6147604 req-23581a9d-5a9e-420e-b886-33d5e3f94002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b741a8d1-dfab-4c4b-b3bb-8921608f0b92", "name": "network-vif-deleted", "tag": "07c9ebd3-8017-4745-91ff-5d0ad9065b40"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:35.033678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-04066757-7074-4ec2-a77b-5dd4e6147604 req-23581a9d-5a9e-420e-b886-33d5e3f94002 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.034459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-04066757-7074-4ec2-a77b-5dd4e6147604 req-23581a9d-5a9e-420e-b886-33d5e3f94002 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.045496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-04066757-7074-4ec2-a77b-5dd4e6147604 req-23581a9d-5a9e-420e-b886-33d5e3f94002 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.072254 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-04066757-7074-4ec2-a77b-5dd4e6147604 req-23581a9d-5a9e-420e-b886-33d5e3f94002 service nova] Creating event network-vif-deleted:07c9ebd3-8017-4745-91ff-5d0ad9065b40 for instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 on n-h1-854882-3 Aug 29 15:28:35.077569 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-04066757-7074-4ec2-a77b-5dd4e6147604 req-23581a9d-5a9e-420e-b886-33d5e3f94002 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076411 Aug 29 15:28:35.078535 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 297/599] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:35.095401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.117716 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f3d37e32-a38d-47f9-a688-91ebb7048ef4 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 200 len: 1481 microversion: 2.1 time: 0.171680 Aug 29 15:28:35.140155 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 303/600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 1481 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:35.198559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.199684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:35.210236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.210835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.211389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.212194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.212683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.213311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.408433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.409188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:35.419669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.436327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.437047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.437854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.438337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.439761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.445819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.459110 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83a11e50-c8b6-4765-b54a-50ad22077618 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1313 microversion: 2.1 time: 0.265198 Aug 29 15:28:35.459709 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 298/601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:35.550585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f4c903c3-17c8-460b-89fe-2cbbdaf379b1 req-baa8c89b-48db-480e-ad58-7ff29d326427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6ff27d-4c6e-4dd5-889a-90b75dd4d388", "name": "network-vif-deleted", "tag": "8a8272b8-9eda-4e14-9620-772885850fee"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:35.562404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f4c903c3-17c8-460b-89fe-2cbbdaf379b1 req-baa8c89b-48db-480e-ad58-7ff29d326427 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.563295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f4c903c3-17c8-460b-89fe-2cbbdaf379b1 req-baa8c89b-48db-480e-ad58-7ff29d326427 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.563939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f4c903c3-17c8-460b-89fe-2cbbdaf379b1 req-baa8c89b-48db-480e-ad58-7ff29d326427 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.576863 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f4c903c3-17c8-460b-89fe-2cbbdaf379b1 req-baa8c89b-48db-480e-ad58-7ff29d326427 service nova] Creating event network-vif-deleted:8a8272b8-9eda-4e14-9620-772885850fee for instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 on n-h2-854882-3 Aug 29 15:28:35.583257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f4c903c3-17c8-460b-89fe-2cbbdaf379b1 req-baa8c89b-48db-480e-ad58-7ff29d326427 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036762 Aug 29 15:28:35.583886 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 299/602] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:35.626999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.627707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:35.629837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:35.643747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.644250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.644686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.645407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.645857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.646270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.767082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.781123 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-98e7366d-763a-49c3-b978-46b3e7b281af tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1276 microversion: 2.1 time: 0.158002 Aug 29 15:28:35.782304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 300/603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:35.818098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.827282 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a88a6269-66b2-4b66-8ba0-c232e5b228d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.426710 Aug 29 15:28:35.827794 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 304/604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:35.946069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.946705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:35.953632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.954133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.954571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.955334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.955792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.956221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.021930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.022667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.042006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.042549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.042998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.043738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.044191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.044613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.129934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.137835 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3361884f-7ffc-4e80-a5dd-0a0e39661087 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.195803 Aug 29 15:28:36.138445 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 301/605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:36.145971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.146684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.152784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.153401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.153977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.155075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.155624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.156149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.187998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.188517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.188905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.189352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lazy-loading 'fault' on Instance uuid b741a8d1-dfab-4c4b-b3bb-8921608f0b92 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:36.190747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.199386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.200829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.202691 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96ff7956-56dd-4d99-8385-58cd5a4804fe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.185891 Aug 29 15:28:36.203278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 305/606] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:36.234351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad54919d097f4a5eada522d696ced88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f618c91ce540038aa1698ae84216d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.242994 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e5f73d7-d23d-4194-b71c-c092c0d29e54 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 200 len: 1313 microversion: 2.1 time: 0.100603 Aug 29 15:28:36.243746 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 302/607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 1313 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:36.479864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.482103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.488743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.489923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.490638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.491594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.492235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.492838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.754091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.765910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ad9cc69-6bdc-43c3-bc1e-112799485e7a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1463 microversion: 2.1 time: 0.289073 Aug 29 15:28:36.769711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 306/608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1463 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:36.805787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.807995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.825518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.827671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.828289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.830832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.831539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.832969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.969590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.971867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.972535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.979191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.979688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.980726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.981477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.981943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.983102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.983761 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f30a8c86-02af-42ba-ac18-857f3a61df89 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1282 microversion: 2.1 time: 0.182910 Aug 29 15:28:36.984907 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 307/609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:36.996124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.997037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.004283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.005070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.005727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.006699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.007428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.008038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.221796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.233536 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9cda6fe-ccb1-4ce6-8465-16a02369ac82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.244468 Aug 29 15:28:37.249101 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 308/610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:37.254810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.255691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.263023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.264687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.264687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.265160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.265915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.266327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.386624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c4dc1655-ba57-4453-b400-c0b126d86c89 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1614 microversion: 2.1 time: 0.599815 Aug 29 15:28:37.388196 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 303/611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1614 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:37.397258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.397931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.405928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.406843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.407343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.410230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.410916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.411895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.517124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.527725 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7da72f26-3b66-4d23-9f00-5e78da9fe145 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.276981 Aug 29 15:28:37.533524 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 309/612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:37.538373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.541600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: b741a8d1-dfab-4c4b-b3bb-8921608f0b92] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.553956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.554769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.555418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.556238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.556782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.557282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.579776 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] HTTP exception thrown: Instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 could not be found. Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 HTTP/1.1 Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:28:37.581644 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 could not be found. Aug 29 15:28:37.583110 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b741a8d1-dfab-4c4b-b3bb-8921608f0b92'} Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 could not be found. Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:37.583862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 could not be found. Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 could not be found. Aug 29 15:28:37.585082 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.586233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 404 to user: Instance b741a8d1-dfab-4c4b-b3bb-8921608f0b92 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:37.586233 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-618ee854-7454-47b7-8303-8a66c46aa727 tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92" status: 404 len: 111 microversion: 2.1 time: 0.048660 Aug 29 15:28:37.586233 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 310/613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/b741a8d1-dfab-4c4b-b3bb-8921608f0b92 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:37.589067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:37.590117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.600433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.601204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.601861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.602759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.603560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.604139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.698468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a475f784dacf42f09574889b479994c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99027d125a554aa8ba6d93ec8d8647df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.699952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] flavor_id is None. Assuming migration. {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:28:37.700807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:28:37.732914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.743109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.744573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.745797 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-04ea3409-9ea6-419c-8c6b-ab34959a9547 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1568 microversion: 2.25 time: 0.353634 Aug 29 15:28:37.755941 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 304/614] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1568 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:37.762162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.768744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] [instance: 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.782113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.784722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.801199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.804518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.805296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.805703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.830031 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] HTTP exception thrown: Instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 could not be found. Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Request method failure captured: Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 HTTP/1.1 Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrpNY-4q3jmpom2qI7RWtQDKot634YCpy8aa61mCxJMMwnv7L83PQm1nCqegB7Vb1-2SN8RXdLF-ieENhBrEVIumSlKswSHJ2L5J8Xd6wgTP8omkWwY5ffvjZdXQpBKduXkGRheATAtEQYzYeJCmt4dAvGmKPvL3MD0Al0V5iQLxmE Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:37.831816 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6f618c91ce540038aa1698ae84216d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6f618c91ce540038aa1698ae84216d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6f618c91ce540038aa1698ae84216d2"}]}] Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f6f618c91ce540038aa1698ae84216d2 Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1852133765 Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: ad54919d097f4a5eada522d696ced88b Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListServersNegativeTestJSON-1852133765-project Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 could not be found. Aug 29 15:28:37.833276 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '3c6ff27d-4c6e-4dd5-889a-90b75dd4d388'} Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 could not be found. Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:37.834040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 could not be found. Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 could not be found. Aug 29 15:28:37.835790 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:37.836867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] Returning 404 to user: Instance 3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:37.836867 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eb7daaf1-f7fd-4091-a362-1f541e675f1c tempest-ListServersNegativeTestJSON-1852133765 tempest-ListServersNegativeTestJSON-1852133765-project] 10.222.0.16 "GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388" status: 404 len: 111 microversion: 2.1 time: 0.076320 Aug 29 15:28:37.836867 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 305/615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/3c6ff27d-4c6e-4dd5-889a-90b75dd4d388 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:37.944125 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-197861fd-87a1-4193-bfda-5a0bdc04a4a7 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5/action" status: 202 len: 0 microversion: 2.1 time: 0.358674 Aug 29 15:28:37.945256 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 311/616] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:37 2022] POST /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:37.954971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.955937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.966469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.967769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.968807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.971049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.972154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.973372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.005845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.006465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:38.012676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.013161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.014180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.014889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.015332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.016022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.271839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:38.283282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:38.287867 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cf31b978-bb38-44e6-bbbb-ce545a5ea4d9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1324 microversion: 2.1 time: 0.285688 Aug 29 15:28:38.290169 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 312/617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:38.298284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9543f696-2fc1-4a28-ab02-c1ba67657992 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1472 microversion: 2.1 time: 0.343439 Aug 29 15:28:38.300164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.304723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:38.313949 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 306/618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:38.322460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.323229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.323812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.324853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.326036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.326628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.329964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:38.554033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.556077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:38.563948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.564764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.565528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.566499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.567176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.567849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.885112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:38.894864 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9a60aae-3048-41b4-aa31-8fc3cbe6098e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.603016 Aug 29 15:28:38.895621 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 313/619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:38.901002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.901786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:38.910504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.911231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.912006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.912711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.913193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.913659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.263972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:39.273732 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c58a6cd1-f900-48c9-b1ee-79053bd0f971 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.724889 Aug 29 15:28:39.278073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 307/620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:39.296273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8730ffcb-1638-4f8f-a8e2-aedfee90e1e9 req-54dbd705-3fba-43a9-8880-bec83199f254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "616f6c8d-7b8e-4889-baaa-5e49f7266e52", "tag": "66e4cd42-7809-46ca-a764-834819d7ff80"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:39.329602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8730ffcb-1638-4f8f-a8e2-aedfee90e1e9 req-54dbd705-3fba-43a9-8880-bec83199f254 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.330496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8730ffcb-1638-4f8f-a8e2-aedfee90e1e9 req-54dbd705-3fba-43a9-8880-bec83199f254 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.332502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8730ffcb-1638-4f8f-a8e2-aedfee90e1e9 req-54dbd705-3fba-43a9-8880-bec83199f254 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.365104 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8730ffcb-1638-4f8f-a8e2-aedfee90e1e9 req-54dbd705-3fba-43a9-8880-bec83199f254 service nova] Creating event network-changed:66e4cd42-7809-46ca-a764-834819d7ff80 for instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 on n-h1-854882-3 Aug 29 15:28:39.376943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8730ffcb-1638-4f8f-a8e2-aedfee90e1e9 req-54dbd705-3fba-43a9-8880-bec83199f254 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095087 Aug 29 15:28:39.380906 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 308/621] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:39.389982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.391024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:39.399515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.400312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.401240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.402644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.403373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.405276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.646644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:39.656049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:39.665226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:39.667064 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29927b0a-16a9-4909-940f-b13667b5909c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1558 microversion: 2.25 time: 0.769452 Aug 29 15:28:39.667679 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 314/622] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1558 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:39.688151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:39.693135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.694001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:39.699202 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4aafbe76-5715-4a64-ac65-2e487647d833 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1324 microversion: 2.1 time: 0.316812 Aug 29 15:28:39.701596 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 309/623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:39 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:39.708564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f3b86d9-6966-482f-bf69-b6462494a60b tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '.version_select at 0x7fb0e381d3a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.719087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.720077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.720444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3b86d9-6966-482f-bf69-b6462494a60b tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.721031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.722242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.722516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3b86d9-6966-482f-bf69-b6462494a60b tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.723104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3b86d9-6966-482f-bf69-b6462494a60b tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.723411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.724302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.756059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9f3b86d9-6966-482f-bf69-b6462494a60b tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1716 microversion: 2.25 time: 0.053038 Aug 29 15:28:39.761003 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 310/624] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Aug 29 15:28:39 2022] GET /compute/v2.1/os-migrations => generated 1716 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:39.779431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.781590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:39.797133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.804102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.804102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.804102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.804387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.804677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.132802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:40.152741 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9a310f7e-b91f-4c54-8288-6ef180905229 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1472 microversion: 2.1 time: 0.459170 Aug 29 15:28:40.154421 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 315/625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:39 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:40.170598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:40.171656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:40.179433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.180485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.181309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.182732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.183455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.184145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.233847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 5131cda1-4999-4c3e-b1dc-88a941e779f2 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:40.249057 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63b6f243-456d-4874-b219-4a53e81cf8b4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 2051 microversion: 2.25 time: 0.476079 Aug 29 15:28:40.250022 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 311/626] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:39 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 2051 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:40.301999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:40.313469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:40.351054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.351548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.351986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.361582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.362327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.363067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.471545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:40.486197 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2fc778e-8282-4674-b3b4-f10cb522d9b2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.327106 Aug 29 15:28:40.486997 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 316/627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:40 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:40.511046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1407086669", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5ab8f307-77e2-4e82-973f-058294ab71aa"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:40.579474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] validate_networks() for [('5ab8f307-77e2-4e82-973f-058294ab71aa', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:40.691170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:40.693916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:40.704860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a79d6b13-118d-49eb-b37c-1f5c1952548f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.408848 Aug 29 15:28:40.705466 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 312/628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:40 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:40.732206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:40.733759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:40.740966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.741820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.742495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.743199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.743840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.744551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.004559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:41.015498 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2146170c-5ce9-4b20-ad0f-16d468356c06 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1324 microversion: 2.1 time: 0.288077 Aug 29 15:28:41.031520 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 313/629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:40 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:41.053181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:41.053976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:41.054627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:41.055213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:41.055839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:41.064385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=29 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:41.067758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.068216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.068654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.069616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.070255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.070863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.080450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=17 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:41.094719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:41.100407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for user f331c1e3ee1442ad863d8909ca76020b and project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:41.115434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:41.118442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:41.179817 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-18fdc747-fba2-4b07-b25f-a0b3ce80a4cf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.677777 Aug 29 15:28:41.188923 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 317/630] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:28:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:28:41.189641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:41.189641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:41.201701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e20e4809-67c9-429e-8419-3917fd7fa4de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:41.202603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e20e4809-67c9-429e-8419-3917fd7fa4de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:41.203377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.203791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.207865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.208928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.209741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.210805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.379564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e20e4809-67c9-429e-8419-3917fd7fa4de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:41.396590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e20e4809-67c9-429e-8419-3917fd7fa4de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:41.400593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e20e4809-67c9-429e-8419-3917fd7fa4de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:41.403833 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e20e4809-67c9-429e-8419-3917fd7fa4de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1262 microversion: 2.25 time: 0.210035 Aug 29 15:28:41.407278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 318/631] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:41 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1262 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:41.457988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:41.524981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:41.533716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:41.569465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:41.584207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.585136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.593955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.595452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.601682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.602510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.683581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:41.713801 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4fec3fc5-3452-4e79-93bd-e8b12fbafbd8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1472 microversion: 2.1 time: 0.533211 Aug 29 15:28:41.715277 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 314/632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:41 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1472 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:41.733818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:41.735320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:41.762680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.763910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.766740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.767565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.769620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.771446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.056648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.081888 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55bead55-b783-4699-a22e-c9d7fb40c35d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.563334 Aug 29 15:28:42.083226 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 319/633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:41 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:42.095539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f4c897f8-d5ae-4171-bb91-c5664a970e67 req-6d26e42a-cba6-4586-bcc2-a4f2c139970e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507afd7-0e79-497f-b26d-65fbeef242e3", "name": "network-vif-plugged", "status": "completed", "tag": "e9c1a183-45af-4136-a73f-ccf56c310916"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:42.111517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f4c897f8-d5ae-4171-bb91-c5664a970e67 req-6d26e42a-cba6-4586-bcc2-a4f2c139970e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.112426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f4c897f8-d5ae-4171-bb91-c5664a970e67 req-6d26e42a-cba6-4586-bcc2-a4f2c139970e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.113552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f4c897f8-d5ae-4171-bb91-c5664a970e67 req-6d26e42a-cba6-4586-bcc2-a4f2c139970e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.128143 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f4c897f8-d5ae-4171-bb91-c5664a970e67 req-6d26e42a-cba6-4586-bcc2-a4f2c139970e service nova] Creating event network-vif-plugged:e9c1a183-45af-4136-a73f-ccf56c310916 for instance a507afd7-0e79-497f-b26d-65fbeef242e3 on n-h2-854882-3 Aug 29 15:28:42.134777 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f4c897f8-d5ae-4171-bb91-c5664a970e67 req-6d26e42a-cba6-4586-bcc2-a4f2c139970e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043576 Aug 29 15:28:42.135673 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 320/634] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:42.142755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:42.143637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:42.160813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.161607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.162804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.163863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.164762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.165331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.443109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.454051 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da04d835-d2f9-4765-a94f-dfeb44a35a1f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.730021 Aug 29 15:28:42.456838 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 315/635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:41 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:42.473992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:42.475704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:42.490559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.491869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.492494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.493809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.495322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.495983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.516353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.526744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3515449f-5930-4641-ac86-23c7d1aa7023 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1324 microversion: 2.1 time: 0.389708 Aug 29 15:28:42.532782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 321/636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:42 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:42.688725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.698861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.700325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.701662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bdba18a9-7d2c-4ea8-be05-3a254fe20c19 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1258 microversion: 2.25 time: 0.242498 Aug 29 15:28:42.702231 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 316/637] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:42 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:42.736662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:42.737277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:42.743447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.743929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.744356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.745059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.745533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.745952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.898470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.908071 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-00ab0a71-31bd-4725-a6e4-c7338029d0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1472 microversion: 2.1 time: 0.175792 Aug 29 15:28:42.909252 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 322/638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:42 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:43.106440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:43.107141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:43.114126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.114619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.115050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.115761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.116219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.116644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.490313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:43.491381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:43.507719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.508482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.509451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.510344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.511100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.511831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.696858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.705753 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cd42c77e-ffea-4cd2-bbbe-3a404c9dbc0a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1317 microversion: 2.1 time: 0.233254 Aug 29 15:28:43.720496 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 323/639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:43 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:43.720496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:43.720496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:43.720496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.721008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.721008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.721008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.721008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.721496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.723789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.732289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff24c963-e380-4cda-b3d3-ad622550d00c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.629478 Aug 29 15:28:43.733174 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 317/640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:43 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:43.753978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:43.754760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:43.765841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.768919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.769464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.770207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.770667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.771099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.902024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.919971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.924368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.925965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f9983197-3bfd-4a3c-8995-403752089403 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1314 microversion: 2.25 time: 0.191714 Aug 29 15:28:43.927054 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 318/641] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:43 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:43.952032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:43.953366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:43.960055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.961120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.961933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.963354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.964122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.964819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.980778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.991750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d85f563b-705d-4d1d-a479-1c3eda8c8fd8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1324 microversion: 2.1 time: 0.283651 Aug 29 15:28:43.993641 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 324/642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:43 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:44.307469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:44.323804 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a6b661dc-ea2d-4f7e-9961-bad646f18216 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.394945 Aug 29 15:28:44.334673 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 319/643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:43 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:44.727126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:44.728692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:44.741650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:44.742385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:44.742994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:44.744213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:44.744903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:44.745547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:44.752756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:44.753374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:44.763781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:44.774352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:44.774813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:44.775558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:44.776015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:44.776437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.019490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:45.030436 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab36a8a2-19a1-4138-982e-24ee27f1403e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.281283 Aug 29 15:28:45.031127 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 320/644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:44 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:45.037543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:45.038163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:45.049721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.050447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.051073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.052530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.053066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.053643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.154394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:45.165011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:45.168746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:45.173360 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-22520b31-25e1-4570-9427-9e5cd5c83b12 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1320 microversion: 2.25 time: 0.140458 Aug 29 15:28:45.174164 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 321/645] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:45 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1320 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:45.178019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:45.182337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:45.187825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:45.189573 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-49e214bd-a0fe-414f-9486-3938c1b77ea6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1466 microversion: 2.1 time: 0.466293 Aug 29 15:28:45.191380 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 325/646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:44 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1466 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:45.203406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.203985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.204520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.205329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.205918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.206437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.227647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-468352727", "metadata": {"image_type": "test"}}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:45.230941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:45.244060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.245321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.246062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.247280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.248933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.249827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.297238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Getting quotas for project 03575bcf80404b0994fc8d967804b6df. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:45.307987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Getting quotas for user 7ead06f178974869a251628cca018175 and project 03575bcf80404b0994fc8d967804b6df. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:45.549657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:45.564242 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a962c98-0ad4-43ba-8c5f-5aee887953e2 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1324 microversion: 2.1 time: 0.385059 Aug 29 15:28:45.565496 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 322/647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:45 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:45.574631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-412fcfd3-217d-4151-8409-ae29f39660f9 req-0994286e-dc51-4739-b244-cba07a0f602c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ea2f92-896a-47a6-b083-80d43213b701", "name": "network-vif-unplugged", "status": "completed", "tag": "d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:45.600451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-412fcfd3-217d-4151-8409-ae29f39660f9 req-0994286e-dc51-4739-b244-cba07a0f602c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.601182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-412fcfd3-217d-4151-8409-ae29f39660f9 req-0994286e-dc51-4739-b244-cba07a0f602c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.602098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-412fcfd3-217d-4151-8409-ae29f39660f9 req-0994286e-dc51-4739-b244-cba07a0f602c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.616073 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-412fcfd3-217d-4151-8409-ae29f39660f9 req-0994286e-dc51-4739-b244-cba07a0f602c service nova] Creating event network-vif-unplugged:d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6 for instance e4ea2f92-896a-47a6-b083-80d43213b701 on n-h1-854882-3 Aug 29 15:28:45.623729 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-412fcfd3-217d-4151-8409-ae29f39660f9 req-0994286e-dc51-4739-b244-cba07a0f602c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056133 Aug 29 15:28:45.624911 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 323/648] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:45.634255 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f23d78fe-4e53-40c9-b7f7-2ae1e06db2b3 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "POST /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3/action" status: 202 len: 0 microversion: 2.1 time: 0.412262 Aug 29 15:28:45.634931 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 326/649] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:45 2022] POST /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:28:45.639626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:45.640331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:45.646366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6127c239-ba40-42bf-8d76-b97f5c063370 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3850c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:45.652861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.653364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.653868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.654562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.655565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.656191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.722880 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6127c239-ba40-42bf-8d76-b97f5c063370 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.080626 Aug 29 15:28:45.723878 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 327/650] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:45 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:45.804735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-83a33356-c0b3-468d-bfdc-176b9d00a061 req-f040607d-d5f6-4601-b038-1ddc68e27bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616f6c8d-7b8e-4889-baaa-5e49f7266e52", "name": "network-vif-plugged", "status": "completed", "tag": "66e4cd42-7809-46ca-a764-834819d7ff80"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:45.818539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-83a33356-c0b3-468d-bfdc-176b9d00a061 req-f040607d-d5f6-4601-b038-1ddc68e27bbc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:45.819691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-83a33356-c0b3-468d-bfdc-176b9d00a061 req-f040607d-d5f6-4601-b038-1ddc68e27bbc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:45.820495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-83a33356-c0b3-468d-bfdc-176b9d00a061 req-f040607d-d5f6-4601-b038-1ddc68e27bbc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:45.836466 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-83a33356-c0b3-468d-bfdc-176b9d00a061 req-f040607d-d5f6-4601-b038-1ddc68e27bbc service nova] Creating event network-vif-plugged:66e4cd42-7809-46ca-a764-834819d7ff80 for instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 on n-h1-854882-3 Aug 29 15:28:45.845682 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-83a33356-c0b3-468d-bfdc-176b9d00a061 req-f040607d-d5f6-4601-b038-1ddc68e27bbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045015 Aug 29 15:28:45.848493 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 328/651] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:28:45.965337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:46.011155 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a8ca986-2123-4123-9480-ea067cbc4770 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.382480 Aug 29 15:28:46.013308 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 324/652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:45 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:46.059338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:46.060671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:46.074740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.075972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.077117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.078442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.079525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.080620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.199044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:46.200377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:46.211408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.212672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.213719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.215412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.216243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.217864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.413405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:46.427976 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-049b08fb-e629-4214-ad8a-63c1e153d9be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.376669 Aug 29 15:28:46.428747 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 329/653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:46 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:46.599157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:46.601013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:46.617948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.620185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.624984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.626710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.627961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.628850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.855304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:46.865116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:46.867015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:46.868323 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9d2069d-67ee-4e85-9bdb-bc5c03acc79c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.674573 Aug 29 15:28:46.868896 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 325/654] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:46 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:46.876012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b394177-e673-4511-b803-08ebd6bff47c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3aa4790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:46.926585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b394177-e673-4511-b803-08ebd6bff47c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.056337 Aug 29 15:28:46.927770 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 326/655] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:46 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:46.963575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:46.976149 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9623d368-2037-4a91-95f4-66954da69119 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1324 microversion: 2.1 time: 0.391763 Aug 29 15:28:46.983388 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 330/656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:46 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:47.053905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:47.055843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:47.064997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.065565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.065994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.066702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.067155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.067795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.257967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:47.269651 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1634df0-39e2-46fa-8d2f-d4edd231caf0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.222130 Aug 29 15:28:47.271288 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 327/657] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:47 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:47.458690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:47.460929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:47.473021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.474706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.475468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.476531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.477140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.477833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.655180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fb0585ec-5809-41de-a35a-502088ae8646 req-632976c6-ce5f-4773-9a8c-b672c4529d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a18289-bd6c-4503-a954-36e1aaa0c110", "tag": "0dcba184-a55c-4388-8169-12ea22b34d6f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:47.673246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fb0585ec-5809-41de-a35a-502088ae8646 req-632976c6-ce5f-4773-9a8c-b672c4529d19 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.674088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fb0585ec-5809-41de-a35a-502088ae8646 req-632976c6-ce5f-4773-9a8c-b672c4529d19 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.674776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fb0585ec-5809-41de-a35a-502088ae8646 req-632976c6-ce5f-4773-9a8c-b672c4529d19 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.703276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fb0585ec-5809-41de-a35a-502088ae8646 req-632976c6-ce5f-4773-9a8c-b672c4529d19 service nova] Creating event network-changed:0dcba184-a55c-4388-8169-12ea22b34d6f for instance d9a18289-bd6c-4503-a954-36e1aaa0c110 on n-h2-854882-3 Aug 29 15:28:47.710060 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fb0585ec-5809-41de-a35a-502088ae8646 req-632976c6-ce5f-4773-9a8c-b672c4529d19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065105 Aug 29 15:28:47.711209 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 328/658] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:47.717486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8355476c-b201-4c32-ad93-47d6189e1634 req-afc056a1-dc25-43c3-97a1-85eaa79ba48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ea2f92-896a-47a6-b083-80d43213b701", "tag": "d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:47.730446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8355476c-b201-4c32-ad93-47d6189e1634 req-afc056a1-dc25-43c3-97a1-85eaa79ba48e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.731493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8355476c-b201-4c32-ad93-47d6189e1634 req-afc056a1-dc25-43c3-97a1-85eaa79ba48e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.732881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8355476c-b201-4c32-ad93-47d6189e1634 req-afc056a1-dc25-43c3-97a1-85eaa79ba48e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.746151 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8355476c-b201-4c32-ad93-47d6189e1634 req-afc056a1-dc25-43c3-97a1-85eaa79ba48e service nova] Creating event network-changed:d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6 for instance e4ea2f92-896a-47a6-b083-80d43213b701 on n-h1-854882-3 Aug 29 15:28:47.765657 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8355476c-b201-4c32-ad93-47d6189e1634 req-afc056a1-dc25-43c3-97a1-85eaa79ba48e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050723 Aug 29 15:28:47.773591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 329/659] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:47.808844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:47.817281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:47.823468 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29211653-eb0e-451d-a6df-908a73031fea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.376557 Aug 29 15:28:47.829032 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 331/660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:47 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:47.898781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:47.900896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:47.911354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.912435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.913167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.914218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.914867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.915656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.942116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-130d8a5c-c3aa-4933-9f40-4403ce7dc97b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e35e7b80>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.009041 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-130d8a5c-c3aa-4933-9f40-4403ce7dc97b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.070791 Aug 29 15:28:48.015836 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 332/661] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:47 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:48.020582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.022111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:48.032897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.033799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.034490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.035451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.036125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.036770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.285418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:48.287096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:48.298195 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae389652-3c0e-4849-bce7-5e79fdc5a2f9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1520 microversion: 2.1 time: 0.286790 Aug 29 15:28:48.299226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:48.300159 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 333/662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:48 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:48.301156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:48.303224 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-356aa2c0-5afc-4b03-b0d7-4b3f5ea44562 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.409892 Aug 29 15:28:48.304165 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 330/663] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:47 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:48.306972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.307910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:48.319751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.320638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.321507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.322226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.322684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.323468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.339222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.340829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:48.350387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.351300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.352212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.353357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.355281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.356475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.587974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:48.594697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:48.603267 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eddecc6b-df2e-4699-908e-03eec35718e8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1520 microversion: 2.1 time: 0.269590 Aug 29 15:28:48.611147 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5bf883b2-0ee6-4b7d-bcfb-02ff6bc63fb1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.300860 Aug 29 15:28:48.619036 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 331/664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:48 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:48.619557 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 334/665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:48 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:48.626147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1236945090"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:48.628122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:48.640312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.640811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.641254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.642055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.642616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.642929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.660717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:48.848368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.849328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:48.858817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.859581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.860087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.861173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.861866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.862525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.886720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-607ea28c-99f5-421b-afc8-79dc47a20999 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52/action" status: 202 len: 0 microversion: 2.1 time: 0.265487 Aug 29 15:28:48.887783 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 332/666] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:48 2022] POST /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:28:48.912817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae533aa7-40e5-4dbf-9436-e5c940343a0d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '.version_select at 0x7fb0e36cf310>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.075137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.086580 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45bb97ed-b79f-4630-a242-73fa2f0586d3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.243016 Aug 29 15:28:49.087779 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 335/667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:48 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:49.096070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25834dd1-3c8d-4008-b82b-64e65331a18b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38f4d30>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.134561 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae533aa7-40e5-4dbf-9436-e5c940343a0d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439" status: 204 len: 0 microversion: 2.1 time: 0.235539 Aug 29 15:28:49.135459 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 333/668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:48 2022] DELETE /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:28:49.144206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7bc22455-60b7-42c8-b8aa-d1d4472a6557 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '.version_select at 0x7fb0e3813820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.173744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25834dd1-3c8d-4008-b82b-64e65331a18b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.082900 Aug 29 15:28:49.182146 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 336/669] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:49.183782 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-7bc22455-60b7-42c8-b8aa-d1d4472a6557 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Image not found. Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7bc22455-60b7-42c8-b8aa-d1d4472a6557 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439 HTTP/1.1 Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:28:49.193319 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '383430b5-dbd8-4c76-8d65-e77f779b8439'} Aug 29 15:28:49.196225 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:28:49.197883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 383430b5-dbd8-4c76-8d65-e77f779b8439 Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:28:49.199225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 383430b5-dbd8-4c76-8d65-e77f779b8439 could not be found. Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:28:49.200499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:28:49.201959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7bc22455-60b7-42c8-b8aa-d1d4472a6557 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:49.204248 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7bc22455-60b7-42c8-b8aa-d1d4472a6557 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439" status: 404 len: 62 microversion: 2.1 time: 0.056397 Aug 29 15:28:49.204248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 334/670] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:28:49.209561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.210368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:49.219040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.219983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.220279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.221185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.221873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.222304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.349204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.350902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:49.363335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.364122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.365988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.366895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.370483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.371416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.399784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.414014 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24bc3ce0-1539-40ea-9e78-b3e6bfb500eb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1532 microversion: 2.1 time: 0.209920 Aug 29 15:28:49.416512 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 337/671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1532 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:49.598655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.608812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.611011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.612253 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a98e11ea-0c7a-46ba-9389-73059b232ab0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.276461 Aug 29 15:28:49.613996 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 335/672] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:49.634202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.634822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:49.642372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.642906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.643354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.644188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.644592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.645083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.807573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.819238 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a49c1ddc-f0dd-436a-9452-9729da8f8649 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.189066 Aug 29 15:28:49.819837 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 338/673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:50.109129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.110064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.118206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.118769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.119562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.120315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.120831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.121296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.192830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b2a63fa-fc98-4781-a515-a087cc885e53 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e35d10d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.248078 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b2a63fa-fc98-4781-a515-a087cc885e53 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.060322 Aug 29 15:28:50.248979 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 339/674] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:50.436898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.437877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.444758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.445557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.445998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.446714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.447192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.447585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.683109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:50.695849 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77eae178-aaf4-4b52-9888-c44106adee60 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.591303 Aug 29 15:28:50.696819 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 336/675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:50.703009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.703995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.715458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.717742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.718754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.720492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.721741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.722823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.777365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:50.793117 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ea12e41-2976-482c-bb34-6249f71cbb6f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1538 microversion: 2.1 time: 0.360087 Aug 29 15:28:50.806733 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 340/676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1538 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:50.840623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.841181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.848762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.849268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.849741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.850467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.850931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.851395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.092068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:51.095725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:51.099863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:51.108632 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-405deccd-c24b-4538-99f6-b12c6aa0d26c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.271634 Aug 29 15:28:51.109087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:51.110996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:51.112310 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2ce94f4-922f-4763-9951-e1425b043c11 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.414000 Aug 29 15:28:51.113060 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 341/677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:51.126593 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 337/678] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:51.264114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4a8dc37-d00c-43cb-8a8b-259c940f9ac1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e363eaf0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.323623 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4a8dc37-d00c-43cb-8a8b-259c940f9ac1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.064279 Aug 29 15:28:51.324578 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 342/679] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:51.413273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3aab45c4-6a2a-4fe8-bbe5-5560825ecc10 req-37e377c9-4e62-437d-9f6a-66039aa62314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507afd7-0e79-497f-b26d-65fbeef242e3", "name": "network-vif-plugged", "status": "completed", "tag": "e9c1a183-45af-4136-a73f-ccf56c310916"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:51.423981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3aab45c4-6a2a-4fe8-bbe5-5560825ecc10 req-37e377c9-4e62-437d-9f6a-66039aa62314 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.424727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3aab45c4-6a2a-4fe8-bbe5-5560825ecc10 req-37e377c9-4e62-437d-9f6a-66039aa62314 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.425402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3aab45c4-6a2a-4fe8-bbe5-5560825ecc10 req-37e377c9-4e62-437d-9f6a-66039aa62314 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.445614 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3aab45c4-6a2a-4fe8-bbe5-5560825ecc10 req-37e377c9-4e62-437d-9f6a-66039aa62314 service nova] Creating event network-vif-plugged:e9c1a183-45af-4136-a73f-ccf56c310916 for instance a507afd7-0e79-497f-b26d-65fbeef242e3 on n-h2-854882-3 Aug 29 15:28:51.460146 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3aab45c4-6a2a-4fe8-bbe5-5560825ecc10 req-37e377c9-4e62-437d-9f6a-66039aa62314 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049783 Aug 29 15:28:51.462037 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 338/680] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:51.719793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.720660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:51.740080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:51.743566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.744059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.744502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.745221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.749133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.749621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.819564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.820816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:51.834896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.838024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.839518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.840463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.844138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.844778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.048706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.063479 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cdb68a27-8250-466a-971c-6ba5342e453a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1533 microversion: 2.1 time: 0.248829 Aug 29 15:28:52.064777 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 339/681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1533 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:52.110750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.119728 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39ccbc72-8f8c-42a6-a905-68066b19e7f1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.405139 Aug 29 15:28:52.143504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:52.144493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:52.165306 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 343/682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:52.168344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.168972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.171551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:52.172593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:52.176608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.177635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.178128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.178567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.180572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.181553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.182161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.183048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.183669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.185653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.586123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.609210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.611660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.614718 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a64e67e6-0ee4-406c-9398-4967a81a10eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.447963 Aug 29 15:28:52.616470 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 344/683] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:52 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:52.625545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-11322ae9-8aa0-47cc-8adf-01630c488efb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e35e7a60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:52.727964 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-11322ae9-8aa0-47cc-8adf-01630c488efb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.106811 Aug 29 15:28:52.729504 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 345/684] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:52 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:52.893468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.914676 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a817a1c-bfda-41af-b7c1-a2b5fe0b15ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.781170 Aug 29 15:28:52.916300 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 340/685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:52 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:53.084660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.085648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.100045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.100812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.101528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.103108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.104045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.106035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.178716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.179706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.195045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.196459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.199034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.202018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.202619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.209583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.417937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:53.427825 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-94169a2a-689f-4fc1-a7db-9f4b58661d3d tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1520 microversion: 2.1 time: 0.347541 Aug 29 15:28:53.450010 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 346/686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:53.459188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.459684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.476731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.479363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.480057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.484214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.485196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.486004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.518385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:53.531951 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5653ce9c-ffda-45ea-9aaf-5127e4b92932 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.363112 Aug 29 15:28:53.547936 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 341/687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:53.562021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:28:53.648385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.649341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.661732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.662951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.665738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.668550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.669256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.670082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.699293 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b70c2e6c-7d5e-49cf-ac9f-00497698b43f tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 204 len: 0 microversion: 2.1 time: 0.241555 Aug 29 15:28:53.705660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 347/688] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:28:53 2022] DELETE /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:28:53.718093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.719140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.735467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.736144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.736764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.741998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.742853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.743551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.925417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:53.939578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:53.941617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:53.943000 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-01b0a1ca-58e3-4159-a9f7-4498dc812df2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.299222 Aug 29 15:28:53.944110 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 342/689] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:53.962525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62059dae-f9fc-4af0-94b3-5aefb5d882e9 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38d2820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:54.063111 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-62059dae-f9fc-4af0-94b3-5aefb5d882e9 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.117691 Aug 29 15:28:54.070259 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 343/690] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:54.070259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:54.070259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:54.076464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.076966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.077430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.078155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.080683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.081141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.284145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.284906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.292809 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe6c3194-0789-47fe-aa69-e5c3e0f43566 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.228014 Aug 29 15:28:54.293962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 344/691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:54 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:54.302599 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31cd2d20-3674-4df3-89c4-e1d0ae32043c tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1526 microversion: 2.1 time: 0.584135 Aug 29 15:28:54.303930 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 348/692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1526 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:54.571151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:54.571839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:54.582781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.583312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.583840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.584631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.585151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.585911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.868505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.884518 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe146265-d48b-4627-9aec-ce4708385a86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.321309 Aug 29 15:28:54.898329 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 345/693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:54 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:54.971581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:54.972292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:54.983670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.984530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.986417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.987867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.988600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.990185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.078376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b830ad56-bbd8-4e30-8a45-366b995ec066 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38ce8b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.146737 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b830ad56-bbd8-4e30-8a45-366b995ec066 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.072273 Aug 29 15:28:55.149814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 346/694] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:55.317115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.318043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:55.331451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.332260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.332882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.335994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.336680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.337566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.517308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:55.531847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:55.545660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:55.551760 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b846e4f3-d103-45b3-9dbc-d0ccf02fb360 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.584067 Aug 29 15:28:55.552393 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 349/695] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:54 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:55.570528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.571686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:55.580871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.581705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.589945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.590800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.591334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.591768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.866291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:55.879032 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c19e9df8-10f8-41d3-9b93-ecd879628b2f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.567987 Aug 29 15:28:55.898680 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 347/696] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:55.910440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-63872a07-e989-4643-8b13-a7c1817995d7 req-71489f35-0c37-41fb-b903-679a40f2affe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a18289-bd6c-4503-a954-36e1aaa0c110", "name": "network-vif-plugged", "status": "completed", "tag": "0dcba184-a55c-4388-8169-12ea22b34d6f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:55.930660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-63872a07-e989-4643-8b13-a7c1817995d7 req-71489f35-0c37-41fb-b903-679a40f2affe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.932349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-63872a07-e989-4643-8b13-a7c1817995d7 req-71489f35-0c37-41fb-b903-679a40f2affe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.933230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-63872a07-e989-4643-8b13-a7c1817995d7 req-71489f35-0c37-41fb-b903-679a40f2affe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.940181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:55.954689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-63872a07-e989-4643-8b13-a7c1817995d7 req-71489f35-0c37-41fb-b903-679a40f2affe service nova] Creating event network-vif-plugged:0dcba184-a55c-4388-8169-12ea22b34d6f for instance d9a18289-bd6c-4503-a954-36e1aaa0c110 on n-h2-854882-3 Aug 29 15:28:55.957033 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a10f5748-8ac9-43a1-9919-d599858dfe01 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1526 microversion: 2.1 time: 0.402509 Aug 29 15:28:55.958105 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 350/697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1526 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:55.961456 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-63872a07-e989-4643-8b13-a7c1817995d7 req-71489f35-0c37-41fb-b903-679a40f2affe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061260 Aug 29 15:28:55.962652 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 348/698] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:55.962918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.963529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:55.990504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.993810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.994818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.995760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.996598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.997218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.166029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-371be7dd-2b6c-4fe4-934c-e9a15dca0d04 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e36df8b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:56.237181 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-371be7dd-2b6c-4fe4-934c-e9a15dca0d04 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.075905 Aug 29 15:28:56.250950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 349/699] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:56 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:56.435810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c35e1b90-a1d4-4de8-adef-32abfdafa9be req-e437dbb6-0eed-49a4-b4e6-81be8f077525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616f6c8d-7b8e-4889-baaa-5e49f7266e52", "name": "network-vif-deleted", "tag": "66e4cd42-7809-46ca-a764-834819d7ff80"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:56.477356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c35e1b90-a1d4-4de8-adef-32abfdafa9be req-e437dbb6-0eed-49a4-b4e6-81be8f077525 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.492179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:56.496275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:56.508024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c35e1b90-a1d4-4de8-adef-32abfdafa9be req-e437dbb6-0eed-49a4-b4e6-81be8f077525 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.514188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c35e1b90-a1d4-4de8-adef-32abfdafa9be req-e437dbb6-0eed-49a4-b4e6-81be8f077525 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.524764 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d5b2a9fb-fdea-42b3-87d7-808df05ca2f7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1504 microversion: 2.1 time: 0.565529 Aug 29 15:28:56.525373 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 351/700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:56.574412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c35e1b90-a1d4-4de8-adef-32abfdafa9be req-e437dbb6-0eed-49a4-b4e6-81be8f077525 service nova] Creating event network-vif-deleted:66e4cd42-7809-46ca-a764-834819d7ff80 for instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 on n-h1-854882-3 Aug 29 15:28:56.583074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:56.584748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:56.594463 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c35e1b90-a1d4-4de8-adef-32abfdafa9be req-e437dbb6-0eed-49a4-b4e6-81be8f077525 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161606 Aug 29 15:28:56.596806 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 350/701] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:56.620685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.621346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.625583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.629730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.630293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.633596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.908313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:56.909072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:56.944422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.944931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.947125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.947891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.948357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.950816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.142061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:57.158143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:57.162611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:57.165594 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a0b10e30-373f-4dcf-9809-3be1405a7053 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1362 microversion: 2.25 time: 0.589479 Aug 29 15:28:57.166279 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 352/702] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:56 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1362 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:57.174083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:57.184744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-689c5395-084e-4f10-bc32-b3f3f3f3d916 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.283788 Aug 29 15:28:57.186108 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 351/703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:56 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:57.193889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.196802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:57.212072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.214853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.215895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.217309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.217955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.218588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.254455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-32b89afa-7af1-4638-b928-fb197cd15975 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3813940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.265004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.266751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.267379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.268034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lazy-loading 'fault' on Instance uuid 616f6c8d-7b8e-4889-baaa-5e49f7266e52 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:57.369431 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-32b89afa-7af1-4638-b928-fb197cd15975 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.118265 Aug 29 15:28:57.370176 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 352/704] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:57.412229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:57.420646 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9819af47-8068-4e97-b9a0-b84f20f9dcf0 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 200 len: 1314 microversion: 2.1 time: 0.249967 Aug 29 15:28:57.432349 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 353/705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:57.551343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.554252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:57.568406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.569883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.570972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.571856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.572933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.573567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.866335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:57.875631 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-de19fdc8-e10a-4b5e-a72a-023c1077d304 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1494 microversion: 2.1 time: 0.328537 Aug 29 15:28:57.890794 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 353/706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1494 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:57.897325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2720cc45-da4d-4343-aad5-e0993f900fde tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '.version_select at 0x7fb0e3715670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.901729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2720cc45-da4d-4343-aad5-e0993f900fde tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.902456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2720cc45-da4d-4343-aad5-e0993f900fde tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.903058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2720cc45-da4d-4343-aad5-e0993f900fde tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.913087 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2720cc45-da4d-4343-aad5-e0993f900fde tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.019508 Aug 29 15:28:57.923032 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 354/707] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:57.928100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.929060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:57.936948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.937819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.938426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.939482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.940196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.940828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.006412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-976933956", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "9b813ef3-9d20-4ccd-a4f0-46fe476fa609"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:58.109201 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56187bb8-3626-4157-8c6c-d92d9aab3fe1 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1645 microversion: 2.1 time: 0.184753 Aug 29 15:28:58.109849 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 355/708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1645 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:58.152609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] validate_networks() for [('9b813ef3-9d20-4ccd-a4f0-46fe476fa609', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:58.193237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:58.193897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:58.208797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.209305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.209765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.214410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.215288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.215925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.236719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:58.465349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.477480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.479601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.481639 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-166b89e5-f21f-43aa-b266-5d9c822c9868 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1557 microversion: 2.25 time: 0.292860 Aug 29 15:28:58.498221 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 356/709] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:58 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1557 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:58.546369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:58.546369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:58.587581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.588089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.588989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.590099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.590760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.591940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.863463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.882780 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cd99a03a-043b-4568-a7b0-44657084714a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.382866 Aug 29 15:28:58.886502 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 357/710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:58 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:58.898639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1412074017", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "1edccff3-384b-4b0d-b706-83561d318ba9"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:58.939921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:58.947261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:58.948047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:58.948683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:58.949254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:58.949844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:58.972658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.973166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.973639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.974406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.974862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.983759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.045845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] validate_networks() for [('1edccff3-384b-4b0d-b706-83561d318ba9', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:59.052451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Getting quotas for project 905e27cb0f35425d90acb91886ca47e7. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:59.059455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Getting quotas for user 6350cfd37a994b469e21ecd19908c296 and project 905e27cb0f35425d90acb91886ca47e7. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:59.078216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:59.080976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:59.199264 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa19faaf-453e-40e7-8747-1f1aa950cde4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407052 Aug 29 15:28:59.207032 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 354/711] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:28:59.216937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8c294e9d-500e-4885-8cb0-850cde9d32a8 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e35e7040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.272977 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8c294e9d-500e-4885-8cb0-850cde9d32a8 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.063138 Aug 29 15:28:59.273722 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 355/712] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.290242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.291066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.311406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.314077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.314906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.316565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.318134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.319167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.360149 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 HTTP/1.1 Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:28:59.369026 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:28:59.370782 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '616f6c8d-7b8e-4889-baaa-5e49f7266e52'} Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:59.371691 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:28:59.374291 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:28:59.377309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:59.377309 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53a54b11-8484-4102-bbd3-e13611a55063 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 404 len: 111 microversion: 2.1 time: 0.096227 Aug 29 15:28:59.377309 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 356/713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:59.379055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.382227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.397080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.399468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.400225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.408655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.410081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.411157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.732410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid d9a18289-bd6c-4503-a954-36e1aaa0c110 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:59.761757 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30e5fb43-c55a-4ff4-8716-1c5f26e0b6be tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 2050 microversion: 2.25 time: 0.383524 Aug 29 15:28:59.777416 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 357/714] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 2050 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:59.787274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-beb16acc-7846-4a0b-94d8-471d56edb901 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.787274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-beb16acc-7846-4a0b-94d8-471d56edb901 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.819767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:59.820387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:59.820834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:59.821492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:59.822125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:59.844349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.846704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.847148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.847917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.848379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.848834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.891947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:59.908008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for user e7e71fcf6711470db5a71ddc74ff709c and project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:59.923273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-beb16acc-7846-4a0b-94d8-471d56edb901 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.933036 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-beb16acc-7846-4a0b-94d8-471d56edb901 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1216 microversion: 2.1 time: 0.164986 Aug 29 15:28:59.938914 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 358/715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.944089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.947766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.949822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:59.953148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:59.962901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.963758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.964217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.968047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.968563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.969845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.063835 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55b41422-f82a-4521-80a0-cead53c704ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175919 Aug 29 15:29:00.067467 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 358/716] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:00.084551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1485778996", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:00.224687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] validate_networks() for [('5bdccba5-6d96-4038-aca5-09236e5feac2', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:00.324226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid d9a18289-bd6c-4503-a954-36e1aaa0c110 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:00.359738 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-77c79dda-ae61-4a89-95b7-967167082dc4 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 2050 microversion: 2.25 time: 0.419156 Aug 29 15:29:00.365722 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 359/717] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 2050 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:00.385117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.386367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.395095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:00.413891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.415773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.417998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.419502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.420513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.421447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.704815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:00.725185 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9224e52-48c0-4a13-8427-dacaa71578c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.352329 Aug 29 15:29:00.729551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 360/718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:00.739748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-81237cdb-3cb9-49e8-ad92-3b63386320f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.740385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-81237cdb-3cb9-49e8-ad92-3b63386320f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.879195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81237cdb-3cb9-49e8-ad92-3b63386320f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:00.894589 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-81237cdb-3cb9-49e8-ad92-3b63386320f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1211 microversion: 2.1 time: 0.163468 Aug 29 15:29:00.909424 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 361/719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1211 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:00.909424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27d9b46d-543f-4d88-953a-054d34fb0ff5 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3af2f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.002934 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27d9b46d-543f-4d88-953a-054d34fb0ff5 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.105537 Aug 29 15:29:01.003755 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 362/720] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:01.021102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.026290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.026771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.027205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.027971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.028414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.029132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.093094 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a828819-b60b-4749-805a-5603a97d7f95 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077108 Aug 29 15:29:01.094526 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 363/721] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:01.112430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.113680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.126228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.126736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.127181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.127921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.128407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.128809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.150859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:01.151394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:01.151989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:01.152512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:01.153042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:01.186408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.187656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.188613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.190329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.192117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.192850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.234677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:01.249621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.249833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Getting quotas for user 7bd967d46f614bb4a187218498e934f3 and project 7ef825b35f554cbb81bc25e06e2b5681. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:01.274177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:01.274414 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b6b75a5-c453-4d13-988c-cb810234c73a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1220 microversion: 2.1 time: 0.178220 Aug 29 15:29:01.275119 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 364/722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:01.277986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:01.285943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:01.287224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.307784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.311008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.311469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.314632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.315132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.316769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.379843 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-496621b0-5839-405e-91cf-7765dd669342 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.309095 Aug 29 15:29:01.388952 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 359/723] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:01.418381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7880be45-62e7-4941-9df1-d3a38800b7e7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.419219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7880be45-62e7-4941-9df1-d3a38800b7e7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.573460 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-503d77e1-5100-493a-92e0-64df6e7a7f47 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110/action" status: 202 len: 0 microversion: 2.25 time: 0.296963 Aug 29 15:29:01.577091 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 365/724] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:29:01 2022] POST /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:01.594690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.596325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.622812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.623561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.624228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.625332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.626538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.631265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.706443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7880be45-62e7-4941-9df1-d3a38800b7e7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.724970 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7880be45-62e7-4941-9df1-d3a38800b7e7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1225 microversion: 2.1 time: 0.333710 Aug 29 15:29:01.730465 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 360/725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1225 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:01.756055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.756702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.785030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.786873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.787350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.792619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.794818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.795737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.003847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid d9a18289-bd6c-4503-a954-36e1aaa0c110 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:02.048564 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d61d3366-2378-4dbf-a5ec-68c65cf040c8 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 2055 microversion: 2.25 time: 0.466753 Aug 29 15:29:02.049796 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 366/726] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 2055 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:02.069281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.071284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:02.079128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.079966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.080961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.081881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.082491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.083667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.162721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.190672 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e421fab-5f61-4712-877c-cd503386b0cc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1263 microversion: 2.1 time: 0.136809 Aug 29 15:29:02.191900 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 367/727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:02.204215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da0a10b3-70df-48de-bd7b-60c115d59c7f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39cc1f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.291445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.302241 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-abb97e10-2c68-4577-9ebe-f3591d10436d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1477 microversion: 2.1 time: 0.551144 Aug 29 15:29:02.324004 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 361/728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1477 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:02.335285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.336098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:02.343894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.345166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.345966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.347008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.347689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.348356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.363982 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da0a10b3-70df-48de-bd7b-60c115d59c7f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.170666 Aug 29 15:29:02.379537 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 368/729] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:02.518891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.531810 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91c0c736-9570-4f69-bb38-9f70898e208f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1268 microversion: 2.1 time: 0.200248 Aug 29 15:29:02.545949 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 362/730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:02.764916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.777800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:02.865541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.866329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.866959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.874611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.876118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.876953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.075849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.078101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.088572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.089116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.095586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.104888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.105553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.106014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.123723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.136871 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f0dfddc-0d74-4469-a02b-1c3a35b504f7 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1229 microversion: 2.1 time: 0.385320 Aug 29 15:29:03.139420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 369/731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1229 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.220596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.222054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.232299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.233324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.234071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.235096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.235765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.236459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.423104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.439750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab327d2d-b9af-4fc1-829f-b3f5b27f58b3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1271 microversion: 2.1 time: 0.227161 Aug 29 15:29:03.451418 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 370/732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.466847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.467696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.484956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.485501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.485945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.488056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.488560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.492693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.683969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid d9a18289-bd6c-4503-a954-36e1aaa0c110 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:03.717975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d43ed7a7-e5df-4c73-ae8f-a7b86499e3df tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 2035 microversion: 2.25 time: 0.646797 Aug 29 15:29:03.719144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 363/733] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 2035 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:03.724219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1c8723c0-7651-4cf2-82b2-bb1c4fba190b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38d2820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.823910 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1c8723c0-7651-4cf2-82b2-bb1c4fba190b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.103089 Aug 29 15:29:03.827626 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 364/734] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.834514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-18265a70-5374-4078-8304-d266b5f76040 req-e6ac73a0-8b79-4869-95f5-a2b7f8e55002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37169b83-efb2-4cd0-a106-c388cfdd59b5", "name": "network-vif-unplugged", "status": "completed", "tag": "38298e49-8d6b-4848-b75a-a48df8ce6169"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:03.899964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18265a70-5374-4078-8304-d266b5f76040 req-e6ac73a0-8b79-4869-95f5-a2b7f8e55002 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.900901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18265a70-5374-4078-8304-d266b5f76040 req-e6ac73a0-8b79-4869-95f5-a2b7f8e55002 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.901700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18265a70-5374-4078-8304-d266b5f76040 req-e6ac73a0-8b79-4869-95f5-a2b7f8e55002 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.929412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-18265a70-5374-4078-8304-d266b5f76040 req-e6ac73a0-8b79-4869-95f5-a2b7f8e55002 service nova] Creating event network-vif-unplugged:38298e49-8d6b-4848-b75a-a48df8ce6169 for instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 on n-h2-854882-3 Aug 29 15:29:03.939549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-18265a70-5374-4078-8304-d266b5f76040 req-e6ac73a0-8b79-4869-95f5-a2b7f8e55002 service nova] Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:29:03.961604 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-18265a70-5374-4078-8304-d266b5f76040 req-e6ac73a0-8b79-4869-95f5-a2b7f8e55002 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131397 Aug 29 15:29:03.962808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 365/735] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:03.971809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.973061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.991581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.992658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.993471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.995242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.995711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.996142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.163775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:04.186535 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e400446c-3bf0-4d10-9507-edf5bb543051 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1274 microversion: 2.1 time: 0.220188 Aug 29 15:29:04.187154 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 366/736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:04.205078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854882-3", "block_migration": "auto"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:04.215275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.241652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.242939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.245364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.247828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.252407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.257106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.393017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'flavor' on Instance uuid d9a18289-bd6c-4503-a954-36e1aaa0c110 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:04.428401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Going to try to live migrate instance to n-h1-854882-3 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:29:04.634746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:04.656071 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-717b53d0-3e9f-4bb8-9a87-7cdb5cb3299b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1476 microversion: 2.1 time: 1.201203 Aug 29 15:29:04.699045 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 371/737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1476 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:04.761264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.764363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.813420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.821546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.832174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.834973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.854138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.854903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.307480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.321200 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e592d40a-1ad1-47b5-8429-a935c9e07252 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1283 microversion: 2.1 time: 0.646317 Aug 29 15:29:05.335842 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 372/738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1283 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:05.347298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:05.348315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:05.362886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.363787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.365571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.366746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.367429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.368077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.378382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:06.091865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.107940 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ad47360-cd5f-4dd9-9e5e-a9a90d14a2e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.765753 Aug 29 15:29:06.119226 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 373/739] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:05 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:06.134694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fa8c2ac8-e9b4-4e33-9baa-cfdf3dd10b97 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39b3550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.228752 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fa8c2ac8-e9b4-4e33-9baa-cfdf3dd10b97 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.106863 Aug 29 15:29:06.229889 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 374/740] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:06.240619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.247194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:06.264797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.265609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.270465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.271735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.272367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.272971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.624527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.640952 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d9fe9798-a051-4b3a-911f-0dd18f7a707a tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1274 microversion: 2.1 time: 0.409966 Aug 29 15:29:06.654874 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 375/741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1274 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:06.660840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.661682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:06.670503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.675738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.676207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.676962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.677806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.678063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.109135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:07.119244 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-399d8239-a296-41d2-86d2-c26bb9ed2506 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1476 microversion: 2.1 time: 0.462700 Aug 29 15:29:07.126007 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 376/742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:07.131207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b33729ec-eab8-440b-bf51-8c081118776d req-0bfb3e36-75dd-4758-b593-b219d8cebabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37169b83-efb2-4cd0-a106-c388cfdd59b5", "tag": "38298e49-8d6b-4848-b75a-a48df8ce6169"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:07.161855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b33729ec-eab8-440b-bf51-8c081118776d req-0bfb3e36-75dd-4758-b593-b219d8cebabb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.163339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b33729ec-eab8-440b-bf51-8c081118776d req-0bfb3e36-75dd-4758-b593-b219d8cebabb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.163990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b33729ec-eab8-440b-bf51-8c081118776d req-0bfb3e36-75dd-4758-b593-b219d8cebabb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.198822 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b33729ec-eab8-440b-bf51-8c081118776d req-0bfb3e36-75dd-4758-b593-b219d8cebabb service nova] Creating event network-changed:38298e49-8d6b-4848-b75a-a48df8ce6169 for instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 on n-h2-854882-3 Aug 29 15:29:07.255901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-b33729ec-eab8-440b-bf51-8c081118776d req-0bfb3e36-75dd-4758-b593-b219d8cebabb service nova] Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:29:07.290254 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b33729ec-eab8-440b-bf51-8c081118776d req-0bfb3e36-75dd-4758-b593-b219d8cebabb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162253 Aug 29 15:29:07.301880 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 377/743] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:07.311841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.315017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.343807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.345180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.345929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.346904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.347533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.348125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.635781 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf1151c3-6e31-4efb-9905-90c11d90d2f6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110/action" status: 202 len: 0 microversion: 2.25 time: 3.444510 Aug 29 15:29:07.641581 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 367/744] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:29:04 2022] POST /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110/action => generated 0 bytes in 3448 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:07.649740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e1a4b986-9758-443a-95e8-1190b8e29e3a req-0fb44ee6-f3cf-4849-9c78-deaabbb7fa25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c", "tag": "0b2683e6-b468-4488-a8ef-755f005fa2bb"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:07.680662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e1a4b986-9758-443a-95e8-1190b8e29e3a req-0fb44ee6-f3cf-4849-9c78-deaabbb7fa25 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.695374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e1a4b986-9758-443a-95e8-1190b8e29e3a req-0fb44ee6-f3cf-4849-9c78-deaabbb7fa25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.698557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e1a4b986-9758-443a-95e8-1190b8e29e3a req-0fb44ee6-f3cf-4849-9c78-deaabbb7fa25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.735971 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e1a4b986-9758-443a-95e8-1190b8e29e3a req-0fb44ee6-f3cf-4849-9c78-deaabbb7fa25 service nova] Creating event network-changed:0b2683e6-b468-4488-a8ef-755f005fa2bb for instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c on n-h1-854882-3 Aug 29 15:29:07.745380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e1a4b986-9758-443a-95e8-1190b8e29e3a req-0fb44ee6-f3cf-4849-9c78-deaabbb7fa25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102082 Aug 29 15:29:07.754189 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 368/745] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:07.769412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.770185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.793532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.795575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.799091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.800161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.800838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.801494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.143580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.156268 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8bf08fd1-f153-4669-b74b-c4c2e1590109 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.852476 Aug 29 15:29:08.159276 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 378/746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.197202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b11f133-223d-439a-9d86-9cab062a8ae1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39b35e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.292635 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b11f133-223d-439a-9d86-9cab062a8ae1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.131016 Aug 29 15:29:08.293926 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 379/747] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.307071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.308776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.328489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.329302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.330016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.331745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.336377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.337147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.511276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.523125 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4f2738e0-0fae-4459-a9a5-06eb8025a425 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.767090 Aug 29 15:29:08.524248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 369/748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.545981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.547011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.560383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.561427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.568985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.570784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.571516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.572793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.776474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.794034 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-763f3004-f404-499d-8fd6-29729c0b1976 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.268551 Aug 29 15:29:08.813927 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 370/749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.819351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.826532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.833966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.835806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.836263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.837149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.837968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.838406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.925787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.940502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.944112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.945713 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a8b8dcd-8f10-4e8a-8353-60ad4c8aa4f9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.650588 Aug 29 15:29:08.951567 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 380/750] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:09.055113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.064454 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea08af20-13f7-4ce3-997a-f5c069c3519e tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1474 microversion: 2.1 time: 0.249099 Aug 29 15:29:09.065054 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 371/751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1474 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:09.207124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.208497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.219362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.220727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.221603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.223778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.225241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.226410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.309135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a445543-1047-4c7d-b75e-e4404032a3e2 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39a3af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.411115 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a445543-1047-4c7d-b75e-e4404032a3e2 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.106621 Aug 29 15:29:09.411717 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 372/752] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:09.547199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.549151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.571046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.572167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.573071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.577381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.578441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.579996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.820621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.845757 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2403ca4-76db-40f7-831a-bdba7035add1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.651231 Aug 29 15:29:09.847488 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 381/753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:09.866414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.867042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.875846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.876349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.876793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.877888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.878368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.878804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.137541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:10.145680 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a56f579-3bfe-45a4-9d79-b7a0a7ecf637 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.602663 Aug 29 15:29:10.161780 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 373/754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:10.167502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:10.168342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:10.176415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.177342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.178601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.179688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.180443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.181188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.441294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:10.473560 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d37f0ec0-4ef3-49f4-b192-c89fc2d602e0 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.610542 Aug 29 15:29:10.490975 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 382/755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:10.499517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:10.500457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:10.519775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.520795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.521445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.522372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.523012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.523593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.876775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:10.886419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:10.899292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:10.906526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:10.908504 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-97398af7-9a6b-4d8b-968a-159ce9c9bbe6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.745415 Aug 29 15:29:10.910065 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 374/756] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:10 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:10.915455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-80fe61cd-f3cc-4e56-80d8-bec6cc6c981f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3869dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.001784 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-80fe61cd-f3cc-4e56-80d8-bec6cc6c981f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1421 microversion: 2.1 time: 0.089833 Aug 29 15:29:11.003200 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 375/757] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:10 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.011927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.014099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.023904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.024973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.026354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.028424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.029446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.030115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.038217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:11.217974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:11.270465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.283906 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b41a4c58-a082-4fa1-a168-4f147a9c99b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1474 microversion: 2.1 time: 0.791446 Aug 29 15:29:11.290930 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 383/758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:10 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1474 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.296589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f518e4e5-f0e4-4615-9111-143ac54647ba req-ef520708-85aa-4dae-b694-34a7a4787c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68eda8c5-1df5-440f-ab05-a074606911ca", "tag": "144e57e1-9261-4399-85dd-ce019fe20cc0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:11.321711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f518e4e5-f0e4-4615-9111-143ac54647ba req-ef520708-85aa-4dae-b694-34a7a4787c6c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.322341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f518e4e5-f0e4-4615-9111-143ac54647ba req-ef520708-85aa-4dae-b694-34a7a4787c6c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.327323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f518e4e5-f0e4-4615-9111-143ac54647ba req-ef520708-85aa-4dae-b694-34a7a4787c6c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.328821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.339501 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a142293-b7d3-46f9-8977-bfe963db77c5 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.333878 Aug 29 15:29:11.341684 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f518e4e5-f0e4-4615-9111-143ac54647ba req-ef520708-85aa-4dae-b694-34a7a4787c6c service nova] Creating event network-changed:144e57e1-9261-4399-85dd-ce019fe20cc0 for instance 68eda8c5-1df5-440f-ab05-a074606911ca on n-h1-854882-3 Aug 29 15:29:11.349130 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 376/759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.355838 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f518e4e5-f0e4-4615-9111-143ac54647ba req-ef520708-85aa-4dae-b694-34a7a4787c6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063362 Aug 29 15:29:11.365934 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 384/760] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:11.376410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.378055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.391109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.391938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.393856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.395005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.395669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.396811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.404397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:11.514842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.529916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.573150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.574617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.580117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.581221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.583997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.584709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.645995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.655518 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e519b67-40c6-4ead-aef5-50165d2297e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.304644 Aug 29 15:29:11.671742 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 377/761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.679536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-18233d59-c974-4e48-88ef-6d4f0a6010fe req-6618c717-c352-43ba-94ae-ed028d9441f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a18289-bd6c-4503-a954-36e1aaa0c110", "name": "network-vif-unplugged", "status": "completed", "tag": "0dcba184-a55c-4388-8169-12ea22b34d6f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:11.702009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18233d59-c974-4e48-88ef-6d4f0a6010fe req-6618c717-c352-43ba-94ae-ed028d9441f9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.703111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18233d59-c974-4e48-88ef-6d4f0a6010fe req-6618c717-c352-43ba-94ae-ed028d9441f9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.704004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18233d59-c974-4e48-88ef-6d4f0a6010fe req-6618c717-c352-43ba-94ae-ed028d9441f9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.721325 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-18233d59-c974-4e48-88ef-6d4f0a6010fe req-6618c717-c352-43ba-94ae-ed028d9441f9 service nova] Creating event network-vif-unplugged:0dcba184-a55c-4388-8169-12ea22b34d6f for instance d9a18289-bd6c-4503-a954-36e1aaa0c110 on n-h2-854882-3 Aug 29 15:29:11.732371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:11.741793 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-18233d59-c974-4e48-88ef-6d4f0a6010fe req-6618c717-c352-43ba-94ae-ed028d9441f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066669 Aug 29 15:29:11.742357 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 378/762] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:11.939964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.941816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.968071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.968461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.971080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.979164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.981045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.981707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.137655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.157733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c06beea3-96df-442c-ba1b-43ca01be334e tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.651057 Aug 29 15:29:12.158402 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 385/763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.165192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f34de32-a4b1-4499-8436-4e829853ce86 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39cc940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.199160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.213946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.217274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.219342 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f5e7bc66-4266-4b4d-81d2-345889f844c1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.289925 Aug 29 15:29:12.220958 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 379/764] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:12.261852 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f34de32-a4b1-4499-8436-4e829853ce86 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1430 microversion: 2.1 time: 0.101115 Aug 29 15:29:12.262869 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 386/765] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1430 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.286643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59251f7d-8a1f-4fc2-9290-063ee6815b39 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e371a550>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.312138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.314720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.339602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.340344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.341956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.343622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.344730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.345423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.359725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-59251f7d-8a1f-4fc2-9290-063ee6815b39 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 200 len: 1430 microversion: 2.1 time: 0.077846 Aug 29 15:29:12.366157 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 380/766] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 1430 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.377880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.378620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.388322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.389199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.389896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.391597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.392306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.392907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.611392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.623055 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1798d7e5-ebbc-4ee4-baf9-017c78e0be37 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.254559 Aug 29 15:29:12.623770 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 381/767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.629481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.630435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.637035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.638445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.638961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.639779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.640455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.640947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.817855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.830818 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73ac81a6-576b-4c03-85e1-09ddf2a1ad9a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1466 microversion: 2.1 time: 0.205556 Aug 29 15:29:12.831779 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 382/768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1466 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.839233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.840469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.848481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.849313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.850001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.850927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.851391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.851825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.996459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.012050 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7b96266-54b2-42df-afe4-c2e51a9dd0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1471 microversion: 2.1 time: 0.703874 Aug 29 15:29:13.013687 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 387/769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1471 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:13.018688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-270c2af3-766f-4a7c-96b8-f95d39d7b096 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3b5aee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.067346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.069711 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-270c2af3-766f-4a7c-96b8-f95d39d7b096 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/69b80579-025a-47db-8397-1d03ce8a20ab" status: 200 len: 784 microversion: 2.1 time: 0.054698 Aug 29 15:29:13.070667 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 388/770] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/images/69b80579-025a-47db-8397-1d03ce8a20ab => generated 784 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:13.076297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:13.076840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.080795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-198d483a-c9e6-454e-bead-6a20acdc3cb9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.247255 Aug 29 15:29:13.081714 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 383/771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:13.083922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.084426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.084863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.086910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.087137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d26ce781-0c86-4e27-be79-00e5ec73276f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.087720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.088160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.096184 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d26ce781-0c86-4e27-be79-00e5ec73276f tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013181 Aug 29 15:29:13.096943 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 384/772] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:13.108505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15d745f8-8739-4b06-aba6-5e43b689ebc6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38d23a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.174688 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88463118-e738-4a48-a166-83c241d42561 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5/action" status: 204 len: 0 microversion: 2.1 time: 0.102615 Aug 29 15:29:13.175371 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 389/773] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:13 2022] POST /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5/action => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:13.184176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.185075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.191888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.192355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.192795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.193536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.193985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.194415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.357794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.368375 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-309b9cb3-06f2-4988-9b65-b6caf39f237f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.188827 Aug 29 15:29:13.368985 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 390/774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:13.375096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.375891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.384007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.384490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.384926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.385712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.386173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.386717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.553895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.563805 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3c9326cf-6fd3-445e-8133-6dbf6291657d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1471 microversion: 2.1 time: 0.193538 Aug 29 15:29:13.564576 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 391/775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:13.570567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.571424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.580755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.581631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.582322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.583137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.583713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.584223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.678987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-15d745f8-8739-4b06-aba6-5e43b689ebc6 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "DELETE /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 204 len: 0 microversion: 2.1 time: 0.574305 Aug 29 15:29:13.679712 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 385/776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] DELETE /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:29:13.688270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2dd27781-4009-4e72-ab8c-b95399c889ef req-8a357f5f-bcdb-4958-8531-38c0e2f8a2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc76b644-c4f9-40da-8a51-f83f12f2ea8c", "tag": "cbdfbc2a-6da6-4447-8da8-28c618b3fca4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:13.706187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2dd27781-4009-4e72-ab8c-b95399c889ef req-8a357f5f-bcdb-4958-8531-38c0e2f8a2f8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.706691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2dd27781-4009-4e72-ab8c-b95399c889ef req-8a357f5f-bcdb-4958-8531-38c0e2f8a2f8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.707103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2dd27781-4009-4e72-ab8c-b95399c889ef req-8a357f5f-bcdb-4958-8531-38c0e2f8a2f8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.733122 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2dd27781-4009-4e72-ab8c-b95399c889ef req-8a357f5f-bcdb-4958-8531-38c0e2f8a2f8 service nova] Creating event network-changed:cbdfbc2a-6da6-4447-8da8-28c618b3fca4 for instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c on n-h1-854882-3 Aug 29 15:29:13.738608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2dd27781-4009-4e72-ab8c-b95399c889ef req-8a357f5f-bcdb-4958-8531-38c0e2f8a2f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057211 Aug 29 15:29:13.739316 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 386/777] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:13.745251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.746108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.754287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.755174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.755816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.756712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.757172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.757629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.767684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.781078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.782626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.783842 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d327988-e02b-4722-bf3f-949566fc7b0c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.217799 Aug 29 15:29:13.789448 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 392/778] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:13.789771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3396936f-278d-4382-bc45-53711fc199d1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3a15430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.818604 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-3396936f-278d-4382-bc45-53711fc199d1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] HTTP exception thrown: Image not found. Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3396936f-278d-4382-bc45-53711fc199d1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Request method failure captured: Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 HTTP/1.1 Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNsXCxQwXRphqZavOt7y20Fi3fZa661l_saF4MMv99J9WaNRiLHM5jyKKcCWDyIdMH3wEMjyfQ82MuS4vSnOfDnMJwojkBA12TashFi64rwm6U9ndQJgRIOUHRv6ukmNB01EeekYOAGBWpt3J4tJWRokbj-PqjXZsqZS7cP476uGXl0 Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 03575bcf80404b0994fc8d967804b6df Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:29:13.822954 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03575bcf80404b0994fc8d967804b6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03575bcf80404b0994fc8d967804b6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03575bcf80404b0994fc8d967804b6df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03575bcf80404b0994fc8d967804b6df"}]}] Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 03575bcf80404b0994fc8d967804b6df Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesOneServerTestJSON-532890142-project Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7ead06f178974869a251628cca018175 Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesOneServerTestJSON-532890142-project Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e0a688c7-6ff8-4ad9-8d81-72b743ccb653'} Aug 29 15:29:13.824503 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:13.825587 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e0a688c7-6ff8-4ad9-8d81-72b743ccb653 Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:13.826872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e0a688c7-6ff8-4ad9-8d81-72b743ccb653 could not be found. Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:13.828308 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:13.830343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3396936f-278d-4382-bc45-53711fc199d1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:13.831560 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3396936f-278d-4382-bc45-53711fc199d1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 404 len: 62 microversion: 2.1 time: 0.045007 Aug 29 15:29:13.837124 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 393/779] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:29:13.844221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b11b73ae-8b2b-4990-9653-bba058ab5761 req-d5778d36-4194-4dad-8f73-6d83d858df77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c", "name": "network-vif-plugged", "status": "completed", "tag": "0b2683e6-b468-4488-a8ef-755f005fa2bb"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:13.857911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b11b73ae-8b2b-4990-9653-bba058ab5761 req-d5778d36-4194-4dad-8f73-6d83d858df77 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.858409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b11b73ae-8b2b-4990-9653-bba058ab5761 req-d5778d36-4194-4dad-8f73-6d83d858df77 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.858974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b11b73ae-8b2b-4990-9653-bba058ab5761 req-d5778d36-4194-4dad-8f73-6d83d858df77 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.871664 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b11b73ae-8b2b-4990-9653-bba058ab5761 req-d5778d36-4194-4dad-8f73-6d83d858df77 service nova] Creating event network-vif-plugged:0b2683e6-b468-4488-a8ef-755f005fa2bb for instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c on n-h1-854882-3 Aug 29 15:29:13.877426 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b11b73ae-8b2b-4990-9653-bba058ab5761 req-d5778d36-4194-4dad-8f73-6d83d858df77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043509 Aug 29 15:29:13.878592 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 394/780] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:13.884895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-6dbd468a-10dd-4633-9975-8664aaacc56c req-c8482391-abbf-47d2-a434-68d1cb2aaec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a18289-bd6c-4503-a954-36e1aaa0c110", "tag": "0dcba184-a55c-4388-8169-12ea22b34d6f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:13.898078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6dbd468a-10dd-4633-9975-8664aaacc56c req-c8482391-abbf-47d2-a434-68d1cb2aaec0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.898576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6dbd468a-10dd-4633-9975-8664aaacc56c req-c8482391-abbf-47d2-a434-68d1cb2aaec0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.899182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6dbd468a-10dd-4633-9975-8664aaacc56c req-c8482391-abbf-47d2-a434-68d1cb2aaec0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.912002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:13.914759 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6dbd468a-10dd-4633-9975-8664aaacc56c req-c8482391-abbf-47d2-a434-68d1cb2aaec0 service nova] Creating event network-changed:0dcba184-a55c-4388-8169-12ea22b34d6f for instance d9a18289-bd6c-4503-a954-36e1aaa0c110 on n-h2-854882-3 Aug 29 15:29:13.922915 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-6dbd468a-10dd-4633-9975-8664aaacc56c req-c8482391-abbf-47d2-a434-68d1cb2aaec0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042581 Aug 29 15:29:13.924215 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 395/781] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:13.930914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1444684224"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:13.933861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.946771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.947686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.948312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.948890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.949917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.950672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.951313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.960504 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-50009cad-b936-4dee-a001-da4b5ace6b46 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.219696 Aug 29 15:29:13.961124 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 387/782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:14.112012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.113011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.119937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.120989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.121874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.123114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.123845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.124438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.245948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8a23d8c6-9f63-4826-8c0c-4d1c704b9a9c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "POST /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3/action" status: 202 len: 0 microversion: 2.1 time: 0.319994 Aug 29 15:29:14.247139 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 396/783] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:13 2022] POST /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:29:14.259569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1bb4479-b6c3-4dac-9f08-a56bd806f69b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38aa160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.340029 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1bb4479-b6c3-4dac-9f08-a56bd806f69b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.085810 Aug 29 15:29:14.344965 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 397/784] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:14.366122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:14.380325 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d80556ae-e4eb-4b96-b3bf-6b611a4e8bfc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.275002 Aug 29 15:29:14.381686 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 388/785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:14.401841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.402489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.411170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.411663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.412102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.412822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.413481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.413717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.592008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.594562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.604149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.605048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.606229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.607264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.608011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.608659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.864999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:14.876944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18733150-7866-4639-9e59-be549e689142 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1471 microversion: 2.1 time: 0.290498 Aug 29 15:29:14.889740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:14.890631 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 389/786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:14.895644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.896299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.901323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e554bb40-c54f-43a9-b577-5c73665b31f5 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.505053 Aug 29 15:29:14.909472 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 398/787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:14.909680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.909680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.909680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.909680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.910125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.910125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.985118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.985933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.993113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.993631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.994332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.995296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.996078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.996691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.052697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.062164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.063609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.064795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ec45c64-727c-4494-bd40-e946e61aaae8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.173114 Aug 29 15:29:15.065363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 390/788] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:15.174015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.182685 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-657ad1a5-4057-4158-9610-293131e95266 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.202572 Aug 29 15:29:15.183502 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 399/789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:15.358494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b921c28e-ef03-4e4a-9623-7a612d0b5f0b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3ce5280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.402724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.403943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:15.404987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b921c28e-ef03-4e4a-9623-7a612d0b5f0b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.051084 Aug 29 15:29:15.406070 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 391/790] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:15.413797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.414286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.414772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.415489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.415963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.416379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.574901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.583713 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9b6c8f6-98e4-44f2-817b-569f1287e826 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.184827 Aug 29 15:29:15.584312 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 400/791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:15.893837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37169b83-efb2-4cd0-a106-c388cfdd59b5", "name": "network-vif-plugged", "status": "completed", "tag": "38298e49-8d6b-4848-b75a-a48df8ce6169"}, {"server_uuid": "a507afd7-0e79-497f-b26d-65fbeef242e3", "name": "network-vif-unplugged", "status": "completed", "tag": "e9c1a183-45af-4136-a73f-ccf56c310916"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:15.897659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.898286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:15.906618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.907188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.907713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.908503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.909030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.909574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.919412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.920031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.920325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.935899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] Creating event network-vif-plugged:38298e49-8d6b-4848-b75a-a48df8ce6169 for instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 on n-h2-854882-3 Aug 29 15:29:15.936517 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] Creating event network-vif-unplugged:e9c1a183-45af-4136-a73f-ccf56c310916 for instance a507afd7-0e79-497f-b26d-65fbeef242e3 on n-h2-854882-3 Aug 29 15:29:15.942825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:29:15.956674 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-31a7c4da-4223-4a01-a9ef-aa3159317211 req-835faf53-8ba4-4af7-9833-b07febf62820 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.066995 Aug 29 15:29:15.957719 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 392/792] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:15.963796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.964497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:15.970729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.971233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.971667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.972388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.972817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.973236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.051854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.061151 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-15eab49e-3667-419f-9b6f-844d04bb438b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1471 microversion: 2.1 time: 0.167362 Aug 29 15:29:16.061757 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 401/793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:16.087646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.088268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:16.095215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.095703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.096141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.096839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.097299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.098201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.108471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.116907 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8248a5b6-d4ff-4fa1-8a15-5dba578887b4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.157748 Aug 29 15:29:16.117518 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 393/794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:16.204064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.204694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:16.211217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.211946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.212389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.213104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.213719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.214160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.238621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.246822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.248321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.249537 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b08dfcda-86ae-43be-befb-6dcfede9fe3e tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.165863 Aug 29 15:29:16.261884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 402/795] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:16.351021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.359264 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d60bc4e-0222-43ae-ad5b-5c3107eb7ff9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.160048 Aug 29 15:29:16.359851 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 394/796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:16.420915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c47da8b4-ca57-4db1-8ee0-8690f9ca4c95 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3afa550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.464551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c47da8b4-ca57-4db1-8ee0-8690f9ca4c95 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.048318 Aug 29 15:29:16.465126 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 403/797] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:16.610765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.611970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:16.620650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.621145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.621625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.622894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.623355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.623783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.784509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.793053 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16a24fab-36ab-492b-b40f-829c379c9487 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1311 microversion: 2.1 time: 0.190262 Aug 29 15:29:16.793696 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 395/798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:17.083695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.084343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.090640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.091684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.092114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.093741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.094402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.094831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.140743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.142274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.150966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.151843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.152524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.153981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.154729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.155617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.298131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.306631 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5400dc86-1fd5-4235-b562-f03c380cb94a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1471 microversion: 2.1 time: 0.227422 Aug 29 15:29:17.307438 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 404/799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:17.311978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.312499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.315586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.318526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.318984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.319589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.320293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.320742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.321166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.323906 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-88f7cb0e-84ba-43ea-b6d3-080933782c6d tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.189317 Aug 29 15:29:17.324493 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 396/800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:17.381254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.381816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.388231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.388725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.389621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.390357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.390821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.391258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.575479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.577479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.587932 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0fe1ee2-16e1-42c6-a548-810b44a8fe92 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.210517 Aug 29 15:29:17.590276 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 397/801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:17.592849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.594361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.595578 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-28ec27c0-54e0-4911-b6c5-9a640aed1ad7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.287436 Aug 29 15:29:17.596143 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 405/802] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:17.610062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-560caabf-5a39-482c-bef0-840e5544a519 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3715b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.675607 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-560caabf-5a39-482c-bef0-840e5544a519 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.083192 Aug 29 15:29:17.676053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 398/803] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:17.814364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.815422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.823769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.824799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.825606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.826787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.827735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.828399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.972573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3645ce70-37b6-4b58-9534-1de30b7bba54 req-612cdd67-187f-42c4-9f67-94ef10e1d049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eda8c5-1df5-440f-ab05-a074606911ca", "name": "network-vif-plugged", "status": "completed", "tag": "144e57e1-9261-4399-85dd-ce019fe20cc0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:17.978101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:17.985152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3645ce70-37b6-4b58-9534-1de30b7bba54 req-612cdd67-187f-42c4-9f67-94ef10e1d049 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.985677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3645ce70-37b6-4b58-9534-1de30b7bba54 req-612cdd67-187f-42c4-9f67-94ef10e1d049 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.986112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3645ce70-37b6-4b58-9534-1de30b7bba54 req-612cdd67-187f-42c4-9f67-94ef10e1d049 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.998259 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3645ce70-37b6-4b58-9534-1de30b7bba54 req-612cdd67-187f-42c4-9f67-94ef10e1d049 service nova] Creating event network-vif-plugged:144e57e1-9261-4399-85dd-ce019fe20cc0 for instance 68eda8c5-1df5-440f-ab05-a074606911ca on n-h1-854882-3 Aug 29 15:29:18.003456 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3645ce70-37b6-4b58-9534-1de30b7bba54 req-612cdd67-187f-42c4-9f67-94ef10e1d049 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034841 Aug 29 15:29:18.004261 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 399/804] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:18.054000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:18.076569 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a82aedfb-1233-4540-9c5b-4b97d7925fa8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1493 microversion: 2.1 time: 0.265836 Aug 29 15:29:18.077653 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 406/805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:18.103702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.104548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.113094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.113732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.114278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.115099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.115641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.116149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.317093 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9ed91471-b340-4b1e-9832-42db5fe4cc29 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1644 microversion: 2.1 time: 0.222092 Aug 29 15:29:18.318464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 400/806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1644 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:18.330514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.331967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.347057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.348561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.350407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.351299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.352402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.353434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.354086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.354541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.367786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.368722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.369922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.371032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.371763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.372465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.377047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:18.588241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:18.599726 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-871f5665-ca22-4839-8153-76eff778eb7b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.257755 Aug 29 15:29:18.600519 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 401/807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:18.609342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.610805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.619184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.619855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.620553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.621577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.623213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.623948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.836455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:18.854940 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88aa959b-83db-4ac9-a7b7-915dd0d37abb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1463 microversion: 2.1 time: 0.529899 Aug 29 15:29:18.855686 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a2d7198-be73-4ff3-be5a-e8d1599ad4b4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1644 microversion: 2.1 time: 0.253325 Aug 29 15:29:18.856475 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 407/808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1463 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:18.856875 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 402/809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1644 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:18.862667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.863465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.876426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.877662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.877963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.878555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.879195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.880165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.880852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.881579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.889573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.890071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.890515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.891254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.891706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.892138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.093896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:19.104025 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9c90c013-73d4-45b2-8a92-867961ba4dbb tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.245889 Aug 29 15:29:19.111689 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 408/810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:19.120604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-151dc37d-bcd0-4b62-9532-1432948c6508 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e359d5e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.121108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:19.131918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:19.133670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:19.135205 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3846e071-70ba-48f7-ae44-db7945d8a0b1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.277129 Aug 29 15:29:19.140557 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 403/811] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:19.146332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.150579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.151084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.151536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.152419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.152919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.153585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.184965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3b9fdc89-86d4-430c-8447-4adfc490dca2 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042055 Aug 29 15:29:19.194297 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 404/812] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:19.194297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.194297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:19.199357 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-151dc37d-bcd0-4b62-9532-1432948c6508 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.084495 Aug 29 15:29:19.200081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.200442 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 409/813] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:19.201052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.201954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.202945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.203568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.204256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.206476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:19.207155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:19.214195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.215135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.215760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.216598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.217241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.217857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.301170 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4c97b936-fb4d-4d94-842d-cb37a30fabaa tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c/action" status: 202 len: 0 microversion: 2.1 time: 0.099121 Aug 29 15:29:19.302239 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 410/814] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:19 2022] POST /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:19.313617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.314414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:19.321331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.321861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.322303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.323037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.323497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.323925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.435627 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08e3c0ba-0127-43ac-82a7-9f58a51b43f3 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1614 microversion: 2.1 time: 0.248907 Aug 29 15:29:19.437120 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 405/815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1614 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:19.473864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81e00778-e861-47c9-bd5f-d80d170e67ee tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '.version_select at 0x7fb0e381dca0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.480371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81e00778-e861-47c9-bd5f-d80d170e67ee tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.481272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81e00778-e861-47c9-bd5f-d80d170e67ee tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.482111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81e00778-e861-47c9-bd5f-d80d170e67ee tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.496403 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81e00778-e861-47c9-bd5f-d80d170e67ee tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1559 microversion: 2.1 time: 0.030188 Aug 29 15:29:19.497730 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 406/816] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/os-migrations => generated 1559 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:19.578678 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5f6fb3e-50ff-450c-a98c-ffc24d5cd0f8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1649 microversion: 2.1 time: 0.265512 Aug 29 15:29:19.581787 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 411/817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1649 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:19.632149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.633611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:19.682410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.683322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.684102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.722226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.727406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.728261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.812063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-665513420", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:19.979744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:20.125039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:20.134754 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d91dcb30-4e86-48a3-b67f-2f4c4d948591 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1316 microversion: 2.1 time: 0.513206 Aug 29 15:29:20.154163 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 407/818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:20.161415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:20.162210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:20.170768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.171593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.172304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.173256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.174847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.175487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.210027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:29:20.339184 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-332e978c-f26a-4595-944a-82ae86d9be81 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 204 len: 0 microversion: 2.1 time: 0.182754 Aug 29 15:29:20.349931 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 408/819] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:29:20 2022] DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:20.358527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:20.359440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:20.367697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.368350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.368898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.369844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.370709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.371479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.615164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:20.616421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:20.617644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:20.619312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:20.620404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:20.663436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.667328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.676615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.682999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.686781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.687880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.777574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:20.809765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for user 1869270af6874c4db42112d4aa9417a6 and project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:20.853272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:20.855893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:20.873248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:20.925435 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d3b2e0e-8463-4e5b-8a53-fc0565c23a85 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125930 Aug 29 15:29:20.926837 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 412/820] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:20.934791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:20.935670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:20.950927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.954301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.955260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.956775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.963050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.963663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.965154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:20.984912 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b671293-6154-43e2-88c4-aa5be930a535 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.631878 Aug 29 15:29:20.986962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 409/821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:20 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:21.005015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dfde7d1c-14c9-4076-906b-7f47d5b06ac0 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38d23a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.116408 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dfde7d1c-14c9-4076-906b-7f47d5b06ac0 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.123577 Aug 29 15:29:21.117510 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 410/822] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:20 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:21.126496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e817341d-04b1-47e1-99ab-087f8e254934 req-96c35ffb-dbfd-4da6-9893-c96732a535f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507afd7-0e79-497f-b26d-65fbeef242e3", "name": "network-vif-plugged", "status": "completed", "tag": "e9c1a183-45af-4136-a73f-ccf56c310916"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:21.151913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e817341d-04b1-47e1-99ab-087f8e254934 req-96c35ffb-dbfd-4da6-9893-c96732a535f6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.152786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e817341d-04b1-47e1-99ab-087f8e254934 req-96c35ffb-dbfd-4da6-9893-c96732a535f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.155108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e817341d-04b1-47e1-99ab-087f8e254934 req-96c35ffb-dbfd-4da6-9893-c96732a535f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.180818 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e817341d-04b1-47e1-99ab-087f8e254934 req-96c35ffb-dbfd-4da6-9893-c96732a535f6 service nova] Creating event network-vif-plugged:e9c1a183-45af-4136-a73f-ccf56c310916 for instance a507afd7-0e79-497f-b26d-65fbeef242e3 on n-h2-854882-3 Aug 29 15:29:21.193009 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e817341d-04b1-47e1-99ab-087f8e254934 req-96c35ffb-dbfd-4da6-9893-c96732a535f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072685 Aug 29 15:29:21.194416 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 411/823] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:21.209440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.210886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:21.225813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.226441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.227088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.227922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.228487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.229041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.358775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:21.362789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:21.373211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:21.375492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:21.377321 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-70cf70cf-0573-4a9f-bc1c-06c7ed8e6bae tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1567 microversion: 2.25 time: 0.448825 Aug 29 15:29:21.378499 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 413/824] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:20 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1567 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:21.391231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1015926172", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "662348314", "adminPass": "***", "networks": [{"uuid": "4172a6c2-ee06-4374-b572-6ae7a18ac735"}], "security_groups": [{"name": "tempest-securitygroup--1430668484"}], "key_name": "tempest-keypair-85438069", "user_data": "}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:21.513366 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c62b85d-2721-4482-a58c-0e0e9854bfcb tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1629 microversion: 2.1 time: 0.308116 Aug 29 15:29:21.552189 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 412/825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:21 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1629 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:21.564650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-04f0bb49-b062-43b5-8a21-a949a5b0d59b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.566418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-04f0bb49-b062-43b5-8a21-a949a5b0d59b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:21.674732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] validate_networks() for [('4172a6c2-ee06-4374-b572-6ae7a18ac735', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:21.711180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04f0bb49-b062-43b5-8a21-a949a5b0d59b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:21.726765 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-04f0bb49-b062-43b5-8a21-a949a5b0d59b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1212 microversion: 2.1 time: 0.170118 Aug 29 15:29:21.727755 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 413/826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:21 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1212 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:21.736226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.737142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:21.751543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.752646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.753260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.755276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.756308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.757163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.992003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:22.008932 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-808ec784-300e-4ae3-9e3c-a9d539033c4c tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1505 microversion: 2.1 time: 0.279461 Aug 29 15:29:22.013354 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 414/827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:21 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:22.022057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854882-3", "block_migration": true, "disk_over_commit": false}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:22.026897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:22.037513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.038390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.039664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.041233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.042243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.043099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.075774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lazy-loading 'flavor' on Instance uuid 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:22.092250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Going to try to live migrate instance to n-h2-854882-3 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:29:22.677806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:22.678364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:22.678693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:22.679098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:22.679745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:22.715037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.715529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.716532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.717448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.717807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.718237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.776960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Getting quotas for project 6e9ae755ad68447087da4df60c36c746. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:22.786383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Getting quotas for user 199c2a20a7e8425e8df281cfe251c880 and project 6e9ae755ad68447087da4df60c36c746. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:22.805329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:22.808085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:22.897680 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c5f40a5-2b06-41d5-bf27-b832164792ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.517286 Aug 29 15:29:22.899373 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 414/828] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:22.906433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:22.909101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:22.920954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.922285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.923203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.924533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.925314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.926119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.389785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:23.401519 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53b64105-e797-45a6-a3a9-81df379b06b9 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.500189 Aug 29 15:29:23.403829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 415/829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:22 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:23.424253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:23.435780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:23.448702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.449377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.450025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.450971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.451593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.452174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.486269 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a4f80b8-2c44-4206-a946-64467676b9e4 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca/ips" status: 200 len: 109 microversion: 2.1 time: 0.080336 Aug 29 15:29:23.487230 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 416/830] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:29:23 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca/ips => generated 109 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:23.494596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d0c28d8-7a0c-41c4-b156-79ba7d2e4923 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3aa4940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:23.579444 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d0c28d8-7a0c-41c4-b156-79ba7d2e4923 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.090933 Aug 29 15:29:23.581888 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 417/831] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:23 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:23.597252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:23.599791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:23.611077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.611876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.612511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.613761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.615362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.632467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.666094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:24.691537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:24.700683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:24.701977 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c90508e2-db4f-4a0f-9c44-14a67e2430eb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1542 microversion: 2.25 time: 1.119207 Aug 29 15:29:24.704437 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 418/832] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:23 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1542 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:24.709603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:24.711085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:24.721291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:24.722058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:24.722899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.759064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:24.759961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:24.766008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.815322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12157df5-ede7-41fd-bef6-7c1b3ce81ecd tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c/action" status: 202 len: 0 microversion: 2.1 time: 2.799559 Aug 29 15:29:24.816923 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 415/833] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:22 2022] POST /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c/action => generated 0 bytes in 2802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:24.824152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:24.827198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:24.855149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:24.864352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:24.865463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.869788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:24.871716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:24.875355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.970751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:24.994938 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b9718ac7-e582-4323-ae26-737e0b90f782 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1270 microversion: 2.1 time: 0.288655 Aug 29 15:29:25.010435 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 419/834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:24 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1270 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:25.027334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a6b9b6e5-3fdb-4376-bc51-abb587d59a6a req-916a73ab-bf52-4272-8a6a-1ce40c0b2750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc76b644-c4f9-40da-8a51-f83f12f2ea8c", "name": "network-vif-plugged", "status": "completed", "tag": "cbdfbc2a-6da6-4447-8da8-28c618b3fca4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:25.041123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a6b9b6e5-3fdb-4376-bc51-abb587d59a6a req-916a73ab-bf52-4272-8a6a-1ce40c0b2750 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.042132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a6b9b6e5-3fdb-4376-bc51-abb587d59a6a req-916a73ab-bf52-4272-8a6a-1ce40c0b2750 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.044016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a6b9b6e5-3fdb-4376-bc51-abb587d59a6a req-916a73ab-bf52-4272-8a6a-1ce40c0b2750 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.061852 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a6b9b6e5-3fdb-4376-bc51-abb587d59a6a req-916a73ab-bf52-4272-8a6a-1ce40c0b2750 service nova] Creating event network-vif-plugged:cbdfbc2a-6da6-4447-8da8-28c618b3fca4 for instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c on n-h1-854882-3 Aug 29 15:29:25.075844 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a6b9b6e5-3fdb-4376-bc51-abb587d59a6a req-916a73ab-bf52-4272-8a6a-1ce40c0b2750 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063059 Aug 29 15:29:25.078109 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 420/835] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:25.095367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.096104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:25.115701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.116622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.117257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.117955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:25.118400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.119037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.119475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.147833 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf18c219-f8ab-42fa-b500-6a9cb21cb5de tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1313 microversion: 2.1 time: 0.320653 Aug 29 15:29:25.158153 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 416/836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:24 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:25.172771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.173412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:25.176740 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-62630128-840f-4a1d-b693-96642843aaed tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca/ips" status: 200 len: 109 microversion: 2.1 time: 0.093543 Aug 29 15:29:25.192566 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 421/837] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca/ips => generated 109 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:25.222637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b4de79a0-e0b0-4ef0-b8ca-8ba6586c361d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3aa4820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.239176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.239983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.243441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.244483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.245967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.248309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.362672 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b4de79a0-e0b0-4ef0-b8ca-8ba6586c361d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.167903 Aug 29 15:29:25.369686 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 422/838] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:25.392777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bdbe03fb-fbf3-438f-8de2-44aef1a012d1 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '.version_select at 0x7fb0e3bf4af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.402176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbe03fb-fbf3-438f-8de2-44aef1a012d1 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.403197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbe03fb-fbf3-438f-8de2-44aef1a012d1 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.405007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbe03fb-fbf3-438f-8de2-44aef1a012d1 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.452960 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bdbe03fb-fbf3-438f-8de2-44aef1a012d1 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2366 microversion: 2.25 time: 0.062062 Aug 29 15:29:25.454803 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 423/839] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/os-migrations => generated 2366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:25.461882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.466611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:25.500282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.508173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.509320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.513278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.514829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.515843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.974871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:25.991148 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a912ff7c-6ae3-4676-9e33-6c2d522c6211 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1325 microversion: 2.1 time: 0.831393 Aug 29 15:29:25.992459 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 417/840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1325 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:26.001699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:26.003147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:26.025479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.026310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.027316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.029612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.032664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.033374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.047696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:26.120247 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26b1e991-ac76-40d9-84bb-927e6a7f7b0f tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca/ips/tempest-ServerAddressesTestJSON-1483931923-network" status: 200 len: 94 microversion: 2.1 time: 0.124368 Aug 29 15:29:26.129492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 418/841] 10.222.0.16 () {58 vars in 1401 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca/ips/tempest-ServerAddressesTestJSON-1483931923-network => generated 94 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:29:26.135941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d33da5e6-6ac5-4714-8335-36bbba2fdb2b req-f5529f99-7e07-41ba-8fdd-cd79633c1cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfefb0af-3933-4c2b-9c7a-38e4e6ae9445", "name": "network-vif-deleted", "tag": "1a84eb00-1b8d-4d5a-bd50-14a00bf99e99"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:26.150355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d33da5e6-6ac5-4714-8335-36bbba2fdb2b req-f5529f99-7e07-41ba-8fdd-cd79633c1cf2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.151091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d33da5e6-6ac5-4714-8335-36bbba2fdb2b req-f5529f99-7e07-41ba-8fdd-cd79633c1cf2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.151630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d33da5e6-6ac5-4714-8335-36bbba2fdb2b req-f5529f99-7e07-41ba-8fdd-cd79633c1cf2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.173592 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d33da5e6-6ac5-4714-8335-36bbba2fdb2b req-f5529f99-7e07-41ba-8fdd-cd79633c1cf2 service nova] Creating event network-vif-deleted:1a84eb00-1b8d-4d5a-bd50-14a00bf99e99 for instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 on n-h2-854882-3 Aug 29 15:29:26.183918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d33da5e6-6ac5-4714-8335-36bbba2fdb2b req-f5529f99-7e07-41ba-8fdd-cd79633c1cf2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051166 Aug 29 15:29:26.185049 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 419/842] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:26.192519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:26.193810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:26.205680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.206319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.206995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.209380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.210447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.212432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.342708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:26.365656 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-74ee1109-052e-428c-a968-5e6e3e0cdeb3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 0.909135 Aug 29 15:29:26.366524 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 424/843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:26.386319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:26.389147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:26.413054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.415205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.415870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.419717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.420565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.421481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.931939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid d9a18289-bd6c-4503-a954-36e1aaa0c110 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:26.974699 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8dd204cf-bf6b-480f-b553-8588ee0f0a24 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 2035 microversion: 2.25 time: 0.788117 Aug 29 15:29:26.979480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 420/844] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:26 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 2035 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:27.035489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.035996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:27.076603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.080679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.083118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.086046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.090528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.091099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.197008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:29:27.490186 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8f22cdb-0ca4-4409-8a6a-c12c7b3996e6 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "DELETE /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 204 len: 0 microversion: 2.1 time: 0.470773 Aug 29 15:29:27.493254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 421/845] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:29:26 2022] DELETE /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:27.508605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.511037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:27.528170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.530130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.533766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.534850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.536082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.537548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.670829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:27.684127 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-78f172c2-a00c-47a1-a065-60119ac13169 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1319 microversion: 2.1 time: 0.188649 Aug 29 15:29:27.689699 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 422/846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:27.709798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6a8c6d97-5164-44bf-9ef0-5d5d16b416a0 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39a35e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.807281 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6a8c6d97-5164-44bf-9ef0-5d5d16b416a0 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.113483 Aug 29 15:29:27.808453 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 423/847] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:27.810854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:27.819235 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ba189b5-5d48-47dd-a556-6d14bf98e1e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1312 microversion: 2.1 time: 1.447475 Aug 29 15:29:27.819839 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 425/848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:26 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1312 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:27.821915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-90db7dcf-0a41-4739-8eeb-18eee6708975 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Action: 'create', calling method: .version_select at 0x7fb0e3813940>, body: {"keypair": {"name": "tempest-keypair-520662627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwm3xVAfwjjnnduak/6pPOWUu24zp90jvBJmciNb5/jFUpn5/xbmbdU0JnUu4cDsyMFSO5jKT/I18FQHUYULb3UgeJ5gYFGNd5u2yATTJuz6Pty+1pgQr/nne+BY28Hg=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:27.837910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.838589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:27.869961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-90db7dcf-0a41-4739-8eeb-18eee6708975 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for project 0145760115bc47d188f32fca7793b863. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:27.870386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.870887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.875423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.876398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.876892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.877335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.885359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-90db7dcf-0a41-4739-8eeb-18eee6708975 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for user f331c1e3ee1442ad863d8909ca76020b and project 0145760115bc47d188f32fca7793b863. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:27.939661 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-90db7dcf-0a41-4739-8eeb-18eee6708975 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.129983 Aug 29 15:29:27.941041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 424/849] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:29:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:29:27.953795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.954721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:27.975943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.977913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.978618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.984794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.985972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.986806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.296331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:28.322938 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a0fc5ef-d46a-4069-9475-08a7891daf6a tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1520 microversion: 2.1 time: 0.502000 Aug 29 15:29:28.327329 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 426/850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1520 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:28.342940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.343904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:28.363419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.367602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.368186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.370531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.373124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.375028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.413138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:28.422596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ebc723f5-47ee-46eb-9e4f-0245a96358ec tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 0.480129 Aug 29 15:29:28.430190 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 425/851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:28.435469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.440301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:28.452030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.454768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.457236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.458034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.458512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.458941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.543150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:29:28.762496 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e6f624c-ac69-475d-baf8-6a3e9da743d6 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 204 len: 0 microversion: 2.1 time: 0.329893 Aug 29 15:29:28.769231 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 426/852] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:29:28 2022] DELETE /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:28.819115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-accc797d-6631-4660-a95b-c803d10a2d46 req-e7b3247f-1a98-4930-bc7a-91c090c359b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef0b637-0366-4873-95e7-1ffb74a351e0", "tag": "6913f0ac-c831-4118-b4c0-6a42ef5dc00b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:28.846232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-accc797d-6631-4660-a95b-c803d10a2d46 req-e7b3247f-1a98-4930-bc7a-91c090c359b0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.846713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-accc797d-6631-4660-a95b-c803d10a2d46 req-e7b3247f-1a98-4930-bc7a-91c090c359b0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.847239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-accc797d-6631-4660-a95b-c803d10a2d46 req-e7b3247f-1a98-4930-bc7a-91c090c359b0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.869328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-accc797d-6631-4660-a95b-c803d10a2d46 req-e7b3247f-1a98-4930-bc7a-91c090c359b0 service nova] Creating event network-changed:6913f0ac-c831-4118-b4c0-6a42ef5dc00b for instance aef0b637-0366-4873-95e7-1ffb74a351e0 on n-h2-854882-3 Aug 29 15:29:28.890972 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-accc797d-6631-4660-a95b-c803d10a2d46 req-e7b3247f-1a98-4930-bc7a-91c090c359b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119930 Aug 29 15:29:28.891885 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 427/853] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:28.897656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.902002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:28.924414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.925201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.925935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.926892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.927562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.928203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.962260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:28.984260 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d1172e8e-8595-433f-866e-6c191796dd04 tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1511 microversion: 2.1 time: 0.650626 Aug 29 15:29:28.987759 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 427/854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:28 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1511 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.016167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.031229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.041737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:29.042800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.044719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.047933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.050328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.051130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.051845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.061102 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1cc054fd-2c01-4270-9057-ebb2485a6f4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1319 microversion: 2.1 time: 0.167734 Aug 29 15:29:29.080527 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 428/855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:28 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.085801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75e74ca0-8ac9-436b-9b13-8fed356b746b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3869670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.159392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:29.230180 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75e74ca0-8ac9-436b-9b13-8fed356b746b tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.143845 Aug 29 15:29:29.230834 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 429/856] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.239200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.246292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.266354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.266859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.267293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.268013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.268575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.269110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.369308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:29.415691 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f18f5838-56b8-4bd2-ac10-91e375aed77e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1526 microversion: 2.1 time: 0.425841 Aug 29 15:29:29.425893 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 428/857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:28 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1526 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.456245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.457240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.466738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.467863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.468820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.470521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.471626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.472286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.668068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:29.680128 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3845023-45a1-41e9-a6a1-dda549fa9b94 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1312 microversion: 2.1 time: 0.447536 Aug 29 15:29:29.681366 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 430/858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1312 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.827682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7fb3ec21-e07f-4a2c-aafe-4ff8672312b0 req-59d7f711-46ef-42e5-a9d2-7e1d2f063cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b2683e6-b468-4488-a8ef-755f005fa2bb"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:29.850563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7fb3ec21-e07f-4a2c-aafe-4ff8672312b0 req-59d7f711-46ef-42e5-a9d2-7e1d2f063cc4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.853538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7fb3ec21-e07f-4a2c-aafe-4ff8672312b0 req-59d7f711-46ef-42e5-a9d2-7e1d2f063cc4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.853538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7fb3ec21-e07f-4a2c-aafe-4ff8672312b0 req-59d7f711-46ef-42e5-a9d2-7e1d2f063cc4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.910508 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7fb3ec21-e07f-4a2c-aafe-4ff8672312b0 req-59d7f711-46ef-42e5-a9d2-7e1d2f063cc4 service nova] Creating event network-vif-unplugged:0b2683e6-b468-4488-a8ef-755f005fa2bb for instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c on n-h1-854882-3 Aug 29 15:29:29.936989 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7fb3ec21-e07f-4a2c-aafe-4ff8672312b0 req-59d7f711-46ef-42e5-a9d2-7e1d2f063cc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115078 Aug 29 15:29:29.946297 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 431/859] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:30.020126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:30.020126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:30.030906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.031484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.031826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.037999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.039489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.040113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.363221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:30.380291 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f99551d0-8f2d-496a-af47-05669859a6c4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 0.928460 Aug 29 15:29:30.399811 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 429/860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:30.414995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:30.415641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:30.454894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.455732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.456367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.457514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.463487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.466229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.615143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6350cfd37a994b469e21ecd19908c296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905e27cb0f35425d90acb91886ca47e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:30.624687 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8cdc8c1-6c78-46ab-97d5-aed0689fd8fd tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 200 len: 1511 microversion: 2.1 time: 0.617791 Aug 29 15:29:30.639119 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 432/861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:30 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:30.645076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-04f48307-e133-4564-948e-cf567444cab5 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39a3940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:30.742111 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-04f48307-e133-4564-948e-cf567444cab5 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.101538 Aug 29 15:29:30.760935 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 433/862] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:30 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:30.761338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:30.761661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:30.773100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.773916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.774544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.775798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.776440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.777035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.144281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:31.174941 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c31f4725-fd04-4548-8a73-0823c2f53d59 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 0.773646 Aug 29 15:29:31.179375 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 430/863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:30 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:31.190269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:31.191267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:31.200120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.200971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.201940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.203576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.204312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.204980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.312555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:31.329814 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ebcac2c3-d008-4bf2-a509-840d41590058 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1526 microversion: 2.1 time: 0.573240 Aug 29 15:29:31.330915 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 434/864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:30 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1526 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:31.338393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-76f6bec5-c911-4ee9-b8a9-fed7892c06d9 req-820370e8-4715-4030-a9a0-ece0965f8e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eda8c5-1df5-440f-ab05-a074606911ca", "name": "network-vif-deleted", "tag": "144e57e1-9261-4399-85dd-ce019fe20cc0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:31.382368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-76f6bec5-c911-4ee9-b8a9-fed7892c06d9 req-820370e8-4715-4030-a9a0-ece0965f8e67 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.383392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-76f6bec5-c911-4ee9-b8a9-fed7892c06d9 req-820370e8-4715-4030-a9a0-ece0965f8e67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.384168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-76f6bec5-c911-4ee9-b8a9-fed7892c06d9 req-820370e8-4715-4030-a9a0-ece0965f8e67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.439704 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-76f6bec5-c911-4ee9-b8a9-fed7892c06d9 req-820370e8-4715-4030-a9a0-ece0965f8e67 service nova] Creating event network-vif-deleted:144e57e1-9261-4399-85dd-ce019fe20cc0 for instance 68eda8c5-1df5-440f-ab05-a074606911ca on n-h1-854882-3 Aug 29 15:29:31.451141 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-76f6bec5-c911-4ee9-b8a9-fed7892c06d9 req-820370e8-4715-4030-a9a0-ece0965f8e67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116298 Aug 29 15:29:31.452052 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 435/865] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:31.466205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92a18020-f34a-49db-a82c-afc212c7b58d"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:31.472719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:31.482813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.484661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.485809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.486903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.487866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.488895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.122451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:32.151958 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91cce48c-b880-4b2e-aa8e-ad4bf930fd69 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "POST /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698344 Aug 29 15:29:32.153555 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 436/866] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:29:31 2022] POST /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:32.178376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.182967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.195254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:32.234570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.236680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.237175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.243265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.247656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.248272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.451404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:32.479019 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcd1d135-e9ef-473a-aed6-20aab4105b8b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1312 microversion: 2.1 time: 1.297742 Aug 29 15:29:32.480285 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 431/867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:31 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1312 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:32.509768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.519004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] [instance: 68eda8c5-1df5-440f-ab05-a074606911ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.531365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.541501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.542253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.543261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.544020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.544818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.569742 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] HTTP exception thrown: Instance 68eda8c5-1df5-440f-ab05-a074606911ca could not be found. Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Request method failure captured: Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca HTTP/1.1 Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNs50WeTv4qZhiMKKXCRYszhhwNSqgy6cK2hlQvoftYqM3WWiaJ0Ro3bN3UcVFuwQuj3bjO755z-RYvKv9xANKu6Zwp5kL3kOzl5PzCk9aACp-UP-W_cyVLCp5ktWtM0vTniJoVo3VEJE-mDgwUmx7lJz0XP1-VF8uH8XKWSH8kVRb0 Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 905e27cb0f35425d90acb91886ca47e7 Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerAddressesTestJSON-325423646 Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:29:32.572082 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/905e27cb0f35425d90acb91886ca47e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/905e27cb0f35425d90acb91886ca47e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_905e27cb0f35425d90acb91886ca47e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/905e27cb0f35425d90acb91886ca47e7"}]}] Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerAddressesTestJSON-325423646 Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 905e27cb0f35425d90acb91886ca47e7 Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerAddressesTestJSON-325423646 Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerAddressesTestJSON-325423646-project Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 6350cfd37a994b469e21ecd19908c296 Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerAddressesTestJSON-325423646-project Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 68eda8c5-1df5-440f-ab05-a074606911ca could not be found. Aug 29 15:29:32.573727 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '68eda8c5-1df5-440f-ab05-a074606911ca'} Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68eda8c5-1df5-440f-ab05-a074606911ca could not be found. Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:32.574724 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68eda8c5-1df5-440f-ab05-a074606911ca could not be found. Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68eda8c5-1df5-440f-ab05-a074606911ca could not be found. Aug 29 15:29:32.576272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:32.578532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] Returning 404 to user: Instance 68eda8c5-1df5-440f-ab05-a074606911ca could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:32.579586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d65b6e3b-456f-429a-9f01-4015a0123f8b tempest-ServerAddressesTestJSON-325423646 tempest-ServerAddressesTestJSON-325423646-project] 10.222.0.16 "GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca" status: 404 len: 111 microversion: 2.1 time: 0.084066 Aug 29 15:29:32.580905 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 432/868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/68eda8c5-1df5-440f-ab05-a074606911ca => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:32.586864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9d8c64c7-7399-48d9-b412-0c73dddb7ba8 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e38aa550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.648977 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9d8c64c7-7399-48d9-b412-0c73dddb7ba8 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.066673 Aug 29 15:29:32.649984 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 433/869] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:32.656093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.657070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.664892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.666032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.666715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.667884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.668649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.669307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.673570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:32.688809 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7ee827e2-2fee-4aa1-9095-b778dbf40b34 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 0.533689 Aug 29 15:29:32.693549 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 437/870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:32.723951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.724667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.773838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:32.800416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=12 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:32.806345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.807247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.807907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.808900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.810080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.812184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.432922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.458988 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19a30b82-43df-45ea-9840-be15b8262805 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 0.805180 Aug 29 15:29:33.472022 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 434/871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:33.477649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-31b2efd3-c793-4380-a4ec-cc4100ddd67c req-6741dcc0-7845-4e4b-b27c-c2c00b0b0604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c", "tag": "0b2683e6-b468-4488-a8ef-755f005fa2bb"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:33.508416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-31b2efd3-c793-4380-a4ec-cc4100ddd67c req-6741dcc0-7845-4e4b-b27c-c2c00b0b0604 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.508908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-31b2efd3-c793-4380-a4ec-cc4100ddd67c req-6741dcc0-7845-4e4b-b27c-c2c00b0b0604 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.509346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-31b2efd3-c793-4380-a4ec-cc4100ddd67c req-6741dcc0-7845-4e4b-b27c-c2c00b0b0604 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.553430 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-31b2efd3-c793-4380-a4ec-cc4100ddd67c req-6741dcc0-7845-4e4b-b27c-c2c00b0b0604 service nova] Creating event network-changed:0b2683e6-b468-4488-a8ef-755f005fa2bb for instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c on n-h1-854882-3 Aug 29 15:29:33.563236 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-31b2efd3-c793-4380-a4ec-cc4100ddd67c req-6741dcc0-7845-4e4b-b27c-c2c00b0b0604 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090021 Aug 29 15:29:33.564245 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 435/872] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:33.573020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:33.573766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:33.599685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.600510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.601181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.602236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.602926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.603539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.635122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.652865 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e7c70aa-4d54-4a8e-ac5c-b5374320325e tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1526 microversion: 2.1 time: 0.958074 Aug 29 15:29:33.654019 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 438/873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1526 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:33.694643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91edede8-e07b-4c31-a6e5-8485e7c69cf5 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e362e430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:33.790971 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91edede8-e07b-4c31-a6e5-8485e7c69cf5 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.103603 Aug 29 15:29:33.791865 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 439/874] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:33 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:33.805738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:33.813261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:33.834703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.835508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.836472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.837466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.838118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.838711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.203625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.225983 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77a16610-7905-42be-84f3-50cbfc4921f5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 0.423878 Aug 29 15:29:34.230839 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 440/875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:33 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:34.467260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.482605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:34.483475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:34.509011 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-10225631-6b32-4987-ac09-11ef5f790f06 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1312 microversion: 2.1 time: 0.943141 Aug 29 15:29:34.512952 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 436/876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:33 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1312 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:34.516571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.522896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.526753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.534064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.535917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.538396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.695888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:34.697186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:34.722699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.727038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.727994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.752746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.753627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.754362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.890080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:34.942555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.943336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.943966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.946092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lazy-loading 'fault' on Instance uuid dc76b644-c4f9-40da-8a51-f83f12f2ea8c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:35.191812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:35.226505 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07861032-3cff-41ed-a83c-a0da60f3b7a1 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1315 microversion: 2.1 time: 0.536816 Aug 29 15:29:35.235061 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 437/877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:34 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:35.259160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-764837d4-81bb-48ed-a897-9cfb0fb95c3d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3890040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.323790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:35.344117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ab32499-6bfc-44fb-bea9-1cb0e01c4fc0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 0.858391 Aug 29 15:29:35.353424 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 441/878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:34 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:35.362621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.380452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:35.400525 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-764837d4-81bb-48ed-a897-9cfb0fb95c3d tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.163917 Aug 29 15:29:35.401125 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 438/879] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:35.421836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.425103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.425658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.426501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.426978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.427409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.535602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.536452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:35.549912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.550414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.550850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.552960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.553454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.556195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.020492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.040388 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-932cab7a-5f25-4b7a-b8d7-7be60e3b4341 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1312 microversion: 2.1 time: 0.510697 Aug 29 15:29:36.053997 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 439/880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:36.070974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-87fe3bc6-b4ca-4cac-b0b6-564baad0a4ee req-427676c0-91ec-4859-a928-9ebdfd33120a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc76b644-c4f9-40da-8a51-f83f12f2ea8c", "name": "network-vif-deleted", "tag": "cbdfbc2a-6da6-4447-8da8-28c618b3fca4"}, {"name": "network-changed", "server_uuid": "f9b94bea-6849-4238-8a96-278971ebf178", "tag": "918f6dda-e2c9-4486-88f5-24c81c1da093"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:36.094911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-87fe3bc6-b4ca-4cac-b0b6-564baad0a4ee req-427676c0-91ec-4859-a928-9ebdfd33120a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.096574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-87fe3bc6-b4ca-4cac-b0b6-564baad0a4ee req-427676c0-91ec-4859-a928-9ebdfd33120a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.097719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-87fe3bc6-b4ca-4cac-b0b6-564baad0a4ee req-427676c0-91ec-4859-a928-9ebdfd33120a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.123750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-87fe3bc6-b4ca-4cac-b0b6-564baad0a4ee req-427676c0-91ec-4859-a928-9ebdfd33120a service nova] Creating event network-vif-deleted:cbdfbc2a-6da6-4447-8da8-28c618b3fca4 for instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c on n-h1-854882-3 Aug 29 15:29:36.124528 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-87fe3bc6-b4ca-4cac-b0b6-564baad0a4ee req-427676c0-91ec-4859-a928-9ebdfd33120a service nova] Creating event network-changed:918f6dda-e2c9-4486-88f5-24c81c1da093 for instance f9b94bea-6849-4238-8a96-278971ebf178 on n-h1-854882-3 Aug 29 15:29:36.138546 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-87fe3bc6-b4ca-4cac-b0b6-564baad0a4ee req-427676c0-91ec-4859-a928-9ebdfd33120a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081943 Aug 29 15:29:36.142269 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 440/881] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:36.272168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:36.273884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:36.317791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.321025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.322513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.324964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.328135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.330310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.341488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.366060 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-daf416a7-b2e8-4671-93e8-550d4701c1d0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 1.008482 Aug 29 15:29:36.367108 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 442/882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:36.390677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:36.402198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:36.422833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.426115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.426846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.434993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.436785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.437622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.438302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.438506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.439000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lazy-loading 'fault' on Instance uuid dc76b644-c4f9-40da-8a51-f83f12f2ea8c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:36.440637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.612580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd967d46f614bb4a187218498e934f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef825b35f554cbb81bc25e06e2b5681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.629968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a075617b-acbc-4a7d-9a85-065b63381eaf tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 200 len: 1315 microversion: 2.1 time: 0.375072 Aug 29 15:29:36.631123 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 441/883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:36 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:36.636046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4d2ad70c-3531-4584-a99d-fec99dae8eea tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39b3430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:36.721529 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4d2ad70c-3531-4584-a99d-fec99dae8eea tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.088943 Aug 29 15:29:36.722388 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 442/884] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:36 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:36.762858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.777693 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93340d28-6222-44eb-9c42-291163e1eb64 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 0.409384 Aug 29 15:29:36.784736 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 443/885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:36 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:37.050983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-634583798", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5ab8f307-77e2-4e82-973f-058294ab71aa"}], "security_groups": [{"name": "tempest-securitygroup--1750948005"}], "key_name": "tempest-keypair-520662627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:37.069007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:37.069797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:37.084019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.088997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.089699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.091424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.096600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.097934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.590163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:37.599123 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-97f02fac-b984-45ab-8543-ca69464cc36c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1312 microversion: 2.1 time: 0.536043 Aug 29 15:29:37.600381 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 444/886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1312 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:37.613481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:37.614762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:37.635611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.636236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.636783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.637732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.638467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.639146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.682169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] validate_networks() for [('5ab8f307-77e2-4e82-973f-058294ab71aa', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:37.901332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:38.127846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:38.140663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ad899978-fa7f-4c4e-83b4-eeea394565dc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 0.537528 Aug 29 15:29:38.141729 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 445/887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:38.150047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4cdfb225-dc18-48d4-8876-e843df224687 req-5570b020-1a02-42bb-ba5e-2f48048834f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef0b637-0366-4873-95e7-1ffb74a351e0", "name": "network-vif-plugged", "status": "completed", "tag": "6913f0ac-c831-4118-b4c0-6a42ef5dc00b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:38.162342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4cdfb225-dc18-48d4-8876-e843df224687 req-5570b020-1a02-42bb-ba5e-2f48048834f6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:38.165760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4cdfb225-dc18-48d4-8876-e843df224687 req-5570b020-1a02-42bb-ba5e-2f48048834f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:38.166708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4cdfb225-dc18-48d4-8876-e843df224687 req-5570b020-1a02-42bb-ba5e-2f48048834f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:38.210660 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4cdfb225-dc18-48d4-8876-e843df224687 req-5570b020-1a02-42bb-ba5e-2f48048834f6 service nova] Creating event network-vif-plugged:6913f0ac-c831-4118-b4c0-6a42ef5dc00b for instance aef0b637-0366-4873-95e7-1ffb74a351e0 on n-h2-854882-3 Aug 29 15:29:38.227339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4cdfb225-dc18-48d4-8876-e843df224687 req-5570b020-1a02-42bb-ba5e-2f48048834f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084062 Aug 29 15:29:38.228582 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 446/888] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:38.235168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.241964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: dc76b644-c4f9-40da-8a51-f83f12f2ea8c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:38.256044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:38.266244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:38.267016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:38.267955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:38.268597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:38.269204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:38.289806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c could not be found. Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c HTTP/1.1 Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:29:38.299454 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c could not be found. Aug 29 15:29:38.301271 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'dc76b644-c4f9-40da-8a51-f83f12f2ea8c'} Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c could not be found. Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:38.302268 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c could not be found. Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c could not be found. Aug 29 15:29:38.303912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.306219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Instance dc76b644-c4f9-40da-8a51-f83f12f2ea8c could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:38.307260 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ccb2b654-eb93-4974-87cf-7023c6540f09 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c" status: 404 len: 111 microversion: 2.1 time: 0.077358 Aug 29 15:29:38.308386 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 447/889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:38 2022] GET /compute/v2.1/servers/dc76b644-c4f9-40da-8a51-f83f12f2ea8c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:38.317153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf615432-f7fd-441c-b2f8-1112f0d31e6c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e35f8dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.452760 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf615432-f7fd-441c-b2f8-1112f0d31e6c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.139458 Aug 29 15:29:38.469438 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 448/890] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:38 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:38.469438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.469438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:38.483514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:38.484096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:38.484602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:38.488559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:38.489317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:38.493949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:39.498038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:39.552278 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ebcdf4b0-e5ca-41f6-a84f-207cde31ded0 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 1.088389 Aug 29 15:29:39.556750 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 449/891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:38 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:39.574266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73daed47-f19a-43fe-aabb-fd82d8485af8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '.version_select at 0x7fb0e35c25e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.652019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-73daed47-f19a-43fe-aabb-fd82d8485af8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Image not found. Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73daed47-f19a-43fe-aabb-fd82d8485af8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439 HTTP/1.1 Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:29:39.657147 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '383430b5-dbd8-4c76-8d65-e77f779b8439'} Aug 29 15:29:39.658606 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 383430b5-dbd8-4c76-8d65-e77f779b8439 to delete Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:39.659539 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 383430b5-dbd8-4c76-8d65-e77f779b8439 could not be found. Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:39.660830 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73daed47-f19a-43fe-aabb-fd82d8485af8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:39.662282 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73daed47-f19a-43fe-aabb-fd82d8485af8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439" status: 404 len: 62 microversion: 2.1 time: 0.100205 Aug 29 15:29:39.663234 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 450/892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:39 2022] DELETE /compute/v2.1/images/383430b5-dbd8-4c76-8d65-e77f779b8439 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:29:39.686702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.698824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:39.728394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:39.728946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:39.729992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:39.733219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:39.733771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:39.734241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.503699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:40.550913 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7f76660-5028-48b9-9579-3baade4e74b1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1312 microversion: 2.1 time: 0.874439 Aug 29 15:29:40.551325 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 451/893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1312 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:40.578908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:40.589158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:40.634970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.635808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.636702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.638279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.639202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.642373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.031036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:41.035469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:41.036292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:41.037097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:41.037787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:41.075347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.081346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.086540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.091047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.091680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.093571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.174592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:41.191429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for user f331c1e3ee1442ad863d8909ca76020b and project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:41.228976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:41.237352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:41.343769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c67e613b-73b9-4b53-8269-9995d09ef584 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 4.296659 Aug 29 15:29:41.351304 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 443/894] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:29:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 4305 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:29:41.359211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c769689f-d346-4c4f-ac46-87c9c24fb131 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e363e670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.438212 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c769689f-d346-4c4f-ac46-87c9c24fb131 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.084427 Aug 29 15:29:41.439798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 444/895] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:41.446093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.446973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:41.456340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.457120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.458372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.459751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.460408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.461327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.483173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 HTTP/1.1 Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:29:41.485264 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:41.487109 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '616f6c8d-7b8e-4889-baaa-5e49f7266e52'} Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:41.487978 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:41.489305 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.495260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:41.497069 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a19043d-c808-42cd-9890-2a42e70a8b05 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 404 len: 111 microversion: 2.1 time: 0.055554 Aug 29 15:29:41.521582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:41.540365 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 445/896] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:29:41 2022] DELETE /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:41.550246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.550884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:41.554268 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-841ff587-3516-485e-927e-2561d34a8a5d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 0.986182 Aug 29 15:29:41.554955 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 452/897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:40 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:41.580999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66d4e1ee-8708-443a-83f1-fac2686bef1b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.589381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.589899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.590414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.591155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.591617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.592095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.597915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66d4e1ee-8708-443a-83f1-fac2686bef1b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:42.083185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66d4e1ee-8708-443a-83f1-fac2686bef1b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:42.092586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66d4e1ee-8708-443a-83f1-fac2686bef1b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:42.094085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66d4e1ee-8708-443a-83f1-fac2686bef1b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:42.106616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66d4e1ee-8708-443a-83f1-fac2686bef1b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1284 microversion: 2.25 time: 0.536777 Aug 29 15:29:42.114788 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 453/898] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1284 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:42.122897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.123528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: 616f6c8d-7b8e-4889-baaa-5e49f7266e52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:42.163667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.164174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.164618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.165348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.165831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.166262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.228040 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 HTTP/1.1 Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:29:42.238233 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:42.239824 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '616f6c8d-7b8e-4889-baaa-5e49f7266e52'} Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:42.240669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. Aug 29 15:29:42.242023 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:42.244011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Instance 616f6c8d-7b8e-4889-baaa-5e49f7266e52 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:42.252572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08e89cf3-bae6-427d-b205-f4e0b0b41318 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52" status: 404 len: 111 microversion: 2.1 time: 0.132944 Aug 29 15:29:42.260437 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 454/899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/servers/616f6c8d-7b8e-4889-baaa-5e49f7266e52 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:42.276347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.285409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:42.287894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:42.299691 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ab18c4f-f1b7-4235-93d3-38c851b06713 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 0.762568 Aug 29 15:29:42.302444 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 446/900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:42.312376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.312980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.313462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.313929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-db2e7a79-5ecd-4afc-a157-71e0b0e426d8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '.version_select at 0x7fb0e3cd6af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.314223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.328769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.329245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.379984 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-db2e7a79-5ecd-4afc-a157-71e0b0e426d8 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046640130" status: 202 len: 0 microversion: 2.1 time: 0.075932 Aug 29 15:29:42.381497 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 447/901] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:29:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046640130 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:42.457260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcb73c93-2e77-485f-ad05-4bc36bde90aa tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e377edc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.669814 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcb73c93-2e77-485f-ad05-4bc36bde90aa tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.218417 Aug 29 15:29:42.685850 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 448/902] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:42.709768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.719590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:42.749598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.758967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.768758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.769793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.771668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.773747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:43.739554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:43.748918 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7c8b467-67cc-4f4c-9da6-3c217719acf6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 1.061342 Aug 29 15:29:43.759677 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 449/903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:43.775010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:43.775633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:43.797260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:43.802417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.804449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.805254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:43.807472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.808211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.810169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.224214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.248425 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ccfdb6c1-aa5d-44d9-a0ed-8a8f8e8513d5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1461 microversion: 2.1 time: 1.981569 Aug 29 15:29:44.250142 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 455/904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1461 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:44.268046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:44.271498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:44.285015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.288195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.289636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.291728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.293025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.294029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.460195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.497633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.501428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.508059 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb8943f1-3ec0-4b3f-b79c-0f228190f780 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1344 microversion: 2.25 time: 0.742435 Aug 29 15:29:44.515174 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 450/905] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:43 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1344 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:44.529774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cabe1789-39e1-4709-a7d0-08e829f67a5e tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39a2a60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:44.736028 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cabe1789-39e1-4709-a7d0-08e829f67a5e tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1427 microversion: 2.1 time: 0.218386 Aug 29 15:29:44.761178 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 451/906] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:44 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1427 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:44.790029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:44.807901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:44.835750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.838205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.850196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.851439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.852330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.852940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.977494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.989006 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b740c44-80c8-4ef1-83ce-c48ce4b4bd4d tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 0.730977 Aug 29 15:29:44.989657 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 456/907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:44 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:45.000864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-92cd3cfd-25da-4441-b789-97b303570293 req-f21c2c23-9b89-4452-a96a-43ea9e1d8e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b94bea-6849-4238-8a96-278971ebf178", "name": "network-vif-plugged", "status": "completed", "tag": "918f6dda-e2c9-4486-88f5-24c81c1da093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:45.044033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92cd3cfd-25da-4441-b789-97b303570293 req-f21c2c23-9b89-4452-a96a-43ea9e1d8e2b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.044533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92cd3cfd-25da-4441-b789-97b303570293 req-f21c2c23-9b89-4452-a96a-43ea9e1d8e2b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.044966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92cd3cfd-25da-4441-b789-97b303570293 req-f21c2c23-9b89-4452-a96a-43ea9e1d8e2b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.089418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-92cd3cfd-25da-4441-b789-97b303570293 req-f21c2c23-9b89-4452-a96a-43ea9e1d8e2b service nova] Creating event network-vif-plugged:918f6dda-e2c9-4486-88f5-24c81c1da093 for instance f9b94bea-6849-4238-8a96-278971ebf178 on n-h1-854882-3 Aug 29 15:29:45.098595 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-92cd3cfd-25da-4441-b789-97b303570293 req-f21c2c23-9b89-4452-a96a-43ea9e1d8e2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102413 Aug 29 15:29:45.099647 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 457/908] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:45.111278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:45.114441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:45.127487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.133316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.134233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.135196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.135866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.136471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.159027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:45.166499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Old instance type m1.heat2, new instance type m1.heat {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:29:45.196561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:45.197176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:45.200544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:45.201226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:45.202028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:45.560544 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c926bf3a-62e2-423e-839f-e5a736b23573 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0/action" status: 202 len: 0 microversion: 2.1 time: 0.792512 Aug 29 15:29:45.562468 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 452/909] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:44 2022] POST /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:45.576012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:45.577028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:45.599359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.600906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.602795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.605698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.610782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.615423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.792340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:45.811932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:45.814143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:45.815836 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65164cd3-dc10-481a-b021-8a7637b343e2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1342 microversion: 2.25 time: 0.251872 Aug 29 15:29:45.816689 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 453/910] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:45 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1342 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:45.839147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:45.840628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:45.848949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.849940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.850715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.852013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.852709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.853355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.129516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:46.144434 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66a49b3b-8ed9-44be-80d7-7f4376c45bd9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1503 microversion: 2.1 time: 1.037169 Aug 29 15:29:46.157858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:46.160434 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 458/911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:45 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1503 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:46.164933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-38cf0131-44e6-4250-a321-10a64cc8dd0b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1470 microversion: 2.1 time: 0.333277 Aug 29 15:29:46.179224 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 454/912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:45 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1470 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:46.185062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-081dc45b-7d88-4f77-a29f-e5dc0fc572fc tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e34d8c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.201015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4827277e-6c4a-4ffa-af23-e425acc4ec47 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '.version_select at 0x7fb0e3ed7b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.253410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4827277e-6c4a-4ffa-af23-e425acc4ec47 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Image not found. Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4827277e-6c4a-4ffa-af23-e425acc4ec47 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/images/51f99502-ade9-4786-8c7b-694a4c980a0c HTTP/1.1 Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:29:46.255386 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '51f99502-ade9-4786-8c7b-694a4c980a0c'} Aug 29 15:29:46.257124 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 51f99502-ade9-4786-8c7b-694a4c980a0c to delete Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:46.258141 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 51f99502-ade9-4786-8c7b-694a4c980a0c could not be found. Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:46.259603 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4827277e-6c4a-4ffa-af23-e425acc4ec47 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:46.261560 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4827277e-6c4a-4ffa-af23-e425acc4ec47 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/images/51f99502-ade9-4786-8c7b-694a4c980a0c" status: 404 len: 62 microversion: 2.1 time: 0.091513 Aug 29 15:29:46.264823 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-081dc45b-7d88-4f77-a29f-e5dc0fc572fc tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1436 microversion: 2.1 time: 0.078814 Aug 29 15:29:46.265017 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 459/913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:46 2022] DELETE /compute/v2.1/images/51f99502-ade9-4786-8c7b-694a4c980a0c => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:29:46.265107 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 455/914] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1436 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:46.273517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.274355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:46.285583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.286141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:46.296138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.296860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.297430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.298263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.298840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.299368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.301072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.301633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.302080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.302803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.305269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.306064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.341722 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 HTTP/1.1 Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:29:46.347455 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.349189 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ea96d7b0-2728-4dec-b28d-a85089376221'} Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:46.350110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.351677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.358460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:46.359816 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42d80b3d-e4b6-4314-b73a-d653d4c80bd4 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 404 len: 111 microversion: 2.1 time: 0.085088 Aug 29 15:29:46.365789 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 456/915] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:29:46 2022] DELETE /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:46.381519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-883eda78-b45c-43b3-a333-2c78b2e39b51 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e39a2b80>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.502838 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-883eda78-b45c-43b3-a333-2c78b2e39b51 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 200 len: 1436 microversion: 2.1 time: 0.134044 Aug 29 15:29:46.517844 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 457/916] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 1436 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:46.526678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.527479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] [instance: ea96d7b0-2728-4dec-b28d-a85089376221] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:46.546299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.547041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.547739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.548730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.549459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.550350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.555033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:46.565191 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9329eee-a0c3-4d48-ae03-4c95ed0c9675 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1387 microversion: 2.1 time: 0.301661 Aug 29 15:29:46.609838 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 460/917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1387 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:46.615387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.623344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:46.625263 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] HTTP exception thrown: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Request method failure captured: Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 HTTP/1.1 Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrcLib6XtiM_SLxDO-a_Js-ovMk7pgGm7gz2tiTEb06gYwlXcREjGakCfussRhVRmzvmwZS3JfZ06BC5ueg_E2gNDPbMf8fiFY4M7AHehV2tvhUdo5Z1g7tnQfauKRHYucLERKIL0qp56fCH18QhsAvCbjRHJCrA5fGpTJCSvm-cqQ Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:29:46.627765 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef825b35f554cbb81bc25e06e2b5681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef825b35f554cbb81bc25e06e2b5681", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef825b35f554cbb81bc25e06e2b5681"}]}] Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7ef825b35f554cbb81bc25e06e2b5681 Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839 Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 7bd967d46f614bb4a187218498e934f3 Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2000086839-project Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.629266 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ea96d7b0-2728-4dec-b28d-a85089376221'} Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:46.630089 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. Aug 29 15:29:46.631366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:46.634541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.635026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.635674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.636105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] Returning 404 to user: Instance ea96d7b0-2728-4dec-b28d-a85089376221 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:46.637858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.638336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.638769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.639753 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7dff6b37-110a-44ab-aa20-e3dd92b26b44 tempest-ImagesOneServerNegativeTestJSON-2000086839 tempest-ImagesOneServerNegativeTestJSON-2000086839-project] 10.222.0.16 "GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221" status: 404 len: 111 microversion: 2.1 time: 0.119298 Aug 29 15:29:46.641360 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 458/918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/servers/ea96d7b0-2728-4dec-b28d-a85089376221 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:46.642427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:46.845840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.846480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:46.873834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.874406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.874849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.885029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.885353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.885906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.116646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.127745 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ee7b38c8-f524-4bb1-8bea-1b0699d81c11 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1466 microversion: 2.1 time: 0.516024 Aug 29 15:29:47.129066 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 461/919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1466 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:47.152247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c0907fb4-c43a-431a-8b42-cbaa7611084e tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e35950d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:47.436990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.453120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.462107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.463326 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3af3e54-6881-4d63-b883-35d6bd270871 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1410 microversion: 2.25 time: 0.623327 Aug 29 15:29:47.468616 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 459/920] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1410 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:47.480282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:47.490815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:47.504694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.505191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.505651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.516799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.517451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.517919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.832826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.867390 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a377befc-3353-4063-bcf7-ca0e6fd6cf93 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1478 microversion: 2.1 time: 0.396888 Aug 29 15:29:47.892912 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 460/921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:47 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1478 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:47.914470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:47.919075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:47.933823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.934334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.942922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.943718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.950937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.951677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.577245 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c0907fb4-c43a-431a-8b42-cbaa7611084e tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "DELETE /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2" status: 204 len: 0 microversion: 2.1 time: 1.429183 Aug 29 15:29:48.577879 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 462/922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:47 2022] DELETE /compute/v2.1/images/33784481-c64e-429c-9da9-549d5a3e33f2 => generated 0 bytes in 1431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:29:48.591635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:48.592259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:48.606146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.606571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.607001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.607707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.608535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.616555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.968834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:48.992961 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b0d2ab4-b9ea-48d9-b420-2577a7e129f0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1470 microversion: 2.1 time: 1.094728 Aug 29 15:29:48.999998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 461/923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:47 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1470 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:49.020829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd260047-2850-46b5-b020-9e7d5f7fb08e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '.version_select at 0x7fb0e34d8ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.031016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd260047-2850-46b5-b020-9e7d5f7fb08e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.031953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd260047-2850-46b5-b020-9e7d5f7fb08e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.032722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd260047-2850-46b5-b020-9e7d5f7fb08e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.049497 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fd260047-2850-46b5-b020-9e7d5f7fb08e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.047256 Aug 29 15:29:49.050630 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 462/924] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:29:49 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:49.058536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.060559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:49.067925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.068837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.069805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.070790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.071480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.072134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.383945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.399551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a014a6c1-afd6-4a58-9b75-23c9b68bed20 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1586 microversion: 2.1 time: 0.819204 Aug 29 15:29:49.418097 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 463/925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:48 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1586 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:49.429436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87af0e06-d369-4647-b1c3-73b767a6b71c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '.version_select at 0x7fb0e3585430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.463598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-87af0e06-d369-4647-b1c3-73b767a6b71c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] HTTP exception thrown: Image not found. Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87af0e06-d369-4647-b1c3-73b767a6b71c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Request method failure captured: Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 HTTP/1.1 Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNsXCxQwXRphqZavOt7y20Fi3fZa661l_saF4MMv99J9WaNRiLHM5jyKKcCWDyIdMH3wEMjyfQ82MuS4vSnOfDnMJwojkBA12TashFi64rwm6U9ndQJgRIOUHRv6ukmNB01EeekYOAGBWpt3J4tJWRokbj-PqjXZsqZS7cP476uGXl0 Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 03575bcf80404b0994fc8d967804b6df Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:29:49.468603 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03575bcf80404b0994fc8d967804b6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03575bcf80404b0994fc8d967804b6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03575bcf80404b0994fc8d967804b6df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03575bcf80404b0994fc8d967804b6df"}]}] Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 03575bcf80404b0994fc8d967804b6df Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerTestJSON-532890142-project Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7ead06f178974869a251628cca018175 Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerTestJSON-532890142-project Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'e0a688c7-6ff8-4ad9-8d81-72b743ccb653'} Aug 29 15:29:49.470986 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e0a688c7-6ff8-4ad9-8d81-72b743ccb653 to delete Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:49.472326 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e0a688c7-6ff8-4ad9-8d81-72b743ccb653 could not be found. Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:49.473848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:29:49.476108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:49.483159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87af0e06-d369-4647-b1c3-73b767a6b71c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:49.486663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-87af0e06-d369-4647-b1c3-73b767a6b71c tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "DELETE /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653" status: 404 len: 62 microversion: 2.1 time: 0.065905 Aug 29 15:29:49.488200 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 464/926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:49 2022] DELETE /compute/v2.1/images/e0a688c7-6ff8-4ad9-8d81-72b743ccb653 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:29:49.513094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d98baf1c-fd66-4223-ba77-112aabece1b0 req-fdef22f7-edbc-403b-8a59-c11b424cb2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507afd7-0e79-497f-b26d-65fbeef242e3", "name": "network-vif-unplugged", "status": "completed", "tag": "e9c1a183-45af-4136-a73f-ccf56c310916"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:49.544753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d98baf1c-fd66-4223-ba77-112aabece1b0 req-fdef22f7-edbc-403b-8a59-c11b424cb2e6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.545188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d98baf1c-fd66-4223-ba77-112aabece1b0 req-fdef22f7-edbc-403b-8a59-c11b424cb2e6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.545850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d98baf1c-fd66-4223-ba77-112aabece1b0 req-fdef22f7-edbc-403b-8a59-c11b424cb2e6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.562592 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d98baf1c-fd66-4223-ba77-112aabece1b0 req-fdef22f7-edbc-403b-8a59-c11b424cb2e6 service nova] Creating event network-vif-unplugged:e9c1a183-45af-4136-a73f-ccf56c310916 for instance a507afd7-0e79-497f-b26d-65fbeef242e3 on n-h2-854882-3 Aug 29 15:29:49.568602 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d98baf1c-fd66-4223-ba77-112aabece1b0 req-fdef22f7-edbc-403b-8a59-c11b424cb2e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075283 Aug 29 15:29:49.570318 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 465/927] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:49.577345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.578740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:49.586657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.587414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.588022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.589013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.591578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.592229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.604542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.622230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.624080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.625228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40cd700a-0cfc-473c-87ae-d3db4811e296 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1410 microversion: 2.25 time: 0.572503 Aug 29 15:29:49.625830 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 463/928] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:49 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1410 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:49.630814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9e5a8f53-70bf-48ea-972d-07591feba4d2 req-75c09732-ba39-4074-a760-3996c0f91113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704fa114-40c8-4d26-bd16-838f3a8dcb5f", "tag": "082f5e62-9263-4994-b619-d36cc2fcb932"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:49.640546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e5a8f53-70bf-48ea-972d-07591feba4d2 req-75c09732-ba39-4074-a760-3996c0f91113 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.641427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e5a8f53-70bf-48ea-972d-07591feba4d2 req-75c09732-ba39-4074-a760-3996c0f91113 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.642014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e5a8f53-70bf-48ea-972d-07591feba4d2 req-75c09732-ba39-4074-a760-3996c0f91113 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.646441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:49.657112 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9e5a8f53-70bf-48ea-972d-07591feba4d2 req-75c09732-ba39-4074-a760-3996c0f91113 service nova] Creating event network-changed:082f5e62-9263-4994-b619-d36cc2fcb932 for instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f on n-h1-854882-3 Aug 29 15:29:49.663737 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9e5a8f53-70bf-48ea-972d-07591feba4d2 req-75c09732-ba39-4074-a760-3996c0f91113 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036370 Aug 29 15:29:49.664652 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 464/929] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:49.670875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.671880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:49.679307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.679788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.680217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.680938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.681370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.682010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.856217 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f2a257c-99fb-4adf-84c3-9463566fd2a7 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188675 Aug 29 15:29:49.859784 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 465/930] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:29:49 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:49.872521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.873127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:49.885452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.888923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.890704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.892845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.894051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.895195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.945913 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4b355ab-1e5c-4230-a039-d647114c4282 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1629 microversion: 2.1 time: 0.373838 Aug 29 15:29:49.947179 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 466/931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:49 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1629 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:49.961313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:29:49.992473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fada41a-4e60-411e-9041-a48bea0f156c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Action: 'create', calling method: .version_select at 0x7fb0e35f8a60>, body: {"keypair": {"name": "tempest-keypair-435751087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4GyhLVJQbDpwCqmHpcPii4mRAefDGI/5lX/KfEChxJ/eEEmcCrAcNl1fE6gu6nTzntKc2fkeTVWAp3GwQchZWmWLvSDEqapkmvaLvtZiR5Sq/VCprxgcTB3p2pyjN0BQ=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:50.011475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1fada41a-4e60-411e-9041-a48bea0f156c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:50.018211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1fada41a-4e60-411e-9041-a48bea0f156c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for user e7e71fcf6711470db5a71ddc74ff709c and project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:50.055626 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1fada41a-4e60-411e-9041-a48bea0f156c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070114 Aug 29 15:29:50.057198 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 467/932] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:29:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:50.064399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.065290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.072933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.073874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.075470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.076909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.077720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.078519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.099228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a811e57-4231-40ea-aa6f-026da06035e1 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 204 len: 0 microversion: 2.1 time: 0.235908 Aug 29 15:29:50.103630 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 466/933] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:29:49 2022] DELETE /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:50.113432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.115528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.128576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.129710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.130880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.132647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.133675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.134460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.474116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.498450 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1475b7d0-6220-4a16-b6b1-eb8f21c0c54b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1470 microversion: 2.1 time: 0.436517 Aug 29 15:29:50.505799 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 468/934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1470 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:50.630385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.642057 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0accb250-ac84-4173-a5ec-3673d04fbe27 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1472 microversion: 2.1 time: 0.536487 Aug 29 15:29:50.643776 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 467/935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1472 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:50.668822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.670168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.677442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.678197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.678805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.679747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.680368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.680971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.930838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.942091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.944265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.946771 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b7a7990-b499-4e41-80d8-3472f73b946a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1410 microversion: 2.25 time: 0.282492 Aug 29 15:29:50.963374 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 469/936] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1410 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:51.520128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:51.521373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:51.524197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:51.524870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:51.544265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.545107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.545804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:51.546725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.547425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.548145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:51.663198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:51.664134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:51.676521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.678072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.678692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:51.680482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.681259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.681907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:52.021996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.044374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.056832 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c3e26c3-3aee-41c7-a49e-1c09a43205ea tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1470 microversion: 2.1 time: 0.540750 Aug 29 15:29:52.057604 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 468/937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:51 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1470 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:52.067393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:52.068351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:52.078020 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd857c00-de93-4b4b-bf1c-2234db18c1ae tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1472 microversion: 2.1 time: 0.417145 Aug 29 15:29:52.079636 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 470/938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:51 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:52.083254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:52.083754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:52.084196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:52.084910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:52.085358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:52.085811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:52.798583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.808905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.813582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.815210 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d1398b9f-b48e-4a51-809b-26bfbc793371 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1410 microversion: 2.25 time: 0.756388 Aug 29 15:29:52.820789 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 469/939] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:52 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1410 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:53.081446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:53.082059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:53.094450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.098306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.098999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.099994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.100114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:53.100703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:53.101032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.101843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.113740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.114977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.115568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.117009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.117688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.118262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.440938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:53.450107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-32725e65-387b-463d-b70a-049cff85a159 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1470 microversion: 2.1 time: 0.372381 Aug 29 15:29:53.450723 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 471/940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:53 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1470 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:53.866129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:53.869282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:53.917583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.921381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.922898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.925335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.927052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.933053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.936953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:53.959145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-21f7f6d4-39db-4b76-b618-976406ba3713 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1472 microversion: 2.1 time: 0.862919 Aug 29 15:29:53.960300 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 470/941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:53 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1472 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:54.443353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:54.473809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:54.497024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:54.499370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f861b45b-4668-465f-9e0b-a27ad17de8ca tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1410 microversion: 2.25 time: 0.655316 Aug 29 15:29:54.505859 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 472/942] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:53 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1410 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:54.522570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:54.529166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:54.545121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.545707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.546089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.546800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.547260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.547663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.805069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:54.809283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:54.829895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.833229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.833786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.835963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.836456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.839308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.889751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:54.911272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-05e4aab3-2163-462e-865f-97403c145a60 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.403728 Aug 29 15:29:54.912337 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 473/943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:54 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:54.980156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:54.981003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:54.994573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.995193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.995747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.997103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.997701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.998252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.643573 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] HTTP exception thrown: Volume cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba could not be found. Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Request method failure captured: Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments/92a18020-f34a-49db-a82c-afc212c7b58d HTTP/1.1 Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 74 Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNr1Ze-jFfe4ImQreIDE-7WK5n1mvweQiQsLnosMEYtshae115Xvbpfbj4csJfSsOEbpjsptSjLC9of2d7an7ImDLibZrq91kgruo72Q6ZxnsbWW50d7D_TrzvcfCy89iDJ98QBkVR_e3FAy46EKG9eriuRvRWp8pQODa_SAPTiDPGM Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 64edf13094b74182b6d8b33ad3026b5c Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesAdminNegativeTest-1041747914 Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:29:55.647952 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64edf13094b74182b6d8b33ad3026b5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64edf13094b74182b6d8b33ad3026b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64edf13094b74182b6d8b33ad3026b5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64edf13094b74182b6d8b33ad3026b5c"}]}] Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesAdminNegativeTest-1041747914 Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 64edf13094b74182b6d8b33ad3026b5c Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1041747914 Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesAdminNegativeTest-1041747914-project-admin Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 958a45cf5eb647df9b53037171349898 Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesAdminNegativeTest-1041747914-project-admin Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: {"volumeAttachment": {"volumeId": "cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba"}} Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:29:55.649878 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba could not be found. Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': '5bf291a9-4160-4710-97ef-4067a3e5bf59', 'id': '92a18020-f34a-49db-a82c-afc212c7b58d', 'body': {'volumeAttachment': {'volumeId': 'cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba'}}} Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:29:55.651013 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba could not be found. (HTTP 404) (Request-ID: req-31ea0f2a-8c82-4541-9444-9a14308f3f1e) Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:29:55.652382 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba could not be found. Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:55.659705 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba could not be found. Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba could not be found. Aug 29 15:29:55.661360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:29:55.663342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Returning 400 to user: Volume cf7a5f92-81ec-44b0-a9b1-cd3cf47612ba could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:55.663342 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30b49e8d-d1c1-4fdd-aca1-b8295c11b33a tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments/92a18020-f34a-49db-a82c-afc212c7b58d" status: 400 len: 107 microversion: 2.1 time: 1.267034 Aug 29 15:29:55.663342 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 471/944] 10.222.0.16 () {60 vars in 1433 bytes} [Mon Aug 29 15:29:54 2022] PUT /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments/92a18020-f34a-49db-a82c-afc212c7b58d => generated 107 bytes in 1274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:29:55.673511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:55.694749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:55.712466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.712871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.713335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.719687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.720181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.720622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.874474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:55.888129 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b7be4608-afd1-45dc-ba02-8fff634c945a tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1472 microversion: 2.1 time: 0.910910 Aug 29 15:29:55.901459 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 474/945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:54 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1472 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:55.913772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f41a1c75-886a-4c68-80e7-c297eef3115d req-84362f2c-99a7-4284-8792-7b25b6b8f811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9b94bea-6849-4238-8a96-278971ebf178", "tag": "918f6dda-e2c9-4486-88f5-24c81c1da093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:55.940896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f41a1c75-886a-4c68-80e7-c297eef3115d req-84362f2c-99a7-4284-8792-7b25b6b8f811 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.942330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f41a1c75-886a-4c68-80e7-c297eef3115d req-84362f2c-99a7-4284-8792-7b25b6b8f811 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.943052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f41a1c75-886a-4c68-80e7-c297eef3115d req-84362f2c-99a7-4284-8792-7b25b6b8f811 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.958909 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f41a1c75-886a-4c68-80e7-c297eef3115d req-84362f2c-99a7-4284-8792-7b25b6b8f811 service nova] Creating event network-changed:918f6dda-e2c9-4486-88f5-24c81c1da093 for instance f9b94bea-6849-4238-8a96-278971ebf178 on n-h1-854882-3 Aug 29 15:29:55.965015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f41a1c75-886a-4c68-80e7-c297eef3115d req-84362f2c-99a7-4284-8792-7b25b6b8f811 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073739 Aug 29 15:29:55.966168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 475/946] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:55.971772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:55.972847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:55.995455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.999950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.001001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.003933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.006306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.008799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.522103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:56.544602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:56.563732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:56.568253 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cddba31f-e5d2-4432-9df9-cb59b5af9915 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1410 microversion: 2.25 time: 0.599337 Aug 29 15:29:56.569271 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 476/947] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:55 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1410 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:56.609477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:56.610985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:56.633356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.636500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.637187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.640540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.647078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.647874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.901512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:56.969708 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-094f3777-624d-4137-b596-f5b2195a15fc tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1586 microversion: 2.1 time: 1.307958 Aug 29 15:29:56.973724 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 472/948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:55 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1586 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:57.015195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:57.016825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:57.050495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.051496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.052608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.059884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.061019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.061813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.160814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lazy-loading 'services' on Instance uuid 5bf291a9-4160-4710-97ef-4067a3e5bf59 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:57.472421 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-651791d0-e402-4c46-baef-906350f74388 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments/92a18020-f34a-49db-a82c-afc212c7b58d" status: 202 len: 0 microversion: 2.1 time: 0.899784 Aug 29 15:29:57.473101 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 477/949] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:29:56 2022] DELETE /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments/92a18020-f34a-49db-a82c-afc212c7b58d => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:57.489349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-055c4a4d-ca36-44ba-bd3e-8c95830ce413 req-0e221141-df94-4897-94f7-5fd77b02af4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704fa114-40c8-4d26-bd16-838f3a8dcb5f", "name": "network-vif-plugged", "status": "completed", "tag": "082f5e62-9263-4994-b619-d36cc2fcb932"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:57.517420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-055c4a4d-ca36-44ba-bd3e-8c95830ce413 req-0e221141-df94-4897-94f7-5fd77b02af4a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.518449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-055c4a4d-ca36-44ba-bd3e-8c95830ce413 req-0e221141-df94-4897-94f7-5fd77b02af4a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.519291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-055c4a4d-ca36-44ba-bd3e-8c95830ce413 req-0e221141-df94-4897-94f7-5fd77b02af4a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.534024 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-055c4a4d-ca36-44ba-bd3e-8c95830ce413 req-0e221141-df94-4897-94f7-5fd77b02af4a service nova] Creating event network-vif-plugged:082f5e62-9263-4994-b619-d36cc2fcb932 for instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f on n-h1-854882-3 Aug 29 15:29:57.547973 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-055c4a4d-ca36-44ba-bd3e-8c95830ce413 req-0e221141-df94-4897-94f7-5fd77b02af4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073160 Aug 29 15:29:57.549213 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 478/950] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:57.564122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:57.565355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:57.578876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.579783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.580486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.582529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.585532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.586250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.635597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.636406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.637955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.638657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lazy-loading 'fault' on Instance uuid a507afd7-0e79-497f-b26d-65fbeef242e3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:57.706441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:57.719068 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d0dc0f5-4bee-45a7-8f5a-bc49a302a6ab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.736424 Aug 29 15:29:57.722089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 473/951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:56 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:57.740462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-447927373", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "1edccff3-384b-4b0d-b706-83561d318ba9"}], "security_groups": [{"name": "tempest-securitygroup--2119051484"}], "key_name": "tempest-keypair-435751087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:57.858815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead06f178974869a251628cca018175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03575bcf80404b0994fc8d967804b6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:57.912750 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-161dafb7-e002-4fde-a445-624dfc1ad6cb tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 200 len: 1307 microversion: 2.1 time: 0.352450 Aug 29 15:29:57.919189 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 479/952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:57 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 1307 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:57.932295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:57.937995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:57.954894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.956892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.958572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.962357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.963869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.971610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] validate_networks() for [('1edccff3-384b-4b0d-b706-83561d318ba9', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:57.977948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.085619 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a182a01-11a5-41da-98ab-49b7e0ff96a1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161753 Aug 29 15:29:58.086367 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 480/953] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:29:57 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:58.101114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:58.102540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:58.138821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.139358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.139802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.140891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.141546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.142354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.718027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:58.720513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:58.731663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:58.740935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:58.742395 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3035330a-bd93-46c5-9546-4a5797f6429a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1410 microversion: 2.25 time: 0.652850 Aug 29 15:29:58.755613 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 481/954] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:58 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1410 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:58.755613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1841489d-dc10-4977-a744-f45688cabd77 req-34eefb3f-fa87-4773-8e63-d9a44076d4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507afd7-0e79-497f-b26d-65fbeef242e3", "name": "network-vif-deleted", "tag": "e9c1a183-45af-4136-a73f-ccf56c310916"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:58.775656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1841489d-dc10-4977-a744-f45688cabd77 req-34eefb3f-fa87-4773-8e63-d9a44076d4d9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.776175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1841489d-dc10-4977-a744-f45688cabd77 req-34eefb3f-fa87-4773-8e63-d9a44076d4d9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.776581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1841489d-dc10-4977-a744-f45688cabd77 req-34eefb3f-fa87-4773-8e63-d9a44076d4d9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.803461 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1841489d-dc10-4977-a744-f45688cabd77 req-34eefb3f-fa87-4773-8e63-d9a44076d4d9 service nova] Creating event network-vif-deleted:e9c1a183-45af-4136-a73f-ccf56c310916 for instance a507afd7-0e79-497f-b26d-65fbeef242e3 on n-h2-854882-3 Aug 29 15:29:58.812111 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1841489d-dc10-4977-a744-f45688cabd77 req-34eefb3f-fa87-4773-8e63-d9a44076d4d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067264 Aug 29 15:29:58.812744 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 482/955] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:58.829488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:58.830216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:58.865328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.870543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.873188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.883543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.884293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.884934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.966515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:58.967552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:58.968681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:58.982377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:58.983425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:59.019570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.020342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.022356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.025237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.028945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.031416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.080682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:59.090968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for user e7e71fcf6711470db5a71ddc74ff709c and project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:59.109926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:59.113593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:59.177360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:59.197635 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-488af527-609b-45c0-9652-7bf205488684 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.374705 Aug 29 15:29:59.198454 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 483/956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:58 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:59.206777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.211779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] [instance: a507afd7-0e79-497f-b26d-65fbeef242e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.239490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.239990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.240432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.241162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.241872 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3aa6394-e66d-417a-874d-b739fdd920de tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.517848 Aug 29 15:29:59.243340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 474/957] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:59.249209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.252024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.257683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3c1ca5f4-f44a-4d00-85b7-c9c4f938de5f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32c2040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.356617 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] HTTP exception thrown: Instance a507afd7-0e79-497f-b26d-65fbeef242e3 could not be found. Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Request method failure captured: Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 HTTP/1.1 Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNsXCxQwXRphqZavOt7y20Fi3fZa661l_saF4MMv99J9WaNRiLHM5jyKKcCWDyIdMH3wEMjyfQ82MuS4vSnOfDnMJwojkBA12TashFi64rwm6U9ndQJgRIOUHRv6ukmNB01EeekYOAGBWpt3J4tJWRokbj-PqjXZsqZS7cP476uGXl0 Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 03575bcf80404b0994fc8d967804b6df Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:29:59.359339 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03575bcf80404b0994fc8d967804b6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03575bcf80404b0994fc8d967804b6df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03575bcf80404b0994fc8d967804b6df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03575bcf80404b0994fc8d967804b6df"}]}] Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 03575bcf80404b0994fc8d967804b6df Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-532890142 Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesOneServerTestJSON-532890142-project Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 7ead06f178974869a251628cca018175 Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesOneServerTestJSON-532890142-project Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance a507afd7-0e79-497f-b26d-65fbeef242e3 could not be found. Aug 29 15:29:59.360736 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'a507afd7-0e79-497f-b26d-65fbeef242e3'} Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a507afd7-0e79-497f-b26d-65fbeef242e3 could not be found. Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:59.361533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a507afd7-0e79-497f-b26d-65fbeef242e3 could not be found. Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a507afd7-0e79-497f-b26d-65fbeef242e3 could not be found. Aug 29 15:29:59.362841 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:29:59.371417 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3c1ca5f4-f44a-4d00-85b7-c9c4f938de5f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/78a6050a-bda8-4d6a-80c2-d841ee6123b8" status: 200 len: 662 microversion: 2.1 time: 0.125133 Aug 29 15:29:59.381955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] Returning 404 to user: Instance a507afd7-0e79-497f-b26d-65fbeef242e3 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:59.383560 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24cf2500-051d-43ee-91e9-90e91c458f29 tempest-ImagesOneServerTestJSON-532890142 tempest-ImagesOneServerTestJSON-532890142-project] 10.222.0.16 "GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3" status: 404 len: 111 microversion: 2.1 time: 0.182602 Aug 29 15:29:59.388089 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 484/958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/a507afd7-0e79-497f-b26d-65fbeef242e3 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:59.390036 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 475/959] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/images/78a6050a-bda8-4d6a-80c2-d841ee6123b8 => generated 662 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:59.397263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d528e93-ef2d-457f-831d-6947c9221260 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.398134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d528e93-ef2d-457f-831d-6947c9221260 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.417157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.421714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.430451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.431707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.432453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.433645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.434985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.435912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.482333 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ea50917-507c-4910-be13-226ffbc1928f tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092825 Aug 29 15:29:59.483581 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 485/960] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:59.493758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b2246b3-6dec-4130-8ac6-c759ecceb915 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e356ca60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.520869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d528e93-ef2d-457f-831d-6947c9221260 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:59.540981 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d528e93-ef2d-457f-831d-6947c9221260 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1233 microversion: 2.1 time: 0.148255 Aug 29 15:29:59.542173 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 476/961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1233 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:59.570933 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b2246b3-6dec-4130-8ac6-c759ecceb915 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/78a6050a-bda8-4d6a-80c2-d841ee6123b8" status: 200 len: 662 microversion: 2.1 time: 0.085595 Aug 29 15:29:59.572238 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 486/962] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/images/78a6050a-bda8-4d6a-80c2-d841ee6123b8 => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:59.771579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.772221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.784894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.785821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.785938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.794409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.795145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.796571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.055599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.069118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.072408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.074600 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fabc7be0-2e0e-432a-baf5-07df0fd66853 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1605 microversion: 2.25 time: 0.310079 Aug 29 15:30:00.091691 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 477/963] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1605 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:30:00.098684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:00.103915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.104426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.122431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:00.124126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.124676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.125144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.125983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.126473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.126968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.226476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.229693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.242787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.246828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.250254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.252438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.253501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.254664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.290935 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5d127dfc-7565-4eac-a74d-853d0b8ff258 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.193132 Aug 29 15:30:00.291577 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 487/964] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:30:00.504121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.506983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.535333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.542173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.543042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.544099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.545203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.546076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.635934 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6da3e789-e94d-42fb-b145-aa57945a9365 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137799 Aug 29 15:30:00.642046 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 488/965] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:00.648455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.649619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.658676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.660284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.661035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.662753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.663538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.664210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.834923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.850964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.858387 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9311d359-5e5d-4ef4-a376-64b12bbf9bcd tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1285 microversion: 2.1 time: 0.208382 Aug 29 15:30:00.860344 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 489/966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:00.884742 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-680d9728-9345-4080-94a3-cdc31191a203 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.669166 Aug 29 15:30:00.929452 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 478/967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:01.657864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:01.660793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:01.676918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.677664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.679737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.680832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.681576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.682250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.793000 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a45ae472-f9b9-4960-92de-e35713ddf90d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147055 Aug 29 15:30:01.799558 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 490/968] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:01 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:01.815552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab1c2d21-1f6a-4b69-8822-fba0fab0826b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32c8550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:01.880539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:01.888815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:01.920834 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab1c2d21-1f6a-4b69-8822-fba0fab0826b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/74eee68b-4095-41a1-a20c-ae718d3b1dfb" status: 200 len: 662 microversion: 2.1 time: 0.118360 Aug 29 15:30:01.925064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.925880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.926498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.927573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.931105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.931621 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 479/969] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:01 2022] GET /compute/v2.1/images/74eee68b-4095-41a1-a20c-ae718d3b1dfb => generated 662 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:01.935540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.951776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-90e20e16-a817-4913-a010-5a74fee98ece tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3317dc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:02.080248 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-90e20e16-a817-4913-a010-5a74fee98ece tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/74eee68b-4095-41a1-a20c-ae718d3b1dfb" status: 200 len: 662 microversion: 2.1 time: 0.140165 Aug 29 15:30:02.083808 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 480/970] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:01 2022] GET /compute/v2.1/images/74eee68b-4095-41a1-a20c-ae718d3b1dfb => generated 662 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:02.124654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:02.134429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:02.157810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.158659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.159326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.160574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.161413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.162192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.178785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:02.189429 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d2f06d4-fc7f-4c92-8a52-8e57f3f369a0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1293 microversion: 2.1 time: 0.313077 Aug 29 15:30:02.195947 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 491/971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:01 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1293 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:02.813919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:02.818123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:02.842557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.843052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.849314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.856125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.857084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.858251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.987009 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13388968-d54f-4e18-93ae-8fea8f60f704 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178659 Aug 29 15:30:02.988139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 492/972] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:02 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:03.125876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:03.142769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-62030018-6fb7-497d-af7f-66be22e5eb7f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 1.036183 Aug 29 15:30:03.144428 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 481/973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:02 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:03.220056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:03.220906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:03.243152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.244087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.244818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.246134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.247894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.248379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.400685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:03.427527 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7a3587e-255b-46cb-9ff9-9cb0981ff4f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1291 microversion: 2.1 time: 0.211514 Aug 29 15:30:03.439641 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 493/974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:03 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1291 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:04.003975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:04.008174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:04.031498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.032187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.034674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.037219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.038888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.040724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.067678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-932999862", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:04.117926 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-340bee78-8ee9-4a38-ac5b-d69f324fc152 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117950 Aug 29 15:30:04.124354 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 494/975] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:03 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:04.243346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6159d1d0-8f61-4ebf-a656-58e7c249705f tempest-ListImagesTestJSON-1148003040 tempest-ListImagesTestJSON-1148003040-project] Calling method '.version_select at 0x7fb0e3626280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:04.360541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] validate_networks() for [('067d6abd-b6e5-45e7-afc9-2f54c5c563a0', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:04.396179 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6159d1d0-8f61-4ebf-a656-58e7c249705f tempest-ListImagesTestJSON-1148003040 tempest-ListImagesTestJSON-1148003040-project] 10.222.0.16 "GET /compute/v2.1/images/69b80579-025a-47db-8397-1d03ce8a20ab" status: 200 len: 784 microversion: 2.1 time: 0.242301 Aug 29 15:30:04.397457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 495/976] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:04 2022] GET /compute/v2.1/images/69b80579-025a-47db-8397-1d03ce8a20ab => generated 784 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:04.404223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:04.405512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:04.425697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.426627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.427607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.429427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.429812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.430261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.819621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:04.865156 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-88ea4003-46d2-4c98-8ae7-0efeb4951e11 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.466371 Aug 29 15:30:04.883777 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 496/977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:04 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:04.909959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f409afe5-12c1-43be-8b77-95433740a268 tempest-ListImagesTestJSON-1148003040 tempest-ListImagesTestJSON-1148003040-project] Calling method '.version_select at 0x7fb0e3585b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.146728 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f409afe5-12c1-43be-8b77-95433740a268 tempest-ListImagesTestJSON-1148003040 tempest-ListImagesTestJSON-1148003040-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.248442 Aug 29 15:30:05.148898 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 497/978] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:30:04 2022] GET /compute/v2.1/images => generated 445 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:05.169180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.169180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.190716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.202727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.203921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.211219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.212658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.213809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.360369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:05.378491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29347227-a35f-4815-9b4b-a3c3e758b1d7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1291 microversion: 2.1 time: 0.221965 Aug 29 15:30:05.379511 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 498/979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1291 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:05.391108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-832291f3-529c-4896-86c1-c3320a27bb44 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e35c2af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.482363 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-832291f3-529c-4896-86c1-c3320a27bb44 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/44840df0-1a54-4ccc-a419-14473b75725e" status: 200 len: 662 microversion: 2.1 time: 0.100439 Aug 29 15:30:05.484233 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 499/980] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/images/44840df0-1a54-4ccc-a419-14473b75725e => generated 662 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:05.493862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-48804462-9d52-448a-8658-c2f38cb1fe14 req-b79b85d2-2249-4c3b-ba51-71d1fa456f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704fa114-40c8-4d26-bd16-838f3a8dcb5f", "tag": "082f5e62-9263-4994-b619-d36cc2fcb932"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:05.545233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-48804462-9d52-448a-8658-c2f38cb1fe14 req-b79b85d2-2249-4c3b-ba51-71d1fa456f0f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.546106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-48804462-9d52-448a-8658-c2f38cb1fe14 req-b79b85d2-2249-4c3b-ba51-71d1fa456f0f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.547621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-48804462-9d52-448a-8658-c2f38cb1fe14 req-b79b85d2-2249-4c3b-ba51-71d1fa456f0f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.579108 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-48804462-9d52-448a-8658-c2f38cb1fe14 req-b79b85d2-2249-4c3b-ba51-71d1fa456f0f service nova] Creating event network-changed:082f5e62-9263-4994-b619-d36cc2fcb932 for instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f on n-h1-854882-3 Aug 29 15:30:05.597054 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-48804462-9d52-448a-8658-c2f38cb1fe14 req-b79b85d2-2249-4c3b-ba51-71d1fa456f0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109020 Aug 29 15:30:05.597642 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 500/981] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:05.609175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.614137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.627939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.628835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.629651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.630967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.631771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.632508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.750918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c7f3f1de-53e8-4c4b-a214-8061b622bb02 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150715 Aug 29 15:30:05.762931 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 501/982] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:05.776606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2c8a1e2-f335-4d73-bfec-813c5f0e454b tempest-ListImagesTestJSON-1148003040 tempest-ListImagesTestJSON-1148003040-project] Calling method '.version_select at 0x7fb0e35c2670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.874545 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2c8a1e2-f335-4d73-bfec-813c5f0e454b tempest-ListImagesTestJSON-1148003040 tempest-ListImagesTestJSON-1148003040-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.109118 Aug 29 15:30:05.875973 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 502/983] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:05.912940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f1d4b8f-833e-4688-8168-f17253828071 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e356cee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:06.041795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f1d4b8f-833e-4688-8168-f17253828071 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/44840df0-1a54-4ccc-a419-14473b75725e" status: 200 len: 662 microversion: 2.1 time: 0.151184 Aug 29 15:30:06.044067 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 503/984] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/images/44840df0-1a54-4ccc-a419-14473b75725e => generated 662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:06.049992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:06.050915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:06.059496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.060269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.061624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.062624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.063556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.064451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.410409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:06.427896 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4353a3ed-6b78-41bb-8a85-be0c62ba5f96 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.380669 Aug 29 15:30:06.431192 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 504/985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:06 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:06.446748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:06.448505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:06.467013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.468983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.470075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.473121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.475303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.475932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.778987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:06.779509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:06.780098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:06.780621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:06.781429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:06.800211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.800864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.801921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.808842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.809615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.810168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.857963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Getting quotas for project 42f9ff69e07f4f32bb1a6aa14a937d86. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:06.875640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Getting quotas for user c886c6bd7a0544b499c77b714c6065f7 and project 42f9ff69e07f4f32bb1a6aa14a937d86. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:06.913255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:06.915774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:07.037182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:07.070995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-208934dc-236a-468d-8d1a-c05d7ddb960f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.635627 Aug 29 15:30:07.086858 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 505/986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:06 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:07.105559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1635281873", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:07.150380 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-af2ad130-4280-4526-bf20-36fe823c68bd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.651478 Aug 29 15:30:07.159375 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 482/987] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:30:07.178298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:07.195182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:07.231654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.252934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.256360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.267529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.269647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.272443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.281209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:07.422234 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ade73296-e4ed-4560-a027-c893e9ca2aae tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260532 Aug 29 15:30:07.425884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 483/988] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:07 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:07.431152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-51ade9ea-6b28-4336-821c-9249c18c04ec tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:07.442481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-51ade9ea-6b28-4336-821c-9249c18c04ec tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:07.928537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:07.929818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:07.930493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:07.931194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:07.931881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:07.947223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-51ade9ea-6b28-4336-821c-9249c18c04ec tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:07.961172 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-51ade9ea-6b28-4336-821c-9249c18c04ec tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1223 microversion: 2.1 time: 0.533630 Aug 29 15:30:07.962132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.962634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.962819 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 484/989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:07 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1223 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:07.970301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.975081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.976415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.977019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.983120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:07.987922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:07.994509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:08.008703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.009949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.011032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.016457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.018261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.018956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.099870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Getting quotas for project 18cc1aaed2584885939c5e7351aeb657. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:08.124972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Getting quotas for user 486709a8644a40dea3786a139896fb57 and project 18cc1aaed2584885939c5e7351aeb657. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:08.152569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:08.158771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:08.283938 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1f65fe9b-7aee-4485-a60f-2837ba48e151 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189745 Aug 29 15:30:08.287686 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 506/990] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:30:08.301125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:08.301906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:08.349249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.352286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.353069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.356216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.359347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.360216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.424924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:08.578875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:08.641329 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d962ce28-aad1-4b67-a38b-07c80c81affe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.676204 Aug 29 15:30:08.646522 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 485/991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:07 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:08.740802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:08.758984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:08.775108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.777036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.777543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.778302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.778831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.779253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.844942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:08.854205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e5c1a565-9881-4b33-a59b-b6a2bfd99680 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170707 Aug 29 15:30:08.855668 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 486/992] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:08 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:08.861405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-847867565", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:08.957226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:09.087423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:09.101809 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f8e1222-9be1-49c0-8da9-b3dd309615c8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.812735 Aug 29 15:30:09.120934 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 507/993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:08 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:09.129165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:09.130619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:09.148917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.154447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.155240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.157316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.158474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.162391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.366087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:09.378397 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-27babd8b-1186-4349-a81e-d5b5e7127632 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1275 microversion: 2.1 time: 0.255214 Aug 29 15:30:09.378997 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 508/994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:09 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:09.687687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:09.689147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:09.702784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.703373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.709064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.710612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.713367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.715502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.082682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:10.094583 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-adaa0de4-3e89-4d08-b3c2-a1dbf9e37bab tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.413580 Aug 29 15:30:10.096202 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 509/995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:09 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:10.110626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.114804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.128518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.133173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.133664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.135682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.138221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.138961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.249596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a26351f8-fc87-4bff-8338-4ea36995af15 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151671 Aug 29 15:30:10.264234 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 510/996] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:30:10 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:30:10.277912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.280434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.298391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.300071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.303032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.305908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.309461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.311417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.566434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:10.577125 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9ceb9c77-db64-467f-a4cc-70723feb872f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.310722 Aug 29 15:30:10.578338 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 511/997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:10 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:10.589226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.594154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.601884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.603161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.603802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.604735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.606027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.606683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.735605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:10.747345 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b98930e4-2786-434e-8027-43b25bf7108f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1281 microversion: 2.1 time: 0.166585 Aug 29 15:30:10.749415 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 512/998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:10 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:10.754754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-359577138", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "d3655e24-4eff-4e75-a204-3f8187e99186"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:10.878828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] validate_networks() for [('d3655e24-4eff-4e75-a204-3f8187e99186', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:11.102305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:11.102792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:11.103188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:11.103676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:11.104035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:11.125210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.125662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.126085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.126834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.127420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.127725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.176936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Getting quotas for project 18cc1aaed2584885939c5e7351aeb657. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:11.186667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Getting quotas for user 486709a8644a40dea3786a139896fb57 and project 18cc1aaed2584885939c5e7351aeb657. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:11.203120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:11.205443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:11.321377 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0190856b-fe16-4813-99d0-df10f711b501 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.464156 Aug 29 15:30:11.328242 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 487/999] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:30:11.334376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:11.335033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:11.377764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.378663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.381181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.383005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.384152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.385235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.960240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:11.986608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ce55f4ea-b925-40e7-bf7e-523eafc8b316 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 0.656406 Aug 29 15:30:12.003387 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 488/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:11 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:12.013925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f7f5ca9d-92c0-4bd7-9efe-664496f69d34 req-699ee61a-8838-4c1d-98c0-ef22626f8d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784f3eba-97c4-48b4-aa04-db77584cbee7", "tag": "e81c2643-3312-407a-9390-e39c02caff49"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:12.039989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f7f5ca9d-92c0-4bd7-9efe-664496f69d34 req-699ee61a-8838-4c1d-98c0-ef22626f8d27 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.042499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f7f5ca9d-92c0-4bd7-9efe-664496f69d34 req-699ee61a-8838-4c1d-98c0-ef22626f8d27 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.043896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f7f5ca9d-92c0-4bd7-9efe-664496f69d34 req-699ee61a-8838-4c1d-98c0-ef22626f8d27 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.077839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f7f5ca9d-92c0-4bd7-9efe-664496f69d34 req-699ee61a-8838-4c1d-98c0-ef22626f8d27 service nova] Creating event network-changed:e81c2643-3312-407a-9390-e39c02caff49 for instance 784f3eba-97c4-48b4-aa04-db77584cbee7 on n-h2-854882-3 Aug 29 15:30:12.099733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f7f5ca9d-92c0-4bd7-9efe-664496f69d34 req-699ee61a-8838-4c1d-98c0-ef22626f8d27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093220 Aug 29 15:30:12.101907 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 489/1001] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:12.114527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-308f6eda-12a5-4f67-9d25-531c6f5f24c0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.117596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-308f6eda-12a5-4f67-9d25-531c6f5f24c0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.335382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-308f6eda-12a5-4f67-9d25-531c6f5f24c0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:12.398733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-308f6eda-12a5-4f67-9d25-531c6f5f24c0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1217 microversion: 2.1 time: 0.294120 Aug 29 15:30:12.401655 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 490/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:12 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1217 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:12.424853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.428294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.496703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.498202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.499133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.500197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.508507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.509743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.556883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:12.557502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:12.557842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:12.558242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:12.558694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:12.578987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.579485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.579925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.580682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.581146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.581613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.674149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Getting quotas for project 879d436e9d1a43ee8df0e652dbb6307a. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:12.684429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Getting quotas for user 1ff9744258414abeb64b442b0d295c1c and project 879d436e9d1a43ee8df0e652dbb6307a. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:12.722705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:12.728073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:12.807662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d023497e-942c-424e-8c5f-48c93339c7a6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.056777 Aug 29 15:30:12.814833 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 513/1003] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:30:12.822655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.823529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.850448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.851342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.855116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.856664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.857971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.859687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.217790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:13.249947 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1ebe13a6-7d9b-41f2-9228-6fc749063a2d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1281 microversion: 2.1 time: 0.433188 Aug 29 15:30:13.299843 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 514/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:12 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1281 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:13.359276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d1a9c13-1a92-4ea6-b78f-45da976bb804 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:13.359955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d1a9c13-1a92-4ea6-b78f-45da976bb804 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:13.736128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:13.748797 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2787b7ac-8c51-4084-ad2c-1bff12b54ae6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 1.344520 Aug 29 15:30:13.753606 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 491/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:12 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:13.757940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d1a9c13-1a92-4ea6-b78f-45da976bb804 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:13.770713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:13.771373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:13.786179 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d1a9c13-1a92-4ea6-b78f-45da976bb804 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1217 microversion: 2.1 time: 0.472009 Aug 29 15:30:13.790083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:13.790593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:13.791042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.791773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:13.792230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:13.802504 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 515/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:13 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1217 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:13.815044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.829272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:13.834884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:13.863259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:13.864108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:13.873106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.874909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:13.880249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:13.882348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.144609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:14.172343 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8a7a2e1-b401-4a20-8ca0-55644568225a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1269 microversion: 2.1 time: 0.367931 Aug 29 15:30:14.177651 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 516/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:13 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1269 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:14.292693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:14.293760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:14.316935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.321115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.323626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.327359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.328131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.328771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.693933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:14.715103 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a27c5436-1233-45ef-945a-cc8d3bdf88ae tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 0.427879 Aug 29 15:30:14.716095 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 517/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:14 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:14.799417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:14.801035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:14.813216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.814139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.814612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.815359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.815835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.816262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.958756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:14.999015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08e8a905-295e-4ea2-a696-b2a376113443 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 1.243783 Aug 29 15:30:15.000937 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 492/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:13 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:15.012054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.049334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.076888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.082573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.083332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.084968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.089966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.090813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.196343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:15.207254 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e8420bd-c4b3-42d8-87b5-c40fd691fe23 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.412214 Aug 29 15:30:15.210398 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 518/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:14 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:15.223279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.225309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.236872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.242674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.243431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.244386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.245024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.245663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.382534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:15.414996 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6b9612b-7885-47fb-9ec8-f55074a22518 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1269 microversion: 2.1 time: 0.412279 Aug 29 15:30:15.415935 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 493/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:15 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1269 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:15.484073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:15.509936 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-61ff75fe-447c-4a3b-92a5-de439b15fdcc tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1269 microversion: 2.1 time: 0.297690 Aug 29 15:30:15.511012 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 519/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:15 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1269 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:15.752497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.753681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.762533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.763621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.764307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.766759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.767555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.768253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.041871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:16.042514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:16.067101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.067920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.068594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.069588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.070253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.070717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.180980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:16.200899 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c56e213-4447-4ab2-b1de-a5e19c13d17c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 0.455144 Aug 29 15:30:16.210551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 494/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:15 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:16.248970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:16.249946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:16.256897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.257747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.258426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.259373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.260016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.260612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.842870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:16.862772 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9f5fc156-af5c-4713-af8c-35e446b6e84b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.617117 Aug 29 15:30:16.877312 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 495/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:16 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:16.907269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:16.911686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:16.940708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.942061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.946469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.954095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.957245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.962683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.427862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:17.446837 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0bdccabe-a889-41c9-a177-3d0aac243716 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1275 microversion: 2.1 time: 0.563856 Aug 29 15:30:17.450137 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 496/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:16 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1275 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:17.471709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:17.473003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:17.497226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.500762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.501760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.502972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.505619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.506379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.696257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:17.718181 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7940c2e-5d70-4f7a-a1ec-bd1312823088 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1475 microversion: 2.1 time: 1.680258 Aug 29 15:30:17.719874 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 520/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:16 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1475 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:17.738504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:17.740317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:17.753697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.755012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.756383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.758527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.760213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.760972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.138159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:18.179508 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b99f0376-972c-4f78-a72f-2689480e83a5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1287 microversion: 2.1 time: 0.726197 Aug 29 15:30:18.181330 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 497/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:17 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1287 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:18.189581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:18.191079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:18.202192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.203195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.203845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.205028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.205878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.206462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.774936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:18.796197 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ce32dec4-f1ae-46af-884f-49eb930013c3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.613059 Aug 29 15:30:18.799139 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 498/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:18 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:18.809410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9a866517-39ae-4ee5-bb1a-5c844e135ffc req-a6d1d5ac-ed63-4725-9184-a51992efe148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6aacc5a-4410-43ca-ad4b-ebc777ad45d3", "tag": "ea6034c9-8fa6-458b-877d-d4440be649ea"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:18.826975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9a866517-39ae-4ee5-bb1a-5c844e135ffc req-a6d1d5ac-ed63-4725-9184-a51992efe148 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.828588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9a866517-39ae-4ee5-bb1a-5c844e135ffc req-a6d1d5ac-ed63-4725-9184-a51992efe148 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.829515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9a866517-39ae-4ee5-bb1a-5c844e135ffc req-a6d1d5ac-ed63-4725-9184-a51992efe148 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.862088 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9a866517-39ae-4ee5-bb1a-5c844e135ffc req-a6d1d5ac-ed63-4725-9184-a51992efe148 service nova] Creating event network-changed:ea6034c9-8fa6-458b-877d-d4440be649ea for instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 on n-h1-854882-3 Aug 29 15:30:18.871549 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9a866517-39ae-4ee5-bb1a-5c844e135ffc req-a6d1d5ac-ed63-4725-9184-a51992efe148 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069560 Aug 29 15:30:18.873269 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 499/1019] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:18.881700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c991712a-27d9-48d6-a8f3-73478920c85b req-e632c60f-396e-4e5f-b522-a8526b612fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85573cdb-9434-4da4-a11b-89a5780a0493", "tag": "d044e837-eb27-4ad5-81b7-21637633fde4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:18.901094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c991712a-27d9-48d6-a8f3-73478920c85b req-e632c60f-396e-4e5f-b522-a8526b612fd6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.902627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c991712a-27d9-48d6-a8f3-73478920c85b req-e632c60f-396e-4e5f-b522-a8526b612fd6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.903587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c991712a-27d9-48d6-a8f3-73478920c85b req-e632c60f-396e-4e5f-b522-a8526b612fd6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.921813 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c991712a-27d9-48d6-a8f3-73478920c85b req-e632c60f-396e-4e5f-b522-a8526b612fd6 service nova] Creating event network-changed:d044e837-eb27-4ad5-81b7-21637633fde4 for instance 85573cdb-9434-4da4-a11b-89a5780a0493 on n-h1-854882-3 Aug 29 15:30:18.929104 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c991712a-27d9-48d6-a8f3-73478920c85b req-e632c60f-396e-4e5f-b522-a8526b612fd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053414 Aug 29 15:30:18.930847 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 500/1020] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:18.939207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:18.940766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:18.956253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.958535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.960337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.966910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.968056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.969112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.104827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:19.124361 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e7ec6bfa-e1bf-4bcc-8b9d-e020541d1059 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1275 microversion: 2.1 time: 0.187147 Aug 29 15:30:19.125641 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 501/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:18 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:19.146487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.151833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:19.202916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.203876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.210430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.220896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.221892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.231175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.394703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:19.414217 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9df2b9a8-450b-4923-a1e0-5808f9db6b40 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 1.692430 Aug 29 15:30:19.425414 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 521/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:17 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:19.425414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.425414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:19.432840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.436238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.437283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.438158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.438748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.442902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.643761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:19.653157 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e76085ad-5588-4eb8-b15c-0e2325864145 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1474 microversion: 2.1 time: 0.517474 Aug 29 15:30:19.672668 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 502/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:19 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1474 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:19.727902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:19.750200 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77ffd5a8-08ec-45d1-ae06-e6af756f9f3c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1275 microversion: 2.1 time: 0.332498 Aug 29 15:30:19.761859 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 522/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:19 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1275 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:19.823115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.826165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:19.842956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-80509bd9-557e-4069-9967-b8f20b3f5216 req-a9ecf706-a7b4-41a1-b118-e5bab9a836de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784f3eba-97c4-48b4-aa04-db77584cbee7", "name": "network-vif-plugged", "status": "completed", "tag": "e81c2643-3312-407a-9390-e39c02caff49"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:19.859261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.861663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.862749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.874483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.875775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.876116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.878532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80509bd9-557e-4069-9967-b8f20b3f5216 req-a9ecf706-a7b4-41a1-b118-e5bab9a836de service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.880974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80509bd9-557e-4069-9967-b8f20b3f5216 req-a9ecf706-a7b4-41a1-b118-e5bab9a836de service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.883888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80509bd9-557e-4069-9967-b8f20b3f5216 req-a9ecf706-a7b4-41a1-b118-e5bab9a836de service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.915437 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-80509bd9-557e-4069-9967-b8f20b3f5216 req-a9ecf706-a7b4-41a1-b118-e5bab9a836de service nova] Creating event network-vif-plugged:e81c2643-3312-407a-9390-e39c02caff49 for instance 784f3eba-97c4-48b4-aa04-db77584cbee7 on n-h2-854882-3 Aug 29 15:30:19.927422 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-80509bd9-557e-4069-9967-b8f20b3f5216 req-a9ecf706-a7b4-41a1-b118-e5bab9a836de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092075 Aug 29 15:30:19.928089 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 523/1025] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:20.182862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.186710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:20.209344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.213433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.217058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.218974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.220068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.220947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.281560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:20.302571 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-815c0f30-6613-45ab-b52d-ba22e4fc213f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.485191 Aug 29 15:30:20.307160 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 503/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:19 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:20.437877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.438612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:20.445314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.445924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.446434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.447233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.447767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.448255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.645837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:20.654599 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1cfb20be-70df-4eb6-a6f4-3b59b8bb518c tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 0.221941 Aug 29 15:30:20.655296 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 504/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:20 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:20.683687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.685156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:20.695181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.696489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.697191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.698198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.698846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.699509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.122731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:21.139556 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e7db8f4-71f9-4afc-bb7a-644baccea28a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1474 microversion: 2.1 time: 0.465134 Aug 29 15:30:21.141208 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 505/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:20 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1474 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:21.166169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:21.173517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:21.174540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:21.181342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.182330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.184684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.185771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.186416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.187078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.237027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:21.248286 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-69c71a75-8a61-457f-a6d9-4c1f828c4527 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 1.087721 Aug 29 15:30:21.261989 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 524/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:20 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:21.326060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:21.327867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:21.342732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.343723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.350832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.356549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.358541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.362860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.366473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:21.398901 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a5f2b649-2fd1-4d52-b07b-fda56d05e5a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1275 microversion: 2.1 time: 0.255730 Aug 29 15:30:21.400844 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 506/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:21 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:21.688915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:21.689639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:21.696640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.697575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.698196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.699752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.706944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.707933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.713921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:21.878727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:21.890803 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2e38414b-a95a-4a17-bfdb-afc3dcb01bbe tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1359 microversion: 2.1 time: 0.568746 Aug 29 15:30:21.893659 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 525/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:21 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1359 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:22.014052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:22.028928 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3dda164e-adcf-47c9-b4f9-7437a35a49ac tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 0.343694 Aug 29 15:30:22.029496 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 507/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:21 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:22.054396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4acffd14-6b68-48b4-b485-be147ae8d6b4 req-161ae1f8-b38f-4519-a677-8edd3cbfea47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef0b637-0366-4873-95e7-1ffb74a351e0", "name": "network-vif-unplugged", "status": "completed", "tag": "6913f0ac-c831-4118-b4c0-6a42ef5dc00b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:22.067058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4acffd14-6b68-48b4-b485-be147ae8d6b4 req-161ae1f8-b38f-4519-a677-8edd3cbfea47 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.067884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4acffd14-6b68-48b4-b485-be147ae8d6b4 req-161ae1f8-b38f-4519-a677-8edd3cbfea47 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.068876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4acffd14-6b68-48b4-b485-be147ae8d6b4 req-161ae1f8-b38f-4519-a677-8edd3cbfea47 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.092019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4acffd14-6b68-48b4-b485-be147ae8d6b4 req-161ae1f8-b38f-4519-a677-8edd3cbfea47 service nova] Creating event network-vif-unplugged:6913f0ac-c831-4118-b4c0-6a42ef5dc00b for instance aef0b637-0366-4873-95e7-1ffb74a351e0 on n-h2-854882-3 Aug 29 15:30:22.096367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:22.106306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-4acffd14-6b68-48b4-b485-be147ae8d6b4 req-161ae1f8-b38f-4519-a677-8edd3cbfea47 service nova] Instance aef0b637-0366-4873-95e7-1ffb74a351e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:30:22.114686 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4acffd14-6b68-48b4-b485-be147ae8d6b4 req-161ae1f8-b38f-4519-a677-8edd3cbfea47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065157 Aug 29 15:30:22.115720 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 526/1033] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:22.155385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2abdeb20-b741-47e5-befd-d33e3a66ed44 req-82ea204e-7d3b-44bf-b869-b30f4db866ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e066adea-ffd2-4ed8-b67a-44b5b0793f28", "tag": "e8d5c209-0604-4ee0-bd90-7b6e57c63092"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:22.169405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:22.170283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2abdeb20-b741-47e5-befd-d33e3a66ed44 req-82ea204e-7d3b-44bf-b869-b30f4db866ef service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.170896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:22.171149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2abdeb20-b741-47e5-befd-d33e3a66ed44 req-82ea204e-7d3b-44bf-b869-b30f4db866ef service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.171577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2abdeb20-b741-47e5-befd-d33e3a66ed44 req-82ea204e-7d3b-44bf-b869-b30f4db866ef service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.181632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:22.190712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2abdeb20-b741-47e5-befd-d33e3a66ed44 req-82ea204e-7d3b-44bf-b869-b30f4db866ef service nova] Creating event network-changed:e8d5c209-0604-4ee0-bd90-7b6e57c63092 for instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 on n-h1-854882-3 Aug 29 15:30:22.193700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.194211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.194655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.198729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2abdeb20-b741-47e5-befd-d33e3a66ed44 req-82ea204e-7d3b-44bf-b869-b30f4db866ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047111 Aug 29 15:30:22.201656 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 508/1034] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:22.203763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.204424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.204881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.271737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:22.272742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:22.279824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.280308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.280737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.281787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.282420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.283000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.358532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=24 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:22.455954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:22.477299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6fcc8d29-96eb-4a5b-a96e-6f3d3bbf8368 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1472 microversion: 2.1 time: 0.312501 Aug 29 15:30:22.477928 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 527/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:22 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:22.488304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:22.492714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:22.512449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.513690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.514762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.516405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.517338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.518175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.519939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:22.532480 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4634572e-02dd-4ebd-b889-b9f93e126d34 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.265718 Aug 29 15:30:22.540140 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 509/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:22 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:22.617637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:22.807108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:22.828466 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b9e2794-d772-4240-8f65-90fd567fbe11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.345766 Aug 29 15:30:22.845755 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 528/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:22 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:22.913940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:22.914572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:22.928338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.928848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.929292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.930134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.936977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.937509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:23.063665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:23.064430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:23.076745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:23.080235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:23.081962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:23.085192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:23.090825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:23.093223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:23.502619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:23.512712 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ed0ef0f2-de13-4e83-b89e-3444399b58e8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 0.454215 Aug 29 15:30:23.525418 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 529/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:23 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:23.530001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:23.531461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:23.548134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:23.557186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:23.557186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:23.576409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:23.578840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:23.587735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:23.777829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:24.102937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:24.119935 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9bcd56f6-4434-4fb1-8145-8b2fb1042057 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1542 microversion: 2.1 time: 1.208271 Aug 29 15:30:24.123644 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 510/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:22 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1542 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:24.131935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:24.154259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:24.155420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:24.159106 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d740c73-b186-4d02-b7e4-f7505a1ea529 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1472 microversion: 2.1 time: 0.635910 Aug 29 15:30:24.169869 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 530/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:23 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1472 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:24.176559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.178748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:24.179510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.182463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.185113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.186866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:24.187763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.188412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.208389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.218572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.219898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.221527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.222656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.223662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.756174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:24.786263 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d501f3eb-513f-4aa6-8bb3-95404ae7230c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.611607 Aug 29 15:30:24.790350 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 531/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:24 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:24.810573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:24.811572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:24.823020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.824342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.824993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.826037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.826720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.827350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.993073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:25.002500 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1456670a-f4cb-47b8-a1f4-9fed18c6e786 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.870380 Aug 29 15:30:25.004122 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 511/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:24 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:25.009624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3ea47cb0-6580-4d23-ae74-1a429a9726e8 req-c59c122c-5336-47d9-8756-adbf3fa6a98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6aacc5a-4410-43ca-ad4b-ebc777ad45d3", "name": "network-vif-plugged", "status": "completed", "tag": "ea6034c9-8fa6-458b-877d-d4440be649ea"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:25.026175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3ea47cb0-6580-4d23-ae74-1a429a9726e8 req-c59c122c-5336-47d9-8756-adbf3fa6a98b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.027682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3ea47cb0-6580-4d23-ae74-1a429a9726e8 req-c59c122c-5336-47d9-8756-adbf3fa6a98b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.028674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3ea47cb0-6580-4d23-ae74-1a429a9726e8 req-c59c122c-5336-47d9-8756-adbf3fa6a98b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.046896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3ea47cb0-6580-4d23-ae74-1a429a9726e8 req-c59c122c-5336-47d9-8756-adbf3fa6a98b service nova] Creating event network-vif-plugged:ea6034c9-8fa6-458b-877d-d4440be649ea for instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 on n-h1-854882-3 Aug 29 15:30:25.053456 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3ea47cb0-6580-4d23-ae74-1a429a9726e8 req-c59c122c-5336-47d9-8756-adbf3fa6a98b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047744 Aug 29 15:30:25.080400 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 512/1043] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:25.100137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:25.101237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:25.154167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.160056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.161034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.162299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.162793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.163233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.518345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:25.540313 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cb8cc522-e30f-4855-aff3-e113db6ddbd1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.733850 Aug 29 15:30:25.541048 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 532/1044] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:30:24 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-interface => generated 285 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:25.547459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:25.548321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:25.557789 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-509e6469-503f-4d65-8bc5-f2a180dfdf95 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 0.475748 Aug 29 15:30:25.561075 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 513/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:25 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:25.565102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.565841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.566476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.567481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.568096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.568963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.578263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:25.579309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:25.592248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.594374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.596265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.597235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.601991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.602949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.646265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:25.803118 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dbf4a70b-f51f-4509-bc1a-4998ae1d648a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 204 len: 0 microversion: 2.1 time: 0.260284 Aug 29 15:30:25.805315 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 533/1046] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:25 2022] DELETE /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:25.812912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:25.813660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:25.825639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.826199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.827209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.827991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.828481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.828944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.895608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:25.915303 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1929e919-dca3-4491-835e-104100853d9c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1469 microversion: 2.1 time: 0.352826 Aug 29 15:30:25.931604 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 514/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:25 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:25.931604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:25.931604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:25.934046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.934792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.944918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.944918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.944918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.944918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.213692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:26.229745 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08d41f9a-8968-41e0-b711-7d486c6cc3de tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.421857 Aug 29 15:30:26.239499 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 534/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:25 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:26.247182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:26.255898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:26.256451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.261715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1aee01fe-66e4-4ac2-b06a-747f58464db5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1711 microversion: 2.1 time: 0.343121 Aug 29 15:30:26.265078 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 515/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:25 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1711 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:26.268286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.268788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.274675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.275503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.275916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.276343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.296916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.300091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.317240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.317958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.320219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.321113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.323605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.324193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.402507 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d90d2c57-2926-48e6-b610-61ab0917e3a2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0/action" status: 204 len: 0 microversion: 2.1 time: 0.158178 Aug 29 15:30:26.410422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 535/1050] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:26 2022] POST /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0/action => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:26.424908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3dc96dfd-81f0-4ebd-82cb-e71a807a7dae req-5cbedc09-80ec-4c55-9945-97d7ee7c434b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "732c70a7-f3ed-4ea1-93f1-4c8dc6557798", "tag": "542008f2-a595-47a6-9079-28073e7e45d3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:26.438692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3dc96dfd-81f0-4ebd-82cb-e71a807a7dae req-5cbedc09-80ec-4c55-9945-97d7ee7c434b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.439536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3dc96dfd-81f0-4ebd-82cb-e71a807a7dae req-5cbedc09-80ec-4c55-9945-97d7ee7c434b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.440232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3dc96dfd-81f0-4ebd-82cb-e71a807a7dae req-5cbedc09-80ec-4c55-9945-97d7ee7c434b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.455979 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3dc96dfd-81f0-4ebd-82cb-e71a807a7dae req-5cbedc09-80ec-4c55-9945-97d7ee7c434b service nova] Creating event network-changed:542008f2-a595-47a6-9079-28073e7e45d3 for instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 on n-h2-854882-3 Aug 29 15:30:26.467514 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3dc96dfd-81f0-4ebd-82cb-e71a807a7dae req-5cbedc09-80ec-4c55-9945-97d7ee7c434b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055208 Aug 29 15:30:26.473598 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 536/1051] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:26.481890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.483115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.491491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.493201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.494188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.495954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.497803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.508585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.932945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:26.948618 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1263d04-3143-46be-bd1d-7bd62b43df88 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.681991 Aug 29 15:30:26.952758 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 516/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:26 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:26.957341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:26.971061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93ea1387-b2b9-41ff-a5f1-a2f45f76c144 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1469 microversion: 2.1 time: 0.495598 Aug 29 15:30:26.974305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.974936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.984897 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 537/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:26 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1469 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:26.988464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.988983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.989454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.990154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.990627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.991041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.189149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-dbd90508-b571-4192-a2c3-f98aa88182f0 req-658cc728-d67a-40e6-9ffa-83fca233803e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef0b637-0366-4873-95e7-1ffb74a351e0", "name": "network-vif-plugged", "status": "completed", "tag": "6913f0ac-c831-4118-b4c0-6a42ef5dc00b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:27.213759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dbd90508-b571-4192-a2c3-f98aa88182f0 req-658cc728-d67a-40e6-9ffa-83fca233803e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:27.214810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dbd90508-b571-4192-a2c3-f98aa88182f0 req-658cc728-d67a-40e6-9ffa-83fca233803e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:27.215477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dbd90508-b571-4192-a2c3-f98aa88182f0 req-658cc728-d67a-40e6-9ffa-83fca233803e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.253017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-dbd90508-b571-4192-a2c3-f98aa88182f0 req-658cc728-d67a-40e6-9ffa-83fca233803e service nova] Creating event network-vif-plugged:6913f0ac-c831-4118-b4c0-6a42ef5dc00b for instance aef0b637-0366-4873-95e7-1ffb74a351e0 on n-h2-854882-3 Aug 29 15:30:27.260479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-dbd90508-b571-4192-a2c3-f98aa88182f0 req-658cc728-d67a-40e6-9ffa-83fca233803e service nova] Instance aef0b637-0366-4873-95e7-1ffb74a351e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:30:27.282283 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-dbd90508-b571-4192-a2c3-f98aa88182f0 req-658cc728-d67a-40e6-9ffa-83fca233803e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096216 Aug 29 15:30:27.282940 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 538/1054] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:27.295561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:27.296390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:27.304886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:27.305705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:27.306405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.307351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:27.308179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:27.309126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.369346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:27.384355 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9b6cc3db-cd19-4ece-ab64-c1841f49303d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1323 microversion: 2.1 time: 0.415950 Aug 29 15:30:27.386172 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 517/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:26 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:27.398046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:27.399006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:27.412408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:27.413431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:27.413973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.414837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:27.415361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:27.416022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.607637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:27.626455 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fdeb5c6e-615d-4af3-afd5-d7c23aaa0513 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.342087 Aug 29 15:30:27.628375 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 539/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:27 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:27.974745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:27.982760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b50c32d-8b0a-4113-aa73-a8d8337f6e7b tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0eb7660d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2015282179", "description": "tempest-description-265066814"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:27.991006 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9c9629d6-0889-40d2-9ab5-5a8555b59019 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1711 microversion: 2.1 time: 0.602852 Aug 29 15:30:27.991867 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 518/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:27 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1711 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:28.010498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:28.014226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:28.027690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.029910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.033020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.034032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.036117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.037337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.220807 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b50c32d-8b0a-4113-aa73-a8d8337f6e7b tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.430008 Aug 29 15:30:28.221501 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 540/1058] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:30:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:28.226441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:28.227351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:28.235782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:28.241278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.242334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.244289 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c1a0a5b-3f05-442c-8b56-82b786086df0 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.251144 Aug 29 15:30:28.245170 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 519/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:27 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:28.246639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.247411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.247892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.248324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.252611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bacfa8d9-2977-4f03-ac3d-51e66b1ab07f req-fcf35bd1-7bb1-4949-830f-e4c0f7bf7f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784f3eba-97c4-48b4-aa04-db77584cbee7", "tag": "e81c2643-3312-407a-9390-e39c02caff49"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:28.265427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bacfa8d9-2977-4f03-ac3d-51e66b1ab07f req-fcf35bd1-7bb1-4949-830f-e4c0f7bf7f00 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.266101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bacfa8d9-2977-4f03-ac3d-51e66b1ab07f req-fcf35bd1-7bb1-4949-830f-e4c0f7bf7f00 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.266655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bacfa8d9-2977-4f03-ac3d-51e66b1ab07f req-fcf35bd1-7bb1-4949-830f-e4c0f7bf7f00 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.284214 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bacfa8d9-2977-4f03-ac3d-51e66b1ab07f req-fcf35bd1-7bb1-4949-830f-e4c0f7bf7f00 service nova] Creating event network-changed:e81c2643-3312-407a-9390-e39c02caff49 for instance 784f3eba-97c4-48b4-aa04-db77584cbee7 on n-h2-854882-3 Aug 29 15:30:28.289889 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bacfa8d9-2977-4f03-ac3d-51e66b1ab07f req-fcf35bd1-7bb1-4949-830f-e4c0f7bf7f00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042200 Aug 29 15:30:28.291109 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 520/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:28.304948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c09631ca-3ef0-4752-8eed-074a73447de7 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0e33af1f0>, body: {"security_group_rule": {"parent_group_id": "0ae63ab5-c36a-4877-af46-53bd6a1b8736", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:28.496911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:28.528199 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a0b31087-889d-4ac6-9599-90de0a3a5ef1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1469 microversion: 2.1 time: 0.302873 Aug 29 15:30:28.533803 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 541/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:28 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:28.564771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:28.572125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:28.595746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.596264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.598883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.604612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.605500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.607381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.788399 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c09631ca-3ef0-4752-8eed-074a73447de7 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.494854 Aug 29 15:30:28.789979 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 521/1062] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:28.795731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:28.796838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:28.815319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.816348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.818595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.819618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.822125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.822758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.993211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:29.009585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:29.014777 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fddf406b-3db2-4155-a141-f949b8a4c12b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1520 microversion: 2.1 time: 0.476879 Aug 29 15:30:29.029415 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 542/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:28 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:29.045840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0eda1e6-f867-4452-802e-2c8c22dbe435 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0e3585700>, body: {"security_group_rule": {"parent_group_id": "0ae63ab5-c36a-4877-af46-53bd6a1b8736", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:29.258310 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b0eda1e6-f867-4452-802e-2c8c22dbe435 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: This rule already exists in group 0ae63ab5-c36a-4877-af46-53bd6a1b8736 Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0eda1e6-f867-4452-802e-2c8c22dbe435 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 138 Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:29.261070 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: {"security_group_rule": {"parent_group_id": "0ae63ab5-c36a-4877-af46-53bd6a1b8736", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:30:29.263083 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: exception: This rule already exists in group 0ae63ab5-c36a-4877-af46-53bd6a1b8736 Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ae63ab5-c36a-4877-af46-53bd6a1b8736', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0ae63ab5-c36a-4877-af46-53bd6a1b8736 Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:29.263931 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0ae63ab5-c36a-4877-af46-53bd6a1b8736 Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0ae63ab5-c36a-4877-af46-53bd6a1b8736 Aug 29 15:30:29.266733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:29.269175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0eda1e6-f867-4452-802e-2c8c22dbe435 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 400 to user: This rule already exists in group 0ae63ab5-c36a-4877-af46-53bd6a1b8736 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:29.270262 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0eda1e6-f867-4452-802e-2c8c22dbe435 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.251350 Aug 29 15:30:29.271206 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 543/1064] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:29 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:30:29.283905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:29.291679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:29.316378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.320694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.324218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.327737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.330254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.333574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.485844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:29.523562 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30eff69f-72a8-44ce-b1b9-f71bfa03df18 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.732229 Aug 29 15:30:29.534466 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 522/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:28 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:29.541606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:29.543439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:29.563637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.565728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.568789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.569822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.575504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.576722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.003146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:30.040523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e29a2363-8fc0-4074-a029-3497a191aa1a tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1711 microversion: 2.1 time: 0.766585 Aug 29 15:30:30.044596 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 544/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:29 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1711 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:30.066141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d821e13b-a0d9-4724-bbee-5062533c7a11 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Calling method '.version_select at 0x7fb0e34f8040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:30.432472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:30.456753 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c0a076a4-658d-4680-bfb6-9b2d8cb9e722 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.918683 Aug 29 15:30:30.475690 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 523/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:29 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:30.491667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e00fc914-1e7c-46a1-b4d2-3f013fdd060f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1758099061", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e00fc914-1e7c-46a1-b4d2-3f013fdd060f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 243 Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:30:30.553281 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:30:30.555073 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1758099061", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1758099061', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '067d6abd-b6e5-45e7-afc9-2f54c5c563a0'}]}}} Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:30:30.555955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:30.557527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:30.559257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:30.562665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e00fc914-1e7c-46a1-b4d2-3f013fdd060f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:30.570356 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e00fc914-1e7c-46a1-b4d2-3f013fdd060f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.085666 Aug 29 15:30:30.571886 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 524/1068] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:30 2022] POST /compute/v2.1/servers => generated 175 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:30:30.586890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-290ef17c-d668-4115-be55-39d8ea96585a req-69c18c36-f336-441c-af3b-1822c33202a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85573cdb-9434-4da4-a11b-89a5780a0493", "name": "network-vif-plugged", "status": "completed", "tag": "d044e837-eb27-4ad5-81b7-21637633fde4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:30.623272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-290ef17c-d668-4115-be55-39d8ea96585a req-69c18c36-f336-441c-af3b-1822c33202a4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:30.624183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-290ef17c-d668-4115-be55-39d8ea96585a req-69c18c36-f336-441c-af3b-1822c33202a4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:30.624900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-290ef17c-d668-4115-be55-39d8ea96585a req-69c18c36-f336-441c-af3b-1822c33202a4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.672548 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-290ef17c-d668-4115-be55-39d8ea96585a req-69c18c36-f336-441c-af3b-1822c33202a4 service nova] Creating event network-vif-plugged:d044e837-eb27-4ad5-81b7-21637633fde4 for instance 85573cdb-9434-4da4-a11b-89a5780a0493 on n-h1-854882-3 Aug 29 15:30:30.686274 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-290ef17c-d668-4115-be55-39d8ea96585a req-69c18c36-f336-441c-af3b-1822c33202a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108023 Aug 29 15:30:30.687534 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 525/1069] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:30.695046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:30.696757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:30.715833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:30.718908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:30.721695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.727185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:30.728699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:30.732798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.955691 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d821e13b-a0d9-4724-bbee-5062533c7a11 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/ee687315-f175-4345-b414-a07b9cb19966" status: 202 len: 0 microversion: 2.1 time: 0.909331 Aug 29 15:30:30.956947 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 545/1070] 10.222.0.16 () {58 vars in 1287 bytes} [Mon Aug 29 15:30:30 2022] DELETE /compute/v2.1/os-security-group-rules/ee687315-f175-4345-b414-a07b9cb19966 => generated 0 bytes in 912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:30.963541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:30.964649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:31.000371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.005101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.011838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.015409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.019334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.021790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.359650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:31.374816 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bbdbad22-a03d-4a04-b594-713afc25d69e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.414757 Aug 29 15:30:31.390983 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 546/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:30 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:31.403421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-775c8104-0d09-49d8-ab02-7be9c6ffccb8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:31.403994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-775c8104-0d09-49d8-ab02-7be9c6ffccb8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: 3fd03b87-06f4-4199-83db-a9e5c26d98f6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:31.412069 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-775c8104-0d09-49d8-ab02-7be9c6ffccb8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] HTTP exception thrown: Instance 3fd03b87-06f4-4199-83db-a9e5c26d98f6 could not be found. Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-775c8104-0d09-49d8-ab02-7be9c6ffccb8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/3fd03b87-06f4-4199-83db-a9e5c26d98f6/metadata HTTP/1.1 Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:31.414547 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:31.415953 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 3fd03b87-06f4-4199-83db-a9e5c26d98f6 could not be found. Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': '3fd03b87-06f4-4199-83db-a9e5c26d98f6'} Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd03b87-06f4-4199-83db-a9e5c26d98f6 could not be found. Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:31.416669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd03b87-06f4-4199-83db-a9e5c26d98f6 could not be found. Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd03b87-06f4-4199-83db-a9e5c26d98f6 could not be found. Aug 29 15:30:31.418703 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.430180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-775c8104-0d09-49d8-ab02-7be9c6ffccb8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 404 to user: Instance 3fd03b87-06f4-4199-83db-a9e5c26d98f6 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:31.431555 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-775c8104-0d09-49d8-ab02-7be9c6ffccb8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/3fd03b87-06f4-4199-83db-a9e5c26d98f6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.037494 Aug 29 15:30:31.432308 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 547/1072] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:30:31 2022] GET /compute/v2.1/servers/3fd03b87-06f4-4199-83db-a9e5c26d98f6/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:31.458260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97759dbc-a287-4918-9a98-019826ffa2dd tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0eb723f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1414274927", "description": "tempest-description-1542699124"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:31.520745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:31.535634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b8e0171-86ae-48d3-beba-09c136c9e95a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1469 microversion: 2.1 time: 0.844023 Aug 29 15:30:31.550080 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 526/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:30 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1469 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:31.561446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:31.561932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:31.570211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.570955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.571553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.572538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.575217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.576894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.902370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:31.922703 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f41626f-bf30-4b1c-aa99-4b2cf24d1bc2 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1643 microversion: 2.1 time: 0.371111 Aug 29 15:30:31.927462 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 527/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:31 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1643 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:31.934890 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-97759dbc-a287-4918-9a98-019826ffa2dd tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.485615 Aug 29 15:30:31.935975 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 548/1075] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:30:31 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:31.949881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da1721dc-77f7-44e8-9fab-45ca4ae7988b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1675839723", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:31.961303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:31.963668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da1721dc-77f7-44e8-9fab-45ca4ae7988b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 499 Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:31.973169 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:31.974929 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:31.975656 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1675839723", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} Aug 29 15:30:31.975656 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:31.975656 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:31.975656 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1675839723', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '067d6abd-b6e5-45e7-afc9-2f54c5c563a0'}]}}} Aug 29 15:30:31.975656 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:31.975656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:31.976168 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:30:31.977418 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:30:31.978537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:30:31.979396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:31.979396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:31.983254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da1721dc-77f7-44e8-9fab-45ca4ae7988b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:31.987961 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da1721dc-77f7-44e8-9fab-45ca4ae7988b tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.048215 Aug 29 15:30:31.989594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 549/1076] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:31 2022] POST /compute/v2.1/servers => generated 687 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:30:32.006053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ad04fa0-d506-4ecc-867b-98b187b9db95 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0e34f8e50>, body: {"security_group_rule": {"parent_group_id": "b47b3f6d-7fbd-4671-8c8a-d37c767e335a", "ip_protocol": "tcp", "from_port": 1896604970, "to_port": 22}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:32.023422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.028584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.030284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.032581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.033191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.037377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.104402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:32.163485 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-3ad04fa0-d506-4ecc-867b-98b187b9db95 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: Invalid port range 1896604970:22. Former value cannot be greater than the later Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ad04fa0-d506-4ecc-867b-98b187b9db95 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 146 Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:32.166600 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: {"security_group_rule": {"parent_group_id": "b47b3f6d-7fbd-4671-8c8a-d37c767e335a", "ip_protocol": "tcp", "from_port": 1896604970, "to_port": 22}} Aug 29 15:30:32.168640 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid port range 1896604970:22. Former value cannot be greater than the later Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b47b3f6d-7fbd-4671-8c8a-d37c767e335a', 'ip_protocol': 'tcp', 'from_port': 1896604970, 'to_port': 22}}} Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1896604970:22. Former value cannot be greater than the later Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.169826 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1896604970:22. Former value cannot be greater than the later Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1896604970:22. Former value cannot be greater than the later Aug 29 15:30:32.171077 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.174799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ad04fa0-d506-4ecc-867b-98b187b9db95 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 400 to user: Invalid port range 1896604970:22. Former value cannot be greater than the later {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:32.175802 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ad04fa0-d506-4ecc-867b-98b187b9db95 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.184344 Aug 29 15:30:32.181019 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 550/1077] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:31 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:30:32.192467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-452e8eae-b1e9-4645-ba22-554a9997c13d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-366068712", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-452e8eae-b1e9-4645-ba22-554a9997c13d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 499 Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:32.203439 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:32.204981 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:32.205683 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-366068712", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} Aug 29 15:30:32.205683 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:32.205683 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.205683 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-366068712', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '067d6abd-b6e5-45e7-afc9-2f54c5c563a0'}]}}} Aug 29 15:30:32.205683 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:32.205683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.206142 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:30:32.207215 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:30:32.208134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:30:32.208699 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.208699 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.212434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-452e8eae-b1e9-4645-ba22-554a9997c13d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:32.213692 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-452e8eae-b1e9-4645-ba22-554a9997c13d tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.031193 Aug 29 15:30:32.214880 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 551/1078] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:32 2022] POST /compute/v2.1/servers => generated 689 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:30:32.246222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e4c45ac-2fc6-4d6a-b93d-b651972cd35d tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0e3d89790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1847011514", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:32.260435 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-8e4c45ac-2fc6-4d6a-b93d-b651972cd35d tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: Security group id should be uuid Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e4c45ac-2fc6-4d6a-b93d-b651972cd35d tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 131 Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:32.271050 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1847011514", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:32.272865 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group id should be uuid Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1847011514', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:32.273752 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 29 15:30:32.274997 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.280840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e4c45ac-2fc6-4d6a-b93d-b651972cd35d tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 400 to user: Security group id should be uuid {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:32.285506 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e4c45ac-2fc6-4d6a-b93d-b651972cd35d tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.067620 Aug 29 15:30:32.291485 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 552/1079] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:32 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:32.302735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c5fdbce-e0b5-4658-b06f-9f68d001382a tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0e3813550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1705930524", "description": "tempest-description-374741679"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:32.628750 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c5fdbce-e0b5-4658-b06f-9f68d001382a tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.331560 Aug 29 15:30:32.640562 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 553/1080] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:30:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:32.664937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:32.678503 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f75995a2-0198-4be5-a8ae-5716f8c9e5d1 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.749712 Aug 29 15:30:32.678708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f348d11-c32e-41b0-a286-e180597aadd8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-747775716", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:32.679685 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 528/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:31 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:32.685642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f348d11-c32e-41b0-a286-e180597aadd8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 753 Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:32.686033 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:32.687676 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:32.688437 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-747775716", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} Aug 29 15:30:32.688437 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:32.688437 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-747775716', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '067d6abd-b6e5-45e7-afc9-2f54c5c563a0'}]}}} Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:30:32.688698 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:32.689316 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:30:32.691445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:30:32.692194 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:30:32.692962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:32.692962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.694662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f348d11-c32e-41b0-a286-e180597aadd8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:32.697170 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f348d11-c32e-41b0-a286-e180597aadd8 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.050086 Aug 29 15:30:32.697927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:32.718531 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 554/1082] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:32 2022] POST /compute/v2.1/servers => generated 1197 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 29 15:30:32.720669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:32.725245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.731006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.737257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:32.738010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.738167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:32.739392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.740136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.740890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.772537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.778373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.779051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.782128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.782875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.789818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.178521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:33.189446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f956f3a-7309-4f83-8eb4-c6c71875350a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1461 microversion: 2.1 time: 0.466499 Aug 29 15:30:33.198431 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 555/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:32 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1461 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:33.215559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68cf6600-4330-4d58-8a89-7d014e81b557 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0eb704700>, body: {"security_group_rule": {"parent_group_id": "ca5b2bdf-1bff-4b93-96ac-26e572868eb1", "ip_protocol": "tempest-999-247842215", "from_port": 22, "to_port": 22}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:33.350983 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-68cf6600-4330-4d58-8a89-7d014e81b557 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: Invalid IP protocol tempest-999-247842215. Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68cf6600-4330-4d58-8a89-7d014e81b557 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 156 Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:33.353076 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: {"security_group_rule": {"parent_group_id": "ca5b2bdf-1bff-4b93-96ac-26e572868eb1", "ip_protocol": "tempest-999-247842215", "from_port": 22, "to_port": 22}} Aug 29 15:30:33.354985 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid IP protocol tempest-999-247842215. Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ca5b2bdf-1bff-4b93-96ac-26e572868eb1', 'ip_protocol': 'tempest-999-247842215', 'from_port': 22, 'to_port': 22}}} Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-247842215. Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:33.355746 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-247842215. Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-247842215. Aug 29 15:30:33.356916 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.359399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68cf6600-4330-4d58-8a89-7d014e81b557 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 400 to user: Invalid IP protocol tempest-999-247842215. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:33.360571 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-68cf6600-4330-4d58-8a89-7d014e81b557 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.159000 Aug 29 15:30:33.361614 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 556/1084] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:33 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:33.370001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-629c28a3-271e-49fc-8bf6-163a7ed69e78 req-4372e843-e537-4f4c-8a4c-4baba9e6cc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b94bea-6849-4238-8a96-278971ebf178", "name": "network-vif-deleted", "tag": "918f6dda-e2c9-4486-88f5-24c81c1da093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:33.407388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-629c28a3-271e-49fc-8bf6-163a7ed69e78 req-4372e843-e537-4f4c-8a4c-4baba9e6cc9b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.407886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-629c28a3-271e-49fc-8bf6-163a7ed69e78 req-4372e843-e537-4f4c-8a4c-4baba9e6cc9b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.408329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-629c28a3-271e-49fc-8bf6-163a7ed69e78 req-4372e843-e537-4f4c-8a4c-4baba9e6cc9b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.432739 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-629c28a3-271e-49fc-8bf6-163a7ed69e78 req-4372e843-e537-4f4c-8a4c-4baba9e6cc9b service nova] Creating event network-vif-deleted:918f6dda-e2c9-4486-88f5-24c81c1da093 for instance f9b94bea-6849-4238-8a96-278971ebf178 on n-h1-854882-3 Aug 29 15:30:33.446383 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-629c28a3-271e-49fc-8bf6-163a7ed69e78 req-4372e843-e537-4f4c-8a4c-4baba9e6cc9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083288 Aug 29 15:30:33.450645 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 557/1085] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:33.465530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09f1ce1d-e845-49bd-ab98-e97ae0f79ffd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-232736401", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09f1ce1d-e845-49bd-ab98-e97ae0f79ffd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 1265 Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:33.476118 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:33.477963 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:33.478719 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-232736401", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "067d6abd-b6e5-45e7-afc9-2f54c5c563a0"}]}} Aug 29 15:30:33.478719 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-232736401', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '067d6abd-b6e5-45e7-afc9-2f54c5c563a0'}]}}} Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.478920 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:30:33.480394 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:30:33.482533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:30:33.482533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:33.498477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09f1ce1d-e845-49bd-ab98-e97ae0f79ffd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:33.499666 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-09f1ce1d-e845-49bd-ab98-e97ae0f79ffd tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.047853 Aug 29 15:30:33.505644 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 558/1086] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Aug 29 15:30:33 2022] POST /compute/v2.1/servers => generated 2221 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 29 15:30:33.510941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:33.518690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:33.533180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.534583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.536187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.537178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.537900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.538566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.601999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:33.619503 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e29a225-4e4c-4647-91da-f6e7e003903b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.936837 Aug 29 15:30:33.626351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.628477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.629490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.631924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lazy-loading 'fault' on Instance uuid f9b94bea-6849-4238-8a96-278971ebf178 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:33.635317 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 529/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:32 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:33.641279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:33.642231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:33.650540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.651747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.652410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.653432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.654139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.654815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.779193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199c2a20a7e8425e8df281cfe251c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9ae755ad68447087da4df60c36c746', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:33.792127 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99bd1051-4a65-43c2-8a0d-543063a2ac4f tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 200 len: 1351 microversion: 2.1 time: 0.284910 Aug 29 15:30:33.798161 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 559/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:33 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 1351 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:33.804972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60d59a5f-f79b-445f-994a-0dc5c4acb5ec tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0eb6f88b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1391328376", "description": "tempest-description-624330783"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:34.115970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:34.138436 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-494c735b-a20c-4da9-ba69-1fb57176e9b0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1461 microversion: 2.1 time: 0.501668 Aug 29 15:30:34.140254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 530/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:33 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1461 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:34.163846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa685872-2c3c-4d70-ae05-94ce851044b1 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:34.164708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa685872-2c3c-4d70-ae05-94ce851044b1 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: 65edb1d5-66e7-451d-b8de-f0570c23a64e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:34.181039 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-aa685872-2c3c-4d70-ae05-94ce851044b1 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] HTTP exception thrown: Instance 65edb1d5-66e7-451d-b8de-f0570c23a64e could not be found. Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa685872-2c3c-4d70-ae05-94ce851044b1 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/65edb1d5-66e7-451d-b8de-f0570c23a64e/metadata/test2 HTTP/1.1 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 65edb1d5-66e7-451d-b8de-f0570c23a64e could not be found. Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': '65edb1d5-66e7-451d-b8de-f0570c23a64e', 'id': 'test2'} Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65edb1d5-66e7-451d-b8de-f0570c23a64e could not be found. Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65edb1d5-66e7-451d-b8de-f0570c23a64e could not be found. Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:34.187869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:34.193140 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:34.193140 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:34.193140 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65edb1d5-66e7-451d-b8de-f0570c23a64e could not be found. Aug 29 15:30:34.193140 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:34.194808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa685872-2c3c-4d70-ae05-94ce851044b1 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 404 to user: Instance 65edb1d5-66e7-451d-b8de-f0570c23a64e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:34.197000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa685872-2c3c-4d70-ae05-94ce851044b1 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/65edb1d5-66e7-451d-b8de-f0570c23a64e/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.051270 Aug 29 15:30:34.200389 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 531/1090] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Aug 29 15:30:34 2022] GET /compute/v2.1/servers/65edb1d5-66e7-451d-b8de-f0570c23a64e/metadata/test2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:34.254764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-10685cd3-493d-43ee-904b-35a7576bdf64 req-ebe553b4-5d3f-4a52-adbd-54e3f6fce81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732c70a7-f3ed-4ea1-93f1-4c8dc6557798", "name": "network-vif-plugged", "status": "completed", "tag": "542008f2-a595-47a6-9079-28073e7e45d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:34.291796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10685cd3-493d-43ee-904b-35a7576bdf64 req-ebe553b4-5d3f-4a52-adbd-54e3f6fce81a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.296168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10685cd3-493d-43ee-904b-35a7576bdf64 req-ebe553b4-5d3f-4a52-adbd-54e3f6fce81a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.298779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10685cd3-493d-43ee-904b-35a7576bdf64 req-ebe553b4-5d3f-4a52-adbd-54e3f6fce81a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.328535 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-10685cd3-493d-43ee-904b-35a7576bdf64 req-ebe553b4-5d3f-4a52-adbd-54e3f6fce81a service nova] Creating event network-vif-plugged:542008f2-a595-47a6-9079-28073e7e45d3 for instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 on n-h2-854882-3 Aug 29 15:30:34.359690 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-10685cd3-493d-43ee-904b-35a7576bdf64 req-ebe553b4-5d3f-4a52-adbd-54e3f6fce81a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145500 Aug 29 15:30:34.360368 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 532/1091] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:34.381381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:34.383137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:34.391643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.392620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.399779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.400898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.401604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.402747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.659207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60d59a5f-f79b-445f-994a-0dc5c4acb5ec tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.859640 Aug 29 15:30:34.660689 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 560/1092] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:30:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:34.676708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6d854f6-fe3b-42f3-9f08-bfefde8f7af2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'create', calling method: .version_select at 0x7fb0eb6f4f70>, body: {"keypair": {"name": "tempest-keypair-1274392037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeH3bFtyy2bE78wkep1YZWiWPAcAF5ChYSAkZk8y/692ZTR+bTOQaIZYATt3uhPz2/uGOzOpfkrkg3ymcr0rmtQhcMMqmyK0mBkCpr8yf97XWoQlSa9RxpWpFUqwzlTKA=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:34.716697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-f6d854f6-fe3b-42f3-9f08-bfefde8f7af2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:34.732382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-f6d854f6-fe3b-42f3-9f08-bfefde8f7af2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for user 1869270af6874c4db42112d4aa9417a6 and project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:34.805632 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6d854f6-fe3b-42f3-9f08-bfefde8f7af2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134562 Aug 29 15:30:34.805632 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 561/1093] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:30:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:34.807126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:34.807635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:34.831032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.834058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.834058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.834058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.834058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.842323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.888994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:35.014780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:35.039910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ca9398c7-0ff5-4aec-b7e0-b1938fcc9b6c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.668237 Aug 29 15:30:35.040505 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 533/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:34 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:35.056709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:35.057291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:35.095566 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96fc434d-ed3f-4a73-afdc-e319efbf1d29 tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 204 len: 0 microversion: 2.1 time: 0.291800 Aug 29 15:30:35.096386 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 562/1095] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:34 2022] DELETE /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:35.101145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.107867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.108432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.109201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.109713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.110152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.115922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae05809b-4b85-4498-83b6-1aecf4157c79 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0eb704550>, body: {"security_group_rule": {"parent_group_id": "a5baf0a3-d8f2-42a4-88aa-c5601a52b296", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:35.235153 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ae05809b-4b85-4498-83b6-1aecf4157c79 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae05809b-4b85-4498-83b6-1aecf4157c79 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 138 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: {"security_group_rule": {"parent_group_id": "a5baf0a3-d8f2-42a4-88aa-c5601a52b296", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a5baf0a3-d8f2-42a4-88aa-c5601a52b296', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:30:35.237098 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:30:35.242807 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.244668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae05809b-4b85-4498-83b6-1aecf4157c79 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:35.246133 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae05809b-4b85-4498-83b6-1aecf4157c79 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.145281 Aug 29 15:30:35.246914 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 563/1096] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:35 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:30:35.254336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:35.255696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:35.270524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.273201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.273962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.274731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.275199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.275632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.293433 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] HTTP exception thrown: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Request method failure captured: Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 HTTP/1.1 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrFbHj9-c5weIl2fyHQwNEG7phxM4Q7ovWm5YpVM9CjHBCHFHUhAyJ_aVig-_SZmBtSFbQhUhk7NAKlx5Bh5CrIR7JpWOteP0HP_0zp186ZmejeCEfKAYKhCouc0Sghi33Vk1ZaZVIPoNeXvxXMfU2EMqsk3_Yasuq8BMwvcPfTvVk Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e9ae755ad68447087da4df60c36c746", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}] Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 199c2a20a7e8425e8df281cfe251c880 Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'f9b94bea-6849-4238-8a96-278971ebf178'} Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.295652 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Returning 404 to user: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ade04863-bf42-435e-abf9-5ce2ee747b67 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 404 len: 111 microversion: 2.1 time: 0.048895 Aug 29 15:30:35.300004 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 564/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:35 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:35.307537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:35.309125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:35.319037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.319037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.319037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.320432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.320432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.320743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.463948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:35.487362 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3869f20e-9269-4c12-acfc-d1f01d40a73a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 0.441470 Aug 29 15:30:35.488441 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 534/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:35 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:35.511986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70ff2a8d-71d8-41c5-b454-98d31e37371b tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0e32c2dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1335300608", "description": "tempest-description-1503144576"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:35.566856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:35.599083 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-931f1f19-cd43-4a1e-8fec-9fa8ab9386bb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1526 microversion: 2.1 time: 0.299803 Aug 29 15:30:35.601605 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 565/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:35 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1526 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:35.609719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:35.610895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:35.626586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.627589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.628633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.630094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.631522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.633375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.667659 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] HTTP exception thrown: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Request method failure captured: Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 HTTP/1.1 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrFbHj9-c5weIl2fyHQwNEG7phxM4Q7ovWm5YpVM9CjHBCHFHUhAyJ_aVig-_SZmBtSFbQhUhk7NAKlx5Bh5CrIR7JpWOteP0HP_0zp186ZmejeCEfKAYKhCouc0Sghi33Vk1ZaZVIPoNeXvxXMfU2EMqsk3_Yasuq8BMwvcPfTvVk Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e9ae755ad68447087da4df60c36c746", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}] Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 199c2a20a7e8425e8df281cfe251c880 Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'dfefb0af-3933-4c2b-9c7a-38e4e6ae9445'} Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:35.671446 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Returning 404 to user: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96a47a42-9dad-4f36-bc09-21494af56188 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 404 len: 111 microversion: 2.1 time: 0.072526 Aug 29 15:30:35.683192 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 566/1100] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:35 2022] DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:35.694116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:35.695218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:35.714951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.716497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.718007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.719641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.720154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.720607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.742766 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] HTTP exception thrown: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Request method failure captured: Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 HTTP/1.1 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrFbHj9-c5weIl2fyHQwNEG7phxM4Q7ovWm5YpVM9CjHBCHFHUhAyJ_aVig-_SZmBtSFbQhUhk7NAKlx5Bh5CrIR7JpWOteP0HP_0zp186ZmejeCEfKAYKhCouc0Sghi33Vk1ZaZVIPoNeXvxXMfU2EMqsk3_Yasuq8BMwvcPfTvVk Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e9ae755ad68447087da4df60c36c746", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}] Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 199c2a20a7e8425e8df281cfe251c880 Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'dfefb0af-3933-4c2b-9c7a-38e4e6ae9445'} Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.744481 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:35.748700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Returning 404 to user: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:35.752408 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ec6445b-de96-4edd-82c7-15248f5d2c85 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 404 len: 111 microversion: 2.1 time: 0.065155 Aug 29 15:30:35.753591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 567/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:35 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:35.766668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94812ab9-2ab8-44e0-807d-e0e6937cd611 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '.version_select at 0x7fb0e356caf0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:35.797156 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94812ab9-2ab8-44e0-807d-e0e6937cd611 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85438069" status: 202 len: 0 microversion: 2.1 time: 0.038224 Aug 29 15:30:35.802280 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 568/1102] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Aug 29 15:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85438069 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:30:35.946668 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-70ff2a8d-71d8-41c5-b454-98d31e37371b tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.444595 Aug 29 15:30:35.955633 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 535/1103] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:30:35 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:35.980844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96840c9f-4ef0-4c20-9725-cb98d8d33fbe tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0eb6f8790>, body: {"security_group_rule": {"parent_group_id": "681b4a9c-6eee-44e5-969b-22f7b9e5edb8", "ip_protocol": "tcp", "from_port": 22, "to_port": 248974136}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:36.065581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:36.066775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:36.082542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.083423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.084827 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-96840c9f-4ef0-4c20-9725-cb98d8d33fbe tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: Invalid port range 22:248974136. Valid TCP ports should be between 1-65535 Aug 29 15:30:36.085720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96840c9f-4ef0-4c20-9725-cb98d8d33fbe tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 145 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: {"security_group_rule": {"parent_group_id": "681b4a9c-6eee-44e5-969b-22f7b9e5edb8", "ip_protocol": "tcp", "from_port": 22, "to_port": 248974136}} Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid port range 22:248974136. Valid TCP ports should be between 1-65535 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'security_group_rule': {'parent_group_id': '681b4a9c-6eee-44e5-969b-22f7b9e5edb8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 248974136}}} Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:248974136. Valid TCP ports should be between 1-65535 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:248974136. Valid TCP ports should be between 1-65535 Aug 29 15:30:36.086552 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:248974136. Valid TCP ports should be between 1-65535 Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.091225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96840c9f-4ef0-4c20-9725-cb98d8d33fbe tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 400 to user: Invalid port range 22:248974136. Valid TCP ports should be between 1-65535 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:36.091878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.091963 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96840c9f-4ef0-4c20-9725-cb98d8d33fbe tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.115265 Aug 29 15:30:36.092042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.092042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.097993 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 569/1104] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:35 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:30:36.120648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1297f46-c8b5-412f-9043-a6c85adcd56f tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Action: 'create', calling method: .version_select at 0x7fb0eb723940>, body: {"security_group_rule": {"parent_group_id": "2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:36.208911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-c1297f46-c8b5-412f-9043-a6c85adcd56f tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:36.209742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-c1297f46-c8b5-412f-9043-a6c85adcd56f tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Neutron security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:30:36.210364 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c1297f46-c8b5-412f-9043-a6c85adcd56f tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist Aug 29 15:30:36.210364 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-9f56cd1d-af54-480e-b38c-512e5f0ed60f'] Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1297f46-c8b5-412f-9043-a6c85adcd56f tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 138 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: {"security_group_rule": {"parent_group_id": "2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-9f56cd1d-af54-480e-b38c-512e5f0ed60f'] Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:36.212472 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f56cd1d-af54-480e-b38c-512e5f0ed60f'] Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f56cd1d-af54-480e-b38c-512e5f0ed60f'] Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f56cd1d-af54-480e-b38c-512e5f0ed60f'] Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f56cd1d-af54-480e-b38c-512e5f0ed60f'] Aug 29 15:30:36.217680 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.225886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1297f46-c8b5-412f-9043-a6c85adcd56f tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 404 to user: Security group 2e0ab6e5-8d4a-4c81-bdd3-f9a8e4dcedf5 does not exist Aug 29 15:30:36.225886 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-9f56cd1d-af54-480e-b38c-512e5f0ed60f'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:36.227272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1297f46-c8b5-412f-9043-a6c85adcd56f tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.127586 Aug 29 15:30:36.234883 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 570/1105] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:30:36 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:36.241076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f14bdf19-1e73-4246-b6d9-876cfc2f5a56 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Calling method '.version_select at 0x7fb0e356c820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:36.283771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-f14bdf19-1e73-4246-b6d9-876cfc2f5a56 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:36.284908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-f14bdf19-1e73-4246-b6d9-876cfc2f5a56 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Neutron security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe not found {{(pid=130002) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 29 15:30:36.285746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f14bdf19-1e73-4246-b6d9-876cfc2f5a56 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] HTTP exception thrown: Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist Aug 29 15:30:36.285746 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-955a1d96-96e5-4c60-8c2d-0b66897a1748'] Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f14bdf19-1e73-4246-b6d9-876cfc2f5a56 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Request method failure captured: Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-security-group-rules/53c0219f-89bf-45ad-8446-4c806fc58cbe HTTP/1.1 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNuTnpcag8j734Ebc1rfJQ0Z-sgOwNfvl-eCcrV7uE60DWEyZXxCDfrV8c48JdjmVzWtUb-JJhtRirWKObFeVR5P3tBSlfetFAUjnDPk8N0llAIvcmQhd6fUhYTmtpegMKhutnjskPN398td3M7_aeAftTrBr9L_hagMUPO8iRGoGqo Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d21c1f5bb7149a98a466b4d46aa8c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d21c1f5bb7149a98a466b4d46aa8c7e"}]}] Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3d21c1f5bb7149a98a466b4d46aa8c7e Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a4466b28afba4fe395c17aac6d6b6bb5 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-955a1d96-96e5-4c60-8c2d-0b66897a1748'] Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '53c0219f-89bf-45ad-8446-4c806fc58cbe'} Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:36.288778 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-955a1d96-96e5-4c60-8c2d-0b66897a1748'] Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-955a1d96-96e5-4c60-8c2d-0b66897a1748'] Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-955a1d96-96e5-4c60-8c2d-0b66897a1748'] Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-955a1d96-96e5-4c60-8c2d-0b66897a1748'] Aug 29 15:30:36.292895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:36.297883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f14bdf19-1e73-4246-b6d9-876cfc2f5a56 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Returning 404 to user: Security group rule 53c0219f-89bf-45ad-8446-4c806fc58cbe does not exist Aug 29 15:30:36.297883 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-955a1d96-96e5-4c60-8c2d-0b66897a1748'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:36.299044 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f14bdf19-1e73-4246-b6d9-876cfc2f5a56 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/53c0219f-89bf-45ad-8446-4c806fc58cbe" status: 404 len: 199 microversion: 2.1 time: 0.062809 Aug 29 15:30:36.303587 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 571/1106] 10.222.0.16 () {58 vars in 1287 bytes} [Mon Aug 29 15:30:36 2022] DELETE /compute/v2.1/os-security-group-rules/53c0219f-89bf-45ad-8446-4c806fc58cbe => generated 199 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:36.316056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1e804e84-d409-4eff-9b31-f53186104105 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Calling method '.version_select at 0x7fb0eb6f85e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:36.418495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:36.432106 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3bb5784-8fe6-4b3b-90c6-be501ec45119 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.374758 Aug 29 15:30:36.433594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 536/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:36 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:36.440699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-69eb9fc8-3d4f-416b-af62-ab5f87875ab9 req-b5d1d8d7-29f9-4ff5-8646-ca6f41cf7a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e066adea-ffd2-4ed8-b67a-44b5b0793f28", "name": "network-vif-plugged", "status": "completed", "tag": "e8d5c209-0604-4ee0-bd90-7b6e57c63092"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:36.457710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-69eb9fc8-3d4f-416b-af62-ab5f87875ab9 req-b5d1d8d7-29f9-4ff5-8646-ca6f41cf7a2b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.460147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-69eb9fc8-3d4f-416b-af62-ab5f87875ab9 req-b5d1d8d7-29f9-4ff5-8646-ca6f41cf7a2b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.461576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-69eb9fc8-3d4f-416b-af62-ab5f87875ab9 req-b5d1d8d7-29f9-4ff5-8646-ca6f41cf7a2b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.496343 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-69eb9fc8-3d4f-416b-af62-ab5f87875ab9 req-b5d1d8d7-29f9-4ff5-8646-ca6f41cf7a2b service nova] Creating event network-vif-plugged:e8d5c209-0604-4ee0-bd90-7b6e57c63092 for instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 on n-h1-854882-3 Aug 29 15:30:36.518760 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-69eb9fc8-3d4f-416b-af62-ab5f87875ab9 req-b5d1d8d7-29f9-4ff5-8646-ca6f41cf7a2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082971 Aug 29 15:30:36.520966 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 537/1108] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:36.532715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:36.537482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:36.556223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.557466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.559032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.568927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.571889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.573279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.915734 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1e804e84-d409-4eff-9b31-f53186104105 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/681b4a9c-6eee-44e5-969b-22f7b9e5edb8" status: 202 len: 0 microversion: 2.1 time: 0.609085 Aug 29 15:30:36.919300 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 572/1109] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:36 2022] DELETE /compute/v2.1/os-security-groups/681b4a9c-6eee-44e5-969b-22f7b9e5edb8 => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:36.924316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:36.929361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:36.943633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.944398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.944990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.951359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.951971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.952454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:37.275357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:37.298092 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8076e96e-3384-44d0-b01f-a344d7c2281a tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1526 microversion: 2.1 time: 0.377594 Aug 29 15:30:37.298964 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 573/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:36 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1526 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:37.314491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:37.315463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:37.324272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:37.325488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:37.326176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:37.327252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:37.327908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:37.328502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:37.630687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 704fa114-40c8-4d26-bd16-838f3a8dcb5f {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:37.649985 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-162c3e1b-1daf-4bee-bb7f-b8483a957fee tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 2342 microversion: 2.25 time: 0.348673 Aug 29 15:30:37.650771 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 574/1111] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:30:37 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 2342 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:30:37.657683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa4ba8a0-a327-4201-9ca0-39d78d0a88d6 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Calling method '.version_select at 0x7fb0eb6f4ee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:37.708011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:37.731569 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7cadeabb-566e-4602-95a6-451d45b867b7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1317 microversion: 2.1 time: 1.207759 Aug 29 15:30:37.733018 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 538/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:36 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1317 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:37.754995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:37.757326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:37.769810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:37.771277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:37.772158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:37.773573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:37.775928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:37.777496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:37.972202 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa4ba8a0-a327-4201-9ca0-39d78d0a88d6 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a5baf0a3-d8f2-42a4-88aa-c5601a52b296" status: 202 len: 0 microversion: 2.1 time: 0.320224 Aug 29 15:30:37.976534 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 575/1113] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:37 2022] DELETE /compute/v2.1/os-security-groups/a5baf0a3-d8f2-42a4-88aa-c5601a52b296 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:37.987209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-72fda83c-c17f-4bfe-ba5c-684890812ab6 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.040339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-72fda83c-c17f-4bfe-ba5c-684890812ab6 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/898622378" status: 202 len: 0 microversion: 2.1 time: 0.061979 Aug 29 15:30:38.041437 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 576/1114] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:30:37 2022] DELETE /compute/v2.1/flavors/898622378 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:38.047116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.052472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.053678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.053678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.055067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.055579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.056443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.085409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b87b01e-5c79-401a-a456-3a9ce7dccee6 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042789 Aug 29 15:30:38.086134 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 577/1115] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:30:38.091835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56876fe7-fc91-4bd3-bf48-0f7f344ebef2 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Calling method '.version_select at 0x7fb0eb6f44c0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.137139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:38.164210 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79603d9e-6fe8-4939-95e6-62fa64982b9e tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1317 microversion: 2.1 time: 0.424174 Aug 29 15:30:38.165727 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 539/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:37 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:38.191416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-41ccc422-dc29-4384-afd1-55df286b2d48 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.255302 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-41ccc422-dc29-4384-afd1-55df286b2d48 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5401 microversion: 2.1 time: 0.081269 Aug 29 15:30:38.257242 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 540/1117] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/flavors/detail => generated 5401 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:38.289313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9668cc31-9276-4f41-8d13-f53811d87355 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.344142 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9668cc31-9276-4f41-8d13-f53811d87355 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/662348314" status: 202 len: 0 microversion: 2.1 time: 0.066796 Aug 29 15:30:38.344992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 541/1118] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:30:38 2022] DELETE /compute/v2.1/flavors/662348314 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:30:38.363018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.363917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:38.406848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.425147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.428407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.429671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.431336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.432711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.478340 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56876fe7-fc91-4bd3-bf48-0f7f344ebef2 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ca5b2bdf-1bff-4b93-96ac-26e572868eb1" status: 202 len: 0 microversion: 2.1 time: 0.390173 Aug 29 15:30:38.482286 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 578/1119] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:38 2022] DELETE /compute/v2.1/os-security-groups/ca5b2bdf-1bff-4b93-96ac-26e572868eb1 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:38.491373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae900592-05cf-45c0-bb23-a6b17bd9b077 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.558622 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae900592-05cf-45c0-bb23-a6b17bd9b077 tempest-ServersWithSpecificFlavorTestJSON-1508070730 tempest-ServersWithSpecificFlavorTestJSON-1508070730-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072237 Aug 29 15:30:38.559691 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 579/1120] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:38.565178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93467269-7e4e-4ae4-b988-76013c462979 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Calling method '.version_select at 0x7fb0eb6f81f0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.708806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c886c6bd7a0544b499c77b714c6065f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f9ff69e07f4f32bb1a6aa14a937d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:38.735699 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-35c9b9d7-e528-4a38-ac40-2645fe1d86cb tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 200 len: 1484 microversion: 2.1 time: 0.385622 Aug 29 15:30:38.737023 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 542/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 1484 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:38.744894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.746137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:38.759708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.760611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.761595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.762607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.763244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.764654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.790168 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] HTTP exception thrown: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Request method failure captured: Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 HTTP/1.1 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrFbHj9-c5weIl2fyHQwNEG7phxM4Q7ovWm5YpVM9CjHBCHFHUhAyJ_aVig-_SZmBtSFbQhUhk7NAKlx5Bh5CrIR7JpWOteP0HP_0zp186ZmejeCEfKAYKhCouc0Sghi33Vk1ZaZVIPoNeXvxXMfU2EMqsk3_Yasuq8BMwvcPfTvVk Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e9ae755ad68447087da4df60c36c746", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}] Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 199c2a20a7e8425e8df281cfe251c880 Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'f9b94bea-6849-4238-8a96-278971ebf178'} Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:38.793430 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:38.798096 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:38.800039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Returning 404 to user: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:38.801245 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d506ce15-3865-4306-8275-25e949a1fd69 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 404 len: 111 microversion: 2.1 time: 0.062991 Aug 29 15:30:38.802432 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 543/1122] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:38 2022] DELETE /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:38.809125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-322ac48c-fa40-4ea4-b441-2d5e9141d7d5 req-0cda0491-12e6-48b0-9e08-7c72435f4514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6aacc5a-4410-43ca-ad4b-ebc777ad45d3", "name": "network-vif-deleted", "tag": "ea6034c9-8fa6-458b-877d-d4440be649ea"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:38.825373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-322ac48c-fa40-4ea4-b441-2d5e9141d7d5 req-0cda0491-12e6-48b0-9e08-7c72435f4514 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.826367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-322ac48c-fa40-4ea4-b441-2d5e9141d7d5 req-0cda0491-12e6-48b0-9e08-7c72435f4514 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.827205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-322ac48c-fa40-4ea4-b441-2d5e9141d7d5 req-0cda0491-12e6-48b0-9e08-7c72435f4514 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.846360 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-322ac48c-fa40-4ea4-b441-2d5e9141d7d5 req-0cda0491-12e6-48b0-9e08-7c72435f4514 service nova] Creating event network-vif-deleted:ea6034c9-8fa6-458b-877d-d4440be649ea for instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 on n-h1-854882-3 Aug 29 15:30:38.851698 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-322ac48c-fa40-4ea4-b441-2d5e9141d7d5 req-0cda0491-12e6-48b0-9e08-7c72435f4514 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047736 Aug 29 15:30:38.853635 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 544/1123] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:38.860841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-235e8ad6-0178-4f6e-b0a4-11d9707bc80c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '.version_select at 0x7fb0e3370280>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.865652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-235e8ad6-0178-4f6e-b0a4-11d9707bc80c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.866453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-235e8ad6-0178-4f6e-b0a4-11d9707bc80c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.867115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-235e8ad6-0178-4f6e-b0a4-11d9707bc80c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.880293 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-235e8ad6-0178-4f6e-b0a4-11d9707bc80c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.024992 Aug 29 15:30:38.882104 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 545/1124] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:38.892668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.894049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:38.908003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.909152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.909866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.910879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.911615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.912507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.041897 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93467269-7e4e-4ae4-b988-76013c462979 tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b47b3f6d-7fbd-4671-8c8a-d37c767e335a" status: 202 len: 0 microversion: 2.1 time: 0.480134 Aug 29 15:30:39.044088 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 580/1125] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:38 2022] DELETE /compute/v2.1/os-security-groups/b47b3f6d-7fbd-4671-8c8a-d37c767e335a => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:39.050931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.052933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: f9b94bea-6849-4238-8a96-278971ebf178] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.066179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:39.078497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.079003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.083897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.094210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.095082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.096660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.142625 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] HTTP exception thrown: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Request method failure captured: Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 HTTP/1.1 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrFbHj9-c5weIl2fyHQwNEG7phxM4Q7ovWm5YpVM9CjHBCHFHUhAyJ_aVig-_SZmBtSFbQhUhk7NAKlx5Bh5CrIR7JpWOteP0HP_0zp186ZmejeCEfKAYKhCouc0Sghi33Vk1ZaZVIPoNeXvxXMfU2EMqsk3_Yasuq8BMwvcPfTvVk Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e9ae755ad68447087da4df60c36c746", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}] Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 199c2a20a7e8425e8df281cfe251c880 Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'f9b94bea-6849-4238-8a96-278971ebf178'} Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.147537 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Returning 404 to user: Instance f9b94bea-6849-4238-8a96-278971ebf178 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:39.152655 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae0595c5-dec8-4482-ba9c-671a28f576c5 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178" status: 404 len: 111 microversion: 2.1 time: 0.103624 Aug 29 15:30:39.163339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 581/1126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/servers/f9b94bea-6849-4238-8a96-278971ebf178 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:39.168987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf222bf1-08f9-4a22-9829-ff83edd59c5d tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.190912 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf222bf1-08f9-4a22-9829-ff83edd59c5d tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025846 Aug 29 15:30:39.204812 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 582/1127] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:39.218773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3da0a1d-5e51-47cf-ae2e-8853b3d9fabd tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] Calling method '.version_select at 0x7fb0eb6f83a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.263558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:39.283821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63fd0774-78ee-4e5b-9cd2-53952ba42aac tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1467 microversion: 2.1 time: 0.397730 Aug 29 15:30:39.297440 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 546/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1467 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:39.297440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.297440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.304603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.305094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.305882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.333863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.340364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.340925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.374866 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] HTTP exception thrown: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Request method failure captured: Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 HTTP/1.1 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrFbHj9-c5weIl2fyHQwNEG7phxM4Q7ovWm5YpVM9CjHBCHFHUhAyJ_aVig-_SZmBtSFbQhUhk7NAKlx5Bh5CrIR7JpWOteP0HP_0zp186ZmejeCEfKAYKhCouc0Sghi33Vk1ZaZVIPoNeXvxXMfU2EMqsk3_Yasuq8BMwvcPfTvVk Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e9ae755ad68447087da4df60c36c746", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}] Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 199c2a20a7e8425e8df281cfe251c880 Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'dfefb0af-3933-4c2b-9c7a-38e4e6ae9445'} Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:39.376625 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Returning 404 to user: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:39.381472 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9926ce42-eeeb-41ac-874c-9a7730150ed9 tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 404 len: 111 microversion: 2.1 time: 0.092978 Aug 29 15:30:39.383650 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 547/1129] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:39 2022] DELETE /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:39.396100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.397760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.408296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.409254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.409950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.411252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.412630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.413328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.531629 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3da0a1d-5e51-47cf-ae2e-8853b3d9fabd tempest-SecurityGroupRulesNegativeTestJSON-1745691319 tempest-SecurityGroupRulesNegativeTestJSON-1745691319-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0ae63ab5-c36a-4877-af46-53bd6a1b8736" status: 202 len: 0 microversion: 2.1 time: 0.337819 Aug 29 15:30:39.532876 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 583/1130] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:39 2022] DELETE /compute/v2.1/os-security-groups/0ae63ab5-c36a-4877-af46-53bd6a1b8736 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:39.547057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-58759f5b-61c5-419d-af8b-5a79b0686c4b tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1372076352", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:39.573728 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-58759f5b-61c5-419d-af8b-5a79b0686c4b tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.038081 Aug 29 15:30:39.574570 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 584/1131] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Aug 29 15:30:39 2022] POST /compute/v2.1/flavors => generated 499 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:39.581182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.583130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.594159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.594956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.597761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.598854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.599501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.600093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.815576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:39.830738 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-221439b3-bfa6-4aa5-9c73-daeadeac985c tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1507 microversion: 2.1 time: 0.445921 Aug 29 15:30:39.831665 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 548/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:39.838431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.844389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] [instance: dfefb0af-3933-4c2b-9c7a-38e4e6ae9445] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.864912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.870917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.871824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.872854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.876893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.877790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.915014 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] HTTP exception thrown: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Request method failure captured: Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 HTTP/1.1 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrFbHj9-c5weIl2fyHQwNEG7phxM4Q7ovWm5YpVM9CjHBCHFHUhAyJ_aVig-_SZmBtSFbQhUhk7NAKlx5Bh5CrIR7JpWOteP0HP_0zp186ZmejeCEfKAYKhCouc0Sghi33Vk1ZaZVIPoNeXvxXMfU2EMqsk3_Yasuq8BMwvcPfTvVk Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e9ae755ad68447087da4df60c36c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e9ae755ad68447087da4df60c36c746", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e9ae755ad68447087da4df60c36c746"}]}] Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6e9ae755ad68447087da4df60c36c746 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 199c2a20a7e8425e8df281cfe251c880 Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-285460161-project Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'dfefb0af-3933-4c2b-9c7a-38e4e6ae9445'} Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.923020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] Returning 404 to user: Instance dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-22d29e4b-e244-4e76-80c0-e853874e51ec tempest-ServersWithSpecificFlavorTestJSON-285460161 tempest-ServersWithSpecificFlavorTestJSON-285460161-project] 10.222.0.16 "GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445" status: 404 len: 111 microversion: 2.1 time: 0.090297 Aug 29 15:30:39.927340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 549/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/servers/dfefb0af-3933-4c2b-9c7a-38e4e6ae9445 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:39.934989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0cdfebcb-050f-418e-9ad8-4b86daadc294 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.962888 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0cdfebcb-050f-418e-9ad8-4b86daadc294 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036427 Aug 29 15:30:39.963722 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 550/1134] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:30:39.982906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.983704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] [instance: d6aacc5a-4410-43ca-ad4b-ebc777ad45d3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.994572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.995064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.995580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.996324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.996780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.997199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.042505 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] HTTP exception thrown: Instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 could not be found. Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Request method failure captured: Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 HTTP/1.1 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNt7Jme1ogR_6kSNsu-7FM8vtsj0FR8GaPa6IXAIACX11sC7TZlIH-Xd36dZziNTtqPh1JLJt9mlze497c0SltW1xlNdvRvUNVhDb0qmJCiHSsBPlJ5vAqh3ZYOfzFbavmGw3-nGtbulR9Wg6C-6Tsk3IwuRwQV4rzx1rbj8Hqi6XIk Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f9ff69e07f4f32bb1a6aa14a937d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f9ff69e07f4f32bb1a6aa14a937d86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f9ff69e07f4f32bb1a6aa14a937d86"}]}] Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 42f9ff69e07f4f32bb1a6aa14a937d86 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1898877458 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c886c6bd7a0544b499c77b714c6065f7 Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1898877458-project Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 could not be found. Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd6aacc5a-4410-43ca-ad4b-ebc777ad45d3'} Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 could not be found. Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 could not be found. Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:40.045088 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 could not be found. Aug 29 15:30:40.049137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:40.051672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] Returning 404 to user: Instance d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:40.052842 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cd325fe-487e-4877-891d-00bf6b108e4f tempest-ServerMetadataNegativeTestJSON-1898877458 tempest-ServerMetadataNegativeTestJSON-1898877458-project] 10.222.0.16 "GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3" status: 404 len: 111 microversion: 2.1 time: 0.088414 Aug 29 15:30:40.054082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 551/1135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/servers/d6aacc5a-4410-43ca-ad4b-ebc777ad45d3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:40.404253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1410239474", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "d761291a-8fcd-4df7-b259-78037f58b65f"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:40.468609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:40.547502 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-557dab37-d8bd-4b51-a614-b4833e40e636 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1467 microversion: 2.1 time: 0.971249 Aug 29 15:30:40.549368 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 585/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1467 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:40.589812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1082344357"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:40.601963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:40.634400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.635636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.637275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.652583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.660556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.664502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.665026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:41.319684 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0ab44ac2-0d62-4c1a-ab68-e7535b9254f7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "POST /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493/action" status: 202 len: 0 microversion: 2.1 time: 0.745767 Aug 29 15:30:41.323169 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 586/1137] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:40 2022] POST /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 15:30:41.380057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8fa6ea7-9194-49fa-b375-44253a677e73 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb7660d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:41.613373 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8fa6ea7-9194-49fa-b375-44253a677e73 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.277437 Aug 29 15:30:41.619864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 587/1138] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:41 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:42.496646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:42.498058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:42.499114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:42.500824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:42.501935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:42.533268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.534826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.535868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.537708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.538859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.540598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.640816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:42.642830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0da33b86-ac1e-4548-9148-2af5609006c1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb723af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:42.679035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for user 1869270af6874c4db42112d4aa9417a6 and project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:42.761563 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0da33b86-ac1e-4548-9148-2af5609006c1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.122088 Aug 29 15:30:42.763463 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 588/1139] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:42 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:42.771811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:42.783879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:42.807217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23b40640-0cea-4a19-b43c-c5d883aca1eb", "device": "/dev/xvdb"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:42.816481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:42.830281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.831412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.833569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.835400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.836154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.836821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.916872 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55d813cf-754d-4252-a51a-70b9110de7e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.523570 Aug 29 15:30:42.918927 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 552/1140] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:30:42.930576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67e267a1-b632-400f-859f-388f3d374475 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:42.931383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67e267a1-b632-400f-859f-388f3d374475 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:43.051124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-67e267a1-b632-400f-859f-388f3d374475 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:43.064663 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67e267a1-b632-400f-859f-388f3d374475 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1279 microversion: 2.1 time: 0.138221 Aug 29 15:30:43.069593 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 553/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:42 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:43.103451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:43.429324 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3384c0a2-8509-4838-a5d4-0e2ca7770263 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "POST /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.632753 Aug 29 15:30:43.431808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 589/1142] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Aug 29 15:30:42 2022] POST /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:30:43.703479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9833a04d-8841-4c12-805e-afc3f534e8c5"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:43.707519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:43.737065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.738501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.744056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.746063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.749335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.754409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.786402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e1dd500-bf01-4472-a1e5-0f91c7de91a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb766dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.873142 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] HTTP exception thrown: Volume 18bf8611-5921-4f26-a720-f5a5d7fe7ffd could not be found. Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Request method failure captured: Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28/os-volume_attachments/18bf8611-5921-4f26-a720-f5a5d7fe7ffd HTTP/1.1 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 74 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNr1Ze-jFfe4ImQreIDE-7WK5n1mvweQiQsLnosMEYtshae115Xvbpfbj4csJfSsOEbpjsptSjLC9of2d7an7ImDLibZrq91kgruo72Q6ZxnsbWW50d7D_TrzvcfCy89iDJ98QBkVR_e3FAy46EKG9eriuRvRWp8pQODa_SAPTiDPGM Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 64edf13094b74182b6d8b33ad3026b5c Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesAdminNegativeTest-1041747914 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64edf13094b74182b6d8b33ad3026b5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64edf13094b74182b6d8b33ad3026b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64edf13094b74182b6d8b33ad3026b5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64edf13094b74182b6d8b33ad3026b5c"}]}] Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesAdminNegativeTest-1041747914 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 64edf13094b74182b6d8b33ad3026b5c Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1041747914 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesAdminNegativeTest-1041747914-project-admin Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 958a45cf5eb647df9b53037171349898 Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesAdminNegativeTest-1041747914-project-admin Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: {"volumeAttachment": {"volumeId": "9833a04d-8841-4c12-805e-afc3f534e8c5"}} Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume 18bf8611-5921-4f26-a720-f5a5d7fe7ffd could not be found. Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': 'e066adea-ffd2-4ed8-b67a-44b5b0793f28', 'id': '18bf8611-5921-4f26-a720-f5a5d7fe7ffd', 'body': {'volumeAttachment': {'volumeId': '9833a04d-8841-4c12-805e-afc3f534e8c5'}}} Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18bf8611-5921-4f26-a720-f5a5d7fe7ffd could not be found. (HTTP 404) (Request-ID: req-142ad886-f83a-4d53-9cb8-cc865ac006e7) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:30:43.876152 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18bf8611-5921-4f26-a720-f5a5d7fe7ffd could not be found. Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18bf8611-5921-4f26-a720-f5a5d7fe7ffd could not be found. Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18bf8611-5921-4f26-a720-f5a5d7fe7ffd could not be found. Aug 29 15:30:43.880751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:43.891218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] Returning 404 to user: Volume 18bf8611-5921-4f26-a720-f5a5d7fe7ffd could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:43.891218 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-875bef8d-c3a9-4596-8115-707e49029045 tempest-VolumesAdminNegativeTest-1041747914 tempest-VolumesAdminNegativeTest-1041747914-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28/os-volume_attachments/18bf8611-5921-4f26-a720-f5a5d7fe7ffd" status: 404 len: 109 microversion: 2.1 time: 0.192116 Aug 29 15:30:43.912949 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 554/1143] 10.222.0.16 () {60 vars in 1433 bytes} [Mon Aug 29 15:30:43 2022] PUT /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28/os-volume_attachments/18bf8611-5921-4f26-a720-f5a5d7fe7ffd => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:43.952036 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e1dd500-bf01-4472-a1e5-0f91c7de91a3 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.171909 Aug 29 15:30:43.974760 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 590/1144] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:43 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:44.095359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:44.098284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:44.129045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.129644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.135533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.136573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.137203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.154572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.579499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:44.611297 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45c9f25c-335a-4117-89a7-d39046e66239 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1283 microversion: 2.1 time: 0.521913 Aug 29 15:30:44.613762 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 555/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:44 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1283 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:45.008328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-387937a0-4412-4982-a49b-0f694bc86d09 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb710040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:45.016101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:45.171822 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-387937a0-4412-4982-a49b-0f694bc86d09 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.167716 Aug 29 15:30:45.187752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 591/1146] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:45 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:45.647405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:45.648082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:45.668525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.669029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.669536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.670269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.671081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.671923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.954666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:45.981418 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3548adfb-774b-49c8-8086-b0578349f9d4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1331 microversion: 2.1 time: 0.336246 Aug 29 15:30:45.983455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 556/1147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:45 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1331 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:46.205509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a304a8a2-1dc9-4007-9a0a-07dbb02e6293 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb7660d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:46.291948 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a304a8a2-1dc9-4007-9a0a-07dbb02e6293 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.090861 Aug 29 15:30:46.293296 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 592/1148] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:46 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:46.903077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b31d42ac-0781-4460-9a71-265d69d89f15 req-e4dd2477-af0b-4e90-abab-90830b416081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85573cdb-9434-4da4-a11b-89a5780a0493", "name": "network-vif-plugged", "status": "completed", "tag": "d044e837-eb27-4ad5-81b7-21637633fde4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:46.949960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b31d42ac-0781-4460-9a71-265d69d89f15 req-e4dd2477-af0b-4e90-abab-90830b416081 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.950505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b31d42ac-0781-4460-9a71-265d69d89f15 req-e4dd2477-af0b-4e90-abab-90830b416081 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.954950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b31d42ac-0781-4460-9a71-265d69d89f15 req-e4dd2477-af0b-4e90-abab-90830b416081 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.005655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.006495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:47.017509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b31d42ac-0781-4460-9a71-265d69d89f15 req-e4dd2477-af0b-4e90-abab-90830b416081 service nova] Creating event network-vif-plugged:d044e837-eb27-4ad5-81b7-21637633fde4 for instance 85573cdb-9434-4da4-a11b-89a5780a0493 on n-h1-854882-3 Aug 29 15:30:47.032624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.035584 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b31d42ac-0781-4460-9a71-265d69d89f15 req-e4dd2477-af0b-4e90-abab-90830b416081 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136738 Aug 29 15:30:47.040120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.044201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.052401 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 557/1149] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:47.052697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.053742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.058876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.316714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96c65f33-7133-4bba-a11c-4d0465b3c56e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3299af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.367350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:47.380945 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-986df320-bc9a-4946-b1a5-592b967c26fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1337 microversion: 2.1 time: 0.380064 Aug 29 15:30:47.386569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 593/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:46 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1337 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:47.452205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96c65f33-7133-4bba-a11c-4d0465b3c56e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.140414 Aug 29 15:30:47.461891 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 558/1151] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:47 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:48.411451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.412473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.415633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:48.458310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.459121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.459849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.461153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.461970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.462705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.485805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ddb6772-2fa4-4345-aca8-bd0f402e9268 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32930d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.606137 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ddb6772-2fa4-4345-aca8-bd0f402e9268 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.127532 Aug 29 15:30:48.611612 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 559/1152] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:48 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:49.047724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:49.056281 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f011b00b-8dc5-4eda-bb04-75df5f597772 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1337 microversion: 2.1 time: 0.652488 Aug 29 15:30:49.069912 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 594/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:48 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1337 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:49.627866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-592e5387-5133-46fb-a1b5-3b4ad29ae60c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32993a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:49.813200 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-592e5387-5133-46fb-a1b5-3b4ad29ae60c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.192665 Aug 29 15:30:49.814187 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 560/1154] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:49 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:50.077878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:50.079639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:50.112738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.121095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.122340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.123576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.126449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.128920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.832131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2e1940b8-1846-47c6-807e-c7e36153631b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e33704c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:50.992199 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2e1940b8-1846-47c6-807e-c7e36153631b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.165661 Aug 29 15:30:51.007384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 561/1155] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:50 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:51.362305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:51.371368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:51.426973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:51.445376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:51.458624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.461369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:51.466105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:51.470002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.620308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:51.671998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:52.054734 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-28943d54-7d15-4e75-9f9a-8773f75d0c03 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 204 len: 0 microversion: 2.1 time: 0.700727 Aug 29 15:30:52.058234 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 562/1156] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:51 2022] DELETE /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:52.080678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55bbd087-8031-455b-a13f-6c2ec22046b8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32990d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:52.183395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:52.244223 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cb750aa7-fd35-4466-b7c8-a79015bf3491 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1337 microversion: 2.1 time: 2.170582 Aug 29 15:30:52.256492 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55bbd087-8031-455b-a13f-6c2ec22046b8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.194601 Aug 29 15:30:52.269419 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 595/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:50 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1337 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:52.278075 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 563/1158] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:52 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:52.292671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:52.294492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:52.323757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.329515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.331185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.332710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.338203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.339562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:53.289112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-103f43d2-7460-40a1-8ae3-bfe5967b453c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32d1700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:53.305524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:53.313041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:53.739746 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-103f43d2-7460-40a1-8ae3-bfe5967b453c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.456708 Aug 29 15:30:53.755401 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 564/1159] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:53 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:53.755401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:53.757969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:53.783207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:53.783207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:53.783207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:53.784264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:53.784264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:53.784579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:54.383033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:54.396954 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cad37064-ce56-4839-ab41-d0effb91c9d0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1337 microversion: 2.1 time: 0.652772 Aug 29 15:30:54.397886 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 565/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:53 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1337 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:54.425297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:54.453059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d98dd983-b9fb-4562-8f2a-606965339086 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1513 microversion: 2.1 time: 2.178182 Aug 29 15:30:54.467764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 596/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:52 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1513 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:54.765288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4353b63f-b956-4b54-9e3f-2cde21958374 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32441f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:54.919807 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4353b63f-b956-4b54-9e3f-2cde21958374 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.158415 Aug 29 15:30:54.920401 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 566/1162] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:54 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:55.440277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:55.441425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:55.518970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:55.521963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.522962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.523746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.528681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:55.558805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.559823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.568861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.591577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.592738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.597310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.601236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.602115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.602922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.832618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:55.857844 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d2bddedb-f134-47d8-9781-49cb527c281b tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1471 microversion: 2.1 time: 0.335339 Aug 29 15:30:55.857844 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 567/1163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:55 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:55.941312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1aaf60d-acb4-4878-bfd6-7f853e32c4cf tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3299310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:56.113738 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e1aaf60d-acb4-4878-bfd6-7f853e32c4cf tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.176183 Aug 29 15:30:56.114350 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 568/1164] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:55 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:56.129329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4dc7ad84-f00c-4927-9d9a-fe39651a2799 req-5246da72-57d0-4eb3-92bc-a936b0bec1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e066adea-ffd2-4ed8-b67a-44b5b0793f28", "name": "network-vif-deleted", "tag": "e8d5c209-0604-4ee0-bd90-7b6e57c63092"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:56.157977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4dc7ad84-f00c-4927-9d9a-fe39651a2799 req-5246da72-57d0-4eb3-92bc-a936b0bec1f2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:56.158442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4dc7ad84-f00c-4927-9d9a-fe39651a2799 req-5246da72-57d0-4eb3-92bc-a936b0bec1f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:56.159083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4dc7ad84-f00c-4927-9d9a-fe39651a2799 req-5246da72-57d0-4eb3-92bc-a936b0bec1f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:56.185674 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4dc7ad84-f00c-4927-9d9a-fe39651a2799 req-5246da72-57d0-4eb3-92bc-a936b0bec1f2 service nova] Creating event network-vif-deleted:e8d5c209-0604-4ee0-bd90-7b6e57c63092 for instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 on n-h1-854882-3 Aug 29 15:30:56.193546 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4dc7ad84-f00c-4927-9d9a-fe39651a2799 req-5246da72-57d0-4eb3-92bc-a936b0bec1f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077814 Aug 29 15:30:56.194750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 569/1165] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:56.796373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:56.805347 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a900aba-e03a-4380-af91-ba324da9747d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 1.375849 Aug 29 15:30:56.810661 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 597/1166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:55 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:56.891114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:56.892424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:56.921123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:56.925940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:56.926889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:56.930881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:56.931994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:56.934539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.053034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.058674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.062693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.063505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lazy-loading 'fault' on Instance uuid e066adea-ffd2-4ed8-b67a-44b5b0793f28 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:57.138719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ceeae906-a83f-489b-b64e-58f280a9ab96 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb7150d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:57.222430 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ceeae906-a83f-489b-b64e-58f280a9ab96 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.089737 Aug 29 15:30:57.224060 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 598/1167] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:57 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:57.605204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:57.625554 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8456f4a5-8d4d-43b9-812a-e04cf83aef48 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 200 len: 1307 microversion: 2.1 time: 0.742309 Aug 29 15:30:57.645770 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 570/1168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:56 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 1307 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:57.833765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:57.834428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:57.854837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.855661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.856274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.857199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.857880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.859168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.245598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c071a364-c34a-4c65-a70d-670ef029404d tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32683a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.416102 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c071a364-c34a-4c65-a70d-670ef029404d tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.180621 Aug 29 15:30:58.419340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 571/1169] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:58.659431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.661185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: e066adea-ffd2-4ed8-b67a-44b5b0793f28] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:58.672242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.672991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.674418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.675471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.676132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.676942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.703665 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] HTTP exception thrown: Instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 could not be found. Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Request method failure captured: Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 HTTP/1.1 Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrgVW_JKsop7HWSiZltOvYBApN1E86f0i0LJes_a4oE3off-t1JB1u9-cScA2Z36C8vmrnywISkb--V506cMs7MEokVV7h4C4KpPiziMmYbpBHf0hxiNLa8rOBvgzkfpTJHdtdVRCq199jXM2JlXO7Ic4Ytv0mgPDO-fZ06cg38cmI Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 879d436e9d1a43ee8df0e652dbb6307a Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesAdminNegativeTest-742541852 Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/879d436e9d1a43ee8df0e652dbb6307a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/879d436e9d1a43ee8df0e652dbb6307a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_879d436e9d1a43ee8df0e652dbb6307a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/879d436e9d1a43ee8df0e652dbb6307a"}]}] Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesAdminNegativeTest-742541852 Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 879d436e9d1a43ee8df0e652dbb6307a Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-742541852 Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesAdminNegativeTest-742541852-project Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 1ff9744258414abeb64b442b0d295c1c Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesAdminNegativeTest-742541852-project Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 could not be found. Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e066adea-ffd2-4ed8-b67a-44b5b0793f28'} Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 could not be found. Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 could not be found. Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:58.706449 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:58.712421 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:58.712421 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:58.712421 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:58.712421 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:58.712421 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:58.712421 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 could not be found. Aug 29 15:30:58.712421 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:30:58.715413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Returning 404 to user: Instance e066adea-ffd2-4ed8-b67a-44b5b0793f28 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:58.716655 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13f719d5-7e02-48e0-8d6d-7972e749a7e9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28" status: 404 len: 111 microversion: 2.1 time: 0.066970 Aug 29 15:30:58.721141 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 572/1170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/servers/e066adea-ffd2-4ed8-b67a-44b5b0793f28 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:59.012834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:59.024631 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63929d7b-d3f3-444d-813c-aa9f75cba269 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 1.195156 Aug 29 15:30:59.035460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 599/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:57 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:59.444011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3695bb96-e9d7-4c56-88f1-7d22df5b999b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32443a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:59.566402 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3695bb96-e9d7-4c56-88f1-7d22df5b999b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.131570 Aug 29 15:30:59.567134 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 573/1172] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:59 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:00.056468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:00.057309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:00.084070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:00.090255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:00.093930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:00.094716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:00.095211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:00.108374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:00.253323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-943f228c-d2b7-4f1f-b516-18c28b32ea94 req-e137ae5a-6a02-4a5a-9708-fddc6386df09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d41c49d-24a1-4830-9a08-1fb803cd476f", "tag": "25b207f6-5f3f-41f4-86cb-19208977ab03"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:00.296285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-943f228c-d2b7-4f1f-b516-18c28b32ea94 req-e137ae5a-6a02-4a5a-9708-fddc6386df09 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:00.298541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-943f228c-d2b7-4f1f-b516-18c28b32ea94 req-e137ae5a-6a02-4a5a-9708-fddc6386df09 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:00.301235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-943f228c-d2b7-4f1f-b516-18c28b32ea94 req-e137ae5a-6a02-4a5a-9708-fddc6386df09 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:00.332201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-943f228c-d2b7-4f1f-b516-18c28b32ea94 req-e137ae5a-6a02-4a5a-9708-fddc6386df09 service nova] Creating event network-changed:25b207f6-5f3f-41f4-86cb-19208977ab03 for instance 6d41c49d-24a1-4830-9a08-1fb803cd476f on n-h2-854882-3 Aug 29 15:31:00.343075 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-943f228c-d2b7-4f1f-b516-18c28b32ea94 req-e137ae5a-6a02-4a5a-9708-fddc6386df09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093920 Aug 29 15:31:00.344200 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 574/1173] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:31:00.582602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cad8657c-aad5-4732-b2c4-2bf3500ac21f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3370280>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:00.693508 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cad8657c-aad5-4732-b2c4-2bf3500ac21f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.114733 Aug 29 15:31:00.694456 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 575/1174] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:00 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:01.546959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:01.619142 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7a16da6-fca5-46d4-b9ae-511fb5d2e8e3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 1.564644 Aug 29 15:31:01.625812 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 600/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:00 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:01.715346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f800a4a-d2a3-425c-af44-e71fbd6f37e2 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3244af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:01.840732 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f800a4a-d2a3-425c-af44-e71fbd6f37e2 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.133343 Aug 29 15:31:01.851212 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 576/1176] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:01 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:02.680702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:02.681877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:02.742482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:02.743291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:02.743894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:02.744795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:02.745487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:02.746078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:02.858585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-868c05d2-3180-4785-9949-20e28a84aaf0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3244670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:02.978521 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-868c05d2-3180-4785-9949-20e28a84aaf0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.124602 Aug 29 15:31:02.987275 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 577/1177] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:02 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:03.191606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:03.206239 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-80b4d0d4-7746-47d7-816e-823dbfe4deb6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 0.553333 Aug 29 15:31:03.219478 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 601/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:02 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:03.997308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7f7bcc52-4080-4387-bad0-8390fe8b904e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3293670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:04.183898 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7f7bcc52-4080-4387-bad0-8390fe8b904e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.176326 Aug 29 15:31:04.188986 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 578/1179] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:03 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:04.223866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:04.225183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:04.246976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.247810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.248433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:04.249351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.252739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.254321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:05.050876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:05.060974 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9cbd45cd-8c5d-4b7c-b322-ef9560376ef3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 0.841298 Aug 29 15:31:05.069240 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 602/1180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:04 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:05.207730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cc334a6-32c1-4688-ad1f-ec98a30d485d tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32c24c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:05.268052 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4cc334a6-32c1-4688-ad1f-ec98a30d485d tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.065027 Aug 29 15:31:05.269047 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 579/1181] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:05 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:05.537791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:05.538423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:05.551169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:05.551574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:05.552025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:05.557609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:05.558427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:05.559379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.095708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:06.097000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:06.100139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:06.113165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.113904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.114698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.116940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.117719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.118414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.364090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:06.376001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d7df050d-1c5d-45c6-8d2a-0174a7d9254a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 0.283984 Aug 29 15:31:06.377310 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 580/1182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:06 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:06.382494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-254085d5-0520-4526-9017-2ef4c385e4a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3244820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:06.499126 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-254085d5-0520-4526-9017-2ef4c385e4a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.120393 Aug 29 15:31:06.499703 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 581/1183] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:06 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:06.742398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 704fa114-40c8-4d26-bd16-838f3a8dcb5f {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:06.747417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:06.748031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:06.770717 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18e31b9f-5c8f-4825-a5eb-35aaba882b38 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 2420 microversion: 2.25 time: 1.236637 Aug 29 15:31:06.771451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.772048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.772663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.774207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.776864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.777453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.788129 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 603/1184] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:05 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 2420 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:06.816114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854882-3", "block_migration": "auto"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:06.820961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:06.842677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.846364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.847189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.849218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.852459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.853181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.874817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:31:06.912913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'flavor' on Instance uuid 704fa114-40c8-4d26-bd16-838f3a8dcb5f {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:06.946069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Going to try to live migrate instance to n-h2-854882-3 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:31:07.119776 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a41c5b16-0bd2-42f0-9537-e252b0ffea79 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 204 len: 0 microversion: 2.1 time: 0.372826 Aug 29 15:31:07.124117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 582/1185] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:06 2022] DELETE /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:31:07.129777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:07.140629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:07.166021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:07.166525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:07.167544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:07.168266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:07.168725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:07.169153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:07.846206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:07.859380 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5416a6d-d182-44a9-bfe6-6b76bdc03c32 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1679 microversion: 2.1 time: 0.733947 Aug 29 15:31:07.874301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 583/1186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:07 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1679 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:07.902586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:07.906995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:07.933214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:07.934588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:07.937237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:07.940037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:07.942436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:07.944296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:08.350762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:08.362337 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75d7b3d3-73f2-46ef-b660-4fb6195184dd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 0.478051 Aug 29 15:31:08.366624 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 584/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:07 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:08.371870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0565efa3-009f-4441-8949-63c87b2b0b0e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3273c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:08.506080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0565efa3-009f-4441-8949-63c87b2b0b0e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.137069 Aug 29 15:31:08.506080 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 585/1188] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:08 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:08.889501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:08.890281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:08.935595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:08.941258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:08.948620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:08.950954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:08.958466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:08.963534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:09.459701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:09.490566 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ebb7f42-4260-4fbb-a497-bea16588dfa8 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1679 microversion: 2.1 time: 0.606126 Aug 29 15:31:09.492895 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 586/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:08 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1679 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:09.884463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1182266598", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:10.038679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:10.966616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:10.967681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:10.968839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:10.970504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:10.971126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:10.994198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:10.996494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:11.000030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:11.001132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:11.001774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:11.002412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:11.046737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Getting quotas for project ce5236a48a4d4aa9800ca11f08fb7b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:11.062386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Getting quotas for user a74e72e4a61e4938b54dbb1e51db99dc and project ce5236a48a4d4aa9800ca11f08fb7b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:11.164162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:11.175014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:11.284416 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fbf5a4c1-70a7-479e-a60f-93d648d8489f tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789719 Aug 29 15:31:11.285860 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 587/1190] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:11.300673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:11.301686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:11.339292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:11.340828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:11.342028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:11.343741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:11.344391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:11.347435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:11.891299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-573f4b5a-ef2f-4109-9ec6-32c675fc25f9 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/action" status: 202 len: 0 microversion: 2.25 time: 5.097568 Aug 29 15:31:11.892296 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 604/1191] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:31:06 2022] POST /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/action => generated 0 bytes in 5100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:31:11.900214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47cd7004-8fed-4f45-8b20-e4d3302f36e0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb7021f0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:12.047498 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-47cd7004-8fed-4f45-8b20-e4d3302f36e0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.153921 Aug 29 15:31:12.054953 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 605/1192] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:11 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:12.075709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:12.078057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:12.099256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:12.103730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:12.105198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:12.105864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:12.106807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:12.107433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:12.108017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:12.407646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:12.421330 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-38b07276-4fa4-44aa-803a-588ba7aca85b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 1.131719 Aug 29 15:31:12.424440 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 588/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:11 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:12.442897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d44377b0-8173-4f65-85d4-6a93952d9054 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:12.448190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d44377b0-8173-4f65-85d4-6a93952d9054 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:13.148291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d44377b0-8173-4f65-85d4-6a93952d9054 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.166132 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d44377b0-8173-4f65-85d4-6a93952d9054 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1220 microversion: 2.1 time: 0.728062 Aug 29 15:31:13.179556 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 589/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:12 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1220 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:13.187178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:13.198460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:13.230329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:13.246206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:13.247474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:13.250081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:13.253473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:13.254260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:13.335069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.349170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:13.360970 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ababb582-918c-4369-b9af-56df971caa1d tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1679 microversion: 2.1 time: 1.302304 Aug 29 15:31:13.365743 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 606/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:12 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1679 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:13.383358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5041928f-a391-4ef7-b43e-11dff2b763d0 req-107988cd-3c44-4496-b741-5fd7f720790c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d41c49d-24a1-4830-9a08-1fb803cd476f", "name": "network-vif-plugged", "status": "completed", "tag": "25b207f6-5f3f-41f4-86cb-19208977ab03"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:13.444139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5041928f-a391-4ef7-b43e-11dff2b763d0 req-107988cd-3c44-4496-b741-5fd7f720790c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:13.451199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5041928f-a391-4ef7-b43e-11dff2b763d0 req-107988cd-3c44-4496-b741-5fd7f720790c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:13.457232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5041928f-a391-4ef7-b43e-11dff2b763d0 req-107988cd-3c44-4496-b741-5fd7f720790c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:13.551278 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5041928f-a391-4ef7-b43e-11dff2b763d0 req-107988cd-3c44-4496-b741-5fd7f720790c service nova] Creating event network-vif-plugged:25b207f6-5f3f-41f4-86cb-19208977ab03 for instance 6d41c49d-24a1-4830-9a08-1fb803cd476f on n-h2-854882-3 Aug 29 15:31:13.564833 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5041928f-a391-4ef7-b43e-11dff2b763d0 req-107988cd-3c44-4496-b741-5fd7f720790c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193102 Aug 29 15:31:13.569465 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 607/1196] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:13.583335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2f135a4-f486-4519-8fb9-4c266ba5c96e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb73b160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:13.675607 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e2f135a4-f486-4519-8fb9-4c266ba5c96e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.104776 Aug 29 15:31:13.687526 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 608/1197] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:13 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:13.698290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:13.716954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:13.749426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:13.749933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:13.750382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:13.751280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:13.761599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:13.762284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:13.968570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.987251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.989443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.996506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57e32633-51a7-4695-8346-de9dd7d44db3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.815138 Aug 29 15:31:14.021566 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 590/1198] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:13 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:14.192145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:14.195967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:14.233188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.234081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.236274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:14.237240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.238661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.239161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:14.655995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:14.672232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:14.696164 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7305fb68-5e89-4e4f-a4c5-6ed57c23eb0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1272 microversion: 2.1 time: 0.511603 Aug 29 15:31:14.702113 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 591/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:14 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1272 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:14.729724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:14.744204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:14.783621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.784145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.793216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:14.796348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.800449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.806879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.007858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.053073 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8f07229-6dc9-44f5-9f10-a1aae2df5673 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1611 microversion: 2.1 time: 0.349595 Aug 29 15:31:15.057939 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 592/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:14 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1611 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:15.065709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b100f3a-fb49-4a71-bd0f-e9521d07b6be tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32d1e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:15.134581 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b100f3a-fb49-4a71-bd0f-e9521d07b6be tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.075010 Aug 29 15:31:15.139489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 593/1201] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:15 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:15.144912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:15.154525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:15.164284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.171062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.171839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.172797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.173485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.181126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.419001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.442993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.444583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.452844 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f4732ca-59fd-4ca7-9f8a-efa8a64de1d1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.308450 Aug 29 15:31:15.455140 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 594/1202] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:15 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:15.717902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:15.718533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:15.739046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.739540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.739971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.740679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.741128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.741583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.903008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.926196 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-294157fc-a6d6-48f6-9df2-53873c12a054 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 2.236403 Aug 29 15:31:15.942981 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 609/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:13 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:15.977309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.988228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8badc643-90e7-456d-be80-48c83ac982d0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1278 microversion: 2.1 time: 0.275511 Aug 29 15:31:15.995085 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 595/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:15 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:16.076388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:16.077522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:16.103295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.103812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.104866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.105631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.106097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.106537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.150553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08a9fc5e-08a3-457f-a976-66e0e9bbb634 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3268430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:16.273201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08a9fc5e-08a3-457f-a976-66e0e9bbb634 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.126849 Aug 29 15:31:16.275951 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 596/1205] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:16 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:16.442187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:16.478472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-947a251b-87a2-438c-9599-8f6965876ad6 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1611 microversion: 2.1 time: 0.407563 Aug 29 15:31:16.479506 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 610/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:16 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1611 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:16.479993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:16.480615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:16.511794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.513875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.514326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.515063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.515527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.515950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.931069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f4f6cb6e-eb9f-4307-825e-2c204a7964b0 req-66a12131-0e39-47b8-8b4c-0cce1f9477f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf291a9-4160-4710-97ef-4067a3e5bf59", "name": "network-vif-deleted", "tag": "bd9dd69b-de59-4ca1-9f54-7c18cef0070b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:16.977772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f4f6cb6e-eb9f-4307-825e-2c204a7964b0 req-66a12131-0e39-47b8-8b4c-0cce1f9477f0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.984759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f4f6cb6e-eb9f-4307-825e-2c204a7964b0 req-66a12131-0e39-47b8-8b4c-0cce1f9477f0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.989172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f4f6cb6e-eb9f-4307-825e-2c204a7964b0 req-66a12131-0e39-47b8-8b4c-0cce1f9477f0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:17.102153 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f4f6cb6e-eb9f-4307-825e-2c204a7964b0 req-66a12131-0e39-47b8-8b4c-0cce1f9477f0 service nova] Creating event network-vif-deleted:bd9dd69b-de59-4ca1-9f54-7c18cef0070b for instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 on n-h2-854882-3 Aug 29 15:31:17.146064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f4f6cb6e-eb9f-4307-825e-2c204a7964b0 req-66a12131-0e39-47b8-8b4c-0cce1f9477f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.529866 Aug 29 15:31:17.151394 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 611/1207] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:31:17.171196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:17.174433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:17.214877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:17.236838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:17.241579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:17.243210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:17.245269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:17.248353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:17.969188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:17.987914 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-043c1615-7762-4c41-9b27-83391776a60f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1379 microversion: 2.1 time: 0.833520 Aug 29 15:31:17.992719 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 612/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:17 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1379 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:18.025922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:18.032351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:18.061480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.064448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.067565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.068507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.068981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.069437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.163582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.178853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.184479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.188718 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-48a47d2e-db3e-4546-a3a6-dc89558365de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 1.713122 Aug 29 15:31:18.212766 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 597/1209] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:16 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:18.231459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d6557374-ff5d-4bec-a5db-3e7b17ee7953 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3268f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:18.330992 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d6557374-ff5d-4bec-a5db-3e7b17ee7953 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1453 microversion: 2.1 time: 0.109130 Aug 29 15:31:18.334325 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 598/1210] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:18 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:18.343330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:18.346805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:18.351096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.361239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.362156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.362831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.363777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.364990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.365671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.382018 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c53c19b6-363a-4df8-a17c-36270c31ab23 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1278 microversion: 2.1 time: 0.384122 Aug 29 15:31:18.383135 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 613/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:17 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1278 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:18.424028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.424936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.425636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.429640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lazy-loading 'fault' on Instance uuid 5bf291a9-4160-4710-97ef-4067a3e5bf59 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:18.622491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff9744258414abeb64b442b0d295c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d436e9d1a43ee8df0e652dbb6307a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.647655 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3dbcd4f3-c657-4591-be83-d3d8e41ca109 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 200 len: 1330 microversion: 2.1 time: 0.309813 Aug 29 15:31:18.653629 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 599/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:18 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 1330 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:19.015523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:19.016395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:19.063986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.064573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.065034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.065824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.073528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.073983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.215906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:19.216614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:19.233723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.236790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.243757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.249367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.253313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.254903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.377202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:19.386666 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e918163-f161-4cac-8abb-deb7c495e886 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1529 microversion: 2.1 time: 0.377745 Aug 29 15:31:19.387277 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 614/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:19 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1529 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:19.417686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5af878ae-ee0f-4080-8dac-d409af66360b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb715430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:19.487489 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5af878ae-ee0f-4080-8dac-d409af66360b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1462 microversion: 2.1 time: 0.077674 Aug 29 15:31:19.488106 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 615/1214] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:19 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:19.504836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:19.505496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:19.525546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.526130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.526593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.527529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.528169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.528753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.732704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:19.747364 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-117f8772-7793-4f35-802c-7bd1cb617dfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1278 microversion: 2.1 time: 0.257218 Aug 29 15:31:19.760909 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 616/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:19 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:19.763127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:19.763765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:19.783415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.783415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.783806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.790938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.791785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.792232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.028128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:20.039432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:20.047312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:20.050822 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e22d43f-8100-445c-86fb-57221d9937fb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.840357 Aug 29 15:31:20.066490 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 600/1216] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:19 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:20.083204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27a0da55-b46b-42c4-9b07-948685cf0902 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3317f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.140983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:20.149670 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5a9309e-3fa2-45a0-b417-67e32ab0994d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1529 microversion: 2.1 time: 0.395817 Aug 29 15:31:20.149854 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 617/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:19 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1529 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:20.163625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.164387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] [instance: 5bf291a9-4160-4710-97ef-4067a3e5bf59] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:20.182284 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27a0da55-b46b-42c4-9b07-948685cf0902 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 200 len: 1462 microversion: 2.1 time: 0.114264 Aug 29 15:31:20.183452 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 601/1218] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:20 2022] GET /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 1462 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:20.196592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.197173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.198376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.201317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.201996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.204102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.239959 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] HTTP exception thrown: Instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 could not be found. Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Request method failure captured: Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 HTTP/1.1 Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrgVW_JKsop7HWSiZltOvYBApN1E86f0i0LJes_a4oE3off-t1JB1u9-cScA2Z36C8vmrnywISkb--V506cMs7MEokVV7h4C4KpPiziMmYbpBHf0hxiNLa8rOBvgzkfpTJHdtdVRCq199jXM2JlXO7Ic4Ytv0mgPDO-fZ06cg38cmI Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 879d436e9d1a43ee8df0e652dbb6307a Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-VolumesAdminNegativeTest-742541852 Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/879d436e9d1a43ee8df0e652dbb6307a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/879d436e9d1a43ee8df0e652dbb6307a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_879d436e9d1a43ee8df0e652dbb6307a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/879d436e9d1a43ee8df0e652dbb6307a"}]}] Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-VolumesAdminNegativeTest-742541852 Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 879d436e9d1a43ee8df0e652dbb6307a Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-742541852 Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-VolumesAdminNegativeTest-742541852-project Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 1ff9744258414abeb64b442b0d295c1c Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-VolumesAdminNegativeTest-742541852-project Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 could not be found. Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '5bf291a9-4160-4710-97ef-4067a3e5bf59'} Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 could not be found. Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 could not be found. Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:20.243709 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:31:20.248598 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:20.248598 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:20.248598 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:20.248598 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:20.248598 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:20.248598 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 could not be found. Aug 29 15:31:20.248598 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:31:20.252182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Returning 404 to user: Instance 5bf291a9-4160-4710-97ef-4067a3e5bf59 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:20.255220 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4aa2c84b-99c1-4b80-ad54-548fb7c86ad9 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59" status: 404 len: 111 microversion: 2.1 time: 0.104411 Aug 29 15:31:20.262815 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 618/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:20 2022] GET /compute/v2.1/servers/5bf291a9-4160-4710-97ef-4067a3e5bf59 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:20.273242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3807627-5078-4d12-a27a-26ec38c8f159 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.303850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-829030335", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:20.310872 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3807627-5078-4d12-a27a-26ec38c8f159 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/d761291a-8fcd-4df7-b259-78037f58b65f" status: 202 len: 0 microversion: 2.1 time: 0.046096 Aug 29 15:31:20.312550 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 619/1220] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:20 2022] DELETE /compute/v2.1/flavors/d761291a-8fcd-4df7-b259-78037f58b65f => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:20.318431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.319308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:20.327417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.328345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.329086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.330118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.331049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.333241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.388764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] validate_networks() for [('02d6b91d-ff70-478a-b300-a6e9745c6c46', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:20.573706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:20.585774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-961b28a0-0e49-47d0-825d-68fbe4c3c610 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1467 microversion: 2.1 time: 0.271664 Aug 29 15:31:20.587135 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 620/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:20 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:20.606855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fedd136e-2388-429b-848e-dabdada6b6c5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] Calling method '.version_select at 0x7fb0eb6cc160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.674165 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fedd136e-2388-429b-848e-dabdada6b6c5 tempest-VolumesAdminNegativeTest-742541852 tempest-VolumesAdminNegativeTest-742541852-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-826578100" status: 202 len: 0 microversion: 2.1 time: 0.085601 Aug 29 15:31:20.677497 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 621/1222] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-826578100 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:20.698129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d92ebd0-9325-4375-a1ea-980c05c4ebff tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.790939 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d92ebd0-9325-4375-a1ea-980c05c4ebff tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.106327 Aug 29 15:31:20.802987 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 622/1223] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:31:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:20.808383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.809029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:20.822547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.823088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.823692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.824252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.824747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.825179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:21.020127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:21.401337 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8acb549f-3f79-4e4f-832d-d30f7e82f6e4 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1812 microversion: 2.1 time: 0.603774 Aug 29 15:31:21.413044 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 623/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:20 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1812 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:21.423402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1713700799"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:21.433650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:21.457877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:21.458814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:21.459459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:21.460412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:21.461363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:21.462147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:21.868945 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8589537e-dba7-4385-8504-cf9c47770e5e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "POST /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798/action" status: 202 len: 0 microversion: 2.1 time: 0.454278 Aug 29 15:31:21.872437 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 624/1225] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:21 2022] POST /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:31:21.886575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:21.887632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:21.913262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:21.914583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:21.915269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:21.916228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:21.917491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:21.918115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.182897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:22.191581 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c576701f-bfb0-46df-ac53-1ad1c3a2fbaf tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 0.319498 Aug 29 15:31:22.193503 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 625/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:21 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:22.201551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:22.204341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:22.211488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.212374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.213049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.214651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.215341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.216024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.376160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:22.376684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:22.378052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:22.379004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:22.379587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:22.397701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.398787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:22.401766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.402216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.403011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.407554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Old instance type tempest-test_resize_flavor_-1372076352, new instance type m1.heat {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:31:22.409057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.409534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.414983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:22.415401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:22.415870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:22.416266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:22.421858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:22.461088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for project 505ab4f3173b48559a5c25611af86fc7. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:22.475703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for user a675ad19db254271ba12d2812d0732e3 and project 505ab4f3173b48559a5c25611af86fc7. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:22.521226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:22.523456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:22.587344 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aaf70279-e033-4e50-ad12-62a1066b9580 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f/action" status: 202 len: 0 microversion: 2.1 time: 0.392715 Aug 29 15:31:22.589927 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 626/1227] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:22 2022] POST /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:22.595321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:22.596276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:22.617058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.617584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.617940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.618659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.619125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.619544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.658464 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-38eadcf0-ca9d-4560-a41b-2fddc8790c03 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.473680 Aug 29 15:31:22.659127 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 602/1228] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:22.709343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:22.723221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.724406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.724866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.726867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.727404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.728579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.787936 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5e251779-72c3-4b51-9a30-133c3a90059e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.105881 Aug 29 15:31:22.795029 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 603/1229] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:31:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:22.797347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-06d574aa-1911-489f-ae6c-91491d38fc48 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3293d30>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:22.900324 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-06d574aa-1911-489f-ae6c-91491d38fc48 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.110203 Aug 29 15:31:22.916671 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 604/1230] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:22 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:22.923694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:22.924699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:22.954379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.955349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.956925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.958925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.968824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.971333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:23.067875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.076533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:23.083436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.093131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.094401 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03d9ab7e-481b-4c3b-ac7e-cc7b8dd1b1f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.503196 Aug 29 15:31:23.099507 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 627/1231] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:22 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:23.109215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7de36a00-76e3-4d11-b879-95ea95179b73 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:23.109792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7de36a00-76e3-4d11-b879-95ea95179b73 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:23.255133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7de36a00-76e3-4d11-b879-95ea95179b73 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.268806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7de36a00-76e3-4d11-b879-95ea95179b73 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1221 microversion: 2.1 time: 0.167310 Aug 29 15:31:23.272503 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 628/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:23 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1221 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:23.281712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:23.286162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:23.321073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:23.323770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:23.324542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:23.327369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:23.333896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:23.334752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:23.740737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.754943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4d43363-b386-4664-b7bf-b7cfeb424961 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 0.479571 Aug 29 15:31:23.756594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 629/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:23 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:23.765814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1802954853", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:23.874691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] validate_networks() for [('02d6b91d-ff70-478a-b300-a6e9745c6c46', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:24.654088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:24.671182 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed1bf8d2-563e-4970-a774-5ed9951b368b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1538 microversion: 2.1 time: 1.752608 Aug 29 15:31:24.686882 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 605/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:22 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1538 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:24.703323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a2a13e75-9416-4f0c-8b14-b4a116f5728c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3299160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:24.826194 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a2a13e75-9416-4f0c-8b14-b4a116f5728c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.135061 Aug 29 15:31:24.835574 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 606/1235] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:24 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:24.851387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:24.852604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:24.870273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:24.876786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:24.877616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:24.880558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:24.882279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:24.883017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.154793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:26.155993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:26.156664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:26.157585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:26.159161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:26.195640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.196665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.200379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.201319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.205521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.205843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.255200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for project 505ab4f3173b48559a5c25611af86fc7. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:26.287007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for user a675ad19db254271ba12d2812d0732e3 and project 505ab4f3173b48559a5c25611af86fc7. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:26.319101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:26.322346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:26.435589 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70e3e76d-eb4c-4698-90e2-a08997adcb6a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.677297 Aug 29 15:31:26.436257 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 630/1236] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:26.679629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-eed79835-776e-40ff-98c5-d543e0f1eab5 req-e09cd640-8fb0-4253-bbe1-9e29a7e40682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85573cdb-9434-4da4-a11b-89a5780a0493", "name": "network-vif-unplugged", "status": "completed", "tag": "d044e837-eb27-4ad5-81b7-21637633fde4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:26.707134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eed79835-776e-40ff-98c5-d543e0f1eab5 req-e09cd640-8fb0-4253-bbe1-9e29a7e40682 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.707617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eed79835-776e-40ff-98c5-d543e0f1eab5 req-e09cd640-8fb0-4253-bbe1-9e29a7e40682 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.710608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eed79835-776e-40ff-98c5-d543e0f1eab5 req-e09cd640-8fb0-4253-bbe1-9e29a7e40682 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.745685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-eed79835-776e-40ff-98c5-d543e0f1eab5 req-e09cd640-8fb0-4253-bbe1-9e29a7e40682 service nova] Creating event network-vif-unplugged:d044e837-eb27-4ad5-81b7-21637633fde4 for instance 85573cdb-9434-4da4-a11b-89a5780a0493 on n-h1-854882-3 Aug 29 15:31:26.781721 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-eed79835-776e-40ff-98c5-d543e0f1eab5 req-e09cd640-8fb0-4253-bbe1-9e29a7e40682 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.332163 Aug 29 15:31:26.790299 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 631/1237] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:26.805467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:26.806190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:26.837333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.840776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.842010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.842871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.843342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.843784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.900039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:26.924690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:26.935452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:26.946213 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-caaf01af-3b82-4c07-b8a3-23ecf9b021c2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 2.108253 Aug 29 15:31:26.949711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 607/1238] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:24 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:26.964989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:26.965649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:26.986750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.997797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.998299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.999061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.999588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:27.000009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:27.852188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:27.880572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-499c2e2e-c487-4d59-beb9-dc6bec067d45 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 1.087352 Aug 29 15:31:27.883294 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 632/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:26 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:27.909280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b7e06ad2-e8a8-403b-832e-854ed2d2f5f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb6ccc10>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:28.035821 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b7e06ad2-e8a8-403b-832e-854ed2d2f5f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.150682 Aug 29 15:31:28.039179 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 633/1240] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:27 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:28.060079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:28.062840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:28.083766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.090101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.090884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.091896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.092571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.093220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.218157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:28.230787 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-589bf0a9-653f-4798-8401-c87396b6d8d0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1274 microversion: 2.1 time: 0.190402 Aug 29 15:31:28.234616 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 634/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:28 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:28.260104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-41fa5968-db80-42ae-8570-d041096a7d78 req-4e12dcae-70f3-4f5f-a9ad-490d802bedf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abac90d5-f283-4965-94d1-ad1161fc35f2", "tag": "3d81b31e-8b83-4722-865b-fd57d6fa7cfb"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:28.299933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-41fa5968-db80-42ae-8570-d041096a7d78 req-4e12dcae-70f3-4f5f-a9ad-490d802bedf6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.307416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-41fa5968-db80-42ae-8570-d041096a7d78 req-4e12dcae-70f3-4f5f-a9ad-490d802bedf6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.308410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-41fa5968-db80-42ae-8570-d041096a7d78 req-4e12dcae-70f3-4f5f-a9ad-490d802bedf6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.344110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:28.363452 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-41fa5968-db80-42ae-8570-d041096a7d78 req-4e12dcae-70f3-4f5f-a9ad-490d802bedf6 service nova] Creating event network-changed:3d81b31e-8b83-4722-865b-fd57d6fa7cfb for instance abac90d5-f283-4965-94d1-ad1161fc35f2 on n-h1-854882-3 Aug 29 15:31:28.374486 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5abbc5ba-e247-4715-ba70-324d579eba04 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1538 microversion: 2.1 time: 1.418553 Aug 29 15:31:28.375519 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 608/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:26 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1538 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:28.378587 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-41fa5968-db80-42ae-8570-d041096a7d78 req-4e12dcae-70f3-4f5f-a9ad-490d802bedf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127088 Aug 29 15:31:28.384363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 635/1243] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:28.388335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7b0886e-04e1-4772-b3ea-5d4728090c4b", "device": "/dev/xvdb"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:28.393062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:28.394691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:28.395405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:28.399964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.400509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.413190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.414058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.414578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.415033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.442871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.444032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.444032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.444501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.444954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.445405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:29.127710 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be101a3a-e6b3-4fa2-bcf1-4298a7cfd3be tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "POST /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748697 Aug 29 15:31:29.128726 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 609/1244] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:31:28 2022] POST /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:29.139579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-97d3e9d6-17b6-464d-98a6-3d8019918514 req-bad2dfac-1220-4ef9-b4f8-9920acf78dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732c70a7-f3ed-4ea1-93f1-4c8dc6557798", "name": "network-vif-plugged", "status": "completed", "tag": "542008f2-a595-47a6-9079-28073e7e45d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:29.163894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97d3e9d6-17b6-464d-98a6-3d8019918514 req-bad2dfac-1220-4ef9-b4f8-9920acf78dc4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:29.175558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97d3e9d6-17b6-464d-98a6-3d8019918514 req-bad2dfac-1220-4ef9-b4f8-9920acf78dc4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:29.176771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97d3e9d6-17b6-464d-98a6-3d8019918514 req-bad2dfac-1220-4ef9-b4f8-9920acf78dc4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:29.210126 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-97d3e9d6-17b6-464d-98a6-3d8019918514 req-bad2dfac-1220-4ef9-b4f8-9920acf78dc4 service nova] Creating event network-vif-plugged:542008f2-a595-47a6-9079-28073e7e45d3 for instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 on n-h2-854882-3 Aug 29 15:31:29.222075 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-97d3e9d6-17b6-464d-98a6-3d8019918514 req-bad2dfac-1220-4ef9-b4f8-9920acf78dc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091152 Aug 29 15:31:29.225227 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 610/1245] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:29.238295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:29.239644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:29.255844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:29.258303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:29.259436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:29.262864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:29.263523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:29.265604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.392782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:30.403704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:30.420737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:30.432566 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86819f25-f386-45d2-a318-2c43e31b72de tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 2.038945 Aug 29 15:31:30.459134 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 636/1246] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:28 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:30.465836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e0635dcf-b566-436a-b5b7-8bc8e4eaa445 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb5a3430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.504739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:30.517051 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-93fcee95-62ac-4848-91d1-ba96eec6515a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 1.284492 Aug 29 15:31:30.518593 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 611/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:29 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:30.541804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.542679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.566997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.567700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.568245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.570234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.571481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.574541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.587532 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e0635dcf-b566-436a-b5b7-8bc8e4eaa445 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.126818 Aug 29 15:31:30.589464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 637/1248] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:30 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:30.678341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0dcde185-1619-4be1-8725-927027fa3fe4 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Action: 'create', calling method: .version_select at 0x7fb0e35344c0>, body: {"keypair": {"name": "tempest-keypair-936522922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXgmY/r2+arBtwUR0iLRCxNtw9nLC4Bv3i/LlBQD0KWDqDaYvRUj2491fplkHAg9niWLsYqoCSzw/c8yFps1jOLPif6cRt6Thnax8u78le3E6NAG4PmaNQWBPHx0FDjDQ=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:30.725662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0dcde185-1619-4be1-8725-927027fa3fe4 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Getting quotas for project 2a4920bc88bc467c9c5eb64032ba0c58. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:30.739191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0dcde185-1619-4be1-8725-927027fa3fe4 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Getting quotas for user 783eb573b9464ca2a9dc618d07caa679 and project 2a4920bc88bc467c9c5eb64032ba0c58. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:30.774394 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0dcde185-1619-4be1-8725-927027fa3fe4 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183351 Aug 29 15:31:30.776287 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 638/1249] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:31:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:30.787837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.791918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.792753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:30.806631 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ccc35da3-308e-4b53-9b1c-747f2461242b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1280 microversion: 2.1 time: 0.276614 Aug 29 15:31:30.808043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.808541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.808976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.809738 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 612/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:30 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:30.827149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.827652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.828100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.465691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:31.467626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:31.482590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.484140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.485753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.487866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.490365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.491896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.742828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:31.758081 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca42eaeb-2b55-4f56-be67-a66d6b8bf217 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 0.975580 Aug 29 15:31:31.762082 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 639/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:30 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:31.785482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:31.786127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:31.808817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.809787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.810236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.812301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.812768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.813198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.095858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.106512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.120030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.122803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-347b02bd-60b1-4679-adc9-f642c08fcec5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.662686 Aug 29 15:31:32.124052 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 613/1252] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:31 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:32.129180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ac1fb55-9dce-4e1e-9415-87dddaed20b5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32683a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:32.275935 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ac1fb55-9dce-4e1e-9415-87dddaed20b5 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.150332 Aug 29 15:31:32.276511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 614/1253] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:32 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:32.305250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:32.305953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:32.334263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.339119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.342480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.346248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.349430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.353142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.494056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=14 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:32.508362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.516342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:32.524377 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e84d30a0-d670-4442-a14b-e86262173ce3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1280 microversion: 2.1 time: 0.238490 Aug 29 15:31:32.554953 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 615/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:32 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:32.560116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2401f508-6e08-4253-9a6c-07ff7a6c55a8 req-941387a4-cecb-454a-b82a-6082c0034e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4", "tag": "36e84c6f-e1ee-42d7-8b5e-71c53794e0ba"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:32.575227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2401f508-6e08-4253-9a6c-07ff7a6c55a8 req-941387a4-cecb-454a-b82a-6082c0034e68 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.576102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2401f508-6e08-4253-9a6c-07ff7a6c55a8 req-941387a4-cecb-454a-b82a-6082c0034e68 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.576734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2401f508-6e08-4253-9a6c-07ff7a6c55a8 req-941387a4-cecb-454a-b82a-6082c0034e68 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.594947 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2401f508-6e08-4253-9a6c-07ff7a6c55a8 req-941387a4-cecb-454a-b82a-6082c0034e68 service nova] Creating event network-changed:36e84c6f-e1ee-42d7-8b5e-71c53794e0ba for instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 on n-h1-854882-3 Aug 29 15:31:32.600660 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2401f508-6e08-4253-9a6c-07ff7a6c55a8 req-941387a4-cecb-454a-b82a-6082c0034e68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044070 Aug 29 15:31:32.602878 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 616/1255] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:32.636374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.646718 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12c96dc9-d11a-4996-9658-5a88b3061066 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 0.883464 Aug 29 15:31:32.648552 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 640/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:31 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:32.782825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:32.783791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:32.786258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:32.813514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.814255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.815593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.816798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.821678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.823708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.151691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:33.152310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:33.164661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:33.172559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.181366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.184021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.185036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.185661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.187125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.767668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:33.784185 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7500efad-c16d-47ea-8763-a7e0352597d1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 1.007055 Aug 29 15:31:33.786133 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 617/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:32 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:33.812300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de774c20-9514-4b23-9671-86a2ad1f5a0c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32c2790>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:33.952569 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-de774c20-9514-4b23-9671-86a2ad1f5a0c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.163854 Aug 29 15:31:33.954601 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 618/1258] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:33 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:33.962199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:33.965128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:33.972392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.973328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.974167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.975488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.978445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.980535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.087472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:34.102427 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb102db4-7d36-48ea-8435-4c6ff5a994dd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1280 microversion: 2.1 time: 0.145589 Aug 29 15:31:34.104762 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 619/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:33 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:34.114995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:34.115905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:34.116536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:34.123585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:34.138584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.138811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:34.140283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:34.141564 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6a67e4f1-c913-459f-aa6c-d08993966188 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.993772 Aug 29 15:31:34.143688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.144869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.145656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.146323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.146908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.148526 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 641/1260] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:33 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:34.642774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:34.651984 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-017fa826-4ed1-4938-b4a9-3e9ec25e14d5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 0.545846 Aug 29 15:31:34.690484 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 620/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:34 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:34.811064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:34.811807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:34.840654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.857715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.860039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.862135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.875142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.876173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.895893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-6153427f-b4f7-447d-988f-95cb88858449 req-4d3232c6-ab05-4f3c-8093-87fb03ca2288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abac90d5-f283-4965-94d1-ad1161fc35f2", "name": "network-vif-plugged", "status": "completed", "tag": "3d81b31e-8b83-4722-865b-fd57d6fa7cfb"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:34.929703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6153427f-b4f7-447d-988f-95cb88858449 req-4d3232c6-ab05-4f3c-8093-87fb03ca2288 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.929916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6153427f-b4f7-447d-988f-95cb88858449 req-4d3232c6-ab05-4f3c-8093-87fb03ca2288 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.931002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6153427f-b4f7-447d-988f-95cb88858449 req-4d3232c6-ab05-4f3c-8093-87fb03ca2288 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.977684 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6153427f-b4f7-447d-988f-95cb88858449 req-4d3232c6-ab05-4f3c-8093-87fb03ca2288 service nova] Creating event network-vif-plugged:3d81b31e-8b83-4722-865b-fd57d6fa7cfb for instance abac90d5-f283-4965-94d1-ad1161fc35f2 on n-h1-854882-3 Aug 29 15:31:34.987459 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-6153427f-b4f7-447d-988f-95cb88858449 req-4d3232c6-ab05-4f3c-8093-87fb03ca2288 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096234 Aug 29 15:31:34.990772 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 621/1262] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:35.008771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-392e2b1c-0743-42df-8ae0-a03b690af792 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32685e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:35.158932 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-392e2b1c-0743-42df-8ae0-a03b690af792 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.166607 Aug 29 15:31:35.160258 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 622/1263] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:34 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:35.165759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:35.167813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:35.174977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.175871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.176549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.177884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.178614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.179261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.331443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:35.346462 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d164c030-376c-486f-89f5-3e7a1b451940 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1280 microversion: 2.1 time: 0.184784 Aug 29 15:31:35.347852 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 623/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:35 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:35.370138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:35.371165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:35.377936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.382099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.383509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.384536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.385795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.386512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.046740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:36.067059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:36.075996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:36.077359 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8e43acc-da95-4c52-8086-0c0bce3f7df5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.711111 Aug 29 15:31:36.077992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 624/1265] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:35 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:36.099515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:36.100417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:36.108471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.109151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.109792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.110701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.111331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.111765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.218833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:37.096962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.106443 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-37e75eb8-963c-4d5d-8df9-2f54f40be377 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 1.010805 Aug 29 15:31:37.110742 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 625/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:36 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:37.121416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b08d874-8bd8-4ed5-8f5b-41e92552b417 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3244040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:37.193299 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b08d874-8bd8-4ed5-8f5b-41e92552b417 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.077845 Aug 29 15:31:37.203949 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 626/1267] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:37 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:37.223612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:37.228420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:37.251961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.252943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.254226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.256117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.256818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.257887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.441804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.450660 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9e2197e-8ffc-4797-971d-66900c54b945 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 2.646031 Aug 29 15:31:37.451254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 642/1268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:34 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 2647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:37.472605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:37.473235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:37.514926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.515592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.521958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.522824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.523307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.529514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.692286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.702372 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-840cb82f-51cb-4512-8aec-d2baa9549517 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 0.495609 Aug 29 15:31:37.718692 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 627/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:37 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:38.131568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.132206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.141748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.142313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.145588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.152877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.153724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.154510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.367584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.379848 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9993e7c-4db3-4258-bd91-023eb93f64b6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1320 microversion: 2.1 time: 0.252905 Aug 29 15:31:38.382025 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 628/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:38.387774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5145a2a5-8bc8-4346-a524-f83705df1e8b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32c2550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.428807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.448727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.453032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.457521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13bdc9b2-2598-4f2f-ac2e-5243aedb4bcb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 1.005176 Aug 29 15:31:38.518196 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 643/1271] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:37 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:38.532830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.543860 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5145a2a5-8bc8-4346-a524-f83705df1e8b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.139109 Aug 29 15:31:38.547803 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 629/1272] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:38.551075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.577884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.578565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.580175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.601566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ff4f2e75-135b-4432-98ad-a6e2676c83eb req-8a1beb64-ce53-4020-bf4e-25e317dddc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704fa114-40c8-4d26-bd16-838f3a8dcb5f", "name": "network-vif-unplugged", "status": "completed", "tag": "082f5e62-9263-4994-b619-d36cc2fcb932"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:38.609468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.612192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.616432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.655151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ff4f2e75-135b-4432-98ad-a6e2676c83eb req-8a1beb64-ce53-4020-bf4e-25e317dddc6b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.656005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ff4f2e75-135b-4432-98ad-a6e2676c83eb req-8a1beb64-ce53-4020-bf4e-25e317dddc6b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.658823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ff4f2e75-135b-4432-98ad-a6e2676c83eb req-8a1beb64-ce53-4020-bf4e-25e317dddc6b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.696603 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ff4f2e75-135b-4432-98ad-a6e2676c83eb req-8a1beb64-ce53-4020-bf4e-25e317dddc6b service nova] Creating event network-vif-unplugged:082f5e62-9263-4994-b619-d36cc2fcb932 for instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f on n-h1-854882-3 Aug 29 15:31:38.734301 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ff4f2e75-135b-4432-98ad-a6e2676c83eb req-8a1beb64-ce53-4020-bf4e-25e317dddc6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148627 Aug 29 15:31:38.743968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 630/1273] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:38.757291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.758742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.779135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.784155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.785209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.794916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.801220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.802801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.721189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.738460 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8ba0ef7-0b22-4851-a766-494ad6756e10 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 1.215298 Aug 29 15:31:39.739639 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 644/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:39.772838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.778491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.813043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.813653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.814130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.826373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.834195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.836821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.972936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.005283 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac58bac6-085e-4514-abdf-cf96db0fad5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 1.259534 Aug 29 15:31:40.011252 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 631/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:40.032263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2046457a-4694-4de7-9f40-36213b52bc16 req-ea4935a4-97b5-4102-ba49-b928243f8e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4", "name": "network-vif-plugged", "status": "completed", "tag": "36e84c6f-e1ee-42d7-8b5e-71c53794e0ba"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:40.087023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2046457a-4694-4de7-9f40-36213b52bc16 req-ea4935a4-97b5-4102-ba49-b928243f8e4b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.088551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2046457a-4694-4de7-9f40-36213b52bc16 req-ea4935a4-97b5-4102-ba49-b928243f8e4b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.089722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2046457a-4694-4de7-9f40-36213b52bc16 req-ea4935a4-97b5-4102-ba49-b928243f8e4b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.179397 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2046457a-4694-4de7-9f40-36213b52bc16 req-ea4935a4-97b5-4102-ba49-b928243f8e4b service nova] Creating event network-vif-plugged:36e84c6f-e1ee-42d7-8b5e-71c53794e0ba for instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 on n-h1-854882-3 Aug 29 15:31:40.228908 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2046457a-4694-4de7-9f40-36213b52bc16 req-ea4935a4-97b5-4102-ba49-b928243f8e4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208941 Aug 29 15:31:40.234540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 632/1276] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:40.249247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:40.250720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:40.261924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.265101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.266226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.267608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.268719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.269743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.747527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:40.779323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.790865 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d38b879-4e88-4d57-ba59-33c080cd4eca tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1470 microversion: 2.1 time: 1.048176 Aug 29 15:31:40.798160 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 645/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1470 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:40.803126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08818503-c498-463e-80c4-053a2b21ae1a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb5b7280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:40.874653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.889432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.891901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.895384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c798a41-0771-4e83-a8f5-095d123c0410 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.656659 Aug 29 15:31:40.898052 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 633/1278] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:40 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:40.901531 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08818503-c498-463e-80c4-053a2b21ae1a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.102049 Aug 29 15:31:40.902581 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 646/1279] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:40 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:40.915990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:40.918046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:40.935611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.936405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.938281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.941947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.942567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.943348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.058469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.058975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.078969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.079474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.079915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.080636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.081094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.081570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.125118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:31:41.253198 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc1d6e63-c7ad-4612-8d35-e06a632dca61 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 204 len: 0 microversion: 2.1 time: 0.349080 Aug 29 15:31:41.254465 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 647/1280] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:40 2022] DELETE /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:31:41.260665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-101c885f-07ba-4101-be29-670a4a1b6694 req-dfd67331-bd85-4419-83f4-037c4e7bb923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704fa114-40c8-4d26-bd16-838f3a8dcb5f", "tag": "082f5e62-9263-4994-b619-d36cc2fcb932"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:41.288363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-101c885f-07ba-4101-be29-670a4a1b6694 req-dfd67331-bd85-4419-83f4-037c4e7bb923 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.288963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-101c885f-07ba-4101-be29-670a4a1b6694 req-dfd67331-bd85-4419-83f4-037c4e7bb923 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.289581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-101c885f-07ba-4101-be29-670a4a1b6694 req-dfd67331-bd85-4419-83f4-037c4e7bb923 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.310444 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-101c885f-07ba-4101-be29-670a4a1b6694 req-dfd67331-bd85-4419-83f4-037c4e7bb923 service nova] Creating event network-changed:082f5e62-9263-4994-b619-d36cc2fcb932 for instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f on n-h1-854882-3 Aug 29 15:31:41.320658 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-101c885f-07ba-4101-be29-670a4a1b6694 req-dfd67331-bd85-4419-83f4-037c4e7bb923 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062816 Aug 29 15:31:41.322796 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 648/1281] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:41.336598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.339004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.353502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.354880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.356900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.358826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.361212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.361851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.751760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.766807 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d79ba613-392d-402f-93f5-76f46fdb0b35 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 0.862137 Aug 29 15:31:41.768228 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 634/1282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:40 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:41.778632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.781463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.793153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.801549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.802283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.803191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.803974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.804567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.959136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.968232 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-62c685ae-b1c2-41fb-9169-ec99eddf8e83 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 0.641774 Aug 29 15:31:41.970588 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 649/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:41.976000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-955634603", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4b6a38d0-0be1-4655-b57e-2857055a1aef"}], "security_groups": [{"name": "tempest-securitygroup--1592256212"}], "key_name": "tempest-keypair-936522922", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:42.005778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:42.013997 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-de03ff8b-b1ff-4c92-8d96-d5b986843c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1476 microversion: 2.1 time: 0.243488 Aug 29 15:31:42.014590 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 635/1284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:42.023090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-050c747d-5130-49b9-8ddd-5ff95936578b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3268670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:42.106477 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-050c747d-5130-49b9-8ddd-5ff95936578b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.087221 Aug 29 15:31:42.107149 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 636/1285] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:42 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:42.111990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:42.112826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:42.120213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.121045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.121584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.122533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.123528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.124038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.206022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] validate_networks() for [('4b6a38d0-0be1-4655-b57e-2857055a1aef', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:42.378991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:42.391166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:42.392877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:42.398461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-188ace6f-78f6-4fe7-a503-f47e337b23b4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.289656 Aug 29 15:31:42.399408 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 637/1286] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:42 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:42.787775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:42.788394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:42.802557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.802997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.809604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.810503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.810991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.811455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.047791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:43.056336 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2279b4c0-c182-45dd-9aec-d81b3f2f1655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 0.272295 Aug 29 15:31:43.065027 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 638/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:42 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:43.070247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.071003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.080287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.080821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.081272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.082041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.082503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.083043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.269353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:43.280201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-313a7a1f-c445-43ec-b99c-61316b46390c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 0.212833 Aug 29 15:31:43.290099 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 639/1288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:43.315992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.315992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.335713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.336265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.336770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.337654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.338662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.340805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.347863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:43.441043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Getting quotas for project 2a4920bc88bc467c9c5eb64032ba0c58. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:43.455318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Getting quotas for user 783eb573b9464ca2a9dc618d07caa679 and project 2a4920bc88bc467c9c5eb64032ba0c58. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:43.471229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:43.471757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:43.472405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:43.472920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:43.474622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:43.485061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.485612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.486204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.487117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.487395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.487823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.514176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Getting quotas for project 2a4920bc88bc467c9c5eb64032ba0c58. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:43.520149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Getting quotas for user 783eb573b9464ca2a9dc618d07caa679 and project 2a4920bc88bc467c9c5eb64032ba0c58. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:43.539052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:43.541785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:43.627283 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1453f308-b4df-4cf5-a9b1-77ba188d55cb tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.654229 Aug 29 15:31:43.631584 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 650/1289] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:43.644855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef0484a8-1639-4cc9-9a1b-1a48713b5d04 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb5f8670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.703723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:43.722934 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08e44ae0-6271-4815-a17f-acb4af76b2d6 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1476 microversion: 2.1 time: 0.431559 Aug 29 15:31:43.724156 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 640/1290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:43.740579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-162bdce1-f7d9-434a-ad32-13a5fa92f1b6 req-2933e270-e479-4d7a-8862-b8d16b3a86ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80404306-3d1e-4411-a8e8-b7d2ae05d982", "tag": "ca2fc60d-9008-40e4-b525-a958f71c63da"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:43.764058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-162bdce1-f7d9-434a-ad32-13a5fa92f1b6 req-2933e270-e479-4d7a-8862-b8d16b3a86ff service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.767906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-162bdce1-f7d9-434a-ad32-13a5fa92f1b6 req-2933e270-e479-4d7a-8862-b8d16b3a86ff service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.768351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-162bdce1-f7d9-434a-ad32-13a5fa92f1b6 req-2933e270-e479-4d7a-8862-b8d16b3a86ff service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.786408 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef0484a8-1639-4cc9-9a1b-1a48713b5d04 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.152198 Aug 29 15:31:43.788114 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 651/1291] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:43.794331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.795288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.798171 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-162bdce1-f7d9-434a-ad32-13a5fa92f1b6 req-2933e270-e479-4d7a-8862-b8d16b3a86ff service nova] Creating event network-changed:ca2fc60d-9008-40e4-b525-a958f71c63da for instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 on n-h2-854882-3 Aug 29 15:31:43.805066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.805862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.806554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.808146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.808777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.809618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.811688 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-162bdce1-f7d9-434a-ad32-13a5fa92f1b6 req-2933e270-e479-4d7a-8862-b8d16b3a86ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085954 Aug 29 15:31:43.815799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:43.817940 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 641/1292] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:43.825187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d31301bb-c8b1-45c5-9d8c-629e23f8e26f tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.832213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d31301bb-c8b1-45c5-9d8c-629e23f8e26f tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.086374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d31301bb-c8b1-45c5-9d8c-629e23f8e26f tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.095904 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d31301bb-c8b1-45c5-9d8c-629e23f8e26f tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1276 microversion: 2.1 time: 0.276392 Aug 29 15:31:44.112293 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 642/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:44.128050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:44.128940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.134675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.139324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.143403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.144346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.144577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.145209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.145870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.153475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.155119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.156361 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4fca30c9-e7eb-4349-9206-4c88f7a32de0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.366873 Aug 29 15:31:44.161858 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 652/1294] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:44.313714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:44.315643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.341941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.349078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.350065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.351104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.351813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.352502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.604201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.619662 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-587734af-7764-41a8-a427-f899f7acf6b2 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 0.501425 Aug 29 15:31:44.620824 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 643/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:44.745829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:44.746595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.756971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.774838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.776196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.777077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.777672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.781438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.929110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.947520 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1a0da7b-df38-4b38-8c42-4673f0472bcd tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1434 microversion: 2.1 time: 0.207075 Aug 29 15:31:44.948729 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 644/1296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1434 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:44.957557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-060fc58a-a53d-4b0d-843c-d30cbb098e32 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32d1550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.083094 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-060fc58a-a53d-4b0d-843c-d30cbb098e32 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.132486 Aug 29 15:31:45.091579 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 645/1297] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:45.228103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-15431b9d-7693-4885-a9de-566fae5860aa req-8e58df40-12f6-465e-bb02-906ffba939ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abac90d5-f283-4965-94d1-ad1161fc35f2", "name": "network-vif-deleted", "tag": "3d81b31e-8b83-4722-865b-fd57d6fa7cfb"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:45.259680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-15431b9d-7693-4885-a9de-566fae5860aa req-8e58df40-12f6-465e-bb02-906ffba939ea service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.261490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-15431b9d-7693-4885-a9de-566fae5860aa req-8e58df40-12f6-465e-bb02-906ffba939ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.262395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-15431b9d-7693-4885-a9de-566fae5860aa req-8e58df40-12f6-465e-bb02-906ffba939ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.277820 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-15431b9d-7693-4885-a9de-566fae5860aa req-8e58df40-12f6-465e-bb02-906ffba939ea service nova] Creating event network-vif-deleted:3d81b31e-8b83-4722-865b-fd57d6fa7cfb for instance abac90d5-f283-4965-94d1-ad1161fc35f2 on n-h1-854882-3 Aug 29 15:31:45.286106 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-15431b9d-7693-4885-a9de-566fae5860aa req-8e58df40-12f6-465e-bb02-906ffba939ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178807 Aug 29 15:31:45.287573 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 646/1298] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:45.297701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.299173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.308919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.309965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.310761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.311708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.312584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.313205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.390137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.399117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6706280e-bbbb-4d34-95c9-98f99c44f0cd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 1.098476 Aug 29 15:31:45.404642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.405550 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 653/1299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:45.413078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.414243 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3d38620-465f-43c0-b9d0-0887d9a5c075 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1328 microversion: 2.1 time: 0.125017 Aug 29 15:31:45.421821 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 647/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:45.424455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.434514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.439710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.440382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.441335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.442098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.442760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.642071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.642820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.662103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.662870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.663742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.665099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.665782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.666588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.828773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.841368 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7371ca32-0338-4e5e-afa7-c04e08013b32 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 0.204623 Aug 29 15:31:45.842694 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 648/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:45.870529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.879668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.884046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.888617 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef466f9a-ac1f-41da-9556-1fd9b4708598 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.481770 Aug 29 15:31:45.891409 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 654/1302] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:45.971707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.973232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.982231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.983691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.985857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.987038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.987865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.988674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.052136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.052772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.053648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.054113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lazy-loading 'fault' on Instance uuid abac90d5-f283-4965-94d1-ad1161fc35f2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:46.099303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c0843e87-2b32-4ea8-8a63-75763ed30d78 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb702700>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:46.191950 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c0843e87-2b32-4ea8-8a63-75763ed30d78 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.097952 Aug 29 15:31:46.203285 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 655/1303] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:46 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:46.354203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:46.366270 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9e6feb4-fe26-4d66-ba45-b2de92175c77 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 200 len: 1310 microversion: 2.1 time: 0.398500 Aug 29 15:31:46.367789 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 649/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 1310 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:46.446870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:46.447900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:46.448578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:46.450720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:46.482668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.483176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.483621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.485140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.486286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.486998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.487529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.488836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.489976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.490110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.490478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.491476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.057081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.068321 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f02859ce-de5c-4a36-a475-c1ddf354f67a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 0.648474 Aug 29 15:31:47.081236 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 656/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:46 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:47.081236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.081236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.096983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.097512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.097942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.098780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.099355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.099679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.115127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.134125 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bf7a719-c977-4ff3-b152-56a79bb49095 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1334 microversion: 2.1 time: 0.700958 Aug 29 15:31:47.134771 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 650/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:46 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1334 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:47.152783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.153313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.169517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.170014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.170454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.171404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.171665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.172089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.281878 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-45ee53b5-6a3b-48a3-997e-88f848998174 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1858 microversion: 2.1 time: 0.210998 Aug 29 15:31:47.285946 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 657/1307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1858 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:47.294344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.295337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.305338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.306141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.311357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.317791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.319682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.320317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.510563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.524571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.527062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.528352 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ede1528e-6840-45f4-96b0-6ec8f57663c6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.240878 Aug 29 15:31:47.528939 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 658/1308] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:47.538530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a5c88644-e903-4afe-a02a-a5179a32eeb8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb5b75e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.599486 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a5c88644-e903-4afe-a02a-a5179a32eeb8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.069147 Aug 29 15:31:47.600715 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 659/1309] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:47.608214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.616337 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-35a76f32-fdd0-454a-acc6-3ffa69b39d77 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 0.467592 Aug 29 15:31:47.617202 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 651/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:47.622707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854882-3", "block_migration": true, "disk_over_commit": false}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:47.625625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.626075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.626696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.643083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.646765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.647892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.650121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.651720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.654148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.655030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.655569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.656226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.660102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.660710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.661763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.698413 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] HTTP exception thrown: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Request method failure captured: Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 HTTP/1.1 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNu7O0e3ikIqNrDM7vPAGQqVsavIm_gI9a0BDhaxDK9XCW9DValyf2F4UrNoVATmMhaId8FUm5aJKfZfsmJ02OMut4bTUhuCeGVL82SFmB4Aa7aJtygDhBskdw9hXAcLYQ91GMhuP61sm-Yg3zUJXXYVid0Bz-saPCFVS9pmnjWL-h0 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce5236a48a4d4aa9800ca11f08fb7b8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}] Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a74e72e4a61e4938b54dbb1e51db99dc Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'abac90d5-f283-4965-94d1-ad1161fc35f2'} Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.700378 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:31:47.706116 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.713314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Returning 404 to user: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:47.714556 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0ba0eb9-a291-482f-81cb-a3e140f6b793 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 404 len: 111 microversion: 2.1 time: 0.092380 Aug 29 15:31:47.716591 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 652/1311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:47.717053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lazy-loading 'flavor' on Instance uuid 784f3eba-97c4-48b4-aa04-db77584cbee7 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:47.733423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Going to try to live migrate instance to n-h1-854882-3 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:31:47.803689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1384432060", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:47.900033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:48.460892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:48.461544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:48.461706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:48.462318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:48.466006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:48.488351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.490130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.490815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.492404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.493071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.493689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.533427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Getting quotas for project ce5236a48a4d4aa9800ca11f08fb7b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:48.547983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Getting quotas for user a74e72e4a61e4938b54dbb1e51db99dc and project ce5236a48a4d4aa9800ca11f08fb7b8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:48.582401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:48.590252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:48.700825 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3456eed3-252d-4f02-ad62-276424f98fae tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901728 Aug 29 15:31:48.702304 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 653/1312] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:48.707546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:48.708592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:48.725026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.725868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.726503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.727436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.728055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.743829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.276959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:49.286185 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2079ab9-a236-4ff4-b0be-f96cd20a54d7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 0.582292 Aug 29 15:31:49.299234 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 654/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:48 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:49.306398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:49.307962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:49.351658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.360029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.361165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.365263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.366798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.367058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.146301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-53854d02-818c-466e-8d44-bf767693d11e tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/action" status: 202 len: 0 microversion: 2.1 time: 2.534960 Aug 29 15:31:50.147338 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 660/1314] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:47 2022] POST /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/action => generated 0 bytes in 2538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:50.155045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:50.156039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:50.168705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.168705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.169090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.182118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.183089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.187029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.414855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.434279 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03394bfd-62e1-436e-832b-6d799bc543db tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 1.133808 Aug 29 15:31:50.437458 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 655/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:49 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:50.450417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b997080-7549-4b55-a7b0-27d53c807a07 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e320a5e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:50.548460 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b997080-7549-4b55-a7b0-27d53c807a07 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1453 microversion: 2.1 time: 0.109401 Aug 29 15:31:50.555659 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 656/1316] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:50 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:50.561199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:50.561969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:50.574653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.575148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.578881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.580657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.581202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.582996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.680556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.696155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.698389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.703792 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85a45f5a-2888-4cff-b13f-892064267f1a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.555252 Aug 29 15:31:50.704922 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 661/1317] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:50 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:50.718761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:50.719729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:50.735674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.738137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.738920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.742732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.743457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.744655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.950014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.959199 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92b17981-b737-43bd-9ec5-41574d6218c9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1272 microversion: 2.1 time: 0.249700 Aug 29 15:31:50.987652 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 662/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:50 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:50.993208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:50.994251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:50.994921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.008918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.010647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.010887 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1952ceb2-3953-4d3a-8887-1c132c889839 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1543 microversion: 2.1 time: 0.460176 Aug 29 15:31:51.011448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.021221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.022243 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 657/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:50 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1543 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:51.022632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.023885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.049194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:51.053491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:51.078225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.078726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.082951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.084898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.086671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.087127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.404767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.420218 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0b3130cb-f19a-416d-af40-81f20d6a0993 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 0.396618 Aug 29 15:31:51.437300 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 658/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:51 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:51.437300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-52125c54-0421-4c09-80ae-cffb9ed5a473 req-551fa23d-15dd-4234-9916-27b83b17dac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80404306-3d1e-4411-a8e8-b7d2ae05d982", "name": "network-vif-plugged", "status": "completed", "tag": "ca2fc60d-9008-40e4-b525-a958f71c63da"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:51.456350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-52125c54-0421-4c09-80ae-cffb9ed5a473 req-551fa23d-15dd-4234-9916-27b83b17dac2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.461695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-52125c54-0421-4c09-80ae-cffb9ed5a473 req-551fa23d-15dd-4234-9916-27b83b17dac2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.462373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-52125c54-0421-4c09-80ae-cffb9ed5a473 req-551fa23d-15dd-4234-9916-27b83b17dac2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.488766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-52125c54-0421-4c09-80ae-cffb9ed5a473 req-551fa23d-15dd-4234-9916-27b83b17dac2 service nova] Creating event network-vif-plugged:ca2fc60d-9008-40e4-b525-a958f71c63da for instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 on n-h2-854882-3 Aug 29 15:31:51.506630 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-52125c54-0421-4c09-80ae-cffb9ed5a473 req-551fa23d-15dd-4234-9916-27b83b17dac2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079285 Aug 29 15:31:51.511884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 659/1321] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:51.522921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:51.525311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:51.547819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.548825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.550260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.552370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.554068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.554968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.336222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:52.349243 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-05574f79-e6c3-49a1-9a8d-8e28bd1a2847 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 1.360034 Aug 29 15:31:52.349880 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 663/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:50 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:52.362461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14b316f1-b86f-4e26-918b-cc0b30ef0856 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb5d2c10>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:52.448960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14b316f1-b86f-4e26-918b-cc0b30ef0856 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1462 microversion: 2.1 time: 0.090733 Aug 29 15:31:52.449663 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 664/1323] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:52.462180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:52.462948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:52.481553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.482446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.483147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.484147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.484828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.485516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.684683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:52.695222 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c5a6229-06ed-4fa6-ae42-821758ad89b8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 1.181784 Aug 29 15:31:52.696097 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 660/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:51 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:52.719793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:52.720409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:52.737216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.738222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.738550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.739291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.739748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.740168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.911403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:52.936786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:52.938266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:52.939463 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6af69762-8551-429f-8a7c-496ee3076843 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.488884 Aug 29 15:31:52.940025 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 665/1325] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:52.961590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:52.962767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:52.974383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.978224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.978950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.979860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.980470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.981061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.027961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:53.044951 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42eae907-5d69-40cf-a452-9fb712d0dc4a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1278 microversion: 2.1 time: 0.334000 Aug 29 15:31:53.057999 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 661/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1278 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:53.064729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:53.065770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:53.073980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.074918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.075637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.076607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.077366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.078196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.362500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:53.376884 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7ad56af1-0e84-4593-802e-06c56c9fe52d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1542 microversion: 2.1 time: 0.429677 Aug 29 15:31:53.379318 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 666/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1542 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:53.386920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9de92c4-556e-4b66-95d5-e6352f2b0f4f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb5f8ee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:53.450573 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9de92c4-556e-4b66-95d5-e6352f2b0f4f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 200 len: 1462 microversion: 2.1 time: 0.069498 Aug 29 15:31:53.453521 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 667/1328] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:53 2022] GET /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 1462 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:53.462610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0aee5d0f-ff3f-4e51-9cb4-fba99ff354dc req-274e4443-df10-45a2-93a6-b508f6044ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf505d1e-e625-4f21-af82-5c21de753b6f", "tag": "959b9852-ee4b-48ea-b575-978517e2c981"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:53.474488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0aee5d0f-ff3f-4e51-9cb4-fba99ff354dc req-274e4443-df10-45a2-93a6-b508f6044ebd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.475345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0aee5d0f-ff3f-4e51-9cb4-fba99ff354dc req-274e4443-df10-45a2-93a6-b508f6044ebd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.475844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0aee5d0f-ff3f-4e51-9cb4-fba99ff354dc req-274e4443-df10-45a2-93a6-b508f6044ebd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.490510 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0aee5d0f-ff3f-4e51-9cb4-fba99ff354dc req-274e4443-df10-45a2-93a6-b508f6044ebd service nova] Creating event network-changed:959b9852-ee4b-48ea-b575-978517e2c981 for instance bf505d1e-e625-4f21-af82-5c21de753b6f on n-h1-854882-3 Aug 29 15:31:53.500575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:53.502550 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0aee5d0f-ff3f-4e51-9cb4-fba99ff354dc req-274e4443-df10-45a2-93a6-b508f6044ebd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049523 Aug 29 15:31:53.511381 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 668/1329] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:53.521903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:53.522826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:53.531552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.532465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.533009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.539601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.540278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.540724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.542258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=10 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:53.739883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:53.758254 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0c13261a-f077-431d-9d1d-3049ed060600 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.239794 Aug 29 15:31:53.759143 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 669/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:53 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:53.768084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:53.771556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:53.782451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.790284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.790762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.792110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.792771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.794851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.990772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.000469 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6df530a-3f8d-46b7-95ee-e100ea370eff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1467 microversion: 2.1 time: 0.240103 Aug 29 15:31:54.001335 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 670/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:53 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1467 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:54.022415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:54.024240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:54.037430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.038378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.039116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.040026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.040566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.041183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.100241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:54.149848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.154441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:54.166633 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4290bba0-1816-4cdc-ba5a-fe592188e4d5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1322 microversion: 2.1 time: 1.107438 Aug 29 15:31:54.168691 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 662/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:53 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1322 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:54.174826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:54.176077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:54.184379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.185193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.185680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.186384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.186895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.187319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.305784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.315123 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6e19777-27c2-4986-870e-aa2a426bb44d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.299439 Aug 29 15:31:54.325423 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 671/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:54 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:54.325423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1209893892"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:54.330438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:54.347659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.349433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.350265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.351100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.351616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.352246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.675068 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40f36a00-9537-4436-9f90-963d98d1e2f8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "POST /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493/action" status: 202 len: 0 microversion: 2.1 time: 0.357673 Aug 29 15:31:54.677613 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 672/1334] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:54 2022] POST /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:31:54.684853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:54.686524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:54.694943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.695695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.708507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.710833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.713475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.714346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.914124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.929019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40833106-1b2b-4ee7-a91a-a06aaddf8d9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.249566 Aug 29 15:31:54.930254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 673/1335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:54 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:54.935634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.951273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.954574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-963473ce-94e1-4ba9-8fce-1e7d4f99955b req-089b53d7-c04b-4319-9c9f-a9a9378e78c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d41c49d-24a1-4830-9a08-1fb803cd476f", "name": "network-vif-unplugged", "status": "completed", "tag": "25b207f6-5f3f-41f4-86cb-19208977ab03"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:54.956734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.963009 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1e795ff9-49c3-411a-9b36-1df09eb43e3c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.792790 Aug 29 15:31:54.976823 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 663/1336] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:54 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:54.997002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-963473ce-94e1-4ba9-8fce-1e7d4f99955b req-089b53d7-c04b-4319-9c9f-a9a9378e78c4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.002474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:55.003543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-963473ce-94e1-4ba9-8fce-1e7d4f99955b req-089b53d7-c04b-4319-9c9f-a9a9378e78c4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.004689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-963473ce-94e1-4ba9-8fce-1e7d4f99955b req-089b53d7-c04b-4319-9c9f-a9a9378e78c4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.005840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:55.022787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.024344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.026065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.027881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.029122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.030364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.046828 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-963473ce-94e1-4ba9-8fce-1e7d4f99955b req-089b53d7-c04b-4319-9c9f-a9a9378e78c4 service nova] Creating event network-vif-unplugged:25b207f6-5f3f-41f4-86cb-19208977ab03 for instance 6d41c49d-24a1-4830-9a08-1fb803cd476f on n-h2-854882-3 Aug 29 15:31:55.060927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-963473ce-94e1-4ba9-8fce-1e7d4f99955b req-089b53d7-c04b-4319-9c9f-a9a9378e78c4 service nova] Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:31:55.081201 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-963473ce-94e1-4ba9-8fce-1e7d4f99955b req-089b53d7-c04b-4319-9c9f-a9a9378e78c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145853 Aug 29 15:31:55.085515 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 674/1337] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:55.091893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c033cc07-c824-4342-b9f2-0b6ec2388fbd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb715700>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:55.146859 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c033cc07-c824-4342-b9f2-0b6ec2388fbd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.059932 Aug 29 15:31:55.157566 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 675/1338] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:55 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:55.162819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:55.163565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:55.171996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.172497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.172943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.173881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.174348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.174777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.382981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:55.393541 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c483d6bf-a1e2-4df9-9140-c58f9568b179 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.234575 Aug 29 15:31:55.405928 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 676/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:55 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:55.415522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:55.417339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:55.424448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.425329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.426042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.427181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.427861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.428572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.779323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:55.797655 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4568d6f6-da81-45b9-b55f-1c497f6268d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1542 microversion: 2.1 time: 0.818959 Aug 29 15:31:55.815075 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 664/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:54 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1542 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:55.821676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:55.824472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:55.831338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.831976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.832618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.835232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.835812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.836568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.990609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.000580 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f6210e9-3fb2-4feb-81fe-ad0748991e46 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1516 microversion: 2.1 time: 0.593469 Aug 29 15:31:56.001171 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 677/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:55 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1516 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:56.005935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:56.006723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:56.014957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.015681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.016274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.017166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.018069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.018612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.172997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.182797 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d8dc09a-8e8c-4cd5-bbd0-63af4aa53725 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.180275 Aug 29 15:31:56.184154 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 678/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:56 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:56.191946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:56.193081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:56.201617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.202307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.202751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.203464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.203920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.204440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.349258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.359173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.360646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.362402 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ad9cba91-df52-45e9-ba1a-a99a59831fff tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.176291 Aug 29 15:31:56.363400 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 679/1343] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:56 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:56.385076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:56.387662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:56.394438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.395308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.395974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.397123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.397835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.398480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.428861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'flavor' on Instance uuid 80404306-3d1e-4411-a8e8-b7d2ae05d982 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:56.434195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.452417 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79ed13c0-3df4-43ab-b80a-430b723c4f78 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.636007 Aug 29 15:31:56.453026 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 665/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:55 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:56.470209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-61d1ee33-091d-4a7c-8990-caa641ab6e87 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32685e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:56.545811 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-61d1ee33-091d-4a7c-8990-caa641ab6e87 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.079441 Aug 29 15:31:56.546400 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 666/1345] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:56 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:56.557320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:56.557320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:56.568250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.569072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.569972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.570941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.571593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.572249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.590753 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4aae3907-755d-4ce6-9c0d-c1c16b31a7b3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action" status: 200 len: 32 microversion: 2.1 time: 0.209461 Aug 29 15:31:56.592077 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 680/1346] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:56 2022] POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action => generated 32 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:31:56.608291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:56.611647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:56.626571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.629536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.630046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.630800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.631269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.631695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.809863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.819477 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c4797c2b-5a70-4e53-a4b0-0e549e43b41b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.220713 Aug 29 15:31:56.833102 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 681/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:56 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:56.839808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:56.840683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:56.846874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:56.848721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.849719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.850334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.851238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:56.851856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:56.852445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.016309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.030646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-165084a5-0e7f-4f8c-8f70-ec6c737e4cbe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1474 microversion: 2.1 time: 0.198337 Aug 29 15:31:57.032503 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 682/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:56 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1474 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:57.098975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7ba6a3a1-6cc9-4d2d-a893-ca53e6d9c5ab req-910fd437-26a3-4a6f-a46c-cd5548ab994b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732c70a7-f3ed-4ea1-93f1-4c8dc6557798", "name": "network-vif-unplugged", "status": "completed", "tag": "542008f2-a595-47a6-9079-28073e7e45d3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:57.110358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7ba6a3a1-6cc9-4d2d-a893-ca53e6d9c5ab req-910fd437-26a3-4a6f-a46c-cd5548ab994b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.110888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7ba6a3a1-6cc9-4d2d-a893-ca53e6d9c5ab req-910fd437-26a3-4a6f-a46c-cd5548ab994b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.111355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7ba6a3a1-6cc9-4d2d-a893-ca53e6d9c5ab req-910fd437-26a3-4a6f-a46c-cd5548ab994b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.125917 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7ba6a3a1-6cc9-4d2d-a893-ca53e6d9c5ab req-910fd437-26a3-4a6f-a46c-cd5548ab994b service nova] Creating event network-vif-unplugged:542008f2-a595-47a6-9079-28073e7e45d3 for instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 on n-h2-854882-3 Aug 29 15:31:57.131176 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7ba6a3a1-6cc9-4d2d-a893-ca53e6d9c5ab req-910fd437-26a3-4a6f-a46c-cd5548ab994b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037614 Aug 29 15:31:57.132102 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 683/1349] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:31:57.205978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:57.206906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:57.213736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.214232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.214671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.215376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.215905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.216450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.413526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.424052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.432847 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b1af8ad-34f6-4718-a7a1-e0328189e47a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.885392 Aug 29 15:31:57.433463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 667/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:56 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:57.435662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-893520c9-37cb-4313-8c1f-434b43f1d915 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.234151 Aug 29 15:31:57.450501 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 684/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:57.455855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:57.456504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:57.465961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.466463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.467096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.472544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:57.472705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.473281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.473683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:57.473966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.479994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:57.481747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.482549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.483073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.483859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.484390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.484907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.648836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.659849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.661606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.663181 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03156da9-aaef-490a-b9db-12035bb38655 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.211395 Aug 29 15:31:57.664058 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 685/1352] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:57.670186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce2db6ba-16c1-419b-a297-b8c6b28ec27c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb766430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:57.726582 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce2db6ba-16c1-419b-a297-b8c6b28ec27c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.061347 Aug 29 15:31:57.727668 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 686/1353] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:57.840757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:57.841365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:57.852948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.854462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.855830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.858038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.859160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.860821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.903533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.915357 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-518a9162-22b8-4d7b-bab8-ad0381d593d0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.446477 Aug 29 15:31:57.919594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 668/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:58.021127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7f5f3a00-44db-421a-b14d-8994d44efd77 req-4887371e-cb4a-41c1-bf40-13a607746b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80399e3-adcd-44ba-af67-24a4a71f530d", "tag": "9cc4fbc0-3029-4884-a347-dd4dc76123d5"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:58.074330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7f5f3a00-44db-421a-b14d-8994d44efd77 req-4887371e-cb4a-41c1-bf40-13a607746b31 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.075184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7f5f3a00-44db-421a-b14d-8994d44efd77 req-4887371e-cb4a-41c1-bf40-13a607746b31 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.076373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7f5f3a00-44db-421a-b14d-8994d44efd77 req-4887371e-cb4a-41c1-bf40-13a607746b31 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.093176 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7f5f3a00-44db-421a-b14d-8994d44efd77 req-4887371e-cb4a-41c1-bf40-13a607746b31 service nova] Creating event network-changed:9cc4fbc0-3029-4884-a347-dd4dc76123d5 for instance a80399e3-adcd-44ba-af67-24a4a71f530d on n-h1-854882-3 Aug 29 15:31:58.100747 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7f5f3a00-44db-421a-b14d-8994d44efd77 req-4887371e-cb4a-41c1-bf40-13a607746b31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083762 Aug 29 15:31:58.102627 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 669/1355] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:58.108789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.110139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.119479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.120627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.121304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.124086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.124887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.125594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.203399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.210021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:58.214975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-de114b33-fca5-42c4-82d0-3aefb0d1d63d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.378710 Aug 29 15:31:58.215811 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 687/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:58.464997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.466009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.473245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.474191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.474872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.475824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.477054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.477756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.506165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:58.570170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:58.896638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.904967 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b4fa048d-a910-4cc1-ac67-b96f8213e9a0 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1474 microversion: 2.1 time: 0.800666 Aug 29 15:31:58.910351 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 670/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:58 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1474 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:58.915169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.915846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.936776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.937260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.937757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.938456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.938904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.939320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.058129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.072484 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-392a4309-7a37-4869-bead-6315f3a03519 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.617315 Aug 29 15:31:59.073872 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 688/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:58 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:59.084982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.086072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:59.107493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.108272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.108888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.110038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.110803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.111425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.276560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.289175 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-28d90e23-9d23-498d-9f9b-4cb5f3c4fca3 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.375456 Aug 29 15:31:59.292017 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 671/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:58 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:59.302925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e8eda18-d78e-455f-ba87-136af133936c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32d1940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.377015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0e8eda18-d78e-455f-ba87-136af133936c tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.083572 Aug 29 15:31:59.377936 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 672/1360] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:59.388987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.397427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:59.412400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.413203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.414197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.415125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.416530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.418456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.787016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.797716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.800277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.804423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.805704 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-832c74c0-3647-456b-a85a-b2ed19c42892 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1812 microversion: 2.25 time: 0.730585 Aug 29 15:31:59.808806 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 689/1361] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1812 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:59.821704 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b6b50ff-e0bf-44e3-9767-8a82d080f7af tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.428835 Aug 29 15:31:59.821704 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 673/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:59.828614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.829641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:59.842037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.842752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.843373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.844466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.845504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.846336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.930936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.931856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:59.946057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.948831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.950183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.953757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.954421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.955056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.213220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:00.231064 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-71b63f3d-ef4f-45e2-8aaf-d5f3ef82eb5e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.419561 Aug 29 15:32:00.231730 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 674/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:00.253805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:00.267543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:00.274455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.282120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.283680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.292291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.292909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.293505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.551834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:00.565847 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9de97a95-5d66-4325-b2e3-42f38bc96182 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1471 microversion: 2.1 time: 0.638634 Aug 29 15:32:00.578063 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 690/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:00.597360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:00.598585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:00.621918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.622707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.623382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.624356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.625311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.625995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.772698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:00.794003 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-983d554a-ba3d-40d1-91ca-384db36843ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.561156 Aug 29 15:32:00.798017 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 675/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:00 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:00.814243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ca31461e-1540-4f37-820b-f3cf70e4cbad tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e31dd790>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:00.910689 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ca31461e-1540-4f37-820b-f3cf70e4cbad tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.110366 Aug 29 15:32:00.921012 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 676/1366] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:00 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:00.938201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:00.940025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:00.977941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.985573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.988900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.989887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.990552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.991147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.001120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:01.016504 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b6ca0992-e4f8-4d6a-aafd-35b3c2167281 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.430385 Aug 29 15:32:01.019202 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 691/1367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:00 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:01.036499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:01.039419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:01.054871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.055710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.057342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.061011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.061841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.062540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.104191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.104667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.105091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.105837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.106284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.106697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.192471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:01.206886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for user 1869270af6874c4db42112d4aa9417a6 and project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:01.496675 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-86301a45-42e7-4df3-9e14-d50fc89ac7ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f/action" status: 202 len: 0 microversion: 2.1 time: 0.573897 Aug 29 15:32:01.506366 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 677/1368] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:00 2022] POST /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:01.526420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:01.531655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:01.557339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.558231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.559867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.568123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.569665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.571477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.824829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:01.835365 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0991ab21-fc8b-4616-bf8b-e67b3a94105e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.812851 Aug 29 15:32:01.848852 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 692/1369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:01 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:01.855005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:01.855647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:01.871085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.871593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.872039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.878230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.879877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.880993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:02.072707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.089280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.091398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.093179 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a570db4-25a4-465e-b683-3c9a4cdc4e3a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1802 microversion: 2.25 time: 0.585423 Aug 29 15:32:02.094900 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 678/1370] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:01 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1802 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:02.103018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:02.104528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:02.117844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.118604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.119177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:02.121297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.121895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.122438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:02.296721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.312699 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-04a0a976-3e8e-46a8-8183-7b881aae38a6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.469168 Aug 29 15:32:02.313098 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 693/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:01 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:02.329952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:02.330508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:02.356512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.357709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.359514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:02.361513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.362084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.362587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.203325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.225664 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e8c0ee0-de71-49de-9590-6ef01221a849 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.909155 Aug 29 15:32:03.246431 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 694/1372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:02 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:03.254780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d57cda13-8ae0-4b95-b17a-430c86424dc7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb585ca0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.358057 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d57cda13-8ae0-4b95-b17a-430c86424dc7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.109391 Aug 29 15:32:03.359630 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 695/1373] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:03.369841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.370375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.379398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.380164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.380776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.383060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.384347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.385693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.600555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.612849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ec9b523c-a905-46f0-8f57-232b6b3dd811 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1470 microversion: 2.1 time: 1.516189 Aug 29 15:32:03.632353 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 679/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:02 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1470 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:03.640461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a88eb442-35f6-4c46-bc13-4c44f3aab130 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '.version_select at 0x7fb0e31f1820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.650737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88eb442-35f6-4c46-bc13-4c44f3aab130 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.651348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88eb442-35f6-4c46-bc13-4c44f3aab130 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.651899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88eb442-35f6-4c46-bc13-4c44f3aab130 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.655109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:03.681379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a88eb442-35f6-4c46-bc13-4c44f3aab130 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4048 microversion: 2.25 time: 0.047600 Aug 29 15:32:03.701989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.703378 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 680/1375] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/os-migrations => generated 4048 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:03.707277 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9c4674a9-fcb4-44ac-964a-1635e17c1da7 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.346511 Aug 29 15:32:03.714042 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 696/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:03.714797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-94703f57-917e-417f-b1f7-2cee946d1427 req-f984bb6d-2f54-4464-9523-c62d2d584714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d41c49d-24a1-4830-9a08-1fb803cd476f", "name": "network-vif-plugged", "status": "completed", "tag": "25b207f6-5f3f-41f4-86cb-19208977ab03"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:03.724862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.725937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.740188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.741873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.745324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.746290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.746886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.747631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.767209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-94703f57-917e-417f-b1f7-2cee946d1427 req-f984bb6d-2f54-4464-9523-c62d2d584714 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.767685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-94703f57-917e-417f-b1f7-2cee946d1427 req-f984bb6d-2f54-4464-9523-c62d2d584714 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.787252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-94703f57-917e-417f-b1f7-2cee946d1427 req-f984bb6d-2f54-4464-9523-c62d2d584714 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.841701 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-94703f57-917e-417f-b1f7-2cee946d1427 req-f984bb6d-2f54-4464-9523-c62d2d584714 service nova] Creating event network-vif-plugged:25b207f6-5f3f-41f4-86cb-19208977ab03 for instance 6d41c49d-24a1-4830-9a08-1fb803cd476f on n-h2-854882-3 Aug 29 15:32:03.857031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-94703f57-917e-417f-b1f7-2cee946d1427 req-f984bb6d-2f54-4464-9523-c62d2d584714 service nova] Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:32:03.864409 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-94703f57-917e-417f-b1f7-2cee946d1427 req-f984bb6d-2f54-4464-9523-c62d2d584714 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158808 Aug 29 15:32:03.865778 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 681/1377] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:03.885180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.893576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.904789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.917231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.917829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.918706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.919279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.919812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.069506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:04.079382 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a9f0eff-c575-4b1c-9750-bbad8ac054d2 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.363488 Aug 29 15:32:04.079994 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 697/1378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:04.099011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:04.099640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:04.139203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.140046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.140566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.141761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.147221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.154072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.399115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:04.414527 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df1f047d-8804-4bbb-838b-9aeab88f6b89 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.547263 Aug 29 15:32:04.443507 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 682/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:04.450169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:04.451047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:04.459390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.463914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.464598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.465563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.468847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.469598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.708689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:04.720372 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c114edbb-6a4d-4bfb-8c2d-2852ac87dea2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.274788 Aug 29 15:32:04.721678 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 683/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:04 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:04.728046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88b7ba77-34e6-49d5-b6b6-be5633b307ff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e32930d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:04.814128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88b7ba77-34e6-49d5-b6b6-be5633b307ff tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.091000 Aug 29 15:32:04.821701 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 684/1381] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:04 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:04.826637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:04.827259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:04.834155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.834651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.835268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.836119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.836578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.837006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.987742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 704fa114-40c8-4d26-bd16-838f3a8dcb5f {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:05.003875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:05.016645 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc89fe1b-8c3a-42cb-b959-1af3605a22e8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1470 microversion: 2.1 time: 0.191911 Aug 29 15:32:05.019671 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 685/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:04 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:05.026925 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0deea9c-0336-4ab8-a904-b77d1284f295 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 2420 microversion: 2.25 time: 0.943733 Aug 29 15:32:05.028129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.029458 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 698/1383] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:04 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 2420 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:05.052842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.057001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.058073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.063223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.063725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.069322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.069782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.070628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.071286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.071738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.072080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.072821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.074660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.077407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.079654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.292386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:05.301170 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d30ed51-5ac4-45ec-bf70-8a6d61920d00 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.280353 Aug 29 15:32:05.301809 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 686/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:05.308221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.308456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.314624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.315119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.315563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.316621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.317252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.317721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.460083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:05.471934 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b2941ac-fdc2-452a-9f2f-9a4e4848a69c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.168811 Aug 29 15:32:05.485443 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 687/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:05.490336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.490955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.497554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.498059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.504608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.505381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.505922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.506766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.622889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 704fa114-40c8-4d26-bd16-838f3a8dcb5f {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:05.659815 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a0d968c-2581-42e5-86c0-52ded8d78a74 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 2420 microversion: 2.25 time: 0.607481 Aug 29 15:32:05.664180 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 699/1386] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 2420 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:05.746729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.747361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.759216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.759863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.760303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.767697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.768454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.769064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.838003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:05.862265 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bfa9dc30-66a8-49ba-a6db-60106d378277 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.375617 Aug 29 15:32:05.863254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 688/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:05.869366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6dabac6-68b6-4f15-b4b8-ed7f704bd046 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e320a0d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.958230 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6dabac6-68b6-4f15-b4b8-ed7f704bd046 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.084709 Aug 29 15:32:05.959161 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 689/1388] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:05.975483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.975985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.997781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.998299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.998740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.999458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.999931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.000357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.247584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:06.256719 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba0f1efa-1606-423c-b670-1a5059e43e81 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.513875 Aug 29 15:32:06.265549 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 700/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:06.275135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-51305edd-55ba-44e4-9361-88d25d06d366 req-09676cbd-8d37-4c36-b8cb-adce170a99b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85573cdb-9434-4da4-a11b-89a5780a0493", "name": "network-vif-plugged", "status": "completed", "tag": "d044e837-eb27-4ad5-81b7-21637633fde4"}, {"server_uuid": "bf505d1e-e625-4f21-af82-5c21de753b6f", "name": "network-vif-plugged", "status": "completed", "tag": "959b9852-ee4b-48ea-b575-978517e2c981"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:06.293034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lazy-loading 'services' on Instance uuid 704fa114-40c8-4d26-bd16-838f3a8dcb5f {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:06.334397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-51305edd-55ba-44e4-9361-88d25d06d366 req-09676cbd-8d37-4c36-b8cb-adce170a99b5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.334910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-51305edd-55ba-44e4-9361-88d25d06d366 req-09676cbd-8d37-4c36-b8cb-adce170a99b5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.335470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-51305edd-55ba-44e4-9361-88d25d06d366 req-09676cbd-8d37-4c36-b8cb-adce170a99b5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.645862 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b597c65b-6920-4fdf-8253-2f6635862778 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments/23b40640-0cea-4a19-b43c-c5d883aca1eb" status: 202 len: 0 microversion: 2.25 time: 0.669124 Aug 29 15:32:06.651111 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 690/1390] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Aug 29 15:32:05 2022] DELETE /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments/23b40640-0cea-4a19-b43c-c5d883aca1eb => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:06.662452 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-51305edd-55ba-44e4-9361-88d25d06d366 req-09676cbd-8d37-4c36-b8cb-adce170a99b5 service nova] Creating event network-vif-plugged:d044e837-eb27-4ad5-81b7-21637633fde4 for instance 85573cdb-9434-4da4-a11b-89a5780a0493 on n-h1-854882-3 Aug 29 15:32:06.662960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-51305edd-55ba-44e4-9361-88d25d06d366 req-09676cbd-8d37-4c36-b8cb-adce170a99b5 service nova] Creating event network-vif-plugged:959b9852-ee4b-48ea-b575-978517e2c981 for instance bf505d1e-e625-4f21-af82-5c21de753b6f on n-h1-854882-3 Aug 29 15:32:06.673062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:06.673815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:06.689036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.689892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.690831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.691775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.692442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.693086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.700904 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-51305edd-55ba-44e4-9361-88d25d06d366 req-09676cbd-8d37-4c36-b8cb-adce170a99b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.429967 Aug 29 15:32:06.707730 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 701/1391] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:06.714673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:06.715434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:06.723341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.726364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.726364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.727613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.728611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.729661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.999666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:07.018728 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a27f7d48-bfa0-457e-8a94-571a1b3a5a7d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1470 microversion: 2.1 time: 0.363218 Aug 29 15:32:07.034101 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 691/1392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:06 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:07.039188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.039799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:07.065650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.066248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.066700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.067443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.072601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.073113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.263921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:07.277045 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1c80d4b2-516f-41e9-a676-74777f4a281b tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.567764 Aug 29 15:32:07.291689 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 702/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:06 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:07.307249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.313602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:07.331713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.332374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.336237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.338191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.341564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.342275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.427150 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a6ccb83-8ac8-498c-801b-fbfd46f975b8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130326 Aug 29 15:32:07.427150 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 703/1394] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:07.440829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.441495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:07.456474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.456984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.457463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.458191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.458647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.459419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.661569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:07.670483 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df7d1f3f-0e28-4218-bf0c-0e4dff583b2d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1402 microversion: 2.1 time: 0.646239 Aug 29 15:32:07.676478 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 692/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1402 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:07.692858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-05e2f203-5461-4986-9371-0d1f86206bb7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3268e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.780697 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-05e2f203-5461-4986-9371-0d1f86206bb7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.103112 Aug 29 15:32:07.781300 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 693/1396] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:07.791505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.792135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:07.805491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.806077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.806756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.807788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.808011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.814606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.903186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:07.928141 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9eb8bd9e-fe33-4fce-9ef0-fe57e10a867f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.494091 Aug 29 15:32:07.932747 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 704/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:08.042690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:08.043713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:08.057927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.058574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.059130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.059986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.060910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.064870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.089526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:08.451014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:08.468688 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e1c1f811-1375-4d20-99b9-54b209a3dccb tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1536 microversion: 2.1 time: 0.430260 Aug 29 15:32:08.482498 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 705/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:08 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1536 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:08.514531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:08.514531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:08.514531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.515323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.516158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.518942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.521188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.526260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.800753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:08.814226 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe00cbde-104e-47fa-ace4-75b9985a148e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 1.031976 Aug 29 15:32:08.825485 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 694/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:08.842344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:08.850241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:08.891984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.892667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.893147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.896275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.897016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.897666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.055694 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ecdf2a8-9832-4713-bcfc-eec282649578 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.220983 Aug 29 15:32:09.057606 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 695/1400] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:08 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:09.062785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7de158d0-8f40-4dd1-8289-8d4ebf6e296d req-8a1808fa-ab78-4092-8311-5fe16bafbb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784f3eba-97c4-48b4-aa04-db77584cbee7", "name": "network-vif-unplugged", "status": "completed", "tag": "e81c2643-3312-407a-9390-e39c02caff49"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:09.084716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7de158d0-8f40-4dd1-8289-8d4ebf6e296d req-8a1808fa-ab78-4092-8311-5fe16bafbb83 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.085200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7de158d0-8f40-4dd1-8289-8d4ebf6e296d req-8a1808fa-ab78-4092-8311-5fe16bafbb83 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.085664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7de158d0-8f40-4dd1-8289-8d4ebf6e296d req-8a1808fa-ab78-4092-8311-5fe16bafbb83 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.118615 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7de158d0-8f40-4dd1-8289-8d4ebf6e296d req-8a1808fa-ab78-4092-8311-5fe16bafbb83 service nova] Creating event network-vif-unplugged:e81c2643-3312-407a-9390-e39c02caff49 for instance 784f3eba-97c4-48b4-aa04-db77584cbee7 on n-h2-854882-3 Aug 29 15:32:09.132851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7de158d0-8f40-4dd1-8289-8d4ebf6e296d req-8a1808fa-ab78-4092-8311-5fe16bafbb83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073490 Aug 29 15:32:09.133865 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 696/1401] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:09.139053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.139779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:09.157711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:09.158525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.159025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.159495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.160270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.160775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.161205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.175265 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c59ed08a-40e1-4033-9c5a-f1767d543f0c tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.690819 Aug 29 15:32:09.175891 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 706/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:08 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:09.226786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80399e3-adcd-44ba-af67-24a4a71f530d", "name": "network-vif-plugged", "status": "completed", "tag": "9cc4fbc0-3029-4884-a347-dd4dc76123d5"}, {"server_uuid": "6d41c49d-24a1-4830-9a08-1fb803cd476f", "name": "network-vif-unplugged", "status": "completed", "tag": "25b207f6-5f3f-41f4-86cb-19208977ab03"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:09.261742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.262150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.262772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.297820 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] Creating event network-vif-plugged:9cc4fbc0-3029-4884-a347-dd4dc76123d5 for instance a80399e3-adcd-44ba-af67-24a4a71f530d on n-h1-854882-3 Aug 29 15:32:09.298553 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] Creating event network-vif-unplugged:25b207f6-5f3f-41f4-86cb-19208977ab03 for instance 6d41c49d-24a1-4830-9a08-1fb803cd476f on n-h2-854882-3 Aug 29 15:32:09.308373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:32:09.329032 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-deb3f712-0440-4c1b-8b8a-782953a16951 req-08d87f88-2c96-4d57-b24a-e72b91f7d730 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.133217 Aug 29 15:32:09.332076 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 707/1403] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:09.347315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-36621585-1c6e-4780-860e-ee6ecc4d9025 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb6b8f70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.436298 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-36621585-1c6e-4780-860e-ee6ecc4d9025 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.102739 Aug 29 15:32:09.451042 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 708/1404] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:09.457156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.469969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:09.481304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.485255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.485914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.486785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.491071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.491619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.898767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:09.916021 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2de41b51-41ca-46ff-ad31-ccfeaf36970a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.464794 Aug 29 15:32:09.919587 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 709/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:09.929415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:09.930109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.930305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:09.940211 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df5f8f30-37ce-417a-ad8a-46fd44b1f38c tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1588 microversion: 2.1 time: 0.805048 Aug 29 15:32:09.940814 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 697/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1588 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:09.959069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.959483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.963390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.964386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.965183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.969108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.970469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.977965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:09.992546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.993407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.995337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.996272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.001203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.001997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.215808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:10.230003 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8440e61f-aaa2-49e6-b503-74f17dd94745 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1536 microversion: 2.1 time: 0.304595 Aug 29 15:32:10.231061 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 710/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1536 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:10.404317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-513917524", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "c6251ecf-a75f-4808-83b5-41937559c769"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:10.529791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] validate_networks() for [('c6251ecf-a75f-4808-83b5-41937559c769', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:10.682814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:10.691906 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80998638-cdff-48df-8f8f-d69dc9366196 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.726569 Aug 29 15:32:10.692829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 698/1408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:10.709346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:10.710131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:10.716642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.722745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.723385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.724334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.725053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.725696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.908895 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b12d81fb-ae69-49a5-ab6e-c7920dce382e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.214862 Aug 29 15:32:10.909655 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 699/1409] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:32:10 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:10.915029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:10.923872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:10.948138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.948784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.951522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.952492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.966092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.966838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:11.044801 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83de1238-a78c-4933-8dcb-7fc4cee2c65d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133777 Aug 29 15:32:11.047950 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 700/1410] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:10 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:11.060501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:11.061636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:11.075416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:11.076075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:11.076624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:11.077496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:11.078651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:11.088999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:11.151165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:11.182436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:11.582255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:11.596783 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d83d4a2-112a-4d40-9c7e-e00888fb685e tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1320 microversion: 2.1 time: 0.547118 Aug 29 15:32:11.597462 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 701/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:11 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:11.607362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2370123-501c-4cfb-beb2-3c5bb52fcf11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e33afee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:11.739557 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2370123-501c-4cfb-beb2-3c5bb52fcf11 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.140945 Aug 29 15:32:11.740492 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 702/1412] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:11 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:11.757062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:11.757773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:11.787715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:11.788213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:11.788652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:11.799990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:11.800509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:11.800967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.032270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:12.033265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:12.033618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:12.034411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:12.035311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:12.048542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.049428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.050610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.051842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.052540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.053195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.078957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Getting quotas for project 1b0e1286b14d4f749e3216980f645523. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:12.085934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Getting quotas for user a47bb5a8721d4c09933fec4331761a41 and project 1b0e1286b14d4f749e3216980f645523. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:12.104234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:12.107850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:12.166272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c9470ce5-3301-4d3b-8eab-4abd758e9895 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933217 Aug 29 15:32:12.167563 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 711/1413] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:32:12.173080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-aa6d107c-5418-4eb5-ad0c-0f708d4bb4d5 req-118117f4-2326-4b98-a8be-209af15e1053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784f3eba-97c4-48b4-aa04-db77584cbee7", "tag": "e81c2643-3312-407a-9390-e39c02caff49"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:12.183893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aa6d107c-5418-4eb5-ad0c-0f708d4bb4d5 req-118117f4-2326-4b98-a8be-209af15e1053 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.184898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aa6d107c-5418-4eb5-ad0c-0f708d4bb4d5 req-118117f4-2326-4b98-a8be-209af15e1053 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.185572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aa6d107c-5418-4eb5-ad0c-0f708d4bb4d5 req-118117f4-2326-4b98-a8be-209af15e1053 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.208580 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-aa6d107c-5418-4eb5-ad0c-0f708d4bb4d5 req-118117f4-2326-4b98-a8be-209af15e1053 service nova] Creating event network-changed:e81c2643-3312-407a-9390-e39c02caff49 for instance 784f3eba-97c4-48b4-aa04-db77584cbee7 on n-h2-854882-3 Aug 29 15:32:12.236468 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-aa6d107c-5418-4eb5-ad0c-0f708d4bb4d5 req-118117f4-2326-4b98-a8be-209af15e1053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067106 Aug 29 15:32:12.253570 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 712/1414] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:12.267733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.271518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:12.299655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.307060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.307705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.309851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.310529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.311158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.348119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:12.372429 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73cc403b-d7a4-4c2c-a73a-7e050f781213 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.630440 Aug 29 15:32:12.397138 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 703/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:11 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:12.430491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.434246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:12.456748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.462127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.463845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.468135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.468719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.469162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.651777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:12.663825 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b002a58f-a1c6-4db4-8370-595aced41dca tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1536 microversion: 2.1 time: 0.408547 Aug 29 15:32:12.666711 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 713/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1536 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:12.678396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.684227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:12.700626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.701520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.705209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.707817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.708600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.709458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.797086 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-31f6e1e9-8699-4379-87ba-287b8c142d27 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127694 Aug 29 15:32:12.806057 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 714/1417] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:12.811215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f36d737-8bac-409a-9d24-18b0f937e2b6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.811844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f36d737-8bac-409a-9d24-18b0f937e2b6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:12.954868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f36d737-8bac-409a-9d24-18b0f937e2b6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:12.964361 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f36d737-8bac-409a-9d24-18b0f937e2b6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1223 microversion: 2.1 time: 0.156639 Aug 29 15:32:12.965417 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 715/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1223 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:12.988478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.989121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:13.015146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.015638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.016048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.016790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.017242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.017707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.417772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:13.435680 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eaf86618-5c03-4658-90aa-e3c0ebb7b9db tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1469 microversion: 2.1 time: 0.452109 Aug 29 15:32:13.456943 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 716/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:13.463444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9514a7ea-5adf-4354-96cb-e6ebea8f3375 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb6b8790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:13.532110 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9514a7ea-5adf-4354-96cb-e6ebea8f3375 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.073816 Aug 29 15:32:13.544525 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 717/1420] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:13 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:13.551638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:13.552459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:13.564330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.565962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.567261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.568227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.568842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.569453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.673315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:13.690320 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b8d68e9a-8807-4896-9599-3cc15f0502fc tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 1.286354 Aug 29 15:32:13.694466 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 704/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:13.699993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:13.709908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:13.730622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.731120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.731562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.734375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.734856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.735292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.990083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:14.002055 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a0f5c91-5806-42ff-b5c7-d87744f95943 tempest-DeleteServersAdminTestJSON-163178677 tempest-DeleteServersAdminTestJSON-163178677-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d/action" status: 202 len: 0 microversion: 2.1 time: 0.304547 Aug 29 15:32:14.005612 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 705/1422] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:13 2022] POST /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:14.026900 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35cf8562-fdb6-47f5-a1b9-f261c3f82ed6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.480835 Aug 29 15:32:14.027518 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 718/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:13 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:14.035443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.036074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.054473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.062357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.086814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.087841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.092047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.094478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.095686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.096351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.097162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.097890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.107053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.108612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.111181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.112135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.161711 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c5b7f630-9355-46ad-8188-f377d7b27705 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132932 Aug 29 15:32:14.169659 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 719/1424] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:14.177081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.178371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.193016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.194683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.196395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.197895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.198692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.200424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.342177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:14.359408 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc1d846e-4b4d-4da8-a28a-18e04f9a36bb tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1275 microversion: 2.1 time: 0.187276 Aug 29 15:32:14.360339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 720/1425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:14.380181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.381169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.403325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.403830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.404279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.405319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.405544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.405951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.447225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.448463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.449169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.451400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lazy-loading 'fault' on Instance uuid a80399e3-adcd-44ba-af67-24a4a71f530d {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:14.619119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:14.648312 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3cca4a7b-a94b-42f3-92a9-18a5e3409c9a tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1452 microversion: 2.1 time: 0.286518 Aug 29 15:32:14.649088 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 721/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1452 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:14.664711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51478762-fc45-44ad-91bb-775fe3f72859 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb6b8820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.773262 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51478762-fc45-44ad-91bb-775fe3f72859 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.122719 Aug 29 15:32:14.774234 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 722/1427] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:14.786590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.787104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.811378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.811952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.812970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.813802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.814259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.815547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.876950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:14.886540 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3210af3b-f841-4e11-88af-452c01d401e6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1529 microversion: 2.1 time: 0.882715 Aug 29 15:32:14.901254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 706/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1529 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:14.906528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.918762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.925227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:32:14.948079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.955320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.956244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.958253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.961598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.962707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.143116 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-645b8002-b4e2-4c59-a65a-3fc324797fc2 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 204 len: 0 microversion: 2.1 time: 0.365845 Aug 29 15:32:15.145740 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 723/1429] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:14 2022] DELETE /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:15.158644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.161635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.177911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.178700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.179313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.183202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.184053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.184716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.511776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:15.527501 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8b913c02-4a1d-48a6-886e-304bc8f1d868 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1529 microversion: 2.1 time: 0.375737 Aug 29 15:32:15.528569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 724/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1529 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:15.542541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.543850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.545322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:15.558330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:15.560173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.565715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b8a85b10-2736-4693-a734-828f0fc6d6e5 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.662822 Aug 29 15:32:15.566649 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 707/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:15.579024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.579917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.580078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.580661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.581500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.582013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.582453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.600205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.601036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.601756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.605030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.605779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.606385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.677361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.678165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.678769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.679396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lazy-loading 'fault' on Instance uuid a80399e3-adcd-44ba-af67-24a4a71f530d {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:15.922701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:15.932540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:15.934506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f9a398ed-d9ba-4a58-b4f2-5654aad26dc5 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1458 microversion: 2.1 time: 0.366538 Aug 29 15:32:15.935286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:15.936881 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 708/1432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1458 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:15.942466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.943911 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-430df5f7-def6-4c7a-b24f-96a71c99ed3f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.414555 Aug 29 15:32:15.952310 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 725/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:15.953435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.953742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.960417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.967048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.967543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.967977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.968705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.969163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.969619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.975403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.976384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.977322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.978286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.978850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.979343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.005285 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14232970-a47a-4d22-be85-46832666dcdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066944 Aug 29 15:32:16.006575 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 709/1434] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:16.012213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74cf1e63-c859-42ab-9724-5ae6cb6d90db tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.019082 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-74cf1e63-c859-42ab-9724-5ae6cb6d90db tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] HTTP exception thrown: Flavor d761291a-8fcd-4df7-b259-78037f58b65f could not be found. Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74cf1e63-c859-42ab-9724-5ae6cb6d90db tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Request method failure captured: Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/flavors/d761291a-8fcd-4df7-b259-78037f58b65f HTTP/1.1 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNsRWp7vLwpEg4mL-1QcG04K2oDUeyoFFOy31kYsHx3ZyY5tquIH3ZgZwcmw3KCvClXi5P43SzWw1JG1bejhKx7hD3pop751ZxXR0n0seHD_Pk43fiXM4vnpirpxEVStgtN3D_ZlN-_p5VzPr8YrwIkwbGM0nKUNxCLuvnQ_nU_jY3w Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 99027d125a554aa8ba6d93ec8d8647df Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-MigrationsAdminTest-158914546 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99027d125a554aa8ba6d93ec8d8647df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99027d125a554aa8ba6d93ec8d8647df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99027d125a554aa8ba6d93ec8d8647df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99027d125a554aa8ba6d93ec8d8647df"}]}] Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-MigrationsAdminTest-158914546 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 99027d125a554aa8ba6d93ec8d8647df Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-MigrationsAdminTest-158914546 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-MigrationsAdminTest-158914546-project-admin Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a475f784dacf42f09574889b479994c1 Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-MigrationsAdminTest-158914546-project-admin Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: exception: Flavor d761291a-8fcd-4df7-b259-78037f58b65f could not be found. Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd761291a-8fcd-4df7-b259-78037f58b65f'} Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d761291a-8fcd-4df7-b259-78037f58b65f could not be found. Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor d761291a-8fcd-4df7-b259-78037f58b65f could not be found. Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:16.021255 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d761291a-8fcd-4df7-b259-78037f58b65f could not be found. Aug 29 15:32:16.027270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:16.028776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74cf1e63-c859-42ab-9724-5ae6cb6d90db tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Returning 404 to user: Flavor d761291a-8fcd-4df7-b259-78037f58b65f could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:16.029884 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-74cf1e63-c859-42ab-9724-5ae6cb6d90db tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/d761291a-8fcd-4df7-b259-78037f58b65f" status: 404 len: 109 microversion: 2.1 time: 0.022148 Aug 29 15:32:16.031270 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 710/1435] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:16 2022] DELETE /compute/v2.1/flavors/d761291a-8fcd-4df7-b259-78037f58b65f => generated 109 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:16.052463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.054940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:16.064015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.065022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.065857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.069189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.074909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.075811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.086281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:16.097367 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-510b5244-f96e-4081-abb7-e5c4a768584c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1281 microversion: 2.1 time: 0.149850 Aug 29 15:32:16.107539 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 726/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:16.121236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7076624f-8b3c-4a24-a919-3a7998f486c5 req-eb1f3f78-875c-416a-a0b4-30bdc3828c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf505d1e-e625-4f21-af82-5c21de753b6f", "tag": "959b9852-ee4b-48ea-b575-978517e2c981"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:16.153048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7076624f-8b3c-4a24-a919-3a7998f486c5 req-eb1f3f78-875c-416a-a0b4-30bdc3828c3d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.153833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7076624f-8b3c-4a24-a919-3a7998f486c5 req-eb1f3f78-875c-416a-a0b4-30bdc3828c3d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.154267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7076624f-8b3c-4a24-a919-3a7998f486c5 req-eb1f3f78-875c-416a-a0b4-30bdc3828c3d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.187196 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7076624f-8b3c-4a24-a919-3a7998f486c5 req-eb1f3f78-875c-416a-a0b4-30bdc3828c3d service nova] Creating event network-changed:959b9852-ee4b-48ea-b575-978517e2c981 for instance bf505d1e-e625-4f21-af82-5c21de753b6f on n-h1-854882-3 Aug 29 15:32:16.203048 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7076624f-8b3c-4a24-a919-3a7998f486c5 req-eb1f3f78-875c-416a-a0b4-30bdc3828c3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093835 Aug 29 15:32:16.204121 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 727/1437] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:16.216813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b5ffc1b-8833-4cea-8937-48eec2ca6f0a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb779940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.301430 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b5ffc1b-8833-4cea-8937-48eec2ca6f0a tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.096039 Aug 29 15:32:16.302659 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 728/1438] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:16 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:16.311616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:16.316596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-175633227", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:16.321509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b46737d-476b-4e39-8a89-2deffd69a96e tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1588 microversion: 2.1 time: 0.288794 Aug 29 15:32:16.324335 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 711/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:16 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1588 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:16.429236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:16.568505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3c41db19-b9cf-4ba7-8727-93aed57747e6 req-9f659dec-f468-4c34-a2d7-59578d261d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d41c49d-24a1-4830-9a08-1fb803cd476f", "name": "network-vif-plugged", "status": "completed", "tag": "25b207f6-5f3f-41f4-86cb-19208977ab03"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:16.598864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3c41db19-b9cf-4ba7-8727-93aed57747e6 req-9f659dec-f468-4c34-a2d7-59578d261d88 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.607211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3c41db19-b9cf-4ba7-8727-93aed57747e6 req-9f659dec-f468-4c34-a2d7-59578d261d88 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.611190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3c41db19-b9cf-4ba7-8727-93aed57747e6 req-9f659dec-f468-4c34-a2d7-59578d261d88 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.643695 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3c41db19-b9cf-4ba7-8727-93aed57747e6 req-9f659dec-f468-4c34-a2d7-59578d261d88 service nova] Creating event network-vif-plugged:25b207f6-5f3f-41f4-86cb-19208977ab03 for instance 6d41c49d-24a1-4830-9a08-1fb803cd476f on n-h2-854882-3 Aug 29 15:32:16.658180 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3c41db19-b9cf-4ba7-8727-93aed57747e6 req-9f659dec-f468-4c34-a2d7-59578d261d88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093800 Aug 29 15:32:16.660105 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 712/1440] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:16.675848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.676964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:16.695100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.695719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.696163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.701588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.702184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.703298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.836770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:16.839028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:16.839685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:16.840196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:16.840911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:16.854164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.854791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.855324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.856166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.856812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.857331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.881098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:16.888543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Getting quotas for user 1869270af6874c4db42112d4aa9417a6 and project 69c81aac0e2b4adba8bc9d9c9c24c097. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:16.905193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:16.908472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:16.983577 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d6b99c4-504d-4fe1-965e-11d10c9fd492 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676868 Aug 29 15:32:16.984415 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 729/1441] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:32:16.989537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.992412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:16.998520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.999168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.999701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.000651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.001206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.001982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.044935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.045927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.046482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.047039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lazy-loading 'fault' on Instance uuid a80399e3-adcd-44ba-af67-24a4a71f530d {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:17.195072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:17.204399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef49b7f2-9fd6-468d-a972-e3405bab1f91 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1458 microversion: 2.1 time: 0.218830 Aug 29 15:32:17.206185 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 730/1442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:16 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1458 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.211691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.213157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:17.220089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.221028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.221833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.222770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.223444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.224089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.363836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:17.375727 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0ab7e250-67ea-4f6f-8e2d-651d7bab71ab tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.713455 Aug 29 15:32:17.396082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 713/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:16 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.406416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eaef1c12-4b7a-48c5-a16a-9f5651e97126 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.409009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eaef1c12-4b7a-48c5-a16a-9f5651e97126 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:17.424450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:17.432944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1feadc9f-d45d-44c5-8442-bb80ee5f2fd7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.225571 Aug 29 15:32:17.435229 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 731/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.440057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.453205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:17.468141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.468638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.469265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.470014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.470447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.470875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.582442 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7388c80-e834-404c-9a72-7ebb97fd56bb tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146255 Aug 29 15:32:17.590148 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 732/1445] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:17.606045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.606782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:17.623148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.623641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.624087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.624802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.631651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.632140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.646423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eaef1c12-4b7a-48c5-a16a-9f5651e97126 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:17.667306 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eaef1c12-4b7a-48c5-a16a-9f5651e97126 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1212 microversion: 2.1 time: 0.267040 Aug 29 15:32:17.681544 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 714/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1212 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.687942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ad56c313-e726-444a-a6c7-39db0eaa2797 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e320a160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.852107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:17.860173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ad56c313-e726-444a-a6c7-39db0eaa2797 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.188729 Aug 29 15:32:17.860764 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 715/1447] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.865901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7b44af0-e133-48c5-978d-ecb0342fb5aa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1281 microversion: 2.1 time: 0.268852 Aug 29 15:32:17.867575 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 733/1448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1281 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:18.227133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:18.228626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:18.234394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:18.247257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.248070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.248717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.255209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.255897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.256734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.329064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.330003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.330649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.331305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lazy-loading 'fault' on Instance uuid a80399e3-adcd-44ba-af67-24a4a71f530d {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:18.397961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:18.398689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:18.412377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.413652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.414540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.416644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.417206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.417734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.666954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:18.678727 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60e11727-7b20-464b-be7e-72ccecbc4cae tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.284567 Aug 29 15:32:18.689480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 734/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:18 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:18.695438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:18.695438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:18.709834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.710397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.710843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.711679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.712134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.713176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.944556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:18.955624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e37de48-81c2-44b9-b270-775e68f8c985 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.269888 Aug 29 15:32:18.956749 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 735/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:18 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:18.961790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:18.964650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:18.971166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.971702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.972138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.972855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.973310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.974637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.038551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d67c708-f586-4a87-b522-33fbe733e4bd tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.080680 Aug 29 15:32:19.044205 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 736/1451] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:18 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:19.045856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.046620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:19.063474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.064123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.064660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.065535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.066006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.066432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.237597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:19.274398 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-306c074f-7c1b-48c6-b055-afe550de97d9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1264 microversion: 2.1 time: 0.233742 Aug 29 15:32:19.275350 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 737/1452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:19.279887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12c6e451-7c7d-4ffd-9014-349ea94b4c43 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e366e5e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.301269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:19.313723 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07b362d2-1122-4685-8331-a81d3a1c3764 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1458 microversion: 2.1 time: 1.090248 Aug 29 15:32:19.320998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 716/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:18 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1458 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:19.363513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.375081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:19.394319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.402594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.403047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.403788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.404243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.414786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.431232 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12c6e451-7c7d-4ffd-9014-349ea94b4c43 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.154763 Aug 29 15:32:19.432515 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 738/1454] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:19.443991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-50e232f7-d697-40ba-806b-09385df8fb7a req-811ce419-3cf7-427d-a9ec-00981a16b062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80399e3-adcd-44ba-af67-24a4a71f530d", "name": "network-vif-deleted", "tag": "9cc4fbc0-3029-4884-a347-dd4dc76123d5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:19.474479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50e232f7-d697-40ba-806b-09385df8fb7a req-811ce419-3cf7-427d-a9ec-00981a16b062 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.480092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50e232f7-d697-40ba-806b-09385df8fb7a req-811ce419-3cf7-427d-a9ec-00981a16b062 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.480996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50e232f7-d697-40ba-806b-09385df8fb7a req-811ce419-3cf7-427d-a9ec-00981a16b062 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.524107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-50e232f7-d697-40ba-806b-09385df8fb7a req-811ce419-3cf7-427d-a9ec-00981a16b062 service nova] Creating event network-vif-deleted:9cc4fbc0-3029-4884-a347-dd4dc76123d5 for instance a80399e3-adcd-44ba-af67-24a4a71f530d on n-h1-854882-3 Aug 29 15:32:19.538228 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-50e232f7-d697-40ba-806b-09385df8fb7a req-811ce419-3cf7-427d-a9ec-00981a16b062 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101853 Aug 29 15:32:19.539382 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 739/1455] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:19.640578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:19.658503 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa12279e-573f-42b7-8e4c-e6dd6cc56eaf tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1281 microversion: 2.1 time: 0.332081 Aug 29 15:32:19.662150 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 717/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1281 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:19.705070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.706200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:19.726284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.737174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.744566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.752841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.753424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.753885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.983383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.994958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:20.024041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.034346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.035567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.039679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.043136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.043918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.101344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:20.123670 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2b1bc69-f376-42fe-aae0-02b4613f4e7a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.423496 Aug 29 15:32:20.124274 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 740/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:20.298554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:20.299645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:20.315038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.326681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.330050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.333787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.334552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.335358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.519421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:20.538404 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d57c2ce2-cb7c-4e6e-bd43-ada645bd93da tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1270 microversion: 2.1 time: 0.244975 Aug 29 15:32:20.539942 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 741/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:20 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1270 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:20.547131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:20.548120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:20.555722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.556537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.557209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.559508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.560431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.561333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.621347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.621923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.622430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.622899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lazy-loading 'fault' on Instance uuid a80399e3-adcd-44ba-af67-24a4a71f530d {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:20.684196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74e72e4a61e4938b54dbb1e51db99dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:20.702289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-54f7f406-7d10-4a53-9e5d-2044d620ddfb tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 200 len: 1310 microversion: 2.1 time: 0.160121 Aug 29 15:32:20.731535 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 742/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:20 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:20.746060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6822ea0-8013-4798-9749-ebdfdb6e3af8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e366e5e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:20.823814 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6822ea0-8013-4798-9749-ebdfdb6e3af8 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1453 microversion: 2.1 time: 0.090866 Aug 29 15:32:20.832556 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 743/1460] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:20 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:20.840125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:20.840764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:20.855205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.855725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.856248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.856993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.857483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.857923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.977637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:21.022392 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6019ddd0-79d1-4a70-9912-826604459b6f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 1.043682 Aug 29 15:32:21.022896 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 718/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:21.053267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:21.068520 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c7f0cfb-4bff-495d-930b-a8d38cce3f6a tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.229540 Aug 29 15:32:21.069415 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 744/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:20 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:21.149843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.151027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.171018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.173151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.183463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.184326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.184803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.185324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.561287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.561933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.570596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.571294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.571771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.572505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.573349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.573879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.588951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:21.605495 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-636558c5-9e77-40e1-a50e-1d819ee2d768 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.459946 Aug 29 15:32:21.607847 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 719/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:21.703245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:21.713002 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba5efd51-50a0-4f3d-af27-7c279ff055f3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1270 microversion: 2.1 time: 0.156190 Aug 29 15:32:21.715998 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 745/1464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:21.729008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.730272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.740460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.741376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.742123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.743562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.744318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.746369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.769323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] HTTP exception thrown: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Request method failure captured: Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d HTTP/1.1 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNu7O0e3ikIqNrDM7vPAGQqVsavIm_gI9a0BDhaxDK9XCW9DValyf2F4UrNoVATmMhaId8FUm5aJKfZfsmJ02OMut4bTUhuCeGVL82SFmB4Aa7aJtygDhBskdw9hXAcLYQ91GMhuP61sm-Yg3zUJXXYVid0Bz-saPCFVS9pmnjWL-h0 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce5236a48a4d4aa9800ca11f08fb7b8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}] Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a74e72e4a61e4938b54dbb1e51db99dc Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a80399e3-adcd-44ba-af67-24a4a71f530d'} Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.808072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.813600 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.815764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Returning 404 to user: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:21.818145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13302560-d8e8-49e5-a4a9-d1e8e4932db0 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 404 len: 111 microversion: 2.1 time: 0.093614 Aug 29 15:32:21.827150 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 720/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:21.832207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.832655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.843763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7f344872-3d7c-40d1-a43c-99cfefcdc373 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3136940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.851238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.851738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.852183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.853477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.853946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.854355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.892164 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] HTTP exception thrown: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Request method failure captured: Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d HTTP/1.1 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNu7O0e3ikIqNrDM7vPAGQqVsavIm_gI9a0BDhaxDK9XCW9DValyf2F4UrNoVATmMhaId8FUm5aJKfZfsmJ02OMut4bTUhuCeGVL82SFmB4Aa7aJtygDhBskdw9hXAcLYQ91GMhuP61sm-Yg3zUJXXYVid0Bz-saPCFVS9pmnjWL-h0 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce5236a48a4d4aa9800ca11f08fb7b8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}] Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a74e72e4a61e4938b54dbb1e51db99dc Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'a80399e3-adcd-44ba-af67-24a4a71f530d'} Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:21.895797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:21.900011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:21.905702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Returning 404 to user: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:21.911319 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-546dda36-6659-4447-8c54-7ba2a8d73f66 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 404 len: 111 microversion: 2.1 time: 0.081662 Aug 29 15:32:21.915253 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 746/1466] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:21 2022] DELETE /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:21.924063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.937761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: a80399e3-adcd-44ba-af67-24a4a71f530d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.954671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.955173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.955612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.956334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.956800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.957230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.996608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] HTTP exception thrown: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Request method failure captured: Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d HTTP/1.1 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNu7O0e3ikIqNrDM7vPAGQqVsavIm_gI9a0BDhaxDK9XCW9DValyf2F4UrNoVATmMhaId8FUm5aJKfZfsmJ02OMut4bTUhuCeGVL82SFmB4Aa7aJtygDhBskdw9hXAcLYQ91GMhuP61sm-Yg3zUJXXYVid0Bz-saPCFVS9pmnjWL-h0 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce5236a48a4d4aa9800ca11f08fb7b8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}] Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a74e72e4a61e4938b54dbb1e51db99dc Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'a80399e3-adcd-44ba-af67-24a4a71f530d'} Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.003555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. Aug 29 15:32:22.007833 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.008346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Returning 404 to user: Instance a80399e3-adcd-44ba-af67-24a4a71f530d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:22.009850 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c513eaf4-ddde-4cf7-b5f0-c646319b00e9 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d" status: 404 len: 111 microversion: 2.1 time: 0.089731 Aug 29 15:32:22.010973 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 747/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/servers/a80399e3-adcd-44ba-af67-24a4a71f530d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:22.026353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.026867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.046809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.047986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.048642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.049598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.050951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.052468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.058003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:22.074317 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] HTTP exception thrown: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Request method failure captured: Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 HTTP/1.1 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNu7O0e3ikIqNrDM7vPAGQqVsavIm_gI9a0BDhaxDK9XCW9DValyf2F4UrNoVATmMhaId8FUm5aJKfZfsmJ02OMut4bTUhuCeGVL82SFmB4Aa7aJtygDhBskdw9hXAcLYQ91GMhuP61sm-Yg3zUJXXYVid0Bz-saPCFVS9pmnjWL-h0 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce5236a48a4d4aa9800ca11f08fb7b8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}] Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a74e72e4a61e4938b54dbb1e51db99dc Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'abac90d5-f283-4965-94d1-ad1161fc35f2'} Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:22.076279 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.081030 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.087932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Returning 404 to user: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:22.089019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-adf89cce-f11e-4fee-8c89-674f7dc0f709 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 404 len: 111 microversion: 2.1 time: 0.074334 Aug 29 15:32:22.090212 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 748/1468] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:22 2022] DELETE /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:22.095035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.096705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.103976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.104743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.105776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.107389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.108029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.108933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.456335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:22.475539 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83f7f2e7-2991-4dd3-bac7-df8240d94656 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.383360 Aug 29 15:32:22.476150 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 749/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:22 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:22.482233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.482850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.502168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.502629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.503131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.503911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.504399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.504837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.792227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:22.801138 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2fe0d551-3bf2-4130-ab72-80297292655e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.323893 Aug 29 15:32:22.807115 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 750/1470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:22 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:22.817320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.822397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] [instance: abac90d5-f283-4965-94d1-ad1161fc35f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.830608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.836156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.836972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.850449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.851810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.852442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.881889 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] HTTP exception thrown: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Request method failure captured: Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 HTTP/1.1 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNu7O0e3ikIqNrDM7vPAGQqVsavIm_gI9a0BDhaxDK9XCW9DValyf2F4UrNoVATmMhaId8FUm5aJKfZfsmJ02OMut4bTUhuCeGVL82SFmB4Aa7aJtygDhBskdw9hXAcLYQ91GMhuP61sm-Yg3zUJXXYVid0Bz-saPCFVS9pmnjWL-h0 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce5236a48a4d4aa9800ca11f08fb7b8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce5236a48a4d4aa9800ca11f08fb7b8a"}]}] Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ce5236a48a4d4aa9800ca11f08fb7b8a Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1437075687 Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a74e72e4a61e4938b54dbb1e51db99dc Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersAdminTestJSON-1437075687-project Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'abac90d5-f283-4965-94d1-ad1161fc35f2'} Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.883919 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. Aug 29 15:32:22.898304 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:22.899250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] Returning 404 to user: Instance abac90d5-f283-4965-94d1-ad1161fc35f2 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:22.899389 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a6f6127-d554-4442-bdd4-78449f8c1712 tempest-DeleteServersAdminTestJSON-1437075687 tempest-DeleteServersAdminTestJSON-1437075687-project] 10.222.0.16 "GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2" status: 404 len: 111 microversion: 2.1 time: 0.091213 Aug 29 15:32:22.900148 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 751/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:22 2022] GET /compute/v2.1/servers/abac90d5-f283-4965-94d1-ad1161fc35f2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:22.905671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.906298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.913123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.913679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.914141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.914828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.915319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.915759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.230571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:23.243024 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e2462feb-ff33-40bc-9532-98dd5686968f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.339358 Aug 29 15:32:23.247336 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 752/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:22 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:23.260119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:23.262627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:23.282986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.284100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.284810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.287081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.287997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.292961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.583822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:23.599234 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-69ebb93d-f379-4c30-9f35-e34ea10fec2a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.350389 Aug 29 15:32:23.599856 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 753/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:23 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:23.617783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:23.618926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:23.638108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.638602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.639040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.643256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.643747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.644191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.876087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:23.884738 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aac0f5b3-701c-4637-a161-b1dae328a9dc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.271247 Aug 29 15:32:23.885311 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 754/1474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:23 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:23.894173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-222fbb58-b5bc-4670-aa48-c15f9485832b req-078d338e-9c24-4dba-b5fa-a888511d7767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26", "tag": "2f6e8e6e-c1b9-4810-8681-585d58a349e4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:23.920368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-222fbb58-b5bc-4670-aa48-c15f9485832b req-078d338e-9c24-4dba-b5fa-a888511d7767 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.920855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-222fbb58-b5bc-4670-aa48-c15f9485832b req-078d338e-9c24-4dba-b5fa-a888511d7767 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.921285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-222fbb58-b5bc-4670-aa48-c15f9485832b req-078d338e-9c24-4dba-b5fa-a888511d7767 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.957168 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-222fbb58-b5bc-4670-aa48-c15f9485832b req-078d338e-9c24-4dba-b5fa-a888511d7767 service nova] Creating event network-changed:2f6e8e6e-c1b9-4810-8681-585d58a349e4 for instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 on n-h1-854882-3 Aug 29 15:32:23.967746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-222fbb58-b5bc-4670-aa48-c15f9485832b req-078d338e-9c24-4dba-b5fa-a888511d7767 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076984 Aug 29 15:32:23.968359 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 755/1475] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:23.983506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:23.984220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:23.991392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.992178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.992793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.993745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.994195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.994783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.196252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:24.208126 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-efc627af-e6a4-430d-8bfd-05c110ff0e5d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.238402 Aug 29 15:32:24.212022 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 756/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:23 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:24.295290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:24.296618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:24.316645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.317608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.318927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.320155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.321097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.322532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.740546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:24.750635 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fac01d79-d80d-41de-9b08-2e271231ed20 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.484969 Aug 29 15:32:24.751229 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 757/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:24 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:24.775276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:24.782496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:24.794473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.794980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.795653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.796737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.797463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.797851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.131750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:25.140651 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08ef9862-bf3e-4dff-9a7e-6da97c4e346d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.370892 Aug 29 15:32:25.153787 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 758/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:24 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:25.160564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:25.161499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:25.168861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.169785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.170497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.171508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.172160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.172818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.351823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:25.362674 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ef73d6d-90ee-44ef-afc7-3f37a8e7d4f5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.207271 Aug 29 15:32:25.363958 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 759/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:25 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:25.370850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:25.371763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:25.386653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.391516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.392530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.394712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.396455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.398667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.644606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:25.659566 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-89dc227c-2444-4431-b635-ea5c47e62bc5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.293997 Aug 29 15:32:25.673944 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 760/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:25 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:25.773719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:25.774434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:25.784213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.786314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.789004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.792609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.793995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.794801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.013528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.024459 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-34cfcdd9-ee6c-465f-8bbe-266707ef87af tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.255044 Aug 29 15:32:26.025667 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 761/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:25 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:26.046180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1a9f42ce-522c-4372-8ae7-0bbc757c7f97 req-df3c2529-afc4-494a-abfc-96d0047e5db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:26.058236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1a9f42ce-522c-4372-8ae7-0bbc757c7f97 req-df3c2529-afc4-494a-abfc-96d0047e5db0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.059024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1a9f42ce-522c-4372-8ae7-0bbc757c7f97 req-df3c2529-afc4-494a-abfc-96d0047e5db0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.059785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1a9f42ce-522c-4372-8ae7-0bbc757c7f97 req-df3c2529-afc4-494a-abfc-96d0047e5db0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.074793 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1a9f42ce-522c-4372-8ae7-0bbc757c7f97 req-df3c2529-afc4-494a-abfc-96d0047e5db0 service nova] Creating event network-changed:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h1-854882-3 Aug 29 15:32:26.090462 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1a9f42ce-522c-4372-8ae7-0bbc757c7f97 req-df3c2529-afc4-494a-abfc-96d0047e5db0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039158 Aug 29 15:32:26.092637 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 762/1482] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:26.171973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.172895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:26.181963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.182580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.183114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.184025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.184733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.186152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.342406 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7f344872-3d7c-40d1-a43c-99cfefcdc373 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1462 microversion: 2.1 time: 4.505076 Aug 29 15:32:26.351938 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 721/1483] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1462 bytes in 4515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:26.359662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2197760d-49d6-4190-9f69-2727e8541a30 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e31dd4c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.377180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.388206 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-00c1d017-3c03-40ed-a50c-1e67b5f2d611 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.225111 Aug 29 15:32:26.389311 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 763/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:26.395414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.396250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:26.403425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.404036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.404628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.405640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.406627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.407180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.468786 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2197760d-49d6-4190-9f69-2727e8541a30 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 200 len: 1462 microversion: 2.1 time: 0.115254 Aug 29 15:32:26.469864 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 722/1485] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 1462 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:26.483331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.484049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:26.494732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.496223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.496894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.498806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.499715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.500643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.504114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:26.605440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.614877 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6d251cc-559d-4304-b0d4-a35d3939a771 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.223428 Aug 29 15:32:26.628608 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 764/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:26.676092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.680503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.681716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:26.686354 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8d67514-f5e6-4e63-a7ec-30e36bc8e2fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1480 microversion: 2.1 time: 0.207381 Aug 29 15:32:26.688723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.689227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.689730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.690642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.691146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.691581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.700642 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 723/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1480 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:26.843411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.852266 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03fe4bfa-fdc5-4483-9901-7c0f7663b9cc tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.175903 Aug 29 15:32:26.853165 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 765/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:27.048785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:27.051877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:27.061555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.063145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.064113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.068321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.069539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.070713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.409127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:27.409786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:27.416148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:27.417146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:27.418996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.419786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.420495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.421567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.422313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.423034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.594898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:27.604696 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cc513ae0-6322-4a49-8fcc-d5cc2cafc3d6 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.199600 Aug 29 15:32:27.608465 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 766/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:27 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:27.637937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:27.647943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:27.652516 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e17d86c2-a86d-400f-b190-1dd119ccc809 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.607882 Aug 29 15:32:27.653279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:27.653827 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 724/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:27 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:27.676930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.677451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.681627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.689564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.690525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.692336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.710085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:27.710880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:27.713533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:27.724062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.726657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.729249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.731732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.733191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.733868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.756653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:27.968027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:27.979509 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea42e87d-1f5f-43b8-a9cf-dc3b023abdae tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.347466 Aug 29 15:32:27.981795 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 767/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:27 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:27.986930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:27.988065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:27.996735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.997973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.999284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.003503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.006187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.006895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.224242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:28.230011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:28.232872 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a210b138-5092-4670-9ba9-f7e14770a0ba tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.249812 Aug 29 15:32:28.235515 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 768/1492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:27 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.251567 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3cc6de25-ebc1-486e-a4e7-51d4dbdbce93 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1467 microversion: 2.1 time: 0.548433 Aug 29 15:32:28.267792 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 725/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:27 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1467 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.275700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-02981844-044f-4ab1-843d-5ba5ef9b02c9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb704820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.445693 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-02981844-044f-4ab1-843d-5ba5ef9b02c9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-08-29T15%3A30%3A02Z" status: 200 len: 2377 microversion: 2.1 time: 0.177013 Aug 29 15:32:28.447803 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 769/1494] 10.222.0.16 () {58 vars in 1199 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/images?changes-since=2022-08-29T15%3A30%3A02Z => generated 2377 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.461917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14eed2a5-e39c-4069-8984-e029826f05dd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e338e310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.554473 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14eed2a5-e39c-4069-8984-e029826f05dd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1467255098" status: 200 len: 485 microversion: 2.1 time: 0.096616 Aug 29 15:32:28.555717 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 726/1495] 10.222.0.16 () {58 vars in 1231 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1467255098 => generated 485 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:28.572069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19e316f8-c3bf-4d23-b7ea-83faff0ae024 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e308a0d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.638256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af3690b0-dc9a-4cf9-8943-f96ec8c7ac5e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2086100240", "id": 42711893, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:28.647543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:28.664234 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af3690b0-dc9a-4cf9-8943-f96ec8c7ac5e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.181222 Aug 29 15:32:28.664839 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 770/1496] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:28 2022] POST /compute/v2.1/flavors => generated 424 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:28.669546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.670406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:28.676730 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19e316f8-c3bf-4d23-b7ea-83faff0ae024 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?server=85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 958 microversion: 2.1 time: 0.110613 Aug 29 15:32:28.677298 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 727/1497] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/images?server=85573cdb-9434-4da4-a11b-89a5780a0493 => generated 958 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:28.678563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.679866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.680622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.681672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.681885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f25734f-44b1-4c4d-86f6-edb2376523af tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.682640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.683481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.704709 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f25734f-44b1-4c4d-86f6-edb2376523af tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/42711893" status: 202 len: 0 microversion: 2.1 time: 0.026326 Aug 29 15:32:28.705296 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 728/1498] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:32:28 2022] DELETE /compute/v2.1/flavors/42711893 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:28.710064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.710683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:28.718156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.718645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.719073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.720010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.720390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.720813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.843785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:28.854988 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfe21299-764d-4eef-85de-e444ead0e4ec tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.189043 Aug 29 15:32:28.855753 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 771/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.860677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dadd44e7-709c-4a24-9f6b-2ac8042739f2 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb704820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.873213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:28.882291 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-185feb91-0705-4d65-bb58-2a2e3d3b01b6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1717 microversion: 2.1 time: 0.175908 Aug 29 15:32:28.882879 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 729/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.890906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0aec5d5a-0dab-4c30-b104-365831436452 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.916079 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0aec5d5a-0dab-4c30-b104-365831436452 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031222 Aug 29 15:32:28.916811 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 730/1501] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.926758 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dadd44e7-709c-4a24-9f6b-2ac8042739f2 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 485 microversion: 2.1 time: 0.069943 Aug 29 15:32:28.927657 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 772/1502] 10.222.0.16 () {58 vars in 1317 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 485 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:28.936621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e48ddb52-8c3f-4fc9-bac3-a81ada6d66b8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-843785690", "id": 1829849874, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:28.939904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e5f9577-8536-4e92-8563-4108c8e2245f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb779ca0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.959607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e48ddb52-8c3f-4fc9-bac3-a81ada6d66b8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.026338 Aug 29 15:32:28.960502 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 731/1503] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:28 2022] POST /compute/v2.1/flavors => generated 416 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:28.972443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-827a06dc-6490-4f02-b4c8-01d7f8033e7f tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.995824 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-827a06dc-6490-4f02-b4c8-01d7f8033e7f tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.027065 Aug 29 15:32:28.996412 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 732/1504] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.001330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.002225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:29.002406 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e5f9577-8536-4e92-8563-4108c8e2245f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 485 microversion: 2.1 time: 0.066933 Aug 29 15:32:29.003562 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 773/1505] 10.222.0.16 () {58 vars in 1303 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 485 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:29.019132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa8d3b07-568b-488a-8cca-0458398298f0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb779160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.019352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.019711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.020511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.021243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.021731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.022151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.154531 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa8d3b07-568b-488a-8cca-0458398298f0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3283 microversion: 2.1 time: 0.140596 Aug 29 15:32:29.155125 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 774/1506] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3283 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.161570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a5457787-3774-413d-906a-6248401da8e4 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.178015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a5457787-3774-413d-906a-6248401da8e4 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1829849874" status: 202 len: 0 microversion: 2.1 time: 0.021502 Aug 29 15:32:29.178474 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 775/1507] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:32:29 2022] DELETE /compute/v2.1/flavors/1829849874 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:29.184004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c93ad73-e1c0-45f9-bb75-ffe08bfe74fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e34e1280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.270334 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c93ad73-e1c0-45f9-bb75-ffe08bfe74fd tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.090678 Aug 29 15:32:29.274166 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 776/1508] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.279611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94840d08-06e3-4b03-8ce1-6a24ce29e793 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.308984 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94840d08-06e3-4b03-8ce1-6a24ce29e793 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033623 Aug 29 15:32:29.309633 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 777/1509] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.315497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.316125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:29.329260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.329929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.330458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.331274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.331812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.332429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.440990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:29.470574 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80150497-5a12-4dca-b94f-d4dd61717637 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.472867 Aug 29 15:32:29.471369 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 733/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.478860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3746a29-79d8-4b1a-9403-9f39f4ed8cb9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e320bdc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.539251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:29.549642 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-199ad7f7-a952-4a63-a8b5-980e306367da tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.238491 Aug 29 15:32:29.550591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 778/1511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.555918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2aab2364-0813-4ef7-bdf8-ccb5d4aa791e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1911353413", "id": 1748013789, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:29.578947 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2aab2364-0813-4ef7-bdf8-ccb5d4aa791e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026278 Aug 29 15:32:29.579935 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 779/1512] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:29 2022] POST /compute/v2.1/flavors => generated 429 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:29.601219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-351efb4a-0e7d-4aa8-9b02-851e40fe1a9e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.601439 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3746a29-79d8-4b1a-9403-9f39f4ed8cb9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.129062 Aug 29 15:32:29.601932 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 734/1513] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:29.625752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e4619913-4983-4a74-88ba-35d89560ae2d tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e31368b0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.630292 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-351efb4a-0e7d-4aa8-9b02-851e40fe1a9e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1748013789" status: 202 len: 0 microversion: 2.1 time: 0.042108 Aug 29 15:32:29.633446 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 780/1514] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:32:29 2022] DELETE /compute/v2.1/flavors/1748013789 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:32:29.643125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d351b397-48e9-405b-876a-2042615b479f tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.667867 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d351b397-48e9-405b-876a-2042615b479f tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029289 Aug 29 15:32:29.671479 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 781/1515] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:29.688758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-633debde-f33b-4b76-80c0-5ad5cd4b659c tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-446154781", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:29.716117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-633debde-f33b-4b76-80c0-5ad5cd4b659c tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.032056 Aug 29 15:32:29.717799 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 782/1516] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:29 2022] POST /compute/v2.1/flavors => generated 506 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:29.734789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ddfdcdc-a23d-4c40-8424-050e764da7bb tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.786403 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ddfdcdc-a23d-4c40-8424-050e764da7bb tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/530a51b5-18dc-4c01-b54e-02d0b666a449" status: 202 len: 0 microversion: 2.1 time: 0.059889 Aug 29 15:32:29.787002 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 783/1517] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:29 2022] DELETE /compute/v2.1/flavors/530a51b5-18dc-4c01-b54e-02d0b666a449 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:29.799615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9628e400-ce34-4fd6-8920-e1d4d6dee2e8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.807139 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e4619913-4983-4a74-88ba-35d89560ae2d tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-08-29T15%3A29%3A57Z" status: 200 len: 6330 microversion: 2.1 time: 0.193714 Aug 29 15:32:29.809693 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 735/1518] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-29T15%3A29%3A57Z => generated 6330 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.828626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e932bc0-3c0f-46d1-bc18-3f052dbf2952 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3268d30>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.856532 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9628e400-ce34-4fd6-8920-e1d4d6dee2e8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060521 Aug 29 15:32:29.857157 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 784/1519] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.878408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.879512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:29.895310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.897199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.898612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.900017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.901902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.903057 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e932bc0-3c0f-46d1-bc18-3f052dbf2952 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1467255098" status: 200 len: 665 microversion: 2.1 time: 0.078492 Aug 29 15:32:29.903765 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 736/1520] 10.222.0.16 () {58 vars in 1252 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1467255098 => generated 665 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:29.904166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.925278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-115e8629-783a-44f6-bea3-ee0eaaf5a676 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-831831657", "id": "5b9db2e5-cae7-46be-8623-a08fdc48e4fd", "os-flavor-access:is_public": "True"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:29.959628 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-115e8629-783a-44f6-bea3-ee0eaaf5a676 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.052891 Aug 29 15:32:29.970253 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 737/1521] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:29 2022] POST /compute/v2.1/flavors => generated 506 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:29.975066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.977075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:29.989709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.994080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.994653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.995515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.997894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.998474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.177967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.188622 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c4f6d04-394a-4f63-8ad8-e770eec91de3 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.315488 Aug 29 15:32:30.206764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 785/1522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.212682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f5a615ab-76e1-4a43-9a05-26d0a1edd491 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb779790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.280193 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f5a615ab-76e1-4a43-9a05-26d0a1edd491 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1465 microversion: 2.1 time: 0.071825 Aug 29 15:32:30.282141 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 786/1523] 10.222.0.16 () {58 vars in 1338 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1465 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.295984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-54b84c68-d1b6-49ab-882a-b0e461737f5c tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.319423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.319713 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-54b84c68-d1b6-49ab-882a-b0e461737f5c tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/5b9db2e5-cae7-46be-8623-a08fdc48e4fd" status: 202 len: 0 microversion: 2.1 time: 0.035303 Aug 29 15:32:30.320419 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 787/1524] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:30 2022] DELETE /compute/v2.1/flavors/5b9db2e5-cae7-46be-8623-a08fdc48e4fd => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:30.329068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-71e2a52f-14ec-4351-bc0c-5f6060d63fd1 req-11b9ab3f-52d2-442d-8e49-6cd59bdbb6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26", "name": "network-vif-plugged", "status": "completed", "tag": "2f6e8e6e-c1b9-4810-8681-585d58a349e4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:30.333665 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b50f9b2-7e59-4a0a-aad8-19747269d824 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1707 microversion: 2.1 time: 0.368148 Aug 29 15:32:30.345079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-71e2a52f-14ec-4351-bc0c-5f6060d63fd1 req-11b9ab3f-52d2-442d-8e49-6cd59bdbb6e9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.346121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-71e2a52f-14ec-4351-bc0c-5f6060d63fd1 req-11b9ab3f-52d2-442d-8e49-6cd59bdbb6e9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.346915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-71e2a52f-14ec-4351-bc0c-5f6060d63fd1 req-11b9ab3f-52d2-442d-8e49-6cd59bdbb6e9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.352563 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 738/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1707 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.363418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-71e2a52f-14ec-4351-bc0c-5f6060d63fd1 req-11b9ab3f-52d2-442d-8e49-6cd59bdbb6e9 service nova] Creating event network-vif-plugged:2f6e8e6e-c1b9-4810-8681-585d58a349e4 for instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 on n-h1-854882-3 Aug 29 15:32:30.364521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3482ffc-194a-482a-9679-8e9c38e401cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3268700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.372872 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-71e2a52f-14ec-4351-bc0c-5f6060d63fd1 req-11b9ab3f-52d2-442d-8e49-6cd59bdbb6e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048107 Aug 29 15:32:30.374503 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 788/1526] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:30.383344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16152f85-ce48-4416-9b93-3341b8aeb578 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.433127 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16152f85-ce48-4416-9b93-3341b8aeb578 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056827 Aug 29 15:32:30.434748 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 789/1527] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.440015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f20d6782-eeb7-4256-9567-85cbf7371d4b tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '.version_select at 0x7fb0e34f8670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.444750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f20d6782-eeb7-4256-9567-85cbf7371d4b tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.448054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f20d6782-eeb7-4256-9567-85cbf7371d4b tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.448930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f20d6782-eeb7-4256-9567-85cbf7371d4b tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.473057 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f20d6782-eeb7-4256-9567-85cbf7371d4b tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3496 microversion: 2.1 time: 0.034760 Aug 29 15:32:30.474297 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 790/1528] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/os-migrations => generated 3496 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.491878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a48d1d45-9dbf-4a1a-bae9-152cbb8bd625 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1075122477", "id": 1482615472, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:30.535068 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a48d1d45-9dbf-4a1a-bae9-152cbb8bd625 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.059615 Aug 29 15:32:30.536700 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 791/1529] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:30.542392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.543496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.551024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.551451 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3482ffc-194a-482a-9679-8e9c38e401cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1465 microversion: 2.1 time: 0.195434 Aug 29 15:32:30.551935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.562196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.562556 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 739/1530] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1465 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.562657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.562657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.562657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.567842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.568478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.581212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.585858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.587687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.588483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.588957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.589406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.783781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.804344 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81f21177-ac48-4388-bfbf-95a185c59a61 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1858 microversion: 2.1 time: 0.266611 Aug 29 15:32:30.808080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-71e2868a-73de-40cc-ada1-f6620d0169a1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.253907 Aug 29 15:32:30.809361 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 792/1531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1858 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.810396 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 740/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.818196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a6bcd1b1-a308-4001-8da5-3b4483778839 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.822749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-12ca3b18-8761-4379-b268-c5bf69c5828e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3136dc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.846225 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a6bcd1b1-a308-4001-8da5-3b4483778839 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1482615472" status: 200 len: 414 microversion: 2.1 time: 0.034426 Aug 29 15:32:30.848196 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 793/1533] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/flavors/1482615472 => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:30.862137 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 15:32:30.862467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.862833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.863388 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 15:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/detail?status=ACTIVE (ip 10.222.0.16) !!! Aug 29 15:32:30.879515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.880742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.880742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.881323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.881754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.882177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.941070 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-12ca3b18-8761-4379-b268-c5bf69c5828e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.128094 Aug 29 15:32:30.942030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 741/1534] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.956428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.956428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.962626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.964374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.964830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.969437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.970307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.971052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.088496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:31.098863 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fbf93d18-92a2-4f6a-936d-7eca3f0a1862 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1323 microversion: 2.1 time: 0.249007 Aug 29 15:32:31.099819 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 794/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.128943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-91befbad-ca01-47b4-8b7c-9b8cb6fb1eca tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1858 microversion: 2.1 time: 0.178746 Aug 29 15:32:31.129580 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 742/1536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1858 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.150571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b29f527c-21f0-42c8-bbbd-067ce74e2f7b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e320aee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.227384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b29f527c-21f0-42c8-bbbd-067ce74e2f7b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4371 microversion: 2.1 time: 0.084342 Aug 29 15:32:31.234959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18d39dc3-8521-4080-8286-e9abeae56c54 tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.238093 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 743/1537] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.245787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.246664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:31.254413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.254901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.255350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.256039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.256557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.256987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.266055 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18d39dc3-8521-4080-8286-e9abeae56c54 tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.164988 Aug 29 15:32:31.266864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 795/1538] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.271510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.272010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:31.280110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.280607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.281052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.281952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.282547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.283252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.378109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lazy-loading 'services' on Instance uuid 784f3eba-97c4-48b4-aa04-db77584cbee7 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:31.402921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:31.414544 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df53c592-4f63-4af8-8f32-750a4ef762cd tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.171989 Aug 29 15:32:31.414544 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 744/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.419692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b520ba4c-ef06-4736-90d8-268931823281 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e30d4f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.480573 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca516e02-5528-4412-bfbd-c39dcb7d84e1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments/f7b0886e-04e1-4772-b3ea-5d4728090c4b" status: 202 len: 0 microversion: 2.1 time: 0.212693 Aug 29 15:32:31.481737 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 796/1540] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:32:31 2022] DELETE /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments/f7b0886e-04e1-4772-b3ea-5d4728090c4b => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:31.482851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b520ba4c-ef06-4736-90d8-268931823281 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/69b80579-025a-47db-8397-1d03ce8a20ab" status: 200 len: 784 microversion: 2.1 time: 0.069801 Aug 29 15:32:31.483704 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 745/1541] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/images/69b80579-025a-47db-8397-1d03ce8a20ab => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:31.488877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b062e596-c23a-4037-b36c-ffa5b78cf9d8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.498118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.501361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:31.511515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.512318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.513107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.514052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.514846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.515273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.547532 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b062e596-c23a-4037-b36c-ffa5b78cf9d8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1482615472" status: 202 len: 0 microversion: 2.1 time: 0.063771 Aug 29 15:32:31.548510 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 797/1542] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:32:31 2022] DELETE /compute/v2.1/flavors/1482615472 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:31.560039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8440954d-12a7-4091-9b1b-fe483e3ec060 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e2f92550>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.566128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6214cc12-1607-4cbd-baf3-5a1cb4acf7aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079884 Aug 29 15:32:31.569539 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 746/1543] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:31.575406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-04adbda5-65ff-4d27-b04b-e102bf5d345d tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.605594 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-04adbda5-65ff-4d27-b04b-e102bf5d345d tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033041 Aug 29 15:32:31.606562 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 747/1544] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.625231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-95b9c199-e00d-4edd-b37e-b6298f59ae66 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-784112357", "id": 903579192, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:31.638903 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8440954d-12a7-4091-9b1b-fe483e3ec060 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.089190 Aug 29 15:32:31.640195 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 798/1545] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.656648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dffc61c7-59cb-48e5-aa3c-e795ea67fb58 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e34e15e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.659760 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-95b9c199-e00d-4edd-b37e-b6298f59ae66 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.038229 Aug 29 15:32:31.661051 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 748/1546] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:31 2022] POST /compute/v2.1/flavors => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:31.679428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-20018827-9a22-4d48-af70-6a62c922ea8d tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "903579192"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:31.692270 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-20018827-9a22-4d48-af70-6a62c922ea8d tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] HTTP exception thrown: Flavor 903579192 could not be found. Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-20018827-9a22-4d48-af70-6a62c922ea8d tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] Request method failure captured: Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 106 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwLHK3VDHQbAP_S2rei5fY-6bhf692HJNIbJa8ZjmOpaE3z4g1VGgo3-FZubUX8PsEUasFAzMnSOfvj_oHPA9c8xkFA6sb5Qm0PzTRHVSDVR2MTtUCxxZYMsHvpJUhjZt3pDgYSY1HE9AZxDF29izts9P0x4RCGHkPbOQo_aB66nOs Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: beba0e05ab32426db226acfb78ec7d8d Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FlavorsAdminTestJSON-1913640287 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beba0e05ab32426db226acfb78ec7d8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beba0e05ab32426db226acfb78ec7d8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beba0e05ab32426db226acfb78ec7d8d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beba0e05ab32426db226acfb78ec7d8d"}]}] Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FlavorsAdminTestJSON-1913640287 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: beba0e05ab32426db226acfb78ec7d8d Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1913640287 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FlavorsAdminTestJSON-1913640287-project Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 75c566d8fca04caab835026d330e2001 Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FlavorsAdminTestJSON-1913640287-project Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "test", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "903579192"}} Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: exception: Flavor 903579192 could not be found. Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '903579192'}}} Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 903579192 could not be found. Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:32:31.700338 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 903579192 could not be found. Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 903579192 could not be found. Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-20018827-9a22-4d48-af70-6a62c922ea8d tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] Returning 400 to user: Flavor 903579192 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-20018827-9a22-4d48-af70-6a62c922ea8d tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.027127 Aug 29 15:32:31.706545 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 749/1547] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:31 2022] POST /compute/v2.1/servers => generated 80 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:31.721876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f1de45a-cedf-4e66-b144-87718c844de8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.749337 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f1de45a-cedf-4e66-b144-87718c844de8 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/903579192" status: 202 len: 0 microversion: 2.1 time: 0.036965 Aug 29 15:32:31.750269 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 750/1548] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:32:31 2022] DELETE /compute/v2.1/flavors/903579192 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:32:31.758170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e382145d-682b-47e6-a222-063b2d3356ce tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.779644 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e382145d-682b-47e6-a222-063b2d3356ce tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024948 Aug 29 15:32:31.780238 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 751/1549] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.800136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8541cc5d-a867-456c-b681-4dbadef087ae tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-261720745", "id": 2059797718, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:31.822178 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8541cc5d-a867-456c-b681-4dbadef087ae tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.025109 Aug 29 15:32:31.822882 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 752/1550] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:31.834798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4c502b9d-6f4c-453c-a45b-6296ae4d7f24 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2091631671", "id": 2041786168, "os-flavor-access:is_public": "True"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:31.860323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4c502b9d-6f4c-453c-a45b-6296ae4d7f24 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029159 Aug 29 15:32:31.861856 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 753/1551] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:31.868859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.870111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:31.878709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.879300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.879823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.880616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.881340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.882272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.131115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.173946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9c821a4a-ed4f-4dc1-b7b6-44ac0da2bca2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.310304 Aug 29 15:32:32.176649 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 754/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:32.189691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c83cd19a-8a6f-47a2-9055-1a6338215499 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.231658 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c83cd19a-8a6f-47a2-9055-1a6338215499 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.053575 Aug 29 15:32:32.237566 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 755/1553] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:32.256358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.257362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:32.268364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.277605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.277605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.277605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.277605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.277605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.458082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.468321 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0db1158-37fd-496c-aa8f-3e1959be5154 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1520 microversion: 2.1 time: 0.227482 Aug 29 15:32:32.469308 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 756/1554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:32.489720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6aca6bb0-dc95-4324-bac3-9fb1f7cbd02b tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.505058 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6aca6bb0-dc95-4324-bac3-9fb1f7cbd02b tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.021736 Aug 29 15:32:32.506135 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 757/1555] 10.222.0.16 () {58 vars in 1177 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:32.510931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5502bebc-470b-4ab2-8176-a1755517c04a req-162ec29b-fd6f-482b-a53e-c467a1452ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85573cdb-9434-4da4-a11b-89a5780a0493", "name": "network-vif-unplugged", "status": "completed", "tag": "d044e837-eb27-4ad5-81b7-21637633fde4"}, {"server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "name": "network-vif-plugged", "status": "completed", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:32.522563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5502bebc-470b-4ab2-8176-a1755517c04a req-162ec29b-fd6f-482b-a53e-c467a1452ffe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.523471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5502bebc-470b-4ab2-8176-a1755517c04a req-162ec29b-fd6f-482b-a53e-c467a1452ffe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.524029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5502bebc-470b-4ab2-8176-a1755517c04a req-162ec29b-fd6f-482b-a53e-c467a1452ffe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.541023 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5502bebc-470b-4ab2-8176-a1755517c04a req-162ec29b-fd6f-482b-a53e-c467a1452ffe service nova] Creating event network-vif-unplugged:d044e837-eb27-4ad5-81b7-21637633fde4 for instance 85573cdb-9434-4da4-a11b-89a5780a0493 on n-h1-854882-3 Aug 29 15:32:32.541678 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5502bebc-470b-4ab2-8176-a1755517c04a req-162ec29b-fd6f-482b-a53e-c467a1452ffe service nova] Creating event network-vif-plugged:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h1-854882-3 Aug 29 15:32:32.550454 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5502bebc-470b-4ab2-8176-a1755517c04a req-162ec29b-fd6f-482b-a53e-c467a1452ffe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042841 Aug 29 15:32:32.551301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 758/1556] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:32.561457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.562194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:32.565918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dffc61c7-59cb-48e5-aa3c-e795ea67fb58 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f" status: 204 len: 0 microversion: 2.1 time: 0.913039 Aug 29 15:32:32.568841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.569330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.569828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.570570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.570895 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 799/1557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:31 2022] DELETE /compute/v2.1/images/e4ae48e7-510d-487d-8382-7b39ec80e78f => generated 0 bytes in 919 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:32.571080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.571463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.584969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eccf228f-8b38-498f-9a2a-1b50a4688a56 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'create', calling method: .version_select at 0x7fb0e34f4f70>, body: {"pool": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:32.814359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.830258 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b6d0e817-21cb-4c83-a4ec-39ec2b6ed191 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1312 microversion: 2.1 time: 0.273603 Aug 29 15:32:32.847667 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 759/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:32.847667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25df63ea-2de5-4972-8937-60da6319f4c2 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.865073 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25df63ea-2de5-4972-8937-60da6319f4c2 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.028857 Aug 29 15:32:32.866120 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 760/1559] 10.222.0.16 () {58 vars in 1171 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:32.870785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65eec89f-9591-4c46-8b75-b1dbed94328f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e308aca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:33.474428 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65eec89f-9591-4c46-8b75-b1dbed94328f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00" status: 204 len: 0 microversion: 2.1 time: 0.607002 Aug 29 15:32:33.478356 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 761/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:32 2022] DELETE /compute/v2.1/images/52f7f76f-5651-4975-ac01-f8fe6f1dfb00 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:33.481694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:33.484167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:33.494072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.494072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.494474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.495491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.495995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.496721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.542163 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a5a30d0-8d11-4193-8c5f-d3e17fc13e85 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065937 Aug 29 15:32:33.546666 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 762/1561] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:33 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:33.548707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8352e479-5181-4e1f-ad0f-06022403c343 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:33.560551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8352e479-5181-4e1f-ad0f-06022403c343 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.015541 Aug 29 15:32:33.561431 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 763/1562] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Aug 29 15:32:33 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:33.568653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:33.568653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:33.573100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.573611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.574041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.574729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.575163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.576049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.746612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:33.756984 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-56f6583c-852b-4d52-9fe9-c9aee026aa9b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1522 microversion: 2.1 time: 0.194413 Aug 29 15:32:33.757599 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 764/1563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:33 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:33.798760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-68203d92-9c96-48ad-b430-1d597f6abef4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e308aa60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.373205 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eccf228f-8b38-498f-9a2a-1b50a4688a56 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.798677 Aug 29 15:32:34.381438 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 800/1564] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:32:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:34.381438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-edcf0c7e-c362-4cbf-aa2c-51247c559eaf tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.411124 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-edcf0c7e-c362-4cbf-aa2c-51247c559eaf tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.035619 Aug 29 15:32:34.412313 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 801/1565] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Aug 29 15:32:34 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:34.414106 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-68203d92-9c96-48ad-b430-1d597f6abef4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6" status: 204 len: 0 microversion: 2.1 time: 0.624450 Aug 29 15:32:34.414943 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 765/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:33 2022] DELETE /compute/v2.1/images/2008c4ba-2c66-4ec8-a0aa-b5bc4af0c3a6 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:34.419123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.420044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:34.422876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.423376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:34.427003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.427704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.428305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.429181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.433880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.434515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.438798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.439261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.439865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.440903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.441370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.441793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.503533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:32:34.558832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:34.646915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:34.648196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:34.658006 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-17450492-4159-4272-b424-6d4471b236fe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1462 microversion: 2.1 time: 0.243291 Aug 29 15:32:34.663634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eea2f8ac-6777-4eff-a635-b971be885320 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 204 len: 0 microversion: 2.1 time: 0.243907 Aug 29 15:32:34.664507 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 766/1567] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:34 2022] DELETE /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:32:34.664770 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 802/1568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:34 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1462 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:34.670705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f28bdf2d-394e-4c3c-9c9a-340a6ba684e3 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.670893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.673779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:34.681502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.682283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.683179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.683959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.684463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.684917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.698151 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f28bdf2d-394e-4c3c-9c9a-340a6ba684e3 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.031671 Aug 29 15:32:34.699719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 767/1569] 10.222.0.16 () {58 vars in 1175 bytes} [Mon Aug 29 15:32:34 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:34.704631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-37648534", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "c6251ecf-a75f-4808-83b5-41937559c769"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:34.734923 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8e0688d-8ae5-48cb-a075-45850a63bc1e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068481 Aug 29 15:32:34.735558 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 803/1570] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:34 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:34.740807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.741933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:34.751191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.752142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.753109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.754043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.754820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.755422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.786022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] validate_networks() for [('c6251ecf-a75f-4808-83b5-41937559c769', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:35.007361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.017823 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3936447d-3931-4ff0-be23-061c3591b731 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1473 microversion: 2.1 time: 0.280717 Aug 29 15:32:35.019038 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 804/1571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:34 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.024185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.025200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:35.032256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.033585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.034274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.035345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.036035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.036780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.217865 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa85fb29-8ed3-4d79-922c-1c6542237d88 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1613 microversion: 2.1 time: 0.197102 Aug 29 15:32:35.218456 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 805/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1613 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.223455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a28a5089-801b-4238-9ab0-4a1e3540dd94 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.247196 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a28a5089-801b-4238-9ab0-4a1e3540dd94 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.027324 Aug 29 15:32:35.248147 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 806/1573] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.253472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.254362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:35.260630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.261635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.262261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.263512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.263977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.264411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.439450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.447520 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-59548759-bcf1-4187-8812-649a2dfbd668 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1502 microversion: 2.1 time: 0.197990 Aug 29 15:32:35.452364 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 807/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.457494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:35.458123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:35.464802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.465306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.465779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.466709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.467171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.468084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.565300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a475f784dacf42f09574889b479994c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99027d125a554aa8ba6d93ec8d8647df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.565991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] flavor_id is None. Assuming migration. {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:32:35.566467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:32:35.772761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:35.773307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:35.773713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:35.774151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:35.775114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:35.788281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.789058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.789716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.791341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.792035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.792697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.815899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Getting quotas for project 1b0e1286b14d4f749e3216980f645523. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:35.822283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Getting quotas for user a47bb5a8721d4c09933fec4331761a41 and project 1b0e1286b14d4f749e3216980f645523. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:35.838978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:35.841493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:35.894847 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a648b7f4-ed21-4868-a08c-f49ba7cd43ec tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193671 Aug 29 15:32:35.897612 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 768/1575] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:32:35.916179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1369b4b0-e993-4636-bfa0-4105ac0bfd96 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.961261 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1369b4b0-e993-4636-bfa0-4105ac0bfd96 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.061297 Aug 29 15:32:35.962890 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 769/1576] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.965509 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f8d05d4-116e-4b22-bc11-67ddce690a6c tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d/action" status: 202 len: 0 microversion: 2.1 time: 0.510099 Aug 29 15:32:35.966955 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 808/1577] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:35 2022] POST /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:35.978507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.984653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.001466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.002951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.006927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.008711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.010942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.011865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.013207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.017969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.019279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:36.040996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.041574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.043930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.047747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.048237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.048731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.118114 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a81f3be-3008-4680-b1a1-b3e29ee37400 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149157 Aug 29 15:32:36.128275 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 809/1578] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:36.129795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce210c7e-5a1a-4822-b09d-ad89d5b2671e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.130463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce210c7e-5a1a-4822-b09d-ad89d5b2671e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.220510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce210c7e-5a1a-4822-b09d-ad89d5b2671e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.228841 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce210c7e-5a1a-4822-b09d-ad89d5b2671e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1222 microversion: 2.1 time: 0.103921 Aug 29 15:32:36.230526 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 810/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.236110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.237082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.239342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=15,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:36.245768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.246359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.246910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.247747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.248432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.248938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.383813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.397402 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-20931065-0413-4cf9-90ad-cf2463ea86bc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1515 microversion: 2.1 time: 0.431132 Aug 29 15:32:36.398041 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 770/1580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.406156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c7219a6-b946-4f8f-bdc2-c4763cedb8ee tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.451400 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c7219a6-b946-4f8f-bdc2-c4763cedb8ee tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2041786168" status: 202 len: 0 microversion: 2.1 time: 0.052031 Aug 29 15:32:36.452182 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 771/1581] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:32:36 2022] DELETE /compute/v2.1/flavors/2041786168 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:36.462918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.465495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.482807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.485171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.485838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.488917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.489973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.490524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.495889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.506670 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b2dc97b-f870-48f6-887c-1f2911cab0a1 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1471 microversion: 2.1 time: 0.274759 Aug 29 15:32:36.522534 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 811/1582] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.529370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d5a1c7b5-3f62-4b5e-9741-f7978df5bea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:36.540170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d5a1c7b5-3f62-4b5e-9741-f7978df5bea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 07a82ad8-f5db-4105-b4de-7d004f6a13f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.560080 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d5a1c7b5-3f62-4b5e-9741-f7978df5bea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Instance 07a82ad8-f5db-4105-b4de-7d004f6a13f7 could not be found. Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d5a1c7b5-3f62-4b5e-9741-f7978df5bea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/07a82ad8-f5db-4105-b4de-7d004f6a13f7/action HTTP/1.1 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 14 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: {"rescue": {}} Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 07a82ad8-f5db-4105-b4de-7d004f6a13f7 could not be found. Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '07a82ad8-f5db-4105-b4de-7d004f6a13f7', 'body': {'rescue': {}}} Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a82ad8-f5db-4105-b4de-7d004f6a13f7 could not be found. Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a82ad8-f5db-4105-b4de-7d004f6a13f7 could not be found. Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:36.568559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a82ad8-f5db-4105-b4de-7d004f6a13f7 could not be found. Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d5a1c7b5-3f62-4b5e-9741-f7978df5bea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 404 to user: Instance 07a82ad8-f5db-4105-b4de-7d004f6a13f7 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d5a1c7b5-3f62-4b5e-9741-f7978df5bea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/07a82ad8-f5db-4105-b4de-7d004f6a13f7/action" status: 404 len: 111 microversion: 2.1 time: 0.046825 Aug 29 15:32:36.574812 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 812/1583] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:36 2022] POST /compute/v2.1/servers/07a82ad8-f5db-4105-b4de-7d004f6a13f7/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:36.576780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1dde35b6-d73f-46bd-8255-a940ed2e649e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.606882 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1dde35b6-d73f-46bd-8255-a940ed2e649e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033999 Aug 29 15:32:36.607875 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 813/1584] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.613411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:36.613970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.623242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.624047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.624502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.625382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.625950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.626791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.733044 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea0401b6-d123-41a7-b027-f522f2c7be4d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action" status: 202 len: 0 microversion: 2.1 time: 0.123156 Aug 29 15:32:36.737003 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 814/1585] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:36 2022] POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:36.772409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-354f3090-ed54-48f6-a00b-03449445e2a0 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.807122 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-354f3090-ed54-48f6-a00b-03449445e2a0 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2059797718" status: 202 len: 0 microversion: 2.1 time: 0.071311 Aug 29 15:32:36.807781 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 815/1586] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:32:36 2022] DELETE /compute/v2.1/flavors/2059797718 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:36.818998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.822159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.841857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.844034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.847153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.850297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.855666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.858871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.891298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.911876 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-60ecddde-8340-46a6-b3f0-5d1a4fb479b1 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1473 microversion: 2.1 time: 0.456965 Aug 29 15:32:36.913719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 772/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1473 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.922162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6bd71d76-6c4c-4ac2-b31d-36c27d0291dc tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.978681 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6bd71d76-6c4c-4ac2-b31d-36c27d0291dc tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059480 Aug 29 15:32:37.001817 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 773/1588] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.009527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b13e7a19-8e98-4f41-8208-7df400c7a2bf tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-25111014", "id": 2091270514, "os-flavor-access:is_public": "False"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:37.046674 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b13e7a19-8e98-4f41-8208-7df400c7a2bf tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.040129 Aug 29 15:32:37.059088 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 774/1589] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:37.071641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f966e681-5c89-45b6-b890-e5f4af36363b tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.138538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f966e681-5c89-45b6-b890-e5f4af36363b tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077164 Aug 29 15:32:37.141286 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 775/1590] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.178887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.184305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:37.250251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.252024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.255597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.258032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.258704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.259350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.268184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.297127 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c0f944d2-9199-45ae-99a1-922c0d8f86e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1520 microversion: 2.1 time: 0.483254 Aug 29 15:32:37.302336 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 816/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.328824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29fdd20f-f169-4f3a-9ed1-fa8959546e0d tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.348635 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ea818bd0-4bdb-4fb7-92c8-56a9ad54b7ce tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204852 Aug 29 15:32:37.355968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 776/1592] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:37.362142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.363315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:37.371654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.372875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.376749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.378021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.378656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.380213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.399353 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29fdd20f-f169-4f3a-9ed1-fa8959546e0d tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083678 Aug 29 15:32:37.403875 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 817/1593] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.426639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d9e580e6-46b9-42ec-8fe6-29331faa7efb tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.466764 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d9e580e6-46b9-42ec-8fe6-29331faa7efb tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2091270514" status: 202 len: 0 microversion: 2.1 time: 0.045884 Aug 29 15:32:37.468811 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 818/1594] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:32:37 2022] DELETE /compute/v2.1/flavors/2091270514 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:32:37.481088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a685a416-380d-42e0-af2a-3f3d152db59e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.527989 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a685a416-380d-42e0-af2a-3f3d152db59e tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054654 Aug 29 15:32:37.532351 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 819/1595] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.539238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.540360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:37.558583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.559366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.561365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.562374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.563029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.566068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.596486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.621178 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a4deb2a8-2d90-4b30-b80c-580270f844c9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1218 microversion: 2.1 time: 0.263764 Aug 29 15:32:37.636975 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 777/1596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.638805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0085df21-27fa-4eb6-9cef-84c4fa1505f7 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-866158662", "id": 699878404, "os-flavor-access:is_public": "True"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:37.673661 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0085df21-27fa-4eb6-9cef-84c4fa1505f7 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.047272 Aug 29 15:32:37.674658 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 778/1597] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:37 2022] POST /compute/v2.1/flavors => generated 410 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:37.713718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9b681c8-daf8-4f5d-a978-22ccaab2873a tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.741676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9b681c8-daf8-4f5d-a978-22ccaab2873a tempest-FlavorsAdminTestJSON-1913640287 tempest-FlavorsAdminTestJSON-1913640287-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.047146 Aug 29 15:32:37.743118 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 779/1598] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.779991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9784ae55-261b-4960-ad4f-a175cc0f5df1 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.850870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9784ae55-261b-4960-ad4f-a175cc0f5df1 tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/699878404" status: 202 len: 0 microversion: 2.1 time: 0.083584 Aug 29 15:32:37.858906 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 780/1599] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:32:37 2022] DELETE /compute/v2.1/flavors/699878404 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:37.864327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-26585261-bb81-4451-b21c-9f130463be8c req-e61515f2-193e-43dd-89b2-7dade183e076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732c70a7-f3ed-4ea1-93f1-4c8dc6557798", "name": "network-vif-deleted", "tag": "542008f2-a595-47a6-9079-28073e7e45d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:37.890486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26585261-bb81-4451-b21c-9f130463be8c req-e61515f2-193e-43dd-89b2-7dade183e076 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.894186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26585261-bb81-4451-b21c-9f130463be8c req-e61515f2-193e-43dd-89b2-7dade183e076 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.897231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26585261-bb81-4451-b21c-9f130463be8c req-e61515f2-193e-43dd-89b2-7dade183e076 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.923090 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-26585261-bb81-4451-b21c-9f130463be8c req-e61515f2-193e-43dd-89b2-7dade183e076 service nova] Creating event network-vif-deleted:542008f2-a595-47a6-9079-28073e7e45d3 for instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 on n-h2-854882-3 Aug 29 15:32:37.936770 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-26585261-bb81-4451-b21c-9f130463be8c req-e61515f2-193e-43dd-89b2-7dade183e076 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075460 Aug 29 15:32:37.949795 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 781/1600] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:37.960145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-33eb7e15-b58c-4808-af06-1f48dcfafa3c tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.977876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.006374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-33eb7e15-b58c-4808-af06-1f48dcfafa3c tempest-FlavorsAdminTestJSON-222205679 tempest-FlavorsAdminTestJSON-222205679-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054239 Aug 29 15:32:38.010829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e36f195-0d0b-4eff-94c1-e6ba932f8db4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1471 microversion: 2.1 time: 0.471214 Aug 29 15:32:38.014841 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 782/1601] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:38.026472 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 820/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:38.030418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.031358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.049236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.050075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.050707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.051607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.052227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.053054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.129212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.130078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.130678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.131877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lazy-loading 'fault' on Instance uuid 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:38.256391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.273295 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8fd3b31c-e8c6-45a9-9593-28fd5980362b tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1307 microversion: 2.1 time: 0.254247 Aug 29 15:32:38.294478 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 783/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:38.316110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.316733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.326474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.337776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.338503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.339527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.340244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.340723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.375769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.379504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.399958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.400444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.400865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.405522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.409720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.410393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.493066 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3f4f6fe-7443-49f4-8587-3bdf5d989dbf tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123916 Aug 29 15:32:38.494507 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 784/1604] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:38.590075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.600376 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd902905-04ce-4846-859b-d7f675472343 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1500 microversion: 2.1 time: 0.288124 Aug 29 15:32:38.617009 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 821/1605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1500 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:38.627632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:38.631538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.641012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.641848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.642345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.643671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.644577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.645075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.657257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.658647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.681306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'flavor' on Instance uuid ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:38.691132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.691746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.692921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.695526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.696077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.696622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.741664 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Cannot 'rescue' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state paused Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action HTTP/1.1 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 14 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: {"rescue": {}} Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot 'rescue' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state paused Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4', 'body': {'rescue': {}}} Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 in vm_state paused. Cannot rescue while the instance is in this state. Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state paused Aug 29 15:32:38.744867 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state paused Aug 29 15:32:38.750588 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:32:38.759471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 409 to user: Cannot 'rescue' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state paused {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:38.760895 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08f0a496-ef83-4200-9985-cfde74c1ffc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action" status: 409 len: 144 microversion: 2.1 time: 0.141051 Aug 29 15:32:38.762029 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 785/1606] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:38 2022] POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action => generated 144 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:32:38.781914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:38.785441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.801485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.802101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.805138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.806685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.807438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.809482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.811530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.814794 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d16e1806-ae7e-40a4-aac9-73ed930d60f0 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1274 microversion: 2.1 time: 0.162675 Aug 29 15:32:38.815547 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 822/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:38.978834 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8013acb-c746-44e0-9b2c-049b3be1f74d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action" status: 202 len: 0 microversion: 2.1 time: 0.207506 Aug 29 15:32:38.982120 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 786/1608] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:38 2022] POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:38.991033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.991660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.003299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.010144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.010862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.011627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.016730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.017284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.036890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:39.037711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.053004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.053402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.056806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.059803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.066619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.067267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.336293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:39.356482 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-84bf75b3-cbd7-49a9-8147-f47057468887 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1507 microversion: 2.1 time: 0.369360 Aug 29 15:32:39.357722 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 823/1609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:39.381950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:39.382619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.391109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.392194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.392823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.393817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.394454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.395214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.438969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.439914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.440684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.441327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lazy-loading 'fault' on Instance uuid 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:39.470637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:39.485112 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-61108d81-8ac0-42b4-b411-bb73c7fd786b tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1471 microversion: 2.1 time: 0.453719 Aug 29 15:32:39.486039 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 787/1610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:39 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1471 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:39.507120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:39.513731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.514542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:39.520576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.521024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.521592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.522373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.522898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.523393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.527494 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7ca0ec16-25de-40b0-a4a1-51f2293df280 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 200 len: 1307 microversion: 2.1 time: 0.168116 Aug 29 15:32:39.550948 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 824/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:39 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:39.563404 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a5a08ef-20fa-410c-a2f0-11d39ef7ab90 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060573 Aug 29 15:32:39.565423 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 788/1612] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:39 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:32:39.835825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:39.836601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.863010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.871340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.875115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.876135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.879698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.880405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.017715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:40.026712 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b06522d-2200-4077-9e6d-4b627d753a40 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1280 microversion: 2.1 time: 0.195313 Aug 29 15:32:40.030872 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 825/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:39 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:40.383028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:40.383644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:40.390631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.391121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.391549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.392403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.392900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.393322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.506711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:40.507332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:40.517312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.517845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.518281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.519060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.519446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.519876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.761777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:40.770412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fbe2fee3-f33f-4842-9913-cdf1473e06c4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1471 microversion: 2.1 time: 0.267518 Aug 29 15:32:40.771443 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 826/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:40 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:40.778878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:40.779965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 732c70a7-f3ed-4ea1-93f1-4c8dc6557798] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:40.789300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.790397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.790980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.791800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.792463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.793612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.817825 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] HTTP exception thrown: Instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 could not be found. Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Request method failure captured: Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 HTTP/1.1 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNt0PH6JqwORWCk5BwszSG2zhEWoYuEZP8SV1Tgfhw80KP1yRyII7fMMN7eYvGkD78T0WXnvR3faDXEqkd_ttlQTNf7iogQbi40HQIO0KuZ7q97c06ycJycy_B4MFJGMWj8zsMjxppEYnAjmgcbsPtAObGage9pZME8pk_X2RgqusxU Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 18cc1aaed2584885939c5e7351aeb657 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListImageFiltersTestJSON-362034621 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18cc1aaed2584885939c5e7351aeb657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18cc1aaed2584885939c5e7351aeb657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18cc1aaed2584885939c5e7351aeb657", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18cc1aaed2584885939c5e7351aeb657"}]}] Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListImageFiltersTestJSON-362034621 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 18cc1aaed2584885939c5e7351aeb657 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-362034621 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListImageFiltersTestJSON-362034621-project Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 486709a8644a40dea3786a139896fb57 Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListImageFiltersTestJSON-362034621-project Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 could not be found. Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '732c70a7-f3ed-4ea1-93f1-4c8dc6557798'} Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 could not be found. Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 could not be found. Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:40.820152 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:40.825769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:40.825769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:40.825769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:40.825769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:40.825769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:40.825769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 could not be found. Aug 29 15:32:40.825769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:40.827968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Returning 404 to user: Instance 732c70a7-f3ed-4ea1-93f1-4c8dc6557798 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:40.829207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1122664-b623-40fc-adb0-353b9473d9cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798" status: 404 len: 111 microversion: 2.1 time: 0.056226 Aug 29 15:32:40.830442 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 827/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:40 2022] GET /compute/v2.1/servers/732c70a7-f3ed-4ea1-93f1-4c8dc6557798 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:40.845501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:40.846173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:40.846430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:40.853819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.854574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.855206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.856491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.859122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.859122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.862623 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-47574e93-9bd9-419c-9190-7f22eaf5f3e8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1515 microversion: 2.1 time: 0.484069 Aug 29 15:32:40.863999 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 789/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:40 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1515 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:40.905820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:32:41.053358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.056874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:41.070644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.076255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.077620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.078868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.079548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.081099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.129924 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6fc1ae1b-ce85-4de5-be14-b11792a97a8f tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 204 len: 0 microversion: 2.1 time: 0.290988 Aug 29 15:32:41.133732 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 828/1617] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:40 2022] DELETE /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:41.147162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.147879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:41.160832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.161328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.161793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.163218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.173997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.176172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.285859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:41.304346 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5502c9fb-f43c-4c3f-a368-a5be42585666 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1280 microversion: 2.1 time: 0.255597 Aug 29 15:32:41.307661 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 790/1618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:41.798896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.799577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:41.820361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.823470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.825702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.826649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.830454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.830924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.941219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:41.951596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-84be9b3d-5c64-4b60-b346-2bc07c28b57e tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1473 microversion: 2.1 time: 0.813718 Aug 29 15:32:41.960520 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 829/1619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1473 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:42.324694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:42.330541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:42.332036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:42.339992 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-238378df-acce-49f3-84b8-c03c47ccd27f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1471 microversion: 2.1 time: 0.548738 Aug 29 15:32:42.346587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.349400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.353540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 791/1620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1471 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:42.365181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.366469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.374880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.376587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.432355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:42.991365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:42.994226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:43.005096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.005817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.007053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.009024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.011315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.013139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.530511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:43.569651 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a53723db-bcc0-419f-ad8b-8aac6fd62489 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 1.245361 Aug 29 15:32:43.572305 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 830/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:42 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:43.585542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:43.587145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:43.598491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.599411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.600157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.601526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.602239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.603646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.707258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:43.973255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:43.988947 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24843599-f3d3-4636-8819-df73eea5c0f9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.412873 Aug 29 15:32:43.989567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 831/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:43 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:43.995102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b8db6b32-2580-42dc-b578-4619a0bf786f req-522e1d53-60d2-4af3-9782-29e47455c1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6023c3-ece5-4f05-8f81-64c04a8778ea", "tag": "ec24680a-3fac-4d0f-8751-4edbd8f53cd8"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:44.011883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b8db6b32-2580-42dc-b578-4619a0bf786f req-522e1d53-60d2-4af3-9782-29e47455c1c0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.012969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b8db6b32-2580-42dc-b578-4619a0bf786f req-522e1d53-60d2-4af3-9782-29e47455c1c0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.013687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b8db6b32-2580-42dc-b578-4619a0bf786f req-522e1d53-60d2-4af3-9782-29e47455c1c0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.030191 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b8db6b32-2580-42dc-b578-4619a0bf786f req-522e1d53-60d2-4af3-9782-29e47455c1c0 service nova] Creating event network-changed:ec24680a-3fac-4d0f-8751-4edbd8f53cd8 for instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea on n-h2-854882-3 Aug 29 15:32:44.058433 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b8db6b32-2580-42dc-b578-4619a0bf786f req-522e1d53-60d2-4af3-9782-29e47455c1c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066378 Aug 29 15:32:44.059577 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 832/1623] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:44.079369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:44.082627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:44.105699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.105699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.105699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.105699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.106462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.106574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.156104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'flavor' on Instance uuid ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:44.185467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:44.196018 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a4886b8-6a21-4e81-9188-5b2848cef0f4 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1473 microversion: 2.1 time: 1.216241 Aug 29 15:32:44.197858 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 792/1624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:42 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1473 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:44.308289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c394b13-b3ab-46bf-adf9-af3b71d3fbb6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action" status: 200 len: 32 microversion: 2.1 time: 0.246836 Aug 29 15:32:44.309354 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 833/1625] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:44 2022] POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:32:44.332758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.336353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:44.361279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.365774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.366509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.367663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.369041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.370765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.645216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a77c826-dbd3-4523-b93c-4c800bdc64f3 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-973505274", "id": 1878731628, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:44.669795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a77c826-dbd3-4523-b93c-4c800bdc64f3 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.270928 Aug 29 15:32:44.670773 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 834/1626] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:32:44 2022] POST /compute/v2.1/flavors => generated 448 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:44.677066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.678130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:44.686323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.686831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.687276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.688008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.688470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.688914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.725559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:44.738173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-771addaf-c647-408b-a002-eb56f6ba4cd1 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.420420 Aug 29 15:32:44.738769 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 793/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:44 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:45.005417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a17d7a6-bb90-492c-84bc-f2db1d9d9513 tempest-FlavorsV255TestJSON-680994899 tempest-FlavorsV255TestJSON-680994899-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.010684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.023633 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a17d7a6-bb90-492c-84bc-f2db1d9d9513 tempest-FlavorsV255TestJSON-680994899 tempest-FlavorsV255TestJSON-680994899-project] 10.222.0.16 "GET /compute/v2.1/flavors/1878731628" status: 200 len: 448 microversion: 2.55 time: 0.283172 Aug 29 15:32:45.024221 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 794/1628] 10.222.0.16 () {60 vars in 1199 bytes} [Mon Aug 29 15:32:44 2022] GET /compute/v2.1/flavors/1878731628 => generated 448 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:45.035339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c116719a-6820-4b2e-8c58-57446418a455 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.363352 Aug 29 15:32:45.041777 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 835/1629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:44 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:45.047263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc6031a7-bddd-46fb-a1ad-21ff8f7baa47 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e92144c0>, body: {"flavor": {"description": "new"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:45.049875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.053995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:45.073807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.079443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.080348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.081712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.082422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.083099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.135730 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc6031a7-bddd-46fb-a1ad-21ff8f7baa47 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1878731628" status: 200 len: 449 microversion: 2.55 time: 0.092069 Aug 29 15:32:45.139688 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 836/1630] 10.222.0.16 () {62 vars in 1219 bytes} [Mon Aug 29 15:32:45 2022] PUT /compute/v2.1/flavors/1878731628 => generated 449 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:45.153126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8da57b2-af85-4a0d-9a02-f33a94ace559 tempest-FlavorsV255TestJSON-680994899 tempest-FlavorsV255TestJSON-680994899-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.193867 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8da57b2-af85-4a0d-9a02-f33a94ace559 tempest-FlavorsV255TestJSON-680994899 tempest-FlavorsV255TestJSON-680994899-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.044590 Aug 29 15:32:45.194939 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 837/1631] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:45.218781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-362852ae-dfbf-43b0-92af-4f64e87229f9 tempest-FlavorsV255TestJSON-680994899 tempest-FlavorsV255TestJSON-680994899-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.247633 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-362852ae-dfbf-43b0-92af-4f64e87229f9 tempest-FlavorsV255TestJSON-680994899 tempest-FlavorsV255TestJSON-680994899-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.034400 Aug 29 15:32:45.248613 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 838/1632] 10.222.0.16 () {60 vars in 1166 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:45.253780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.254809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:45.277445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.279948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.281217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.283197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.284184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.285076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.360245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.371581 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6480bab8-f49e-450e-a6c1-9dcd044739cb tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1431 microversion: 2.1 time: 0.121523 Aug 29 15:32:45.372900 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 839/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1431 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:45.378246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63ff7338-39c3-4f7b-adf1-12a08e667284 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.403749 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63ff7338-39c3-4f7b-adf1-12a08e667284 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1878731628" status: 202 len: 0 microversion: 2.55 time: 0.028827 Aug 29 15:32:45.408204 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 840/1634] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Aug 29 15:32:45 2022] DELETE /compute/v2.1/flavors/1878731628 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:45.416199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ddcf0da-95bf-4d84-a016-a6bf29f550a4 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.466698 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ddcf0da-95bf-4d84-a016-a6bf29f550a4 tempest-FlavorsV255TestJSON-1515776351 tempest-FlavorsV255TestJSON-1515776351-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.056223 Aug 29 15:32:45.469725 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 841/1635] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:45.759913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.760594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:45.783490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.786791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.789559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.790603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.793706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.794243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.806202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:45.831975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:45.968413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.982389 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5dbc008-85ea-48c3-8717-be88dcb64117 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.956702 Aug 29 15:32:45.983679 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 795/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:46.057407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:46.058174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:46.085339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.086162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.088289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.090366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.091681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.094079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.131429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.152379 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe985092-584f-47a7-b131-396fe185bbcd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.396944 Aug 29 15:32:46.152989 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 842/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:46.192844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-bfe7974d-cfd2-4e3e-b3df-39b5dd881c64 req-8734bda2-395f-4fba-96bd-80b2ef945ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85573cdb-9434-4da4-a11b-89a5780a0493", "name": "network-vif-deleted", "tag": "d044e837-eb27-4ad5-81b7-21637633fde4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:46.224146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bfe7974d-cfd2-4e3e-b3df-39b5dd881c64 req-8734bda2-395f-4fba-96bd-80b2ef945ac5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.224637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bfe7974d-cfd2-4e3e-b3df-39b5dd881c64 req-8734bda2-395f-4fba-96bd-80b2ef945ac5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.236199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bfe7974d-cfd2-4e3e-b3df-39b5dd881c64 req-8734bda2-395f-4fba-96bd-80b2ef945ac5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.239452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:46.256446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bfe7974d-cfd2-4e3e-b3df-39b5dd881c64 req-8734bda2-395f-4fba-96bd-80b2ef945ac5 service nova] Creating event network-vif-deleted:d044e837-eb27-4ad5-81b7-21637633fde4 for instance 85573cdb-9434-4da4-a11b-89a5780a0493 on n-h1-854882-3 Aug 29 15:32:46.267241 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-bfe7974d-cfd2-4e3e-b3df-39b5dd881c64 req-8734bda2-395f-4fba-96bd-80b2ef945ac5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077033 Aug 29 15:32:46.268707 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 843/1638] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:46.400095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:46.401487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:46.419928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.420431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.426138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.427247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.427890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.428472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.512193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.512515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.512848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.513549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lazy-loading 'fault' on Instance uuid 85573cdb-9434-4da4-a11b-89a5780a0493 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:46.532069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.549424 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-09bc1462-9dad-49d1-848b-80a39f991de1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.496958 Aug 29 15:32:46.550909 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 796/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:46 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:46.622719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486709a8644a40dea3786a139896fb57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cc1aaed2584885939c5e7351aeb657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.633699 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea3c9450-ffc4-4c6d-adb2-c4414eeaa2a9 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 200 len: 1308 microversion: 2.1 time: 0.244227 Aug 29 15:32:46.636722 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 844/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:46 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:47.004433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.007714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:47.015123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.020209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.020836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.021785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.022428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.023074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.178391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.179910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:47.182677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:47.188138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.188729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.189458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.190510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.191205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.191810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.288940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:47.311776 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1be2e427-2006-4c38-8431-786ea2e5fb6f tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.305982 Aug 29 15:32:47.330992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 797/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:46 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:47.472960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:47.488775 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e0cee452-a867-4aa8-b64d-57aa806ea83c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.315934 Aug 29 15:32:47.490188 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 845/1642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:47 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:47.575282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.576237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:47.586076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.587249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.588199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.589838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.591157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.591908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.657808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.658703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] [instance: 85573cdb-9434-4da4-a11b-89a5780a0493] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:47.671195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.671743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.672268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.678668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.679218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.679786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.724284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] HTTP exception thrown: Instance 85573cdb-9434-4da4-a11b-89a5780a0493 could not be found. Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Request method failure captured: Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 HTTP/1.1 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNt0PH6JqwORWCk5BwszSG2zhEWoYuEZP8SV1Tgfhw80KP1yRyII7fMMN7eYvGkD78T0WXnvR3faDXEqkd_ttlQTNf7iogQbi40HQIO0KuZ7q97c06ycJycy_B4MFJGMWj8zsMjxppEYnAjmgcbsPtAObGage9pZME8pk_X2RgqusxU Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 18cc1aaed2584885939c5e7351aeb657 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListImageFiltersTestJSON-362034621 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18cc1aaed2584885939c5e7351aeb657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18cc1aaed2584885939c5e7351aeb657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18cc1aaed2584885939c5e7351aeb657", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18cc1aaed2584885939c5e7351aeb657"}]}] Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListImageFiltersTestJSON-362034621 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 18cc1aaed2584885939c5e7351aeb657 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-362034621 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListImageFiltersTestJSON-362034621-project Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 486709a8644a40dea3786a139896fb57 Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListImageFiltersTestJSON-362034621-project Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 85573cdb-9434-4da4-a11b-89a5780a0493 could not be found. Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '85573cdb-9434-4da4-a11b-89a5780a0493'} Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85573cdb-9434-4da4-a11b-89a5780a0493 could not be found. Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85573cdb-9434-4da4-a11b-89a5780a0493 could not be found. Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:47.756651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85573cdb-9434-4da4-a11b-89a5780a0493 could not be found. Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Returning 404 to user: Instance 85573cdb-9434-4da4-a11b-89a5780a0493 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:47.768166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e82491d9-9235-4282-aa32-3a987badd872 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493" status: 404 len: 111 microversion: 2.1 time: 0.110884 Aug 29 15:32:47.769928 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 846/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:47 2022] GET /compute/v2.1/servers/85573cdb-9434-4da4-a11b-89a5780a0493 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:47.775626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1875392c-b8f2-4768-a9d6-e8c969cc51c0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e3595f70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.952471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:47.966233 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f32d93d1-a905-4e9f-9a30-18dbd18e5ef1 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.397487 Aug 29 15:32:47.968112 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 798/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:47 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:48.338857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.340839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:48.359265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.360760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.364535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.366484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.367126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.367569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.702085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.721594 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b88184ac-1e77-49c6-88c6-32a11fb27ae4 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.387436 Aug 29 15:32:48.722923 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 799/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:48.727888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.728808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:48.737651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:48.746586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.747339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.747981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.748611 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1875392c-b8f2-4768-a9d6-e8c969cc51c0 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/images/44840df0-1a54-4ccc-a419-14473b75725e" status: 204 len: 0 microversion: 2.1 time: 0.978959 Aug 29 15:32:48.749254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.749447 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 847/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:47 2022] DELETE /compute/v2.1/images/44840df0-1a54-4ccc-a419-14473b75725e => generated 0 bytes in 980 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:48.749644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.750041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.759603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29ad88fa-a85b-437f-a4c5-d8d58d6ca650 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0eb779af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.921210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.932375 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16faaf39-47ad-4e23-a958-bb53997ebd33 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.208127 Aug 29 15:32:48.933523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 800/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:48.994639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.995273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:49.015500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.017169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.018272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.020184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.021722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.022865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.260773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.273039 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d1b4c24b-a6ed-46d7-a082-44cdd4752380 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.283057 Aug 29 15:32:49.273885 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 801/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:49.356666 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29ad88fa-a85b-437f-a4c5-d8d58d6ca650 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/images/74eee68b-4095-41a1-a20c-ae718d3b1dfb" status: 204 len: 0 microversion: 2.1 time: 0.602647 Aug 29 15:32:49.358030 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 848/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:48 2022] DELETE /compute/v2.1/images/74eee68b-4095-41a1-a20c-ae718d3b1dfb => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:49.367920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-43b9a3d3-8077-4f22-a4fd-3c7eea8695e7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] Calling method '.version_select at 0x7fb0e33504c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.743566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.744419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:49.753231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.758207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.759433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.760463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.761174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.762402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.950704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.957822 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-43b9a3d3-8077-4f22-a4fd-3c7eea8695e7 tempest-ListImageFiltersTestJSON-362034621 tempest-ListImageFiltersTestJSON-362034621-project] 10.222.0.16 "DELETE /compute/v2.1/images/78a6050a-bda8-4d6a-80c2-d841ee6123b8" status: 204 len: 0 microversion: 2.1 time: 0.594297 Aug 29 15:32:49.958487 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 802/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:49 2022] DELETE /compute/v2.1/images/78a6050a-bda8-4d6a-80c2-d841ee6123b8 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:49.963548 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75196202-24a2-4160-843f-b12ed2942606 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.224050 Aug 29 15:32:49.964218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.964521 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 849/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:49.965026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:49.982984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.984107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.985126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.986116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.987188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.987854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.064508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-627308044", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5ab8f307-77e2-4e82-973f-058294ab71aa"}], "block_device_mapping_v2": [{"uuid": "78cd57f1-8d33-4bef-a70d-d772edf22aaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:50.175724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] validate_networks() for [('5ab8f307-77e2-4e82-973f-058294ab71aa', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:50.234339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:50.246592 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cfc3ad32-7265-4d1f-896c-150de17ae444 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.286997 Aug 29 15:32:50.247272 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 803/1652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:50.311836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:50.312480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:50.325671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.329586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.331935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.336002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.337354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.337994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.647141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:50.673193 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e3821b0-4e51-4535-b0c5-3fa2826a4d61 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.367498 Aug 29 15:32:50.682199 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 804/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:50 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:50.984984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:50.985755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:50.992648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.994179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.994779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.996479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.996929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.998985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.065436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:51.065966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:51.066129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:51.066573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:51.066984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:51.083369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.094036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.100483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.106897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.109188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.112270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.149563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:51.158760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Getting quotas for user f331c1e3ee1442ad863d8909ca76020b and project 0145760115bc47d188f32fca7793b863. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:51.263584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.278690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:51.282012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78cd57f1-8d33-4bef-a70d-d772edf22aaf',volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:51.289493 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7813b0bf-17f0-4d70-8761-bea354292766 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.307056 Aug 29 15:32:51.292384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 805/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:50 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:51.299732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.300367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:51.307850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.308524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.309053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.311024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.311854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.312496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.549522 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6885b46a-451c-49ad-bd23-fd2fd940b669 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.490171 Aug 29 15:32:51.550196 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 850/1655] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:32:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:32:51.562024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-11b28f49-d41a-4f41-a553-3cf6a6b9f7f4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.563253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-11b28f49-d41a-4f41-a553-3cf6a6b9f7f4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:51.595285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.606757 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8dead6b0-2f9c-4152-a9f1-4ba279fba3ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.312835 Aug 29 15:32:51.612793 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 806/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:51.647642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-11b28f49-d41a-4f41-a553-3cf6a6b9f7f4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.657032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-11b28f49-d41a-4f41-a553-3cf6a6b9f7f4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.659399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-11b28f49-d41a-4f41-a553-3cf6a6b9f7f4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.661000 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-11b28f49-d41a-4f41-a553-3cf6a6b9f7f4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1103 microversion: 2.25 time: 0.103605 Aug 29 15:32:51.662379 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 851/1657] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1103 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:51.705131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.705882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:51.732113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.734134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.734803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.736347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.737173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.737810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.950073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.961444 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31ffe4f1-8045-4324-a3ae-aa9ef051b74e tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.265349 Aug 29 15:32:51.963229 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 807/1658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:52.312991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.313555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.328276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.328781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.329220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.329991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.333070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.333619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.520324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] Calling method '.version_select at 0x7fb0e3094430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.552522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.553221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.553810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.555075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.557174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.559665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.592158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.601341 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6eeb7ac-37b0-4d51-b249-c7c96aae24a7 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.292932 Aug 29 15:32:52.616729 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 852/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:52.618982 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-956b6a98-a26a-42b6-952c-bf809ec5266a tempest-AbsoluteLimitsTestJSON-968786179 tempest-AbsoluteLimitsTestJSON-968786179-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.289290 Aug 29 15:32:52.623468 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 808/1660] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:52.657027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.657753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.669504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.670408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.672476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.673569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.674404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.675324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.685634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.687325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.700279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.701242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.701952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.706272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.710038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.710849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.911035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.915490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.923071 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e3c4c1d-66ac-4d8e-82ae-414fda356e01 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.275954 Aug 29 15:32:52.924516 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 853/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:52.927784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.935577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.937064 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-26a3d86d-7d37-410f-b13f-372a63be8b72 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1232 microversion: 2.25 time: 0.256798 Aug 29 15:32:52.937787 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 809/1662] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1232 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:52.983069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.983689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.990574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.991065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.992290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.996216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.001260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.002455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.098974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-817d97f4-fcc6-4412-b2bf-6cbb45b89dca req-0d87ded9-798e-49bc-b307-217c245b373e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6023c3-ece5-4f05-8f81-64c04a8778ea", "name": "network-vif-plugged", "status": "completed", "tag": "ec24680a-3fac-4d0f-8751-4edbd8f53cd8"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:53.116774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-817d97f4-fcc6-4412-b2bf-6cbb45b89dca req-0d87ded9-798e-49bc-b307-217c245b373e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.117199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-817d97f4-fcc6-4412-b2bf-6cbb45b89dca req-0d87ded9-798e-49bc-b307-217c245b373e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.117662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-817d97f4-fcc6-4412-b2bf-6cbb45b89dca req-0d87ded9-798e-49bc-b307-217c245b373e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.145167 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-817d97f4-fcc6-4412-b2bf-6cbb45b89dca req-0d87ded9-798e-49bc-b307-217c245b373e service nova] Creating event network-vif-plugged:ec24680a-3fac-4d0f-8751-4edbd8f53cd8 for instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea on n-h2-854882-3 Aug 29 15:32:53.159091 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-817d97f4-fcc6-4412-b2bf-6cbb45b89dca req-0d87ded9-798e-49bc-b307-217c245b373e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062965 Aug 29 15:32:53.161771 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 810/1663] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:53.261650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:53.275546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-817d9050-6e4b-4cf5-9e34-f0a7cfeb0556 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.296347 Aug 29 15:32:53.278123 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 854/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:53.374017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:53.386108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:53.387859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Searching by: {'deleted': False, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:32:53.394620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.395395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.396022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.396977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.397655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.399863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.436025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:32:53.479579 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-38832c57-5d49-4d0d-9cc5-1de3e47089d5 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.110559 Aug 29 15:32:53.489411 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 811/1665] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:32:53 2022] GET /compute/v2.1/servers => generated 339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:53.493701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:53.500399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:53.502371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Searching by: {'deleted': False, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:32:53.517455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.520479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.521475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.522774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.524238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.525448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.629968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:53.639082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:53.657333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.658340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.671144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.672333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.674241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.675117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.690411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:53.756081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:32:53.859544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:53.866829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.867410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.868474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.878255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:54.205160 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-46b9ac34-bb8a-41e8-972a-9c1db0a41a39 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.714614 Aug 29 15:32:54.206345 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 855/1666] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:53 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:54.212673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:54.214367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:54.242762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.246020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.250952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.259175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.260812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.263069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.439756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.452742 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d0c8ade-b3a0-4ab9-9840-438dc8323e1d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.831288 Aug 29 15:32:54.455209 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 812/1667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:53 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:54.472100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:54.473074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:54.483566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.485810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.488837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.490159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.490792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.491386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.607133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.629574 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ca59364-982d-4c69-8fd9-f88ba8ab14fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.419193 Aug 29 15:32:54.643813 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 856/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:54 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:54.659780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9de025f2-8dfc-4277-8669-7b085e6af2e0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:54.682820 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9de025f2-8dfc-4277-8669-7b085e6af2e0 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037706 Aug 29 15:32:54.692071 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 857/1669] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:54.704525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:54.705177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:54.723384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.723985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.724309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.727170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.728227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.728912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.017136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.018099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.036615 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6df01d9b-4ffa-4f25-87e4-28ae6b216be5 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1322 microversion: 2.1 time: 0.340653 Aug 29 15:32:55.039756 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 858/1670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:54 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:55.049702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.049944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.055755 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63e86dd9-0446-4c99-bffe-18157922c782 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1292 microversion: 2.25 time: 0.597542 Aug 29 15:32:55.059644 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 813/1671] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:54 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1292 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:55.416431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:55.417328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:55.438889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.439762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.441750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.443285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.445773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.456975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.477532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:55.479225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:55.493516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.495475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.496098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.497074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.506398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.507295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.552147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:32:55.721567 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0f73c83-c5a2-487e-8714-1ac3adb152d9 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 204 len: 0 microversion: 2.1 time: 0.312170 Aug 29 15:32:55.723028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 859/1672] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:55 2022] DELETE /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:55.770879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.782085 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8aace20b-1f0a-4fb6-a5a8-481d3797b655 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.311232 Aug 29 15:32:55.790733 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 814/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:55 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:55.796211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:55.797102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:55.804673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.805206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.806252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.806975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.807506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.808464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.060629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:56.085315 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f6fa994-c220-4f1a-952a-9544dddcc82d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.292894 Aug 29 15:32:56.089216 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 815/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:55 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:56.096986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:56.097645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:56.113857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.116523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.116997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.119551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.120030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.122338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.298550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-432169bd-3a2b-45d1-9cd8-6820d20274b5 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] Action: 'create', calling method: .version_select at 0x7fb0e3a55430>, body: {"security_group": {"name": "tempest-securitygroup-1053534870", "description": "tempest-description-1239030260"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:56.383315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:56.392106 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c657dece-1f5c-4df6-a02c-b033044505d8 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1712 microversion: 2.1 time: 0.301242 Aug 29 15:32:56.394731 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 816/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:56 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1712 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:56.400112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:56.400747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:56.407309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.408551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.409655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.410813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.411457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.411889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.602910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:56.620210 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f14a7fd-cbb6-4ecf-8bcd-02f560668aaa tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 200 len: 1518 microversion: 2.1 time: 0.223363 Aug 29 15:32:56.622286 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 817/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:56 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:56.629943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:56.630786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:56.639685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.640447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.641069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.642534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.643301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.643893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.837964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:56.849336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:56.850830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:56.852071 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c1bb1467-abe4-47b2-97a7-c57ce1da4d2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1292 microversion: 2.25 time: 0.228547 Aug 29 15:32:56.853526 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 818/1677] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:56 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1292 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:56.858099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c76ca006-d752-44ec-9b66-f18d89122884 req-f4618b32-3ea2-4314-bd29-8d382d807c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343c0bd3-0da0-465c-aedc-8feadb8076f2", "tag": "379a37b0-4e0d-44a1-b058-4c07eedebe8f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:56.873805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c76ca006-d752-44ec-9b66-f18d89122884 req-f4618b32-3ea2-4314-bd29-8d382d807c1d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.874803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c76ca006-d752-44ec-9b66-f18d89122884 req-f4618b32-3ea2-4314-bd29-8d382d807c1d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.875486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c76ca006-d752-44ec-9b66-f18d89122884 req-f4618b32-3ea2-4314-bd29-8d382d807c1d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.891016 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c76ca006-d752-44ec-9b66-f18d89122884 req-f4618b32-3ea2-4314-bd29-8d382d807c1d service nova] Creating event network-changed:379a37b0-4e0d-44a1-b058-4c07eedebe8f for instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 on n-h1-854882-3 Aug 29 15:32:56.897080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c76ca006-d752-44ec-9b66-f18d89122884 req-f4618b32-3ea2-4314-bd29-8d382d807c1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042305 Aug 29 15:32:56.898163 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 819/1678] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:56.910054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'action', calling method: .version_select at 0x7fb0e9051040>, body: {"addFloatingIp": {"address": "172.25.1.33"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:56.913081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:56.941733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.944855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.945589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.947770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.950711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.951760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.987899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-432169bd-3a2b-45d1-9cd8-6820d20274b5 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.262885 Aug 29 15:32:56.988574 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 860/1679] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:32:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:56.994137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:56.995223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:57.018075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.018859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.019558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.020517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.021235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.021926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.082207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:32:57.082920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquired lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:32:57.331123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:57.345381 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d17e4ef-e86c-461f-9bff-54d7e52e30b8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.355713 Aug 29 15:32:57.363763 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 861/1680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:56 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:57.374576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8a82dc1-0a5d-463a-8f36-a2d35ec9bd1d tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] Action: 'create', calling method: .version_select at 0x7fb0e3715040>, body: {"security_group": {"name": "tempest-securitygroup-1739623238", "description": "tempest-description-24365182"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:57.757216 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8a82dc1-0a5d-463a-8f36-a2d35ec9bd1d tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.391726 Aug 29 15:32:57.757860 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 862/1681] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:32:57 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:57.765737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:57.765737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:57.789588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.791838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.791838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.791838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.792177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.792447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:58.131838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:58.141376 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6dfbbbb-9df0-4b52-b006-f9077af98d0c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.382477 Aug 29 15:32:58.147644 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 863/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:57 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:58.168767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:58.169923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:58.190140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:58.190971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:58.191619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:58.192640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:58.193345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:58.193986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:58.730083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:58.738747 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8729c380-349f-438d-8344-5d9b1c225ca6 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1712 microversion: 2.1 time: 0.589493 Aug 29 15:32:58.739346 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 864/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:58 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1712 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:59.005945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5bddcf44-5013-4c39-a206-15b7e9c347eb tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] Action: 'create', calling method: .version_select at 0x7fb0e3f628b0>, body: {"security_group": {"name": "tempest-securitygroup-1454122227", "description": "tempest-description-1842418246"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:59.906604 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5bddcf44-5013-4c39-a206-15b7e9c347eb tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.157997 Aug 29 15:32:59.908752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 865/1684] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:32:58 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:59.918456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:59.927866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:59.954618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.955507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.956190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.957148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.959509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.962034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.291251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.327134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.329633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.337970 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-04414e03-193d-419e-8c0b-978e055262b9 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1292 microversion: 2.25 time: 0.427150 Aug 29 15:33:00.338583 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 866/1685] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:59 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1292 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:00.356116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:00.363031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:00.395963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.399991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.400807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.404202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.409948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.412528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.836750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.847868 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ba3efbc-1df9-46fe-979a-e93e5dd07e67 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1476 microversion: 2.1 time: 0.505475 Aug 29 15:33:00.851145 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 867/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:00 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:00.879059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:00.882387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:00.900583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.902204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.914226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.923719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.924612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.927895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.079469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Building network info cache for instance {{(pid=130001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:33:02.026511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:02.045746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e89a8c0-4d68-4a60-a8e4-c21ad1c96497 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 1.193221 Aug 29 15:33:02.046350 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 868/1687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:00 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:02.064420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:02.065058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:02.082703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.083200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.087537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.088627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.089284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.101805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.234241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783eb573b9464ca2a9dc618d07caa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4920bc88bc467c9c5eb64032ba0c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:02.245829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-06d325ad-bd7a-4005-8783-cca4a1791981 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 200 len: 1644 microversion: 2.1 time: 0.195687 Aug 29 15:33:02.249269 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 869/1688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:02 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 1644 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:02.256731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-82a35dd3-a952-48b1-a06b-2e1e6041f337 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] Action: 'create', calling method: .version_select at 0x7fb0e34f8e50>, body: {"security_group": {"name": "tempest-securitygroup-242392646", "description": "tempest-description-1585167723"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:02.549140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:02.739055 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-82a35dd3-a952-48b1-a06b-2e1e6041f337 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.488381 Aug 29 15:33:02.739864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 870/1689] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:33:02 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:02.751410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-290dfa1e-7d7f-4476-af2c-81054ae7b632 req-358a191f-6d7b-4ce6-92ae-21ee1102b281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26", "tag": "2f6e8e6e-c1b9-4810-8681-585d58a349e4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:02.787121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-290dfa1e-7d7f-4476-af2c-81054ae7b632 req-358a191f-6d7b-4ce6-92ae-21ee1102b281 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.794064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-290dfa1e-7d7f-4476-af2c-81054ae7b632 req-358a191f-6d7b-4ce6-92ae-21ee1102b281 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.795388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-290dfa1e-7d7f-4476-af2c-81054ae7b632 req-358a191f-6d7b-4ce6-92ae-21ee1102b281 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.816977 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-290dfa1e-7d7f-4476-af2c-81054ae7b632 req-358a191f-6d7b-4ce6-92ae-21ee1102b281 service nova] Creating event network-changed:2f6e8e6e-c1b9-4810-8681-585d58a349e4 for instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 on n-h1-854882-3 Aug 29 15:33:02.823077 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-290dfa1e-7d7f-4476-af2c-81054ae7b632 req-358a191f-6d7b-4ce6-92ae-21ee1102b281 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081775 Aug 29 15:33:02.824185 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 871/1690] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:02.848013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:02.849233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:02.882471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.886144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.887127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.888044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.888659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.890331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:03.416610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:03.606038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:03.833107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:03.853074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:03.861921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:03.865901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ffd22b0-a505-4a74-b5a4-6da5a993f913 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1292 microversion: 2.25 time: 1.037710 Aug 29 15:33:03.866859 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 872/1691] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:02 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1292 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:03.874956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:03.879528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:03.896290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=10 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:03.900841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:03.902367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:03.910171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:03.911214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:03.911862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:03.912497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:04.409573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:04.424019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3989201e-9c2b-4295-a465-1bd5c0f92039 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1475 microversion: 2.1 time: 0.555589 Aug 29 15:33:04.440749 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 873/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:03 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1475 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:04.455234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6a7a7cea-3728-4a31-bd94-8f72338aa979 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] Calling method '.version_select at 0x7fb0e3aa4e50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:05.425866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Updating instance_info_cache with network_info: [{"id": "2f6e8e6e-c1b9-4810-8681-585d58a349e4", "address": "fa:16:3e:7f:de:9b", "network": {"id": "c6251ecf-a75f-4808-83b5-41937559c769", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1768776425-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1b0e1286b14d4f749e3216980f645523", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2f6e8e6e-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:33:05.463633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Releasing lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:33:05.470721 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-74d019c4-1098-4756-8723-9d9b07d2ab86 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action" status: 202 len: 0 microversion: 2.1 time: 8.567229 Aug 29 15:33:05.472826 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 820/1693] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:56 2022] POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action => generated 0 bytes in 8570 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:33:05.485571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:05.493621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:05.513854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:05.533524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:05.535009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:05.538388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:05.540433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:05.541202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.080999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:06.095226 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcb8435b-2d46-4c32-8a4a-a289e5ed8738 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.619186 Aug 29 15:33:06.098811 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 821/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:05 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:06.110504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:06.113761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] [instance: bf505d1e-e625-4f21-af82-5c21de753b6f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:06.135226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.135801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.138586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.140760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.147345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.149280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.179097 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] HTTP exception thrown: Instance bf505d1e-e625-4f21-af82-5c21de753b6f could not be found. Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Request method failure captured: Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f HTTP/1.1 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNvQlG_CEV548dYhacvHJObPKqZYCM5jtXVcL_6ZPbFFcLJISmPUEl02ws_ktB6Q3jwJqC2s_HE38lfq6zEBGOTCXMbg1uWdndLU15QEFI9GbOis7emJwGLxIgGnU4CQxn0pXqKHiXtcGm_D766ZQ9wPg0_GJT7Yc4qi2Qi5OFYuLdA Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2a4920bc88bc467c9c5eb64032ba0c58 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestManualDisk-80619051 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2a4920bc88bc467c9c5eb64032ba0c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2a4920bc88bc467c9c5eb64032ba0c58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2a4920bc88bc467c9c5eb64032ba0c58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2a4920bc88bc467c9c5eb64032ba0c58"}]}] Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestManualDisk-80619051 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2a4920bc88bc467c9c5eb64032ba0c58 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestManualDisk-80619051 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestManualDisk-80619051-project Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 783eb573b9464ca2a9dc618d07caa679 Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestManualDisk-80619051-project Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance bf505d1e-e625-4f21-af82-5c21de753b6f could not be found. Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'bf505d1e-e625-4f21-af82-5c21de753b6f'} Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf505d1e-e625-4f21-af82-5c21de753b6f could not be found. Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf505d1e-e625-4f21-af82-5c21de753b6f could not be found. Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:06.182256 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:06.187114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:06.187114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:06.187114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:06.187114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:06.187114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:06.187114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf505d1e-e625-4f21-af82-5c21de753b6f could not be found. Aug 29 15:33:06.187114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:06.192669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Returning 404 to user: Instance bf505d1e-e625-4f21-af82-5c21de753b6f could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:06.193934 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d46a5ed-b31a-42f2-abfd-f63a4edac663 tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f" status: 404 len: 111 microversion: 2.1 time: 0.092391 Aug 29 15:33:06.195152 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 822/1695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:06 2022] GET /compute/v2.1/servers/bf505d1e-e625-4f21-af82-5c21de753b6f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:06.201091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:06.202468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:06.209322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.213249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.214181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.215879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.216964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.218369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.459224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:06.468055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:06.472477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:06.480851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fa34fa8c-ec2f-40bb-a6e4-c96ec7457cb8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1280 microversion: 2.25 time: 0.283975 Aug 29 15:33:06.482089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 823/1696] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:06 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:06.486913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-dd85c74f-180d-404c-939f-0388389410cc req-45bb1660-98dd-4afd-b40d-4198724288bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf505d1e-e625-4f21-af82-5c21de753b6f", "name": "network-vif-deleted", "tag": "959b9852-ee4b-48ea-b575-978517e2c981"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:06.513436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dd85c74f-180d-404c-939f-0388389410cc req-45bb1660-98dd-4afd-b40d-4198724288bd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.521839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dd85c74f-180d-404c-939f-0388389410cc req-45bb1660-98dd-4afd-b40d-4198724288bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.522373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dd85c74f-180d-404c-939f-0388389410cc req-45bb1660-98dd-4afd-b40d-4198724288bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.547202 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-dd85c74f-180d-404c-939f-0388389410cc req-45bb1660-98dd-4afd-b40d-4198724288bd service nova] Creating event network-vif-deleted:959b9852-ee4b-48ea-b575-978517e2c981 for instance bf505d1e-e625-4f21-af82-5c21de753b6f on n-h1-854882-3 Aug 29 15:33:06.557450 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-dd85c74f-180d-404c-939f-0388389410cc req-45bb1660-98dd-4afd-b40d-4198724288bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073861 Aug 29 15:33:06.559834 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 824/1697] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:06.565522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:06.566639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:06.575254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.576480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.577174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.578869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.579579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.580233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.919168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:06.927314 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96168c77-383f-4800-841f-7b230dda6a87 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1475 microversion: 2.1 time: 0.366178 Aug 29 15:33:06.941206 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 825/1698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:06 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1475 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:06.941206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.33"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:06.941206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:06.962126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.962646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.963080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.963814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.964224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.964647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:07.011557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "refresh_cache-2c6023c3-ece5-4f05-8f81-64c04a8778ea" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:33:07.011945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquired lock "refresh_cache-2c6023c3-ece5-4f05-8f81-64c04a8778ea" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:33:08.299296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6a7a7cea-3728-4a31-bd94-8f72338aa979 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13605 microversion: 2.1 time: 3.857048 Aug 29 15:33:08.300293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 874/1699] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Aug 29 15:33:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13605 bytes in 3859 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:33:08.306251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87886139-b9e7-4069-8f99-2c7465b33c5d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] Calling method '.version_select at 0x7fb0e36cff70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:08.334433 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-87886139-b9e7-4069-8f99-2c7465b33c5d tempest-ServersTestManualDisk-80619051 tempest-ServersTestManualDisk-80619051-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936522922" status: 202 len: 0 microversion: 2.1 time: 0.032508 Aug 29 15:33:08.335554 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 875/1700] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:33:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936522922 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:08.457317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf725a80-a03d-497d-a7c8-50d7d58d9a29 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0e3635940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1639916939", "description": "tempest-description-2106124708"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:08.857672 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf725a80-a03d-497d-a7c8-50d7d58d9a29 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.513225 Aug 29 15:33:08.869199 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 876/1701] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:33:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:08.892839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:08.896591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:08.931171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:08.931679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:08.932127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:08.932860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:08.940254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:08.941774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:09.182446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:09.195231 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2a2a2b3-dbe4-46de-b965-6f7e390566c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1501 microversion: 2.1 time: 0.322999 Aug 29 15:33:09.195874 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 877/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:08 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1501 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:09.209102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:09.210160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:09.224959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:09.225792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:09.226432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:09.228783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:09.229663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:09.233080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:09.524695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:09.573353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:09.577216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:09.580508 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0bfb2e0c-50ec-4d91-87c8-8df6fcf4474c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1280 microversion: 2.25 time: 0.381135 Aug 29 15:33:09.582849 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 878/1703] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:09 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1280 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:09.603944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:09.605686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:09.626124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:09.626379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:09.627494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:09.627494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:09.627873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:09.628546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:09.654380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:10.168527 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.network.neutron [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] re-assign floating IP 172.25.1.33 from instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 Aug 29 15:33:10.268718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Building network info cache for instance {{(pid=130001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:33:10.776387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:10.794023 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c22a3aa-bb87-4cb7-b6fb-0de7d88597ee tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1473 microversion: 2.1 time: 1.208285 Aug 29 15:33:10.798151 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 879/1704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:09 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1473 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:10.807608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d84bdb60-8178-400d-a8e8-4766726f7a02 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] Calling method '.version_select at 0x7fb0e3715d30>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:11.258262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Updating instance_info_cache with network_info: [{"id": "2f6e8e6e-c1b9-4810-8681-585d58a349e4", "address": "fa:16:3e:7f:de:9b", "network": {"id": "c6251ecf-a75f-4808-83b5-41937559c769", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1768776425-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1b0e1286b14d4f749e3216980f645523", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2f6e8e6e-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:33:11.279083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Building network info cache for instance {{(pid=130001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:33:11.567697 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d84bdb60-8178-400d-a8e8-4766726f7a02 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.766483 Aug 29 15:33:11.568332 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 880/1705] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Aug 29 15:33:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:11.573091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "name": "network-vif-unplugged", "status": "completed", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}, {"name": "network-changed", "server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:11.606725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.607235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.607655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.624377 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] Creating event network-vif-unplugged:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h2-854882-3 Aug 29 15:33:11.633207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] Creating event network-changed:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h2-854882-3 Aug 29 15:33:11.652880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:33:11.688400 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-47b8de7e-591d-48ff-b993-64e8ef3fd5f3 req-5f8c258e-c0e7-4778-ad67-cf4a1da676bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.118649 Aug 29 15:33:11.707671 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 881/1706] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:11.723134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-155e7716-dc85-4a9b-b280-4fd029ceba4e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0e3b95280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2124085152", "description": "tempest-description-1207314736"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:12.236239 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-155e7716-dc85-4a9b-b280-4fd029ceba4e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.524948 Aug 29 15:33:12.238967 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 882/1707] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:33:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:12.244118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9141ca40-dd01-4fce-9a4f-55f62fbcdcf4"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:12.252206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:12.270789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.274321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.275119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.279077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.279651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.282173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.334035 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Cannot 'attach_volume' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state rescued Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/os-volume_attachments HTTP/1.1 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 74 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: {"volumeAttachment": {"volumeId": "9141ca40-dd01-4fce-9a4f-55f62fbcdcf4"}} Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'attach_volume' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state rescued Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': 'ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4', 'body': {'volumeAttachment': {'volumeId': '9141ca40-dd01-4fce-9a4f-55f62fbcdcf4'}}} Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 15:33:12.338086 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state rescued Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state rescued Aug 29 15:33:12.342653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:12.348009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 409 to user: Cannot 'attach_volume' instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 while it is in vm_state rescued {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:12.349296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a556a405-6f58-4abc-82d1-b971480f6747 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.109283 Aug 29 15:33:12.350263 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 883/1708] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:33:12 2022] POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/os-volume_attachments => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:33:12.356514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:12.357953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:12.366839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.373014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.373868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.374898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.375763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.376472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.734395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.750362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.751889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.753084 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5dc350f2-7882-4b57-b3e6-a4e5621668d8 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1280 microversion: 2.25 time: 0.401608 Aug 29 15:33:12.753690 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 884/1709] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:12 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1280 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:12.775745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a1bda963-6d68-48f0-9dea-aa55a5ca4fa6 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] Calling method '.version_select at 0x7fb0e3543b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:12.995328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Updating instance_info_cache with network_info: [{"id": "ec24680a-3fac-4d0f-8751-4edbd8f53cd8", "address": "fa:16:3e:9d:4e:0f", "network": {"id": "c6251ecf-a75f-4808-83b5-41937559c769", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1768776425-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1b0e1286b14d4f749e3216980f645523", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapec24680a-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:33:13.011938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Releasing lock "refresh_cache-2c6023c3-ece5-4f05-8f81-64c04a8778ea" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:33:13.013024 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9bd8c84-feb6-4755-bbfb-8005b2d3febe tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea/action" status: 202 len: 0 microversion: 2.1 time: 6.081540 Aug 29 15:33:13.014800 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 826/1710] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:06 2022] POST /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea/action => generated 0 bytes in 6084 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:33:13.026417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:13.027302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:13.043884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.044594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.046020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.047564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.048216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.049813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.077133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:13.295948 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a1bda963-6d68-48f0-9dea-aa55a5ca4fa6 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/dd1c5ece-7820-4429-a25a-040122812f15" status: 202 len: 0 microversion: 2.1 time: 0.525628 Aug 29 15:33:13.298253 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 885/1711] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:12 2022] DELETE /compute/v2.1/os-security-groups/dd1c5ece-7820-4429-a25a-040122812f15 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:13.307285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d8dd3527-f9d3-4a8b-bc06-cb6420315529 req-d1d90c98-a1bf-43bd-89ef-c8feb0b043fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343c0bd3-0da0-465c-aedc-8feadb8076f2", "name": "network-vif-plugged", "status": "completed", "tag": "379a37b0-4e0d-44a1-b058-4c07eedebe8f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:13.322515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d8dd3527-f9d3-4a8b-bc06-cb6420315529 req-d1d90c98-a1bf-43bd-89ef-c8feb0b043fe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.323513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d8dd3527-f9d3-4a8b-bc06-cb6420315529 req-d1d90c98-a1bf-43bd-89ef-c8feb0b043fe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.324212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d8dd3527-f9d3-4a8b-bc06-cb6420315529 req-d1d90c98-a1bf-43bd-89ef-c8feb0b043fe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.345710 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d8dd3527-f9d3-4a8b-bc06-cb6420315529 req-d1d90c98-a1bf-43bd-89ef-c8feb0b043fe service nova] Creating event network-vif-plugged:379a37b0-4e0d-44a1-b058-4c07eedebe8f for instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 on n-h1-854882-3 Aug 29 15:33:13.365994 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d8dd3527-f9d3-4a8b-bc06-cb6420315529 req-d1d90c98-a1bf-43bd-89ef-c8feb0b043fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062103 Aug 29 15:33:13.366647 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 886/1712] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:13.372756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-906059896", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1edccff3-384b-4b0d-b706-83561d318ba9"}], "block_device_mapping_v2": [{"uuid": "73d09ffd-107f-4a1d-a22f-f512a15271e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:13.497473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] validate_networks() for [('1edccff3-384b-4b0d-b706-83561d318ba9', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:13.549715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:13.559962 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dc4c3892-e633-4001-b3fe-7f43e7daa0c9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1470 microversion: 2.1 time: 0.543938 Aug 29 15:33:13.566236 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 827/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:13 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1470 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:13.596729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:13.598286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:13.607195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.607195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.607552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.608038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.608493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.612512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.729962 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e632408a-b9b6-4e4f-94c4-31eb311dd7f3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action" status: 202 len: 0 microversion: 2.1 time: 0.149384 Aug 29 15:33:13.731339 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 828/1714] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:13 2022] POST /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:13.740484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-726183860", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "189490b9-2184-4e71-b8f3-03e8c8636ea7"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:13.844011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] validate_networks() for [('189490b9-2184-4e71-b8f3-03e8c8636ea7', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:14.318481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:14.319574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:14.320339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:14.321659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:14.322339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:14.334548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.335466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.336082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:14.337630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.338265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.338971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:14.360282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:14.368869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Getting quotas for user e7e71fcf6711470db5a71ddc74ff709c and project 74754c19f05f41428bc6d499aac1f9e5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:14.439172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:14.441743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73d09ffd-107f-4a1d-a22f-f512a15271e5',volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:14.582122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:14.612590 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b7b6e8e-e5f4-4aaa-b1e4-d4070b4b7d86 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.243898 Aug 29 15:33:14.623590 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 887/1715] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:14.629637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'action', calling method: .version_select at 0x7fb0e99910d0>, body: {"removeFloatingIp": {"address": "172.25.1.33"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:14.882982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:14.892595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.894064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.896665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:14.898533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.899890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.902941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.056317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:15.057337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:15.058326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:15.058900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:15.059471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:15.073206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.074039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.074713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.075598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.076342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.077597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.105219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Getting quotas for project 5628dcd53a614a4589eb526ba20c291c. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:15.113374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Getting quotas for user 59d36e55c8ad494eb6260410fdecd1a1 and project 5628dcd53a614a4589eb526ba20c291c. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:15.132116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:15.136236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:15.213888 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25136637-2370-40fd-b29d-c04bd7ba1d5e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479916 Aug 29 15:33:15.224406 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 829/1716] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:15.240521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eddf4835-ca7e-4fb3-b236-d6cde0cce1b7 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] Calling method '.version_select at 0x7fb0e31f1820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:15.472328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] HTTP exception thrown: Floating IP 172.25.1.33 is not associated with instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26. Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Request method failure captured: Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action HTTP/1.1 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 48 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNv51X9SAKMXK854F3PNTL6QWtJ3VRyZN1cN5MDmKbDOhjb1MAGg6Xc_5ab9-Lzdhs9BPyELhwExhcE21eAFgksad0YVQnpuhAdvbzDJtVYl8iouBVAaWkYZa1Y_b-5w1ElLQ76CAhqTH5uvhTpHOwEMjc66_T5N5Mo3TWailKbN6J0 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b0e1286b14d4f749e3216980f645523", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}] Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a47bb5a8721d4c09933fec4331761a41 Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: {"removeFloatingIp": {"address": "172.25.1.33"}} Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: exception: Floating IP 172.25.1.33 is not associated with instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26. Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26', 'body': {'removeFloatingIp': {'address': '172.25.1.33'}}} Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.33 is not associated with instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26. Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.33 is not associated with instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26. Aug 29 15:33:15.474444 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:15.479526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Returning 409 to user: Floating IP 172.25.1.33 is not associated with instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:15.479526 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0bb37f9c-826d-4893-8f22-61108596ea96 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action" status: 409 len: 145 microversion: 2.1 time: 0.851064 Aug 29 15:33:15.479526 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 888/1717] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:14 2022] POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action => generated 145 bytes in 852 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:33:15.490122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:15.505491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:15.558999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.566509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.567175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.573579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.574615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.576055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.821708 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-45292142-a98b-4388-945f-42c307274000 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "POST /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d/action" status: 202 len: 0 microversion: 2.1 time: 0.342259 Aug 29 15:33:15.824000 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 889/1718] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:15 2022] POST /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:15.859781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:15.861987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:15.872215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.873039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.873959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.875100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.875820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.876464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.979766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eddf4835-ca7e-4fb3-b236-d6cde0cce1b7 tempest-SecurityGroupsTestAdminJSON-1604587505 tempest-SecurityGroupsTestAdminJSON-1604587505-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/970268a7-771b-4961-a765-448e2a02489a" status: 202 len: 0 microversion: 2.1 time: 0.753126 Aug 29 15:33:15.980601 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 830/1719] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:15 2022] DELETE /compute/v2.1/os-security-groups/970268a7-771b-4961-a765-448e2a02489a => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:15.985886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:15.986787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:16.004298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.010407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.011430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.012832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.016316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.017434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.139042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.150083 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-48a2f81f-344d-4015-89a1-a6b9a7b73d71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1509 microversion: 2.1 time: 0.323246 Aug 29 15:33:16.151081 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 890/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:15 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:16.156739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-bf691688-f2e4-41dd-b4a4-a24ea337cc54 req-dae84fea-e150-423e-a006-1d7e97133f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26", "tag": "2f6e8e6e-c1b9-4810-8681-585d58a349e4"}, {"name": "network-changed", "server_uuid": "2c6023c3-ece5-4f05-8f81-64c04a8778ea", "tag": "ec24680a-3fac-4d0f-8751-4edbd8f53cd8"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:16.171070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bf691688-f2e4-41dd-b4a4-a24ea337cc54 req-dae84fea-e150-423e-a006-1d7e97133f95 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.171660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bf691688-f2e4-41dd-b4a4-a24ea337cc54 req-dae84fea-e150-423e-a006-1d7e97133f95 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.172169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bf691688-f2e4-41dd-b4a4-a24ea337cc54 req-dae84fea-e150-423e-a006-1d7e97133f95 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.200031 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bf691688-f2e4-41dd-b4a4-a24ea337cc54 req-dae84fea-e150-423e-a006-1d7e97133f95 service nova] Creating event network-changed:2f6e8e6e-c1b9-4810-8681-585d58a349e4 for instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 on n-h1-854882-3 Aug 29 15:33:16.200769 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bf691688-f2e4-41dd-b4a4-a24ea337cc54 req-dae84fea-e150-423e-a006-1d7e97133f95 service nova] Creating event network-changed:ec24680a-3fac-4d0f-8751-4edbd8f53cd8 for instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea on n-h2-854882-3 Aug 29 15:33:16.215370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-bf691688-f2e4-41dd-b4a4-a24ea337cc54 req-dae84fea-e150-423e-a006-1d7e97133f95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062600 Aug 29 15:33:16.216391 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 891/1721] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:16.230433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:16.230433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:16.243535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.244031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.244460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.246135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.248184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.248617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.348046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.358359 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e47b973d-5c3c-45e9-86d7-dbaf7f7098f8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1150 microversion: 2.1 time: 0.140765 Aug 29 15:33:16.359527 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 892/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:16 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1150 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:16.364744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:16.365651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:16.377251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.377999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.378872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.379893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.380529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.381157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.436334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.454512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.460613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.462994 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-02c44bc2-9901-434f-8969-0503d529afc7 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1475 microversion: 2.25 time: 0.481164 Aug 29 15:33:16.463835 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 831/1723] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:15 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1475 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:16.492147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.499299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f0ac57c2-0201-44f9-9afe-fb5b936fce67 req-e0f8f45a-e15f-410a-bfe3-0709e1b26869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "name": "network-vif-plugged", "status": "completed", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:16.513278 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac3fdf7d-4ca1-40d4-b0b2-0b8f67909e31 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1211 microversion: 2.1 time: 0.152385 Aug 29 15:33:16.514349 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 893/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:16 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:16.522309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.33"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:16.522558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0ac57c2-0201-44f9-9afe-fb5b936fce67 req-e0f8f45a-e15f-410a-bfe3-0709e1b26869 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.522949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0ac57c2-0201-44f9-9afe-fb5b936fce67 req-e0f8f45a-e15f-410a-bfe3-0709e1b26869 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.523379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0ac57c2-0201-44f9-9afe-fb5b936fce67 req-e0f8f45a-e15f-410a-bfe3-0709e1b26869 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.552646 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f0ac57c2-0201-44f9-9afe-fb5b936fce67 req-e0f8f45a-e15f-410a-bfe3-0709e1b26869 service nova] Creating event network-vif-plugged:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h2-854882-3 Aug 29 15:33:16.560211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-f0ac57c2-0201-44f9-9afe-fb5b936fce67 req-e0f8f45a-e15f-410a-bfe3-0709e1b26869 service nova] Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:33:16.609129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f0ac57c2-0201-44f9-9afe-fb5b936fce67 req-e0f8f45a-e15f-410a-bfe3-0709e1b26869 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118887 Aug 29 15:33:16.610346 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 832/1725] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:16.615951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:16.617050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:16.625107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.625738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.626187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.626933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.627388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.627807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.052393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:17.060101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.060607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.061270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.062024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.062537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.062978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.147580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:17.157967 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-06adcf9e-be7e-4dce-8b32-215f43af25e9 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1469 microversion: 2.1 time: 0.546004 Aug 29 15:33:17.159877 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 833/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:16 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1469 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:17.166905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4ed38fed-61bf-45bf-88e0-41fb3538a451 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] Calling method '.version_select at 0x7fb0e3094820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:17.587464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "refresh_cache-2c6023c3-ece5-4f05-8f81-64c04a8778ea" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:33:17.588448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquired lock "refresh_cache-2c6023c3-ece5-4f05-8f81-64c04a8778ea" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:33:17.832943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4ed38fed-61bf-45bf-88e0-41fb3538a451 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2d3b4ba1-849d-4b3a-885b-0e259374af22" status: 202 len: 0 microversion: 2.1 time: 0.668895 Aug 29 15:33:17.833992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 834/1727] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:17 2022] DELETE /compute/v2.1/os-security-groups/2d3b4ba1-849d-4b3a-885b-0e259374af22 => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:17.843565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:17.844468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:17.875492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.875919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.884387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.886135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.886621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.887065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.348607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 343c0bd3-0da0-465c-aedc-8feadb8076f2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:18.382248 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-87ac334e-ef08-4482-880d-fe7aa8e011b0 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1967 microversion: 2.25 time: 0.540392 Aug 29 15:33:18.384325 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 835/1728] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:17 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1967 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:18.401930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:18.402942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:18.412753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.413376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.417208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.418244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.418836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.419366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.708689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.725151 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c98b370-354c-4f76-8ee8-d564a9dd1029 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1515 microversion: 2.1 time: 0.337555 Aug 29 15:33:18.744191 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 836/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:18 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1515 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:18.773220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:18.775077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:18.783950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:18.794280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.794779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.795221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.795940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.796403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.796834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.959370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.978724 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5f3d60d-96cb-4e3e-a16d-aba3c00527f6 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1168 microversion: 2.1 time: 0.232585 Aug 29 15:33:18.979961 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 837/1730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:18 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1168 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:18.989175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:18.990698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:18.998154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.998639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.999077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.000503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.001160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.001974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.134769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:19.145325 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e1c3e6e-3d44-491f-85ac-8f446e565e92 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1273 microversion: 2.1 time: 0.164025 Aug 29 15:33:19.157606 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 838/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:18 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:19.166875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf92abb3-da5b-4419-8cc6-d9f6fba2dc48 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] Calling method '.version_select at 0x7fb0e321a430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:19.268603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Building network info cache for instance {{(pid=130002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:33:19.814419 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf92abb3-da5b-4419-8cc6-d9f6fba2dc48 tempest-SecurityGroupsTestAdminJSON-1970344926 tempest-SecurityGroupsTestAdminJSON-1970344926-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8fb9c251-6510-45eb-bd83-49557f2a8a63" status: 202 len: 0 microversion: 2.1 time: 0.666970 Aug 29 15:33:19.815165 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 839/1732] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:19 2022] DELETE /compute/v2.1/os-security-groups/8fb9c251-6510-45eb-bd83-49557f2a8a63 => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:20.672292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:20.673263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:20.686495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.690139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.692144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.695317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.696136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.696826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.248830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.262377 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7098273d-be2e-4760-8786-33e4c971dd74 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1469 microversion: 2.1 time: 1.445718 Aug 29 15:33:21.265560 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 840/1733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:19 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1469 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:21.535842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:21.537585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:21.553735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.556066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.558849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.559670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.560153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.563945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.587800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 343c0bd3-0da0-465c-aedc-8feadb8076f2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:22.614766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-310767b8-b208-4c17-a965-e89d9ba77094 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1967 microversion: 2.25 time: 1.347529 Aug 29 15:33:22.615368 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 841/1734] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:21 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1967 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:22.629749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7b013a2e-cd3d-49d4-90f7-d6940782d89c req-c876ba87-222f-4249-9a39-b551535a2f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6023c3-ece5-4f05-8f81-64c04a8778ea", "tag": "ec24680a-3fac-4d0f-8751-4edbd8f53cd8"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:22.644017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7b013a2e-cd3d-49d4-90f7-d6940782d89c req-c876ba87-222f-4249-9a39-b551535a2f54 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.644776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7b013a2e-cd3d-49d4-90f7-d6940782d89c req-c876ba87-222f-4249-9a39-b551535a2f54 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.645370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7b013a2e-cd3d-49d4-90f7-d6940782d89c req-c876ba87-222f-4249-9a39-b551535a2f54 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.658035 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7b013a2e-cd3d-49d4-90f7-d6940782d89c req-c876ba87-222f-4249-9a39-b551535a2f54 service nova] Creating event network-changed:ec24680a-3fac-4d0f-8751-4edbd8f53cd8 for instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea on n-h2-854882-3 Aug 29 15:33:22.663742 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7b013a2e-cd3d-49d4-90f7-d6940782d89c req-c876ba87-222f-4249-9a39-b551535a2f54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039414 Aug 29 15:33:22.665157 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 842/1735] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:22.671340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.672294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:22.679096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.679866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.681007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.681969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.682586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.683173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.814455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Updating instance_info_cache with network_info: [{"id": "ec24680a-3fac-4d0f-8751-4edbd8f53cd8", "address": "fa:16:3e:9d:4e:0f", "network": {"id": "c6251ecf-a75f-4808-83b5-41937559c769", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1768776425-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1b0e1286b14d4f749e3216980f645523", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapec24680a-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:33:22.833120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Releasing lock "refresh_cache-2c6023c3-ece5-4f05-8f81-64c04a8778ea" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:33:22.835828 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3119993d-143c-48be-86be-c36394daa88c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea/action" status: 202 len: 0 microversion: 2.1 time: 6.318669 Aug 29 15:33:22.842348 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 894/1736] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:16 2022] POST /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea/action => generated 0 bytes in 6327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:33:22.848653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.849773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:22.863109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.864563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.865594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.866993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.867931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.868732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.157356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:23.169078 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9a8a75d-0db8-4234-a02a-afe0357c6af7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1210 microversion: 2.1 time: 0.502376 Aug 29 15:33:23.170998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 843/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1210 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:23.176032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-49d6eec6-2c57-4943-b415-9ee898252ba8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'create', calling method: .version_select at 0x7fb0e3190280>, body: {"keypair": {"name": "tempest-keypair-1776601346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxjFp++uqHMOxyghJzvI1Z/g/vkcKU8qLd2CZraNLEDbUoRwsWvcJENXo+GurrO2zFy4hKkgYUN7xcOp6iCL2IuTOKJs2Moy4sJ9pc98CnqcG8MpHIAzcQOP9Rg4aMqHg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:23.194062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-49d6eec6-2c57-4943-b415-9ee898252ba8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for project 505ab4f3173b48559a5c25611af86fc7. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:23.201142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-49d6eec6-2c57-4943-b415-9ee898252ba8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for user a675ad19db254271ba12d2812d0732e3 and project 505ab4f3173b48559a5c25611af86fc7. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:23.246490 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-49d6eec6-2c57-4943-b415-9ee898252ba8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074054 Aug 29 15:33:23.247473 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 844/1738] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:33:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:23.252467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5ec59387-8591-4c81-a663-1dc0ce6c4404 req-26c33ee4-1513-40e1-819b-aeca5af2897d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca689ad-3753-428b-8f23-832b03e57bd8", "tag": "912152b7-14d9-485e-a66f-ee071e97f5d7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:23.264773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ec59387-8591-4c81-a663-1dc0ce6c4404 req-26c33ee4-1513-40e1-819b-aeca5af2897d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.265619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ec59387-8591-4c81-a663-1dc0ce6c4404 req-26c33ee4-1513-40e1-819b-aeca5af2897d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.266368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ec59387-8591-4c81-a663-1dc0ce6c4404 req-26c33ee4-1513-40e1-819b-aeca5af2897d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.282597 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5ec59387-8591-4c81-a663-1dc0ce6c4404 req-26c33ee4-1513-40e1-819b-aeca5af2897d service nova] Creating event network-changed:912152b7-14d9-485e-a66f-ee071e97f5d7 for instance 7ca689ad-3753-428b-8f23-832b03e57bd8 on n-h2-854882-3 Aug 29 15:33:23.290840 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5ec59387-8591-4c81-a663-1dc0ce6c4404 req-26c33ee4-1513-40e1-819b-aeca5af2897d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042186 Aug 29 15:33:23.292077 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 845/1739] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:23.301625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:23.303223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:23.311796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.312590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.314462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.315904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.316827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.317777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.493418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:23.511835 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8fc5fe2d-2b51-4177-9685-6420f6214519 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1315 microversion: 2.1 time: 0.667898 Aug 29 15:33:23.512527 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 895/1740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:23.518308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:23.531458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.531779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.541932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.542990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.544987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.546802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.607274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d7a31a06-4592-4ddf-928f-52d92ea76a30 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093489 Aug 29 15:33:23.613785 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 896/1741] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Aug 29 15:33:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:33:23.619757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:23.625117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:23.642350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.643204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.643782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.644505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.647094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.647991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.703652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:33:23.780018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:23.793037 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b789956-3712-42d0-808f-0889497392fa tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1469 microversion: 2.1 time: 0.495886 Aug 29 15:33:23.794916 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 846/1742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:23 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1469 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:23.807330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854882-3", "block_migration": "auto"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:23.815245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:23.829061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.830863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.838427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.840239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.840943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.841821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.896421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'flavor' on Instance uuid 343c0bd3-0da0-465c-aedc-8feadb8076f2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:23.922658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Going to try to live migrate instance to n-h2-854882-3 {{(pid=130001) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:33:23.951931 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2e9c3f2d-fcca-4911-b37b-84d3b750f70d tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 204 len: 0 microversion: 2.1 time: 0.336452 Aug 29 15:33:23.953165 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 897/1743] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:23 2022] DELETE /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:23.966090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'action', calling method: .version_select at 0x7fb0e9991160>, body: {"addFloatingIp": {"address": "172.25.1.33"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:23.968957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:23.986072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.986744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.988360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.989256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.991010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.998130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:24.024316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:24.041193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:24.072701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:33:24.073587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquired lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:33:24.377591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:25.094076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:28.525692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Building network info cache for instance {{(pid=130002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:33:28.693920 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6fc32c74-9394-44ee-b510-2a4f5c20059a tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2/action" status: 202 len: 0 microversion: 2.25 time: 4.897176 Aug 29 15:33:28.696244 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 847/1744] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:33:23 2022] POST /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2/action => generated 0 bytes in 4901 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:28.701477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:28.704984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:28.730636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.734643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.737144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.741604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.743452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.746619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.983193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.994137 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c78b051-fd2f-48c4-b74b-ba362977db36 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1198 microversion: 2.1 time: 0.294311 Aug 29 15:33:28.995580 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 848/1745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:28 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1198 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:29.003452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.007971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.029201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.030304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.031150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.033480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.034529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.035370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.241953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.252310 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c0904b6d-3b0b-4678-90c4-e44d69e9631d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1315 microversion: 2.1 time: 0.253247 Aug 29 15:33:29.253074 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 849/1746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:28 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:29.258486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ac71876f-4494-451f-bbd2-1e4a3b7153a6 req-f1635855-13ba-4cbf-8db4-7f6fce1f2584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde51b61-25cf-403a-8eb7-6959df2ee9d0", "tag": "f3f3212e-6a1f-4949-accf-c8ae53f03049"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:29.270366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ac71876f-4494-451f-bbd2-1e4a3b7153a6 req-f1635855-13ba-4cbf-8db4-7f6fce1f2584 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.272057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ac71876f-4494-451f-bbd2-1e4a3b7153a6 req-f1635855-13ba-4cbf-8db4-7f6fce1f2584 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.272711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ac71876f-4494-451f-bbd2-1e4a3b7153a6 req-f1635855-13ba-4cbf-8db4-7f6fce1f2584 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.285922 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ac71876f-4494-451f-bbd2-1e4a3b7153a6 req-f1635855-13ba-4cbf-8db4-7f6fce1f2584 service nova] Creating event network-changed:f3f3212e-6a1f-4949-accf-c8ae53f03049 for instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 on n-h2-854882-3 Aug 29 15:33:29.291748 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ac71876f-4494-451f-bbd2-1e4a3b7153a6 req-f1635855-13ba-4cbf-8db4-7f6fce1f2584 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036999 Aug 29 15:33:29.294407 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 850/1747] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:29.299943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.304360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.315893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.316745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.317659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.318391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.318851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.319279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.569679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.578517 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ad5976e9-443b-4f84-826a-a2074a93cd33 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1462 microversion: 2.1 time: 0.282633 Aug 29 15:33:29.579711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 851/1748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1462 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:29.595713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e9470e71-3e49-4207-915d-b8a3efe93510 req-a42fd9a2-0fcd-4dc2-a5c5-a3babb06a3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "name": "network-vif-unplugged", "status": "completed", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}, {"name": "network-changed", "server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:29.612115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e9470e71-3e49-4207-915d-b8a3efe93510 req-a42fd9a2-0fcd-4dc2-a5c5-a3babb06a3e6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.612611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e9470e71-3e49-4207-915d-b8a3efe93510 req-a42fd9a2-0fcd-4dc2-a5c5-a3babb06a3e6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.613039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e9470e71-3e49-4207-915d-b8a3efe93510 req-a42fd9a2-0fcd-4dc2-a5c5-a3babb06a3e6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.631768 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e9470e71-3e49-4207-915d-b8a3efe93510 req-a42fd9a2-0fcd-4dc2-a5c5-a3babb06a3e6 service nova] Creating event network-vif-unplugged:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h1-854882-3 Aug 29 15:33:29.632656 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e9470e71-3e49-4207-915d-b8a3efe93510 req-a42fd9a2-0fcd-4dc2-a5c5-a3babb06a3e6 service nova] Creating event network-changed:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h1-854882-3 Aug 29 15:33:29.639756 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e9470e71-3e49-4207-915d-b8a3efe93510 req-a42fd9a2-0fcd-4dc2-a5c5-a3babb06a3e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057752 Aug 29 15:33:29.640944 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 852/1749] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:29.736378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-975284684", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:29.856189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:30.082527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Updating instance_info_cache with network_info: [{"id": "2f6e8e6e-c1b9-4810-8681-585d58a349e4", "address": "fa:16:3e:7f:de:9b", "network": {"id": "c6251ecf-a75f-4808-83b5-41937559c769", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1768776425-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1b0e1286b14d4f749e3216980f645523", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2f6e8e6e-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:33:30.111060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Releasing lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:33:30.112824 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7d98e516-fdb9-44e1-9af4-b541dfb3bd90 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action" status: 202 len: 0 microversion: 2.1 time: 6.151598 Aug 29 15:33:30.114287 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 898/1750] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:23 2022] POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action => generated 0 bytes in 6154 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:33:30.121160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-db7db45d-efe5-4996-9ecf-37a5a49ddb45 req-62aff4e1-8715-4d4c-b962-f9e841048e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca689ad-3753-428b-8f23-832b03e57bd8", "name": "network-vif-plugged", "status": "completed", "tag": "912152b7-14d9-485e-a66f-ee071e97f5d7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:30.135854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db7db45d-efe5-4996-9ecf-37a5a49ddb45 req-62aff4e1-8715-4d4c-b962-f9e841048e67 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.137436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db7db45d-efe5-4996-9ecf-37a5a49ddb45 req-62aff4e1-8715-4d4c-b962-f9e841048e67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.138850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db7db45d-efe5-4996-9ecf-37a5a49ddb45 req-62aff4e1-8715-4d4c-b962-f9e841048e67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.155612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-db7db45d-efe5-4996-9ecf-37a5a49ddb45 req-62aff4e1-8715-4d4c-b962-f9e841048e67 service nova] Creating event network-vif-plugged:912152b7-14d9-485e-a66f-ee071e97f5d7 for instance 7ca689ad-3753-428b-8f23-832b03e57bd8 on n-h2-854882-3 Aug 29 15:33:30.161890 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-db7db45d-efe5-4996-9ecf-37a5a49ddb45 req-62aff4e1-8715-4d4c-b962-f9e841048e67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045835 Aug 29 15:33:30.163216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 899/1751] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:30.169998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1743933469", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02d6b91d-ff70-478a-b300-a6e9745c6c46"}], "security_groups": [{"name": "tempest-securitygroup--737619751"}], "key_name": "tempest-keypair-1776601346", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:30.528071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] validate_networks() for [('02d6b91d-ff70-478a-b300-a6e9745c6c46', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:30.788526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:30.790098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:30.790831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:30.791657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:30.792298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:30.802292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.803153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.803843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.805439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.806180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.806870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.825699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Getting quotas for project c785a2ff808848958fa8e54ac1db2fdb. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:30.831569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Getting quotas for user a1ab26a46d314c97808cab66c3386ceb and project c785a2ff808848958fa8e54ac1db2fdb. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:30.846826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:30.849658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:30.902950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57a3228f-6d85-48be-a049-2aeaa7a0b04f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259990 Aug 29 15:33:30.916481 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 853/1752] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:30.924026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:30.925017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:30.950359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.950872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.954302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.955507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.956233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.957794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.241356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.250586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.252033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.253215 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5da54cfa-deb3-4914-b19c-2b540f9208a1 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.334449 Aug 29 15:33:31.253990 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 854/1753] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:30 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:31.261248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:31.262312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:31.278812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.279298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.279730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.280429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.280907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.281330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.571270 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2dde4a68-eafa-4a15-bd82-9567b20e3f95 tempest-MigrationsAdminTest-158914546 tempest-MigrationsAdminTest-158914546-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1613 microversion: 2.1 time: 0.314311 Aug 29 15:33:31.581440 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 855/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:31 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1613 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:31.595407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:31.596696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:31.608047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.609302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.610037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.611033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.611870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.612524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.761693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:31.762211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:31.762638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:31.763057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:31.763468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:31.785164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.786080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.786731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.787738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.790131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.794826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.835020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.862892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for project 505ab4f3173b48559a5c25611af86fc7. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:31.869979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Getting quotas for user a675ad19db254271ba12d2812d0732e3 and project 505ab4f3173b48559a5c25611af86fc7. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:31.880011 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b289593-09d6-47cc-a330-c9012e42f36d tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1198 microversion: 2.1 time: 0.306195 Aug 29 15:33:31.880623 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 856/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:31 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1198 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:31.885575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:31.888405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:31.931478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c752662-b12a-4639-badc-122f3f6fdc79 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '.version_select at 0x7fb0e30d4310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:32.032185 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ad44ee06-45f3-4123-94e5-bb099f38f2e7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.867238 Aug 29 15:33:32.036073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 900/1756] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:32.050479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:32.053021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:32.068611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.071559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.073360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.076266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.076946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.077584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.443980 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c752662-b12a-4639-badc-122f3f6fdc79 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/63c569f7-222b-4a24-9568-c818e097abcd" status: 200 len: 184 microversion: 2.1 time: 0.534338 Aug 29 15:33:32.446034 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 857/1757] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:33:31 2022] GET /compute/v2.1/os-floating-ips/63c569f7-222b-4a24-9568-c818e097abcd => generated 184 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:32.452037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-999681087", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:32.570910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:32.599202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.631238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d18aace-8249-4210-a672-953155b6c94c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1504 microversion: 2.1 time: 0.590217 Aug 29 15:33:32.634372 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 901/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:32 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1504 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:32.640488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-485fd546-7a13-478b-8036-8a87608eb560 req-6ba2fef6-4550-420a-9097-9974df5108b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26", "tag": "2f6e8e6e-c1b9-4810-8681-585d58a349e4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:32.653444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-485fd546-7a13-478b-8036-8a87608eb560 req-6ba2fef6-4550-420a-9097-9974df5108b5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.654212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-485fd546-7a13-478b-8036-8a87608eb560 req-6ba2fef6-4550-420a-9097-9974df5108b5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.654818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-485fd546-7a13-478b-8036-8a87608eb560 req-6ba2fef6-4550-420a-9097-9974df5108b5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.679021 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-485fd546-7a13-478b-8036-8a87608eb560 req-6ba2fef6-4550-420a-9097-9974df5108b5 service nova] Creating event network-changed:2f6e8e6e-c1b9-4810-8681-585d58a349e4 for instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 on n-h1-854882-3 Aug 29 15:33:32.697042 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-485fd546-7a13-478b-8036-8a87608eb560 req-6ba2fef6-4550-420a-9097-9974df5108b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049404 Aug 29 15:33:32.700484 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 902/1759] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:32.715707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:32.717731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:32.737016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.737780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.739404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.742492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.743182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.753107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.845016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:33:33.016633 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23967e78-f7b3-4ab0-a2d9-38d1a0403f2c tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 204 len: 0 microversion: 2.1 time: 0.314614 Aug 29 15:33:33.021027 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 903/1760] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:32 2022] DELETE /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:33.031269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f10976dd-7530-4191-9a62-7070d0587b20 req-5b3a65ec-4c87-46ef-afae-1058ae84ab8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6023c3-ece5-4f05-8f81-64c04a8778ea", "name": "network-vif-deleted", "tag": "ec24680a-3fac-4d0f-8751-4edbd8f53cd8"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:33.054885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f10976dd-7530-4191-9a62-7070d0587b20 req-5b3a65ec-4c87-46ef-afae-1058ae84ab8a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.055875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f10976dd-7530-4191-9a62-7070d0587b20 req-5b3a65ec-4c87-46ef-afae-1058ae84ab8a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.057145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f10976dd-7530-4191-9a62-7070d0587b20 req-5b3a65ec-4c87-46ef-afae-1058ae84ab8a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.087239 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f10976dd-7530-4191-9a62-7070d0587b20 req-5b3a65ec-4c87-46ef-afae-1058ae84ab8a service nova] Creating event network-vif-deleted:ec24680a-3fac-4d0f-8751-4edbd8f53cd8 for instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea on n-h2-854882-3 Aug 29 15:33:33.092914 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f10976dd-7530-4191-9a62-7070d0587b20 req-5b3a65ec-4c87-46ef-afae-1058ae84ab8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068989 Aug 29 15:33:33.095127 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 904/1761] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:33.102451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db9b0fef-240a-4645-801c-d7215303630e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.103560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db9b0fef-240a-4645-801c-d7215303630e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.236630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:33.237108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:33.238073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:33.238493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:33.238908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:33.254418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.255196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.255802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.256713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.257354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.258276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.276319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db9b0fef-240a-4645-801c-d7215303630e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.283983 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db9b0fef-240a-4645-801c-d7215303630e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1246 microversion: 2.1 time: 0.187132 Aug 29 15:33:33.286997 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 905/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1246 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:33.297051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.299421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.303017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Getting quotas for project c785a2ff808848958fa8e54ac1db2fdb. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:33.309070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.310099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.310812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.311904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.312589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.313240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.320042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Getting quotas for user a1ab26a46d314c97808cab66c3386ceb and project c785a2ff808848958fa8e54ac1db2fdb. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:33.343554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:33.345704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:33.414922 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f128cd4e-aa75-4746-b76d-9f71740bc3b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967316 Aug 29 15:33:33.415663 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 858/1763] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:33.421317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Action: 'action', calling method: .version_select at 0x7fb0e90510d0>, body: {"removeFloatingIp": {"address": "172.25.1.33"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:33.649296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.656595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.657492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.659006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.659647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.660849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.661148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.714339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.724615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.727778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.729046 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f7d1a5a1-b698-4255-be1a-fae1b9d5d698 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.440899 Aug 29 15:33:33.735360 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 906/1764] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:33.756823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6838eb45-5dfe-4a24-b534-d9db964f5cc2 req-4f0835b8-4745-47e5-ba3d-69abde520bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "name": "network-vif-plugged", "status": "completed", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:33.770670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6838eb45-5dfe-4a24-b534-d9db964f5cc2 req-4f0835b8-4745-47e5-ba3d-69abde520bac service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.771420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6838eb45-5dfe-4a24-b534-d9db964f5cc2 req-4f0835b8-4745-47e5-ba3d-69abde520bac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.772254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6838eb45-5dfe-4a24-b534-d9db964f5cc2 req-4f0835b8-4745-47e5-ba3d-69abde520bac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.789649 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6838eb45-5dfe-4a24-b534-d9db964f5cc2 req-4f0835b8-4745-47e5-ba3d-69abde520bac service nova] Creating event network-vif-plugged:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h1-854882-3 Aug 29 15:33:33.815922 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6838eb45-5dfe-4a24-b534-d9db964f5cc2 req-4f0835b8-4745-47e5-ba3d-69abde520bac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078371 Aug 29 15:33:33.819590 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 907/1765] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:33.857145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1639916939"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:33.863047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.879310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.883636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.887894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.889483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.891580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.892338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.142296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:33:34.142710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquired lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:33:34.260608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.network.security_group_api [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Adding security group 10115a73-7af0-4b79-a793-e49714661a80 to port 912152b7-14d9-485e-a66f-ee071e97f5d7 Aug 29 15:33:35.570598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-47624b95-a43d-492d-8635-4e3d68d85967 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8/action" status: 202 len: 0 microversion: 2.1 time: 1.747303 Aug 29 15:33:35.577084 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 908/1766] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:33 2022] POST /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8/action => generated 0 bytes in 1756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:35.591329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:35.591992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:35.616202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.619681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.620892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.623690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.626723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.629114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.884793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.897999 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51955de9-b48e-4e71-9b95-ea324034f3a4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1198 microversion: 2.1 time: 0.318845 Aug 29 15:33:35.917086 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 909/1767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:35 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1198 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:35.929171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:35.932136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:35.952220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.954797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.955715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.958876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.963106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.966982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.246704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.267990 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dc808006-4ea6-4a7d-b418-cf541f57b339 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 200 len: 1468 microversion: 2.1 time: 0.349244 Aug 29 15:33:36.271105 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 910/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:35 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 1468 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:36.282843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.289537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.308091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.308600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.309061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.309805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.310289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.310716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.410356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.419315 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35f00bbe-781c-464a-9d37-15dd7c10aecd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1265 microversion: 2.1 time: 0.146664 Aug 29 15:33:36.420859 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 911/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:36.437574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.438573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.448121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.448939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.449680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.450621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.451606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.452244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.566478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.582329 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18fc211d-a583-49db-959b-09b7d0b1db48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1298 microversion: 2.1 time: 0.160113 Aug 29 15:33:36.585869 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 912/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:36.612005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.615885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.641713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.642532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.643225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.644412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.645123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.658421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.991240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.005610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.014025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.015363 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2bdb2de9-1d39-41ae-a335-059a89c62cdc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.427747 Aug 29 15:33:37.016043 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 913/1771] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:37.021036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2124085152"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:37.028452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:37.045809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.046724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.047547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.050190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.051111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.051963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.406367 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.network.security_group_api [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Adding security group 7b6d32bb-0fc2-4810-91bd-e31105cba6e0 to port 912152b7-14d9-485e-a66f-ee071e97f5d7 Aug 29 15:33:38.246083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Building network info cache for instance {{(pid=130001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:33:38.270209 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8dbad5ae-a0f3-4b73-9618-b03d3c142b98 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8/action" status: 202 len: 0 microversion: 2.1 time: 1.252124 Aug 29 15:33:38.271076 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 914/1772] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:37 2022] POST /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8/action => generated 0 bytes in 1254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:38.278706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-595741e1-bc67-4668-bcda-3568ffb110fb req-11905695-e662-4cad-88e2-704ecf8f56bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca689ad-3753-428b-8f23-832b03e57bd8", "tag": "912152b7-14d9-485e-a66f-ee071e97f5d7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:38.312966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-595741e1-bc67-4668-bcda-3568ffb110fb req-11905695-e662-4cad-88e2-704ecf8f56bd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.313826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-595741e1-bc67-4668-bcda-3568ffb110fb req-11905695-e662-4cad-88e2-704ecf8f56bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.323809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-595741e1-bc67-4668-bcda-3568ffb110fb req-11905695-e662-4cad-88e2-704ecf8f56bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.360064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-595741e1-bc67-4668-bcda-3568ffb110fb req-11905695-e662-4cad-88e2-704ecf8f56bd service nova] Creating event network-changed:912152b7-14d9-485e-a66f-ee071e97f5d7 for instance 7ca689ad-3753-428b-8f23-832b03e57bd8 on n-h2-854882-3 Aug 29 15:33:38.379941 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-595741e1-bc67-4668-bcda-3568ffb110fb req-11905695-e662-4cad-88e2-704ecf8f56bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106039 Aug 29 15:33:38.383533 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 915/1773] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:38.409130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:38.412832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:38.444206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.446700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.448349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.451799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.453993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.458127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.632525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:39.661527 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-80586205-33a3-4950-9b2e-6c1ffb376d38 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1198 microversion: 2.1 time: 1.275431 Aug 29 15:33:39.664770 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 916/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:38 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1198 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:39.676963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-80d39c4b-edaa-447b-ada4-3fc3cab03570 req-781ae7ed-2d5a-48e0-af2a-d873aa023865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b6ae63-79a6-4399-86fa-3ba41946d99d", "name": "network-vif-deleted", "tag": "54625bec-42bd-4870-ba01-2533c5d71d2c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:39.698101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80d39c4b-edaa-447b-ada4-3fc3cab03570 req-781ae7ed-2d5a-48e0-af2a-d873aa023865 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.699391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80d39c4b-edaa-447b-ada4-3fc3cab03570 req-781ae7ed-2d5a-48e0-af2a-d873aa023865 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.700300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80d39c4b-edaa-447b-ada4-3fc3cab03570 req-781ae7ed-2d5a-48e0-af2a-d873aa023865 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.726975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-80d39c4b-edaa-447b-ada4-3fc3cab03570 req-781ae7ed-2d5a-48e0-af2a-d873aa023865 service nova] Creating event network-vif-deleted:54625bec-42bd-4870-ba01-2533c5d71d2c for instance e4b6ae63-79a6-4399-86fa-3ba41946d99d on n-h1-854882-3 Aug 29 15:33:39.734492 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-80d39c4b-edaa-447b-ada4-3fc3cab03570 req-781ae7ed-2d5a-48e0-af2a-d873aa023865 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067558 Aug 29 15:33:39.736165 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 917/1775] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:39.753297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:39.756977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: e4b6ae63-79a6-4399-86fa-3ba41946d99d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:39.767025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:39.777098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.782391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.783467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.793548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.798984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.799956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.840486 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] HTTP exception thrown: Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d could not be found. Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Request method failure captured: Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d HTTP/1.1 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNsQdi4kbFWXwKbrmydAQ7AdfGYEqn_Aim4qxQLeR5v2LhEJ2CHa-0eg9Rx9m7EWplVuW6W76vA84nXd_SnhEaw0GDBtyziCDkG7Jp39hHuYkWjszphOB18vNL7kTreu4H8Yvmu_8i3Wu8Nh4xodS_r5g5JEPvBkcSo8wuxckKd0Me0 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69c81aac0e2b4adba8bc9d9c9c24c097", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}] Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 1869270af6874c4db42112d4aa9417a6 Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d could not be found. Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'e4b6ae63-79a6-4399-86fa-3ba41946d99d'} Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d could not be found. Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d could not be found. Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:39.844126 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:39.852816 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:39.852816 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:39.852816 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:39.852816 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:39.852816 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:39.852816 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d could not be found. Aug 29 15:33:39.852816 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:39.857302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Returning 404 to user: Instance e4b6ae63-79a6-4399-86fa-3ba41946d99d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:39.859129 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08e1d34a-1dcb-4e6b-83ed-5a2815ca22ae tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d" status: 404 len: 111 microversion: 2.1 time: 0.120024 Aug 29 15:33:39.860120 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 918/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:39 2022] GET /compute/v2.1/servers/e4b6ae63-79a6-4399-86fa-3ba41946d99d => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:39.868281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:39.869686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:39.878717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.879740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.880699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.881829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.882615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.883343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.915324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:40.147932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.162874 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8865154a-2d6c-4712-88d1-356604282847 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1313 microversion: 2.1 time: 0.298640 Aug 29 15:33:40.163553 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 919/1777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:39 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:40.188252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:40.191379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.201825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.202321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.202756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.209335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.209960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.210409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.300160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.315992 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-44a7d318-0762-4366-ae16-33abdc065268 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1304 microversion: 2.1 time: 0.129266 Aug 29 15:33:40.319158 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 920/1778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:40 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:40.331784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:40.332745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.356182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.356858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.357311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.358077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.358536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.359960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.630246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.639028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.641237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.642710 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc4750bd-46e8-4e90-aa88-005e5c96353f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.319028 Aug 29 15:33:40.662204 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 921/1779] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:40 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:40.669111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:40.669914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.677562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.678490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.679093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.680599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.681225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.681862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.018559 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e31f37c1-caf6-48b6-a20d-9b1ff850256d tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.354017 Aug 29 15:33:41.021258 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 922/1780] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:33:40 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8/os-security-groups => generated 1159 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:41.043699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.044711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.052620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.053627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.054383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.055143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.055791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.056227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.104502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:33:41.268442 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6469e5cf-084d-4e4d-a063-4da629a4421a tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 204 len: 0 microversion: 2.1 time: 0.245389 Aug 29 15:33:41.269464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 923/1781] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:41 2022] DELETE /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:41.280789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b4d36e85-64ab-48e0-bfeb-3b0eed9ae2a4 req-c3f76d14-712f-4414-8f37-ea39758a3422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca689ad-3753-428b-8f23-832b03e57bd8", "tag": "912152b7-14d9-485e-a66f-ee071e97f5d7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:41.314483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b4d36e85-64ab-48e0-bfeb-3b0eed9ae2a4 req-c3f76d14-712f-4414-8f37-ea39758a3422 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.314966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b4d36e85-64ab-48e0-bfeb-3b0eed9ae2a4 req-c3f76d14-712f-4414-8f37-ea39758a3422 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.315398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b4d36e85-64ab-48e0-bfeb-3b0eed9ae2a4 req-c3f76d14-712f-4414-8f37-ea39758a3422 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.331181 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b4d36e85-64ab-48e0-bfeb-3b0eed9ae2a4 req-c3f76d14-712f-4414-8f37-ea39758a3422 service nova] Creating event network-changed:912152b7-14d9-485e-a66f-ee071e97f5d7 for instance 7ca689ad-3753-428b-8f23-832b03e57bd8 on n-h2-854882-3 Aug 29 15:33:41.338328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b4d36e85-64ab-48e0-bfeb-3b0eed9ae2a4 req-c3f76d14-712f-4414-8f37-ea39758a3422 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067131 Aug 29 15:33:41.339243 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 924/1782] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:41.345426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.346194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.353544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.354243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.354685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.355398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.355848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.356320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.623654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.646806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4c38c5ae-34fd-40f2-a9cb-2996b272e8c1 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1198 microversion: 2.1 time: 0.298327 Aug 29 15:33:41.650126 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 925/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1198 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:41.660845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa8df3f9-ba12-4303-985b-d552719b663f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0eb5a3e50>, body: {"security_group": {"name": " tempest-securitygroup -67536253 ", "description": "tempest-description-990752043"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:41.825716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:41.879219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Updating instance_info_cache with network_info: [{"id": "2f6e8e6e-c1b9-4810-8681-585d58a349e4", "address": "fa:16:3e:7f:de:9b", "network": {"id": "c6251ecf-a75f-4808-83b5-41937559c769", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1768776425-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1b0e1286b14d4f749e3216980f645523", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2f6e8e6e-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:33:41.933177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Releasing lock "refresh_cache-ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:33:41.936000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14986733-d9c7-430b-a0ea-9171119c8671 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action" status: 202 len: 0 microversion: 2.1 time: 8.517690 Aug 29 15:33:41.937580 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 859/1784] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:33 2022] POST /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26/action => generated 0 bytes in 8521 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:33:41.945739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d8b81910-3b10-413b-a2a6-2d108806763a req-763c3029-0a95-43c0-90d0-c0c4432edd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde51b61-25cf-403a-8eb7-6959df2ee9d0", "name": "network-vif-plugged", "status": "completed", "tag": "f3f3212e-6a1f-4949-accf-c8ae53f03049"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:41.961071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d8b81910-3b10-413b-a2a6-2d108806763a req-763c3029-0a95-43c0-90d0-c0c4432edd19 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.961932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d8b81910-3b10-413b-a2a6-2d108806763a req-763c3029-0a95-43c0-90d0-c0c4432edd19 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.962588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d8b81910-3b10-413b-a2a6-2d108806763a req-763c3029-0a95-43c0-90d0-c0c4432edd19 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.978677 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d8b81910-3b10-413b-a2a6-2d108806763a req-763c3029-0a95-43c0-90d0-c0c4432edd19 service nova] Creating event network-vif-plugged:f3f3212e-6a1f-4949-accf-c8ae53f03049 for instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 on n-h2-854882-3 Aug 29 15:33:41.986949 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d8b81910-3b10-413b-a2a6-2d108806763a req-763c3029-0a95-43c0-90d0-c0c4432edd19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047832 Aug 29 15:33:41.988404 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 860/1785] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:41.997230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.999899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.012317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.013753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.016795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.018573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.020759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.021879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.204798 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa8df3f9-ba12-4303-985b-d552719b663f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.553501 Aug 29 15:33:42.207372 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 926/1786] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:33:41 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:42.213420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.216226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.247869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.252757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.256742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.269655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.277137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.278140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.812009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:42.830944 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b70caac-116b-4c7f-821e-89e1aa6a6205 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1313 microversion: 2.1 time: 0.840972 Aug 29 15:33:42.831870 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 861/1787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:42.836210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:42.842132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.843081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.848103 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-59d445ca-e678-4252-abd5-bd9b5512d9de tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1535 microversion: 2.1 time: 0.638126 Aug 29 15:33:42.850476 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 927/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1535 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:42.852817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.853684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.854624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.855917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.856926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.857699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.863108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.867932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.884996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.885713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.886257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.887553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.888261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.894432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.272283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:43.283062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:43.332573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=22 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:43.448510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.464534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.480047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.482662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e5684b09-3909-4400-a609-570835c52701 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.630859 Aug 29 15:33:43.495162 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 928/1789] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:43.515117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-841aa650-8f5b-4c31-8c2e-7e459820e14e req-3681eee0-3bcc-41c0-8756-005e84298db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26", "tag": "2f6e8e6e-c1b9-4810-8681-585d58a349e4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:43.545101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-841aa650-8f5b-4c31-8c2e-7e459820e14e req-3681eee0-3bcc-41c0-8756-005e84298db9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.549935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-841aa650-8f5b-4c31-8c2e-7e459820e14e req-3681eee0-3bcc-41c0-8756-005e84298db9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.550459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-841aa650-8f5b-4c31-8c2e-7e459820e14e req-3681eee0-3bcc-41c0-8756-005e84298db9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.580874 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-841aa650-8f5b-4c31-8c2e-7e459820e14e req-3681eee0-3bcc-41c0-8756-005e84298db9 service nova] Creating event network-changed:2f6e8e6e-c1b9-4810-8681-585d58a349e4 for instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 on n-h1-854882-3 Aug 29 15:33:43.596615 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-841aa650-8f5b-4c31-8c2e-7e459820e14e req-3681eee0-3bcc-41c0-8756-005e84298db9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099445 Aug 29 15:33:43.597269 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 929/1790] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:43.612642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.613283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:43.633725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.634317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.634843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.635616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.636089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.636534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.685059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] HTTP exception thrown: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Request method failure captured: Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea HTTP/1.1 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNv51X9SAKMXK854F3PNTL6QWtJ3VRyZN1cN5MDmKbDOhjb1MAGg6Xc_5ab9-Lzdhs9BPyELhwExhcE21eAFgksad0YVQnpuhAdvbzDJtVYl8iouBVAaWkYZa1Y_b-5w1ElLQ76CAhqTH5uvhTpHOwEMjc66_T5N5Mo3TWailKbN6J0 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b0e1286b14d4f749e3216980f645523", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}] Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a47bb5a8721d4c09933fec4331761a41 Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '2c6023c3-ece5-4f05-8f81-64c04a8778ea'} Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:43.691963 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:43.699139 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.701043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Returning 404 to user: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:43.702768 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2571fa8a-2f83-4cd9-814d-ae20fef374d6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 404 len: 111 microversion: 2.1 time: 0.103740 Aug 29 15:33:43.703876 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 930/1791] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:43 2022] DELETE /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:43.725494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-61276df7-29c0-400e-adf3-ad86828af19e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5a3430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.792764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.809507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f2f16703-2e1e-4c1a-bfdd-f0fd96505947 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.975881 Aug 29 15:33:43.810953 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 862/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:43.817001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.818139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:43.826832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.827934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.829657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.830605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.831538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.832163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.927061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-61276df7-29c0-400e-adf3-ad86828af19e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f" status: 200 len: 221 microversion: 2.1 time: 0.221786 Aug 29 15:33:43.929535 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 931/1793] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:33:43 2022] GET /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f => generated 221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:43.933701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-09f629ff-e17b-4a59-8bcb-4b722720a0c0 req-72c924f1-c64d-4073-9a6a-f7aba59abe9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6cdabb1-fbba-4bb6-b842-9997c68ae2c7", "tag": "a0f0fda4-49b1-44d3-98b3-efea4f996472"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:43.959175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-09f629ff-e17b-4a59-8bcb-4b722720a0c0 req-72c924f1-c64d-4073-9a6a-f7aba59abe9a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.959958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-09f629ff-e17b-4a59-8bcb-4b722720a0c0 req-72c924f1-c64d-4073-9a6a-f7aba59abe9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.960413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-09f629ff-e17b-4a59-8bcb-4b722720a0c0 req-72c924f1-c64d-4073-9a6a-f7aba59abe9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.983551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-09f629ff-e17b-4a59-8bcb-4b722720a0c0 req-72c924f1-c64d-4073-9a6a-f7aba59abe9a service nova] Creating event network-changed:a0f0fda4-49b1-44d3-98b3-efea4f996472 for instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 on n-h1-854882-3 Aug 29 15:33:43.989256 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-09f629ff-e17b-4a59-8bcb-4b722720a0c0 req-72c924f1-c64d-4073-9a6a-f7aba59abe9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059934 Aug 29 15:33:43.990028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 932/1794] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:43.996369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:44.002417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: 2c6023c3-ece5-4f05-8f81-64c04a8778ea] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:44.012237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.013442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.014908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.015935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.016650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.017316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.059490 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] HTTP exception thrown: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Request method failure captured: Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea HTTP/1.1 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNv51X9SAKMXK854F3PNTL6QWtJ3VRyZN1cN5MDmKbDOhjb1MAGg6Xc_5ab9-Lzdhs9BPyELhwExhcE21eAFgksad0YVQnpuhAdvbzDJtVYl8iouBVAaWkYZa1Y_b-5w1ElLQ76CAhqTH5uvhTpHOwEMjc66_T5N5Mo3TWailKbN6J0 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b0e1286b14d4f749e3216980f645523", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}] Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a47bb5a8721d4c09933fec4331761a41 Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '2c6023c3-ece5-4f05-8f81-64c04a8778ea'} Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:44.063716 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. Aug 29 15:33:44.069169 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:44.071757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Returning 404 to user: Instance 2c6023c3-ece5-4f05-8f81-64c04a8778ea could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:44.072850 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4df5631-577d-48fb-b511-0fd66675cc50 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea" status: 404 len: 111 microversion: 2.1 time: 0.081381 Aug 29 15:33:44.073439 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 933/1795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:43 2022] GET /compute/v2.1/servers/2c6023c3-ece5-4f05-8f81-64c04a8778ea => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:44.087464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:44.089218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:44.102958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.103760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.104332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.105669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.106139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.106574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.843040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:44.853215 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cc77018e-b403-456e-b70d-d324396e36e9 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1198 microversion: 2.1 time: 1.040869 Aug 29 15:33:44.861574 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 863/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:43 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1198 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:44.884717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:44.885652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:44.892686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.894014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.894894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.895842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.897102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.897820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.043482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.058867 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae0eb0bd-58ca-45c1-bb9d-3e784d61ad03 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1313 microversion: 2.1 time: 0.981477 Aug 29 15:33:45.064279 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 934/1797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:44 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:45.075941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09e13009-e337-4c2b-9de2-62ba98ede1f1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e362c1f0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:45.246319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.255400 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df6460b1-b965-4732-af50-8f88a7b2c8c8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 200 len: 1493 microversion: 2.1 time: 0.374852 Aug 29 15:33:45.269629 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 864/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:44 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 1493 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:45.276302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ccaf04f-ff04-42c5-aec9-ab2722482c08 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '.version_select at 0x7fb0e32931f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:46.002331 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-09e13009-e337-4c2b-9de2-62ba98ede1f1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f" status: 202 len: 0 microversion: 2.1 time: 0.935593 Aug 29 15:33:46.003109 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 935/1799] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:45 2022] DELETE /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f => generated 0 bytes in 938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:46.011891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:46.013193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:46.021121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.022415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.023137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.025057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.025799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.026440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.391527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:46.407203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:46.412295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:46.416957 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4f3d8c6-c835-44ca-9791-bb42ce9eaca0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.409227 Aug 29 15:33:46.418541 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 936/1800] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:46 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:46.424705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:46.426259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:46.434351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.434966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.435607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.436863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.437337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.437807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.180260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:47.196885 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa5c3c86-67dc-4abd-bb24-e78a06292149 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.774346 Aug 29 15:33:47.217335 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 937/1801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:46 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:47.229439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-cfc6fdd1-c4be-4de8-aaaf-001068b03ad4 req-48c7a9da-787c-4a8a-899c-8cfe4658650c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d41c49d-24a1-4830-9a08-1fb803cd476f", "name": "network-vif-deleted", "tag": "25b207f6-5f3f-41f4-86cb-19208977ab03"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:47.262019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cfc6fdd1-c4be-4de8-aaaf-001068b03ad4 req-48c7a9da-787c-4a8a-899c-8cfe4658650c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.262728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cfc6fdd1-c4be-4de8-aaaf-001068b03ad4 req-48c7a9da-787c-4a8a-899c-8cfe4658650c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.263533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cfc6fdd1-c4be-4de8-aaaf-001068b03ad4 req-48c7a9da-787c-4a8a-899c-8cfe4658650c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.305085 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-cfc6fdd1-c4be-4de8-aaaf-001068b03ad4 req-48c7a9da-787c-4a8a-899c-8cfe4658650c service nova] Creating event network-vif-deleted:25b207f6-5f3f-41f4-86cb-19208977ab03 for instance 6d41c49d-24a1-4830-9a08-1fb803cd476f on n-h2-854882-3 Aug 29 15:33:47.328348 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-cfc6fdd1-c4be-4de8-aaaf-001068b03ad4 req-48c7a9da-787c-4a8a-899c-8cfe4658650c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106933 Aug 29 15:33:47.329028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 938/1802] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:47.353804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:47.356344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:47.368539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.369830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.370630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.371689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.372469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.373722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.792930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:47.802823 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7292ba76-cf79-4046-b134-71a64d27a09f tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1380 microversion: 2.1 time: 0.470196 Aug 29 15:33:47.808918 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 939/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:47 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1380 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:47.819675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39547546-9e66-4f81-ae83-0e9d942a932b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5d2670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:47.884953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-39547546-9e66-4f81-ae83-0e9d942a932b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:33:47.886064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-39547546-9e66-4f81-ae83-0e9d942a932b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group 6c38af0d-453e-489e-8611-157888f2230f not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:33:47.886896 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-39547546-9e66-4f81-ae83-0e9d942a932b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:33:47.886896 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-e1d07d1d-c9eb-4f49-84ba-c95faaa02689'] Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39547546-9e66-4f81-ae83-0e9d942a932b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f HTTP/1.1 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-e1d07d1d-c9eb-4f49-84ba-c95faaa02689'] Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6c38af0d-453e-489e-8611-157888f2230f'} Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:33:47.890330 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1d07d1d-c9eb-4f49-84ba-c95faaa02689'] Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1d07d1d-c9eb-4f49-84ba-c95faaa02689'] Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1d07d1d-c9eb-4f49-84ba-c95faaa02689'] Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1d07d1d-c9eb-4f49-84ba-c95faaa02689'] Aug 29 15:33:47.897694 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:47.916821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39547546-9e66-4f81-ae83-0e9d942a932b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:33:47.916821 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-e1d07d1d-c9eb-4f49-84ba-c95faaa02689'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:47.921406 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-39547546-9e66-4f81-ae83-0e9d942a932b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f" status: 404 len: 194 microversion: 2.1 time: 0.110909 Aug 29 15:33:47.922429 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 940/1804] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:33:47 2022] GET /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:47.939465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:47.941630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:47.951536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.952405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.953067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.954121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.954845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.955497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.279884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.288365 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-50ef2f49-462e-4393-b3b0-dcfd4f58d794 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1313 microversion: 2.1 time: 0.363806 Aug 29 15:33:48.293970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 941/1805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:47 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:48.301976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:48.302594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 6d41c49d-24a1-4830-9a08-1fb803cd476f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:48.315232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.315873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.316477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.319672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.320531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.321201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.358330 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] HTTP exception thrown: Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f could not be found. Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Request method failure captured: Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f HTTP/1.1 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNsQdi4kbFWXwKbrmydAQ7AdfGYEqn_Aim4qxQLeR5v2LhEJ2CHa-0eg9Rx9m7EWplVuW6W76vA84nXd_SnhEaw0GDBtyziCDkG7Jp39hHuYkWjszphOB18vNL7kTreu4H8Yvmu_8i3Wu8Nh4xodS_r5g5JEPvBkcSo8wuxckKd0Me0 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69c81aac0e2b4adba8bc9d9c9c24c097", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}] Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 1869270af6874c4db42112d4aa9417a6 Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f could not be found. Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6d41c49d-24a1-4830-9a08-1fb803cd476f'} Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f could not be found. Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f could not be found. Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:48.368934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:48.375813 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:48.375813 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:48.375813 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:48.375813 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:48.375813 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:48.375813 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f could not be found. Aug 29 15:33:48.375813 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:48.378435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Returning 404 to user: Instance 6d41c49d-24a1-4830-9a08-1fb803cd476f could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:48.379572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f676ea3a-3749-4e9a-b608-4306e2170ff8 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f" status: 404 len: 111 microversion: 2.1 time: 0.084533 Aug 29 15:33:48.384262 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 942/1806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:48 2022] GET /compute/v2.1/servers/6d41c49d-24a1-4830-9a08-1fb803cd476f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:48.392692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:48.399531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:48.411953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.412456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.412889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.413867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.414348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.414839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.460794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:48.856778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.876090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.878010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.893609 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-114ce6c0-88be-4a6a-9edf-3dbf3fd33aba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.504067 Aug 29 15:33:48.895034 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 943/1807] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:48 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:49.299103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:49.300783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:49.310745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.312396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.313318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.314588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.315753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.316384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.735852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8282b897-00d5-4845-9509-63defdc8ceb6 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1531 microversion: 2.1 time: 0.839319 Aug 29 15:33:49.751693 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 944/1808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:48 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1531 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:49.762678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73e9581c-065d-48a6-907a-fc7fac070bdb tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0e366c430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1974665693", "description": "tempest-description-1469689080"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:50.272337 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73e9581c-065d-48a6-907a-fc7fac070bdb tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.517920 Aug 29 15:33:50.277262 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 945/1809] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:33:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:50.290517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.295758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:50.335335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.338563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.339283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.340644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.341316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.346287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.545197 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ccaf04f-ff04-42c5-aec9-ab2722482c08 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/63c569f7-222b-4a24-9568-c818e097abcd" status: 202 len: 0 microversion: 2.1 time: 5.274049 Aug 29 15:33:50.546252 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 865/1810] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:33:45 2022] DELETE /compute/v2.1/os-floating-ips/63c569f7-222b-4a24-9568-c818e097abcd => generated 0 bytes in 5276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:50.551043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d64f11f3-9f47-46c3-a4d2-65a18407130d req-15120187-11a6-4380-b3b6-6ef183323c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6cdabb1-fbba-4bb6-b842-9997c68ae2c7", "name": "network-vif-plugged", "status": "completed", "tag": "a0f0fda4-49b1-44d3-98b3-efea4f996472"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:50.556832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:50.577818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d64f11f3-9f47-46c3-a4d2-65a18407130d req-15120187-11a6-4380-b3b6-6ef183323c7b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.578588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d64f11f3-9f47-46c3-a4d2-65a18407130d req-15120187-11a6-4380-b3b6-6ef183323c7b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.579016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d64f11f3-9f47-46c3-a4d2-65a18407130d req-15120187-11a6-4380-b3b6-6ef183323c7b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.592170 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d64f11f3-9f47-46c3-a4d2-65a18407130d req-15120187-11a6-4380-b3b6-6ef183323c7b service nova] Creating event network-vif-plugged:a0f0fda4-49b1-44d3-98b3-efea4f996472 for instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 on n-h1-854882-3 Aug 29 15:33:50.598384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d64f11f3-9f47-46c3-a4d2-65a18407130d req-15120187-11a6-4380-b3b6-6ef183323c7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050928 Aug 29 15:33:50.599780 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 866/1811] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:50.605506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-441c287b-4d17-4599-82ba-7641fc9e2f79 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '.version_select at 0x7fb0e3244ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.672899 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-441c287b-4d17-4599-82ba-7641fc9e2f79 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274392037" status: 202 len: 0 microversion: 2.1 time: 0.071419 Aug 29 15:33:50.674181 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 867/1812] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:33:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274392037 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:50.686782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.691586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:50.708032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.708970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.709288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:50.709817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.710746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.711364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.712579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.718995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3cd9770-1f70-49ea-a04d-abff0e06179d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.439225 Aug 29 15:33:50.735236 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 946/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:50 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:50.744829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d5c9ebc6-4067-44a6-96da-87773d5b3f7d req-e6a68acb-022f-4004-9e0b-f2c5c8a97e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343c0bd3-0da0-465c-aedc-8feadb8076f2", "name": "network-vif-unplugged", "status": "completed", "tag": "379a37b0-4e0d-44a1-b058-4c07eedebe8f"}, {"name": "network-changed", "server_uuid": "647883af-6f80-4e9c-8f48-d0e4ba4edef3", "tag": "5010f83a-6966-4d44-9e92-309b22d9c084"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:50.768715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d5c9ebc6-4067-44a6-96da-87773d5b3f7d req-e6a68acb-022f-4004-9e0b-f2c5c8a97e56 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.769065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d5c9ebc6-4067-44a6-96da-87773d5b3f7d req-e6a68acb-022f-4004-9e0b-f2c5c8a97e56 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.773363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d5c9ebc6-4067-44a6-96da-87773d5b3f7d req-e6a68acb-022f-4004-9e0b-f2c5c8a97e56 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.805216 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d5c9ebc6-4067-44a6-96da-87773d5b3f7d req-e6a68acb-022f-4004-9e0b-f2c5c8a97e56 service nova] Creating event network-vif-unplugged:379a37b0-4e0d-44a1-b058-4c07eedebe8f for instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 on n-h1-854882-3 Aug 29 15:33:50.808264 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d5c9ebc6-4067-44a6-96da-87773d5b3f7d req-e6a68acb-022f-4004-9e0b-f2c5c8a97e56 service nova] Creating event network-changed:5010f83a-6966-4d44-9e92-309b22d9c084 for instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 on n-h1-854882-3 Aug 29 15:33:50.816294 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d5c9ebc6-4067-44a6-96da-87773d5b3f7d req-e6a68acb-022f-4004-9e0b-f2c5c8a97e56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.079762 Aug 29 15:33:50.817687 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 947/1814] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:50.826313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.827039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:50.835449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.836422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.837747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.838647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.839275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.840528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.176384 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d5c94f5-97da-420d-aaaa-744574267af8 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1531 microversion: 2.1 time: 0.356954 Aug 29 15:33:51.189469 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 948/1815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:50 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1531 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:51.199740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.206357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:51.219486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.219980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.220414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.229536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.230233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.231003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.420096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.430331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.432726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.434517 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-62e73367-e913-4f57-ae27-12fa955a9e59 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.242892 Aug 29 15:33:51.451322 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 949/1816] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:51.458462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8e69879-46d2-474e-a4e3-db25cc7605f7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0eb73be50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-549463906", "description": "tempest-description-1411483044"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:51.508690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.521862 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d6ef04be-ac91-49c7-8f57-704b3155f799 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1313 microversion: 2.1 time: 0.846380 Aug 29 15:33:51.543840 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 868/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:50 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:51.552919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.555452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:51.578586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.579965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.581748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.582828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.586230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.588681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.674298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:33:51.683673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:51.747601 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8e69879-46d2-474e-a4e3-db25cc7605f7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.294170 Aug 29 15:33:51.754016 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 950/1818] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:33:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:51.762853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.769283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.769817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.770696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.771546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.772013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.772468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.808064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d1adf21-a1e7-430e-b523-c761f919b87a tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052493 Aug 29 15:33:51.818610 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 951/1819] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:51.825049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.826075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:51.833954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.834895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.835516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.837129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.838355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.839059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.877192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7fa1d40e-f937-4894-b10f-651d11166709 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 204 len: 0 microversion: 2.1 time: 0.331136 Aug 29 15:33:51.878491 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 869/1820] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:51 2022] DELETE /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:51.885160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3b168f82-1e08-4c7a-9a44-56995c3a51ad tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0e32a69d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2032382974", "description": "tempest-description-853836726"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:52.056576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.072674 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-89e7ff1a-ebe7-469c-96c2-56df0655c0e3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.248858 Aug 29 15:33:52.086564 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 952/1821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:52.102272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854882-3", "block_migration": false, "disk_over_commit": false}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:52.104789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:52.111769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.112202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.112958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.113886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.114552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.114992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.154624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lazy-loading 'flavor' on Instance uuid fde51b61-25cf-403a-8eb7-6959df2ee9d0 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:52.172808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Going to try to live migrate instance to n-h1-854882-3 {{(pid=130002) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:33:52.183781 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3b168f82-1e08-4c7a-9a44-56995c3a51ad tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.303118 Aug 29 15:33:52.185689 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 870/1822] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:33:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:52.197910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.198919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:52.215637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.216143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.216578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.217296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.217834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.218253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.394263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.408654 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2af58673-01d8-46b3-9f1c-e95cfbc91da6 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1526 microversion: 2.1 time: 0.221383 Aug 29 15:33:52.409749 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 871/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:52 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:52.415557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6fdd0363-5f23-43c0-afe2-8d7baef63530 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e32a6f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.679149 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6fdd0363-5f23-43c0-afe2-8d7baef63530 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.268370 Aug 29 15:33:52.680302 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 872/1824] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:33:52 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:52.685482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.686328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:52.696109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.696828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.697376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.698493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.699418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.699992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.745350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:33:52.854954 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5625ea81-44c7-48e1-8f20-3e8b4ada5fad tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 204 len: 0 microversion: 2.1 time: 0.171040 Aug 29 15:33:52.855648 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 873/1825] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:52 2022] DELETE /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:52.868971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.870873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:52.879410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.880470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.881067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.882233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.883692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.884662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.126330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.141310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.146997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.148416 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-301891bc-8315-44b4-848b-bcb321c323c0 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.291412 Aug 29 15:33:53.165498 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 874/1826] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:52 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:53.165498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:53.165498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:53.169000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.169654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.170191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.170986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.171544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.172059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.358443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.373007 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-33d9d306-5a7c-4096-97da-f5a837718df7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1313 microversion: 2.1 time: 0.220686 Aug 29 15:33:53.373660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 875/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:53 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:53.379588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8c187dcc-d1e6-42fb-b5b0-2dd26721beb9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e32574c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:53.707015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8c187dcc-d1e6-42fb-b5b0-2dd26721beb9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626" status: 202 len: 0 microversion: 2.1 time: 0.331562 Aug 29 15:33:53.707604 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 876/1828] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:53 2022] DELETE /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:53.713058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-05f45ac9-6f24-4555-af19-9f35ca021468 req-26ad3111-e667-4411-9d82-2e01f663449e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "190b045a-6f51-4011-950e-5ca4150a647b", "tag": "271365e6-dc68-453b-9b42-c69b0118f270"}, {"name": "network-changed", "server_uuid": "343c0bd3-0da0-465c-aedc-8feadb8076f2", "tag": "379a37b0-4e0d-44a1-b058-4c07eedebe8f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:53.747075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05f45ac9-6f24-4555-af19-9f35ca021468 req-26ad3111-e667-4411-9d82-2e01f663449e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.748162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05f45ac9-6f24-4555-af19-9f35ca021468 req-26ad3111-e667-4411-9d82-2e01f663449e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.748611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05f45ac9-6f24-4555-af19-9f35ca021468 req-26ad3111-e667-4411-9d82-2e01f663449e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.763597 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-05f45ac9-6f24-4555-af19-9f35ca021468 req-26ad3111-e667-4411-9d82-2e01f663449e service nova] Creating event network-changed:271365e6-dc68-453b-9b42-c69b0118f270 for instance 190b045a-6f51-4011-950e-5ca4150a647b on n-h1-854882-3 Aug 29 15:33:53.764409 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-05f45ac9-6f24-4555-af19-9f35ca021468 req-26ad3111-e667-4411-9d82-2e01f663449e service nova] Creating event network-changed:379a37b0-4e0d-44a1-b058-4c07eedebe8f for instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 on n-h1-854882-3 Aug 29 15:33:53.773058 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-05f45ac9-6f24-4555-af19-9f35ca021468 req-26ad3111-e667-4411-9d82-2e01f663449e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063939 Aug 29 15:33:53.775480 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 877/1829] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:53.782886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:53.783693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:53.791924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.792660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.793308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.794265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.795073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.795690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.953117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.962446 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-06b3da4a-b52b-4717-a987-8b29d92a3e0d tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1467 microversion: 2.1 time: 0.185178 Aug 29 15:33:53.974021 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 878/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:53 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1467 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:53.974021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:53.974021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:53.976143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.978125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.978125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.978355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.978889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.979345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.152497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.161269 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cc639d3-a233-47aa-b711-309ba95fe2b2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.196605 Aug 29 15:33:54.162516 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 879/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:53 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:54.178672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.179295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:54.186701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.187216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.187650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.188355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.188806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.189230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.336528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.345649 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c62e505b-2984-43b0-9f5c-1f28ce1c9e67 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1526 microversion: 2.1 time: 0.181772 Aug 29 15:33:54.346247 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 880/1832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1526 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:54.352348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2b1a1c2-9ee9-46fa-a690-4895e0bd3ef6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e3094dc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.375799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-e2b1a1c2-9ee9-46fa-a690-4895e0bd3ef6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:33:54.376416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-e2b1a1c2-9ee9-46fa-a690-4895e0bd3ef6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group 61ba41e1-57a4-4027-9d77-655eb9383626 not found {{(pid=130001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:33:54.376950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e2b1a1c2-9ee9-46fa-a690-4895e0bd3ef6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:33:54.376950 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-29e61ce0-01a8-4ab1-835c-f775577fb13e'] Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2b1a1c2-9ee9-46fa-a690-4895e0bd3ef6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626 HTTP/1.1 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: exception: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-29e61ce0-01a8-4ab1-835c-f775577fb13e'] Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '61ba41e1-57a4-4027-9d77-655eb9383626'} Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:33:54.383080 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29e61ce0-01a8-4ab1-835c-f775577fb13e'] Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29e61ce0-01a8-4ab1-835c-f775577fb13e'] Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29e61ce0-01a8-4ab1-835c-f775577fb13e'] Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29e61ce0-01a8-4ab1-835c-f775577fb13e'] Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2b1a1c2-9ee9-46fa-a690-4895e0bd3ef6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-29e61ce0-01a8-4ab1-835c-f775577fb13e'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2b1a1c2-9ee9-46fa-a690-4895e0bd3ef6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626" status: 404 len: 194 microversion: 2.1 time: 0.037291 Aug 29 15:33:54.387897 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 881/1833] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:54.393064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.393064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:54.399816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.400303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.400738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.401462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.401981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.402387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.575586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.591012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.595996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.597492 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79346941-e8ce-488e-96f0-251fb5d1ace2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.210674 Aug 29 15:33:54.598566 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 882/1834] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:54.604930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2b09d5f-fb37-4642-adf4-ea8289fddbda tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e3094280>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.150925 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2b09d5f-fb37-4642-adf4-ea8289fddbda tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900" status: 202 len: 0 microversion: 2.1 time: 0.550171 Aug 29 15:33:55.153001 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 883/1835] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:54 2022] DELETE /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:55.160544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.161810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:55.174148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.175475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.177148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.178527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.180160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.180842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.451678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.464565 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a330e04-36bf-480f-bba9-ff3ae72369c9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1463 microversion: 2.1 time: 0.309710 Aug 29 15:33:55.465772 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 884/1836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1463 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:55.471171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.472137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:55.481086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.482008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.482983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.484276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.484982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.485710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.566810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.575114 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-86d5e847-3f7d-41e0-a881-d1f3283c84be tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 200 len: 1425 microversion: 2.1 time: 0.107992 Aug 29 15:33:55.582419 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 885/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 1425 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:55.589833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d20b388b-8fe0-4d34-8cee-a2cca7dbfa84 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e32930d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.618943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-d20b388b-8fe0-4d34-8cee-a2cca7dbfa84 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b9d2d369-6350-4932-b636-359972510900 does not exist", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:33:55.619747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-d20b388b-8fe0-4d34-8cee-a2cca7dbfa84 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group b9d2d369-6350-4932-b636-359972510900 not found {{(pid=130001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:33:55.620398 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d20b388b-8fe0-4d34-8cee-a2cca7dbfa84 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:33:55.620398 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-b0ea0c82-4e53-47f6-8965-3b9ee4eb28a9'] Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d20b388b-8fe0-4d34-8cee-a2cca7dbfa84 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900 HTTP/1.1 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: exception: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-b0ea0c82-4e53-47f6-8965-3b9ee4eb28a9'] Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b9d2d369-6350-4932-b636-359972510900'} Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:33:55.622553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ea0c82-4e53-47f6-8965-3b9ee4eb28a9'] Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ea0c82-4e53-47f6-8965-3b9ee4eb28a9'] Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ea0c82-4e53-47f6-8965-3b9ee4eb28a9'] Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ea0c82-4e53-47f6-8965-3b9ee4eb28a9'] Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d20b388b-8fe0-4d34-8cee-a2cca7dbfa84 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-b0ea0c82-4e53-47f6-8965-3b9ee4eb28a9'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d20b388b-8fe0-4d34-8cee-a2cca7dbfa84 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900" status: 404 len: 194 microversion: 2.1 time: 0.040343 Aug 29 15:33:55.627037 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 886/1838] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:55.630826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.630826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:55.638859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.639343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.639776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.640516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.640970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.641426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.802757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.813943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c6f46bb2-d937-42ff-b756-29ca36d8dbf6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.187487 Aug 29 15:33:55.815103 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 887/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:55.820773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.821425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:55.828829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.829528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.830250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.831168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.832419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.833029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.397653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:56.416907 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ab9220f-7553-418e-958e-56270f07b3d4 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1526 microversion: 2.1 time: 0.600338 Aug 29 15:33:56.417550 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 888/1840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1526 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:56.438164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:56.438788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:56.456286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.457702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.458315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.459212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.459832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.460446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:57.419950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:57.425468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:57.441833 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b3971c93-2e14-4346-ba26-0c1432e716db tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1313 microversion: 2.1 time: 1.007021 Aug 29 15:33:57.443595 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 889/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:56 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1313 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:57.467901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:57.470956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:57.480058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:57.481073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:57.481723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:57.482868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:57.483566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:57.484438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.058621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.077599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.081461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.082708 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f219e584-9f5e-4d90-b43e-032dd949d51c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.636378 Aug 29 15:33:58.085890 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 890/1842] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:57 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:58.098585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-32fe58d3-abb9-42ce-970c-a0bc21cf49ff tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e338ef70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:58.266977 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0a4d9d1-0108-4cf3-872e-d77e4bac520c tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0/action" status: 202 len: 0 microversion: 2.1 time: 6.179109 Aug 29 15:33:58.268286 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 953/1843] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:52 2022] POST /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0/action => generated 0 bytes in 6181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:58.278025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2a92e2fd-99f8-47ab-8077-4f722a1ea0ec req-9de879d1-559d-40bf-bd44-8d5b91527591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef0b637-0366-4873-95e7-1ffb74a351e0", "name": "network-vif-deleted", "tag": "6913f0ac-c831-4118-b4c0-6a42ef5dc00b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:58.305412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2a92e2fd-99f8-47ab-8077-4f722a1ea0ec req-9de879d1-559d-40bf-bd44-8d5b91527591 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.306604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2a92e2fd-99f8-47ab-8077-4f722a1ea0ec req-9de879d1-559d-40bf-bd44-8d5b91527591 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.308222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2a92e2fd-99f8-47ab-8077-4f722a1ea0ec req-9de879d1-559d-40bf-bd44-8d5b91527591 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.337274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2a92e2fd-99f8-47ab-8077-4f722a1ea0ec req-9de879d1-559d-40bf-bd44-8d5b91527591 service nova] Creating event network-vif-deleted:6913f0ac-c831-4118-b4c0-6a42ef5dc00b for instance aef0b637-0366-4873-95e7-1ffb74a351e0 on n-h2-854882-3 Aug 29 15:33:58.353541 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2a92e2fd-99f8-47ab-8077-4f722a1ea0ec req-9de879d1-559d-40bf-bd44-8d5b91527591 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081820 Aug 29 15:33:58.356534 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 954/1844] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:58.377159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:58.380082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: aef0b637-0366-4873-95e7-1ffb74a351e0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:58.394525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.397218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.398657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.400922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.402880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.403666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.511274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] HTTP exception thrown: Instance aef0b637-0366-4873-95e7-1ffb74a351e0 could not be found. Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Request method failure captured: Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 HTTP/1.1 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNsQdi4kbFWXwKbrmydAQ7AdfGYEqn_Aim4qxQLeR5v2LhEJ2CHa-0eg9Rx9m7EWplVuW6W76vA84nXd_SnhEaw0GDBtyziCDkG7Jp39hHuYkWjszphOB18vNL7kTreu4H8Yvmu_8i3Wu8Nh4xodS_r5g5JEPvBkcSo8wuxckKd0Me0 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69c81aac0e2b4adba8bc9d9c9c24c097", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}] Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 1869270af6874c4db42112d4aa9417a6 Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance aef0b637-0366-4873-95e7-1ffb74a351e0 could not be found. Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'aef0b637-0366-4873-95e7-1ffb74a351e0'} Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef0b637-0366-4873-95e7-1ffb74a351e0 could not be found. Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef0b637-0366-4873-95e7-1ffb74a351e0 could not be found. Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:58.518396 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef0b637-0366-4873-95e7-1ffb74a351e0 could not be found. Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:58.528410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Returning 404 to user: Instance aef0b637-0366-4873-95e7-1ffb74a351e0 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:58.530064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dc5ef481-41bf-453f-a25d-b11e604916cf tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0" status: 404 len: 111 microversion: 2.1 time: 0.168979 Aug 29 15:33:58.532025 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 955/1845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:58 2022] GET /compute/v2.1/servers/aef0b637-0366-4873-95e7-1ffb74a351e0 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:58.564704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:58.565852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:58.582336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.584920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.585734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.587148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.588565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.591604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.874255 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-32fe58d3-abb9-42ce-970c-a0bc21cf49ff tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17" status: 202 len: 0 microversion: 2.1 time: 0.785915 Aug 29 15:33:58.876142 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 891/1846] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:33:58 2022] DELETE /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17 => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:58.886350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:58.887429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:58.900307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.902153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.902914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.903932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.904822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.905734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.012428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.014169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.015129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.016972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lazy-loading 'fault' on Instance uuid ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:59.148545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47bb5a8721d4c09933fec4331761a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e1286b14d4f749e3216980f645523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:59.161087 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-079fc88f-5d3c-4e85-a263-81b997c837b9 tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 200 len: 1313 microversion: 2.1 time: 0.277442 Aug 29 15:33:59.164558 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 892/1847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:58 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:59.177084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.178171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:59.194013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.197786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.198531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.201541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.206910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.207552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.245761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:59.257178 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b2f0ff58-85f9-401c-93c0-c4f04beb4618 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.723658 Aug 29 15:33:59.259421 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 956/1848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:58 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:59.269219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.270531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:59.277306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.278124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.278861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.279983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.280698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.281324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.490794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:59.507160 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0475148f-b551-40fc-a527-016f67dad356 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.341072 Aug 29 15:33:59.507818 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 893/1849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:59.519697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.520707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:59.525746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:59.531100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.532357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.533007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.534288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.535052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.536043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.555685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8693e6c-c2c6-46a7-894a-0ac0ea1b167e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1313 microversion: 2.1 time: 0.290350 Aug 29 15:33:59.558054 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 957/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:59.573346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:33:59.579241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-63307cef-8798-431d-bc0d-9061ec9b259c req-1f6b5346-65cf-401d-9206-2de910ca71c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647883af-6f80-4e9c-8f48-d0e4ba4edef3", "name": "network-vif-plugged", "status": "completed", "tag": "5010f83a-6966-4d44-9e92-309b22d9c084"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:59.614123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-63307cef-8798-431d-bc0d-9061ec9b259c req-1f6b5346-65cf-401d-9206-2de910ca71c0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.617354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-63307cef-8798-431d-bc0d-9061ec9b259c req-1f6b5346-65cf-401d-9206-2de910ca71c0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.619312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-63307cef-8798-431d-bc0d-9061ec9b259c req-1f6b5346-65cf-401d-9206-2de910ca71c0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.651077 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-63307cef-8798-431d-bc0d-9061ec9b259c req-1f6b5346-65cf-401d-9206-2de910ca71c0 service nova] Creating event network-vif-plugged:5010f83a-6966-4d44-9e92-309b22d9c084 for instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 on n-h1-854882-3 Aug 29 15:33:59.665467 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-63307cef-8798-431d-bc0d-9061ec9b259c req-1f6b5346-65cf-401d-9206-2de910ca71c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103707 Aug 29 15:33:59.668273 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 958/1851] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:59.688188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-991c991b-6d80-4335-90d8-c7d562094a58 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5b34c0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.775693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-991c991b-6d80-4335-90d8-c7d562094a58 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:33:59.776524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-991c991b-6d80-4335-90d8-c7d562094a58 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group ae767af6-9f51-45e5-af32-f2de9e78af17 not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:33:59.777249 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-991c991b-6d80-4335-90d8-c7d562094a58 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:33:59.777249 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-4b051374-e06f-41ad-bfa5-b949c522ab27'] Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-991c991b-6d80-4335-90d8-c7d562094a58 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17 HTTP/1.1 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-4b051374-e06f-41ad-bfa5-b949c522ab27'] Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ae767af6-9f51-45e5-af32-f2de9e78af17'} Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:33:59.780091 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b051374-e06f-41ad-bfa5-b949c522ab27'] Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b051374-e06f-41ad-bfa5-b949c522ab27'] Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b051374-e06f-41ad-bfa5-b949c522ab27'] Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b051374-e06f-41ad-bfa5-b949c522ab27'] Aug 29 15:33:59.787441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:33:59.794419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-991c991b-6d80-4335-90d8-c7d562094a58 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:33:59.794419 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-4b051374-e06f-41ad-bfa5-b949c522ab27'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:59.795277 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-991c991b-6d80-4335-90d8-c7d562094a58 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17" status: 404 len: 194 microversion: 2.1 time: 0.116568 Aug 29 15:33:59.800846 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 959/1852] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17 => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:33:59.813237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.815255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:59.834300 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0821b6e1-11da-4395-8600-800efec4a264 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "DELETE /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 204 len: 0 microversion: 2.1 time: 0.325145 Aug 29 15:33:59.837643 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 894/1853] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:59 2022] DELETE /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:59.845361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.846458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.846458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.847093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.847783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2847268-f538-4ee6-aeb2-d7705935a625 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e338e040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.855557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.857712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.132871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.151628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.155006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.163538 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52739c66-3847-4401-956a-686ffa09eb6d tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.365250 Aug 29 15:34:00.166054 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 960/1854] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:00.173755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.175236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:00.183263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.183846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.184464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.185360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.185912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.186455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.368385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.378666 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d48d5da-b7f4-4203-9968-8b20558eec72 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1469 microversion: 2.1 time: 0.210323 Aug 29 15:34:00.379689 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 961/1855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:00.386522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.387422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] [instance: ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:00.398355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.399229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.400203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.401497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.402066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.402547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.410574 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2847268-f538-4ee6-aeb2-d7705935a625 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.569300 Aug 29 15:34:00.411305 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 895/1856] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:00.419769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.420248 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] HTTP exception thrown: Instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 could not be found. Aug 29 15:34:00.420772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Request method failure captured: Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 HTTP/1.1 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNv51X9SAKMXK854F3PNTL6QWtJ3VRyZN1cN5MDmKbDOhjb1MAGg6Xc_5ab9-Lzdhs9BPyELhwExhcE21eAFgksad0YVQnpuhAdvbzDJtVYl8iouBVAaWkYZa1Y_b-5w1ElLQ76CAhqTH5uvhTpHOwEMjc66_T5N5Mo3TWailKbN6J0 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b0e1286b14d4f749e3216980f645523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b0e1286b14d4f749e3216980f645523", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b0e1286b14d4f749e3216980f645523"}]}] Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 1b0e1286b14d4f749e3216980f645523 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2107036742 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a47bb5a8721d4c09933fec4331761a41 Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2107036742-project Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 could not be found. Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26'} Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 could not be found. Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 could not be found. Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:00.422342 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 could not be found. Aug 29 15:34:00.427800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:00.430319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] Returning 404 to user: Instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:00.431269 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa9e831f-2dd8-4bdb-bf0e-824c4ff7d51c tempest-FloatingIPsAssociationTestJSON-2107036742 tempest-FloatingIPsAssociationTestJSON-2107036742-project] 10.222.0.16 "GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26" status: 404 len: 111 microversion: 2.1 time: 0.050346 Aug 29 15:34:00.432055 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 962/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/servers/ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:00.437979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a54a2db7-23b9-4f88-9700-97db406af5d7 req-5229595a-a240-47a1-a921-1c413d8e2d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26", "name": "network-vif-deleted", "tag": "2f6e8e6e-c1b9-4810-8681-585d58a349e4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:00.439678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.440537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.441209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.442166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.442944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.443750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.450708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a54a2db7-23b9-4f88-9700-97db406af5d7 req-5229595a-a240-47a1-a921-1c413d8e2d17 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.451745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a54a2db7-23b9-4f88-9700-97db406af5d7 req-5229595a-a240-47a1-a921-1c413d8e2d17 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.452390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a54a2db7-23b9-4f88-9700-97db406af5d7 req-5229595a-a240-47a1-a921-1c413d8e2d17 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.466357 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a54a2db7-23b9-4f88-9700-97db406af5d7 req-5229595a-a240-47a1-a921-1c413d8e2d17 service nova] Creating event network-vif-deleted:2f6e8e6e-c1b9-4810-8681-585d58a349e4 for instance ded44d4e-cc82-4a3f-a35a-a03e2f2bcd26 on n-h1-854882-3 Aug 29 15:34:00.472266 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a54a2db7-23b9-4f88-9700-97db406af5d7 req-5229595a-a240-47a1-a921-1c413d8e2d17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038818 Aug 29 15:34:00.473800 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 963/1858] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:00.483148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-25b3d1dd-4656-40a8-a1cc-3b95eb459b33 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0eb793940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1834194409", "description": "tempest-description-1647000490"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:00.759154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.772057 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6e569a1a-abe3-44e6-bc33-0e660d9fd288 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1371 microversion: 2.1 time: 0.356874 Aug 29 15:34:00.773507 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 896/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:00.780619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.781575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:00.791196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.791745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.792432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.793589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.794441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.794884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.079071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.094249 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-975b1710-55ba-4aa6-88f7-19c58b0b3125 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.319207 Aug 29 15:34:01.095553 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 897/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:01.102313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:01.103451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:01.112147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.113051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.113750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.114803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.115789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.116558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.188041 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-25b3d1dd-4656-40a8-a1cc-3b95eb459b33 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.709886 Aug 29 15:34:01.188682 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 964/1861] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:34:00 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:01.197718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:01.198718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:01.206706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.207469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.208075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.210735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.212265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.212877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.442737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.463960 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8946249-eee7-44ec-9323-470985fd171e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1313 microversion: 2.1 time: 0.366506 Aug 29 15:34:01.467519 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 898/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:01 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:01.479146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97ff1aab-26fc-44a0-95c2-2a8b2803e930 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0e3406790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-350546413", "description": "tempest-description-1579247833"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:01.618468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.636020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.640357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.643532 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8ea4fbb-52f6-482e-8124-489aae6cd9f5 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 0.450586 Aug 29 15:34:01.646095 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 965/1863] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:01 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:01.659339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:01.660410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:01.676790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.678536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.680985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.682126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.683344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.685004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.786995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:01.918782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.924309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:01.944722 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8cdc105d-37e0-4685-93c4-aba69bd5c532 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1469 microversion: 2.1 time: 0.291476 Aug 29 15:34:01.948588 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 966/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:01 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:01.956994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-742f9dd6-a0a3-438a-b5ab-a9931d1276bb req-5bc798c4-aed1-4e88-9650-f9b0a519d25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190b045a-6f51-4011-950e-5ca4150a647b", "name": "network-vif-plugged", "status": "completed", "tag": "271365e6-dc68-453b-9b42-c69b0118f270"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:01.971271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-742f9dd6-a0a3-438a-b5ab-a9931d1276bb req-5bc798c4-aed1-4e88-9650-f9b0a519d25f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.971967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-742f9dd6-a0a3-438a-b5ab-a9931d1276bb req-5bc798c4-aed1-4e88-9650-f9b0a519d25f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.973117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-742f9dd6-a0a3-438a-b5ab-a9931d1276bb req-5bc798c4-aed1-4e88-9650-f9b0a519d25f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.991621 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-742f9dd6-a0a3-438a-b5ab-a9931d1276bb req-5bc798c4-aed1-4e88-9650-f9b0a519d25f service nova] Creating event network-vif-plugged:271365e6-dc68-453b-9b42-c69b0118f270 for instance 190b045a-6f51-4011-950e-5ca4150a647b on n-h1-854882-3 Aug 29 15:34:02.003137 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-742f9dd6-a0a3-438a-b5ab-a9931d1276bb req-5bc798c4-aed1-4e88-9650-f9b0a519d25f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052711 Aug 29 15:34:02.003915 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 967/1865] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:02.009001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.010509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.017372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.017892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.018334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.019045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.019503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.019931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.290119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.301442 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fac9f96a-0093-4ea4-b457-4f1bef61386b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1565 microversion: 2.1 time: 0.295460 Aug 29 15:34:02.313827 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 968/1866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1565 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:02.323426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.324312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.331254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.331988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.332598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.333554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.334183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.334778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.564196 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97ff1aab-26fc-44a0-95c2-2a8b2803e930 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.093948 Aug 29 15:34:02.565201 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 899/1867] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:34:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:02.572020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.572524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.591138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.594356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.594786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.595542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.597948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.598793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.663424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.673364 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e844527-7ae6-4d66-8504-c8406655f0db tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.358029 Aug 29 15:34:02.677850 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 969/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:02.688241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.691629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.713296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.715201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.715201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.715201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.715743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.715954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.944552 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07a87d22-c042-4f50-abc6-54286ebaf291 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378186 Aug 29 15:34:02.946181 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 900/1869] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-interface => generated 284 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:02.951002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.951626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.968620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.969120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.969852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.970574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.971032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.971461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.257040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:03.266339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9212d61-8016-4346-9fb6-d18f94820407 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1313 microversion: 2.1 time: 0.586880 Aug 29 15:34:03.267168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 970/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:03.272823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1088075171", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "189490b9-2184-4e71-b8f3-03e8c8636ea7"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:03.288747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:03.354162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] validate_networks() for [('189490b9-2184-4e71-b8f3-03e8c8636ea7', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:03.996566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:04.018118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:04.019809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:04.021060 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8fbbc958-4d9c-40da-8fe6-05c87058be2a tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1485 microversion: 2.25 time: 1.073923 Aug 29 15:34:04.021677 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 901/1871] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1485 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:04.028321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:04.029027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:04.058026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.058838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.059467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:04.060376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.061086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.061739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.219100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:05.220165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:05.221555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:05.222174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:05.223297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:05.236359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.238017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.238679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.252096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.254825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.255515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.300087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:05.323932 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b668255d-a6d7-4ee0-8e6d-07422e3d98ff tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1469 microversion: 2.1 time: 1.297670 Aug 29 15:34:05.344061 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 902/1872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:04 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1469 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:05.352100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Getting quotas for project 5628dcd53a614a4589eb526ba20c291c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:05.370861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:05.372098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:05.383963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Getting quotas for user 59d36e55c8ad494eb6260410fdecd1a1 and project 5628dcd53a614a4589eb526ba20c291c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:05.396025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.399032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.400196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.402743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.406520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.407383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.487272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:05.489247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:05.687852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce14b953-bb2d-457a-9fc6-3dd746b2711a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419134 Aug 29 15:34:05.698613 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 971/1873] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:34:05.709607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:05.710240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:05.776642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.785825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.787030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.788145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.788962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.790608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.358439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.370219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.374085 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e29ec6f5-e12f-4291-8ce6-bdf6e5051dfa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 1.026377 Aug 29 15:34:06.374790 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 903/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:05 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:06.386438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:06.390414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:06.392300 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c57d0187-37b6-4fa5-a35d-c2801dd38fc9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1462 microversion: 2.1 time: 0.692340 Aug 29 15:34:06.404593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.405089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.408239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.409075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.411781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.412712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.420856 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 972/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:05 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1462 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:06.443518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f69b7c8f-6dae-4a41-af15-a98549f60dcd req-3362c246-75e8-46e5-8646-1ce27229a9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37169b83-efb2-4cd0-a106-c388cfdd59b5", "name": "network-vif-deleted", "tag": "38298e49-8d6b-4848-b75a-a48df8ce6169"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:06.497271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f69b7c8f-6dae-4a41-af15-a98549f60dcd req-3362c246-75e8-46e5-8646-1ce27229a9cc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.515191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f69b7c8f-6dae-4a41-af15-a98549f60dcd req-3362c246-75e8-46e5-8646-1ce27229a9cc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.518394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f69b7c8f-6dae-4a41-af15-a98549f60dcd req-3362c246-75e8-46e5-8646-1ce27229a9cc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.594843 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f69b7c8f-6dae-4a41-af15-a98549f60dcd req-3362c246-75e8-46e5-8646-1ce27229a9cc service nova] Creating event network-vif-deleted:38298e49-8d6b-4848-b75a-a48df8ce6169 for instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 on n-h2-854882-3 Aug 29 15:34:06.622813 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f69b7c8f-6dae-4a41-af15-a98549f60dcd req-3362c246-75e8-46e5-8646-1ce27229a9cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187029 Aug 29 15:34:06.632873 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 973/1876] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:06.671471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-262bea3c-4b16-4807-a8f9-791a45b47786 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:06.672206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-262bea3c-4b16-4807-a8f9-791a45b47786 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:06.899000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-262bea3c-4b16-4807-a8f9-791a45b47786 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.906800 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-262bea3c-4b16-4807-a8f9-791a45b47786 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1216 microversion: 2.1 time: 0.269578 Aug 29 15:34:06.910575 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 974/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:06 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1216 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:06.922702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:06.923372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:06.965148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.975698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.976379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.977209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.977739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.979746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.044924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.068035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.068979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.070433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.073970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.074835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lazy-loading 'fault' on Instance uuid 37169b83-efb2-4cd0-a106-c388cfdd59b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:07.075603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.076897 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d46bf875-c007-42a4-a1c1-8e2625b2e0bc tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1475 microversion: 2.25 time: 0.699357 Aug 29 15:34:07.086935 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 904/1878] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:06 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1475 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:07.101810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-960222430", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "190b045a-6f51-4011-950e-5ca4150a647b"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:07.189201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1869270af6874c4db42112d4aa9417a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c81aac0e2b4adba8bc9d9c9c24c097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.205051 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9870841f-6113-4222-922a-9eda173761a5 tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 200 len: 1303 microversion: 2.1 time: 0.291945 Aug 29 15:34:07.221849 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 975/1879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:06 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 1303 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:07.232605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01340dcb-b601-4bae-a7fd-234dae249731 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '.version_select at 0x7fb0eb5b0dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:07.249955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:07.252495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01340dcb-b601-4bae-a7fd-234dae249731 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.253002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01340dcb-b601-4bae-a7fd-234dae249731 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.253479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01340dcb-b601-4bae-a7fd-234dae249731 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.313745 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-01340dcb-b601-4bae-a7fd-234dae249731 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3872 microversion: 2.25 time: 0.087023 Aug 29 15:34:07.326520 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 976/1880] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Aug 29 15:34:07 2022] GET /compute/v2.1/os-migrations => generated 3872 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:07.337298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:07.346645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:07.354581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.356882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.357624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.358624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.362042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.362781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.872830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:07.873600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:07.873816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:07.874228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:07.875698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:07.889026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.889667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.890120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.890922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.891386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.891810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.928955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Getting quotas for project c785a2ff808848958fa8e54ac1db2fdb. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:07.942054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Getting quotas for user a1ab26a46d314c97808cab66c3386ceb and project c785a2ff808848958fa8e54ac1db2fdb. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:07.987300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:07.993943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:08.107340 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-26add9cb-4ad1-4354-a2fc-9ee1c54e9867 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018938 Aug 29 15:34:08.108808 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 905/1881] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:34:08.114188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.115145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.122736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.123494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.124113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.125139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.125788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.126378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.131632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] Lazy-loading 'services' on Instance uuid 343c0bd3-0da0-465c-aedc-8feadb8076f2 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:08.183441 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b941f8ab-35e5-4332-9328-cb107d7e5c59 tempest-LiveAutoBlockMigrationV225Test-1329147261 tempest-LiveAutoBlockMigrationV225Test-1329147261-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1967 microversion: 2.25 time: 0.855078 Aug 29 15:34:08.197424 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 977/1882] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:07 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1967 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:08.197424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.197424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.237773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.238508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.239374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.241741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.243544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.244850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.318794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:08.343705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a5940fe5-b9d6-44c7-bfae-089916af7914 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.231141 Aug 29 15:34:08.357341 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 906/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:08.358689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d148206-1fb2-486c-8408-010b2830d88a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.359587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d148206-1fb2-486c-8408-010b2830d88a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.373862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:08.392860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:08.403854 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71ad049f-ff55-44c9-9087-61971b9182e0 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1268 microversion: 2.1 time: 0.216496 Aug 29 15:34:08.405551 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 978/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:08.411087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.411840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.419111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.419840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.420465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.421357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.422026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.422623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.467919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:08.488191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d148206-1fb2-486c-8408-010b2830d88a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:08.513077 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d148206-1fb2-486c-8408-010b2830d88a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1213 microversion: 2.1 time: 0.165200 Aug 29 15:34:08.528256 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 907/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:08.528256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.528256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] [instance: 37169b83-efb2-4cd0-a106-c388cfdd59b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.571410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.573737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.574388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.579966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.580382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.581575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.640774 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] HTTP exception thrown: Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 could not be found. Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Request method failure captured: Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 HTTP/1.1 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNsQdi4kbFWXwKbrmydAQ7AdfGYEqn_Aim4qxQLeR5v2LhEJ2CHa-0eg9Rx9m7EWplVuW6W76vA84nXd_SnhEaw0GDBtyziCDkG7Jp39hHuYkWjszphOB18vNL7kTreu4H8Yvmu_8i3Wu8Nh4xodS_r5g5JEPvBkcSo8wuxckKd0Me0 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69c81aac0e2b4adba8bc9d9c9c24c097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69c81aac0e2b4adba8bc9d9c9c24c097", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69c81aac0e2b4adba8bc9d9c9c24c097"}]}] Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-MigrationsAdminTest-1148151336 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 69c81aac0e2b4adba8bc9d9c9c24c097 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-MigrationsAdminTest-1148151336 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 1869270af6874c4db42112d4aa9417a6 Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-MigrationsAdminTest-1148151336-project Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 could not be found. Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '37169b83-efb2-4cd0-a106-c388cfdd59b5'} Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 could not be found. Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 could not be found. Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:08.648068 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 could not be found. Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] Returning 404 to user: Instance 37169b83-efb2-4cd0-a106-c388cfdd59b5 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:08.654327 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1380ea66-b86e-432d-a616-23d150dddcfe tempest-MigrationsAdminTest-1148151336 tempest-MigrationsAdminTest-1148151336-project] 10.222.0.16 "GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5" status: 404 len: 111 microversion: 2.1 time: 0.135346 Aug 29 15:34:08.656072 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 908/1886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/37169b83-efb2-4cd0-a106-c388cfdd59b5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:08.740047 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da125477-5ede-404c-b27c-0186691b413c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 204 len: 0 microversion: 2.25 time: 0.331704 Aug 29 15:34:08.745116 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 979/1887] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:08 2022] DELETE /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:08.751600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.752211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.770707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.770707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.774654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.775431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.777676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.778135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.946979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-30e6b233-e01d-4e86-a91e-844ca0854a04 req-f35cf063-1be3-4fcd-b6ef-860a09fb6f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647883af-6f80-4e9c-8f48-d0e4ba4edef3", "tag": "5010f83a-6966-4d44-9e92-309b22d9c084"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:08.988783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30e6b233-e01d-4e86-a91e-844ca0854a04 req-f35cf063-1be3-4fcd-b6ef-860a09fb6f12 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.988783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30e6b233-e01d-4e86-a91e-844ca0854a04 req-f35cf063-1be3-4fcd-b6ef-860a09fb6f12 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.988783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30e6b233-e01d-4e86-a91e-844ca0854a04 req-f35cf063-1be3-4fcd-b6ef-860a09fb6f12 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.018796 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-30e6b233-e01d-4e86-a91e-844ca0854a04 req-f35cf063-1be3-4fcd-b6ef-860a09fb6f12 service nova] Creating event network-changed:5010f83a-6966-4d44-9e92-309b22d9c084 for instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 on n-h1-854882-3 Aug 29 15:34:09.029274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-30e6b233-e01d-4e86-a91e-844ca0854a04 req-f35cf063-1be3-4fcd-b6ef-860a09fb6f12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087807 Aug 29 15:34:09.032986 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 980/1888] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:09.373498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:09.374949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:09.401264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.401837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.402385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.403278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.403742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.404203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.686569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.734443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29ce038e-f8fb-4bac-bceb-773f920cae01 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.358707 Aug 29 15:34:09.734443 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 981/1889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:09 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:09.771479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:09.771479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:09.786883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.790386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.790386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.791862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.793074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.793751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.013026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.025773 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ee5c572-140a-45ab-9612-d35f21d181cd tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1274 microversion: 2.1 time: 0.296189 Aug 29 15:34:10.028835 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 982/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:09 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1274 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:10.039789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.044126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:10.058327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.059090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.063402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.064494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.065077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.068030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.255838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.265756 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae1a2b50-02d3-4d3f-83dc-7afd1240770d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1265 microversion: 2.1 time: 0.235628 Aug 29 15:34:10.267023 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 983/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:10.325141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.344444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.346741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.354021 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ade4951-b8f5-48c0-ac1b-9150f63e6ac6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1481 microversion: 2.25 time: 1.606947 Aug 29 15:34:10.354931 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 909/1892] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1481 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:10.769461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.771951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:10.780497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.781675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.783048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.785072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.786798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.787478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.062983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:11.066980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.082376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.087671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.088439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.092835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.093346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.093819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.094858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.107103 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-082fc260-a730-4cfa-9a1d-14853beb8a9b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.342843 Aug 29 15:34:11.122397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 984/1893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:11.155959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:11.290269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:11.291202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.298861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.299700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.300377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.301307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.302032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.302681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.327716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:11.382691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.392444 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7fdced78-f2af-4a82-986d-75a1ec3c489b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1271 microversion: 2.1 time: 0.107187 Aug 29 15:34:11.393641 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 985/1894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:11 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:11.398541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:11.399157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.416635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.418075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.418958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.421637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.422709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.423235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.564630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.583823 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fbf51580-e204-4619-a2d4-a254b0a6de93 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1274 microversion: 2.1 time: 0.534240 Aug 29 15:34:11.587366 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 910/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:11 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1274 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:11.646358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.662099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.664591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.666242 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6c264550-3166-449a-aa8c-0fe6a9b0a3b2 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1481 microversion: 2.25 time: 0.271925 Aug 29 15:34:11.679673 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 986/1896] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:11 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1481 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:12.132940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:12.133980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:12.147744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.149195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.150259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.151081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.151646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.155951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.418102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:12.419167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:12.430776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.432103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.432919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.434013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.434734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.435693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.560129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:12.581712 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24b92261-1e23-4ecd-99e2-3a713141a02f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1271 microversion: 2.1 time: 0.167488 Aug 29 15:34:12.584048 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 987/1897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:12 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:12.610243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:12.611379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:12.625061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.626574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.628689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.630151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.632908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.633354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.678950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:12.692452 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b7d98e5e-45ed-4ebf-bc14-6dee15ce66e4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.561606 Aug 29 15:34:12.695725 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 911/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:12 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:12.711447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:12.713040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:12.725508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.729096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.730718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.734625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.735380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.737923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.738074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:12.750685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d51eae66-d9bb-4426-bbef-c30158a3096b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1274 microversion: 2.1 time: 0.145851 Aug 29 15:34:12.765747 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 988/1899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:12 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:13.606439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:13.607076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:13.620393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.620994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.621690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.622556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.635520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.635520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.808108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.822586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-34dc1c60-64b8-42eb-a8e8-fb8b0363d4e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1271 microversion: 2.1 time: 0.216204 Aug 29 15:34:13.823800 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 989/1900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:13.827488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.845815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.847919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.851601 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-158187ca-562c-429c-8600-a84d5fc9260b tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1481 microversion: 2.25 time: 1.150495 Aug 29 15:34:13.866940 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 912/1901] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:12 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1481 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:13.891911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:13.893852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:13.917853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.920179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.922575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.924137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.925632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.925781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.364766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.380420 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58b75d4e-a3ea-44be-9936-ed2a864bb769 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.504086 Aug 29 15:34:14.395135 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 913/1902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:14.406376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-91196665-67f9-4c99-8dba-ab8ff19ebbca req-7d259a18-f9e7-42bd-93e2-63b8a622909e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343c0bd3-0da0-465c-aedc-8feadb8076f2", "name": "network-vif-deleted", "tag": "379a37b0-4e0d-44a1-b058-4c07eedebe8f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:14.415267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Calling method '.version_select at 0x7fb0e3a55a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.432463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91196665-67f9-4c99-8dba-ab8ff19ebbca req-7d259a18-f9e7-42bd-93e2-63b8a622909e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.432959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91196665-67f9-4c99-8dba-ab8ff19ebbca req-7d259a18-f9e7-42bd-93e2-63b8a622909e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.433402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91196665-67f9-4c99-8dba-ab8ff19ebbca req-7d259a18-f9e7-42bd-93e2-63b8a622909e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.447730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.448233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.448676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.449434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.451091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.451861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.464724 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-91196665-67f9-4c99-8dba-ab8ff19ebbca req-7d259a18-f9e7-42bd-93e2-63b8a622909e service nova] Creating event network-vif-deleted:379a37b0-4e0d-44a1-b058-4c07eedebe8f for instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 on n-h2-854882-3 Aug 29 15:34:14.472199 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-91196665-67f9-4c99-8dba-ab8ff19ebbca req-7d259a18-f9e7-42bd-93e2-63b8a622909e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075277 Aug 29 15:34:14.474423 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 914/1903] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:14.477043 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f9c7c89a-9db0-4dee-b2e2-9c7a70076ae6 tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.651901 Aug 29 15:34:14.478517 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 990/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/limits => generated 511 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:14.481827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.482790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:14.490672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.491363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.491990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.493094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.501983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.505517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.598484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1985241212", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": "none"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:14.671372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:14.671941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:14.672621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:14.673114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:14.673629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:14.686398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.688038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.688524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.689364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.690168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.690682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.716268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Getting quotas for project 472ac27a5ec24dcbb2bacd4f2d2aed73. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:14.722510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Getting quotas for user 2de7e02a3f8242ea85479c80821c0edf and project 472ac27a5ec24dcbb2bacd4f2d2aed73. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:14.758104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:14.764458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:14.917493 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0f0f287-ef03-4f54-8ea1-4edc69d98717 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.435679 Aug 29 15:34:14.923879 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 991/1905] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:34:14.975208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-954318940", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:14.995069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.008584 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16c092e3-967f-49d8-9b1a-d41b2484ac07 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.532559 Aug 29 15:34:15.009356 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 915/1906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:15.033804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.034802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.050612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.053612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.055465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.057114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.058031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.059301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.091355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:15.511606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.526945 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80e0a4dc-6da9-4f9f-91fa-360e2db33099 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.502715 Aug 29 15:34:15.527964 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 916/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:15.536100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.542803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.556874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.557730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.558394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.559457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.560107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.561897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.577908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Getting quotas for project 5ed3025a83094f7fa05d519da260f542. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:15.583538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Getting quotas for user 0bdd4cb707404bf28dfa892a1a5aaa76 and project 5ed3025a83094f7fa05d519da260f542. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:15.608442 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Request method failure captured: Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 1751 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNx1eHMnfNQXThZH9kqlBrQCIRdO4iFxyw2pk5aFqcbYppXbaSuZ_KJInChF84EtlatI_RjsJtgL31Mn8TnwTXmhairrCI4L7QJvDzG0SbFucfk3JvBkbLdAHEsgrwvfwkHNQPPFLNCSWU4D0ww_VmBwYY2C-35S3XFF9VYb9H6mnfI Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 5ed3025a83094f7fa05d519da260f542 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1747159805 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ed3025a83094f7fa05d519da260f542"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5ed3025a83094f7fa05d519da260f542"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5ed3025a83094f7fa05d519da260f542", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ed3025a83094f7fa05d519da260f542"}]}] Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1747159805 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 5ed3025a83094f7fa05d519da260f542 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1747159805 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0bdd4cb707404bf28dfa892a1a5aaa76 Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-954318940", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:15.622663 n-d-854882-3 devstack@n-api.service[130002]: exception: Maximum number of metadata items exceeds 128 Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-954318940', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:34:15.625260 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:15.628451 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fdbc9773-7994-4885-9ade-bf06879bfb0d tempest-AbsoluteLimitsNegativeTestJSON-1747159805 tempest-AbsoluteLimitsNegativeTestJSON-1747159805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.702225 Aug 29 15:34:15.634742 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 992/1908] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Aug 29 15:34:14 2022] POST /compute/v2.1/servers => generated 87 bytes in 715 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:34:15.646138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-588224bd-a5ba-4822-b1c1-53933793c52e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:15.655010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-588224bd-a5ba-4822-b1c1-53933793c52e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.797374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-588224bd-a5ba-4822-b1c1-53933793c52e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.811707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-588224bd-a5ba-4822-b1c1-53933793c52e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.813149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-588224bd-a5ba-4822-b1c1-53933793c52e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.816690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:15.831645 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-588224bd-a5ba-4822-b1c1-53933793c52e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "PUT /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1359 microversion: 2.75 time: 0.195736 Aug 29 15:34:15.845415 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 993/1909] 10.222.0.16 () {62 vars in 1297 bytes} [Mon Aug 29 15:34:15 2022] PUT /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:15.856689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.859850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.860675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.869478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.870311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.871003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.872917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.873377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.873979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.874728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.882840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.886110 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-332fd826-1644-4e41-9ae7-aed318114729 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1265 microversion: 2.25 time: 0.357116 Aug 29 15:34:15.888165 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 917/1910] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:15.906473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.907636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.950909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.951405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.951847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.952566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.956647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.957119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.094617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.109954 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6ed364fb-5790-44e2-870d-d5b923c61df4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.259016 Aug 29 15:34:16.111012 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 994/1911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:16.135814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.140052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.149642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.152174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.155982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.157098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.158053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.160005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.193434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.238937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.246360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.265439 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f4d0e67-7849-44fa-b6b5-b0028eac15ef tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1363 microversion: 2.75 time: 0.372695 Aug 29 15:34:16.280276 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 918/1912] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:16.394095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.406604 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99ca2c1a-a768-44d3-9626-35ff1747b9a2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.280430 Aug 29 15:34:16.410242 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 995/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:16.548650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.549662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.565603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.566240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.570539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.571654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.572387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.573911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.918294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.919578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.945664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.947180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.948091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.949089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.950350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.951129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.049520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.060667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.062267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.063854 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f166bfab-0f93-4b85-9d32-9e09041ad087 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1265 microversion: 2.25 time: 0.150751 Aug 29 15:34:17.075113 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 996/1914] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:17.075113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f342c1b0-8eff-4314-a7af-df3d8d282c48 req-d8eb97e3-3b48-448e-b0e5-9be975913104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73c9734-2c89-4c91-9fc7-62dcc39cbe49", "tag": "5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:17.081228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f342c1b0-8eff-4314-a7af-df3d8d282c48 req-d8eb97e3-3b48-448e-b0e5-9be975913104 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.081835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f342c1b0-8eff-4314-a7af-df3d8d282c48 req-d8eb97e3-3b48-448e-b0e5-9be975913104 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.082354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f342c1b0-8eff-4314-a7af-df3d8d282c48 req-d8eb97e3-3b48-448e-b0e5-9be975913104 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.095811 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f342c1b0-8eff-4314-a7af-df3d8d282c48 req-d8eb97e3-3b48-448e-b0e5-9be975913104 service nova] Creating event network-changed:5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d for instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 on n-h2-854882-3 Aug 29 15:34:17.102288 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f342c1b0-8eff-4314-a7af-df3d8d282c48 req-d8eb97e3-3b48-448e-b0e5-9be975913104 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035571 Aug 29 15:34:17.103548 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 997/1915] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:17.136160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.137146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.146544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.147394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.148250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.149578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.150325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.151024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.439609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.456230 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dcb036d4-01a0-4907-8147-15a82e65a1f2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.327514 Aug 29 15:34:17.457318 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 998/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:17.469017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.469860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.481995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.482686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.483410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.484852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.485993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.486573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.668646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.678982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.680555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.693933 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b7cf318-5b45-4be1-a302-160c3978a6af tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1411 microversion: 2.75 time: 0.231991 Aug 29 15:34:17.698113 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 999/1917] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1411 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:17.704764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.705419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.713060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.713697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.714357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.715053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.715399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.715822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.860031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.884875 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f9ee9b28-bf53-45a9-a136-c284c041b82e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 1.339936 Aug 29 15:34:17.887389 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 919/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:18.025878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.034937 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1bf7639d-3d21-4000-ac39-333f3e0cece2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.335086 Aug 29 15:34:18.035777 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1000/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:18.091836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.092406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.094988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:18.120542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.124873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.125748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.128751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.131088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.133723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.343463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.351900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.353354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.355129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-47274549-993c-4dc0-86b7-cf5ca9013689 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1265 microversion: 2.25 time: 0.270401 Aug 29 15:34:18.356287 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 920/1920] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:18.486067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.486699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.498433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.499020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.499406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.500137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.500599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.501033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.727054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.727750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.729845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:18.739248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.739756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.740264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.741048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.760875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.761512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.884204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.894625 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8f164a1f-a22f-4e0d-a08d-5aaa4f30a868 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.412868 Aug 29 15:34:18.907741 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1001/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:18.925563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.926205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.935978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.936481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.937026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.937940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.938523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.939033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.035863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.080378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.086720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.111105 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-749aa716-f09c-494e-af0c-16630be96d6a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1417 microversion: 2.75 time: 0.384138 Aug 29 15:34:19.113763 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 921/1922] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1417 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:19.135061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.136270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.163698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.168701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.169181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.172091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.172565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.178031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.194230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.208868 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08879861-091c-4f88-ab3a-80e52f9b7da5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.299858 Aug 29 15:34:19.210085 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1002/1923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:19.347245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2f53b938-c556-4df0-a5d3-aa5e84504cd1 req-560a5ae6-9c6d-4af9-9e45-c2ec2fbb1ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff74d1c6-a399-41f7-a310-236875d7fb53", "tag": "46016059-a1ff-46a2-b1bc-f801e570e627"}, {"server_uuid": "fde51b61-25cf-403a-8eb7-6959df2ee9d0", "name": "network-vif-unplugged", "status": "completed", "tag": "f3f3212e-6a1f-4949-accf-c8ae53f03049"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:19.375642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f53b938-c556-4df0-a5d3-aa5e84504cd1 req-560a5ae6-9c6d-4af9-9e45-c2ec2fbb1ba1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.376414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f53b938-c556-4df0-a5d3-aa5e84504cd1 req-560a5ae6-9c6d-4af9-9e45-c2ec2fbb1ba1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.377178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f53b938-c556-4df0-a5d3-aa5e84504cd1 req-560a5ae6-9c6d-4af9-9e45-c2ec2fbb1ba1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.395559 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2f53b938-c556-4df0-a5d3-aa5e84504cd1 req-560a5ae6-9c6d-4af9-9e45-c2ec2fbb1ba1 service nova] Creating event network-changed:46016059-a1ff-46a2-b1bc-f801e570e627 for instance ff74d1c6-a399-41f7-a310-236875d7fb53 on n-h1-854882-3 Aug 29 15:34:19.396238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2f53b938-c556-4df0-a5d3-aa5e84504cd1 req-560a5ae6-9c6d-4af9-9e45-c2ec2fbb1ba1 service nova] Creating event network-vif-unplugged:f3f3212e-6a1f-4949-accf-c8ae53f03049 for instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 on n-h2-854882-3 Aug 29 15:34:19.409870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2f53b938-c556-4df0-a5d3-aa5e84504cd1 req-560a5ae6-9c6d-4af9-9e45-c2ec2fbb1ba1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.065238 Aug 29 15:34:19.415675 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1003/1924] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:19.422575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.423294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.430828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.431527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.432301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.433218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.434227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.435704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.578027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.593187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.597333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.603197 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-de5d6bf6-60c1-49d2-9efd-69173a29db99 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1265 microversion: 2.25 time: 0.183402 Aug 29 15:34:19.605145 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1004/1925] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:19.664752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.676601 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9924ef29-bb0e-467e-aa04-5d31747ef026 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.559726 Aug 29 15:34:19.680302 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 922/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:19.928810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.930713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.938984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.939646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.940155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.940904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.942042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.942534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.144373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.144988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.156344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.157136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.158067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.163031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.163245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.164248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.216796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.224739 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b9a14fa-86f1-45d7-8ca3-5a3ed22edad3 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.300409 Aug 29 15:34:20.233028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1005/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:20.240046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.240955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.255457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.256020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.256584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.261225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.262060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.263587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.342117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.352291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.354340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.363270 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6e30826-c786-4a44-a82a-1d10915a950a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1417 microversion: 2.75 time: 0.222191 Aug 29 15:34:20.364703 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 923/1928] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1417 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:20.639188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.643352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.666434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.668785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.670335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.672984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.673704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.674797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.709474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.714482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:20.724988 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4c9b9b4f-6b96-45c6-a542-80772316b227 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.490724 Aug 29 15:34:20.741901 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1006/1929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:20.746305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.747792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.763269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.764112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.766533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.767831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.769702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.770240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.862196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.874586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.876066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.877225 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-38b4990d-e404-45bd-b7e7-2326caf30721 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 200 len: 1265 microversion: 2.25 time: 0.253037 Aug 29 15:34:20.877824 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 924/1930] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:21.016698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.034568 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6426f05e-828b-4b2e-aaa1-25ee3fd48ac3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.302869 Aug 29 15:34:21.035440 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1007/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:21.252011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.253123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.265105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.266938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.267931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.270642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.272159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.274269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.392412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.393001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.410064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.410567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.411200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.414622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.415341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.418439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.591246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.601648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.603314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.610297 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e2cecd7d-2cf2-4fce-83cf-009575808eb8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1438 microversion: 2.75 time: 0.221614 Aug 29 15:34:21.611813 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1008/1932] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1438 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:21.619231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c9a0c619-fb1e-4419-b57b-684524ede44e req-009b50f1-8e91-4912-9573-1ca89c0db969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde51b61-25cf-403a-8eb7-6959df2ee9d0", "tag": "f3f3212e-6a1f-4949-accf-c8ae53f03049"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:21.630512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c9a0c619-fb1e-4419-b57b-684524ede44e req-009b50f1-8e91-4912-9573-1ca89c0db969 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.631667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c9a0c619-fb1e-4419-b57b-684524ede44e req-009b50f1-8e91-4912-9573-1ca89c0db969 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.632823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c9a0c619-fb1e-4419-b57b-684524ede44e req-009b50f1-8e91-4912-9573-1ca89c0db969 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.650775 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c9a0c619-fb1e-4419-b57b-684524ede44e req-009b50f1-8e91-4912-9573-1ca89c0db969 service nova] Creating event network-changed:f3f3212e-6a1f-4949-accf-c8ae53f03049 for instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 on n-h2-854882-3 Aug 29 15:34:21.658229 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c9a0c619-fb1e-4419-b57b-684524ede44e req-009b50f1-8e91-4912-9573-1ca89c0db969 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043784 Aug 29 15:34:21.659797 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1009/1933] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:21.668495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:21.672775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.685143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.685676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.686819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.687952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.688891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.689426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.806091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:21.806509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:21.807187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:21.807771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:21.808381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:21.911684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.921940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.922439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.922930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.923709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.924350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.925188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.017800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.036021 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f7efe85e-a259-44f5-bc6b-4c3e64c4c4b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.788826 Aug 29 15:34:22.041655 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 925/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.054412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.059071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.059824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.070653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.072665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.078198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.079830 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-561c95ed-88ad-4153-ac44-cf34709ecad6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "POST /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c/action" status: 202 len: 1495 microversion: 2.75 time: 0.417733 Aug 29 15:34:22.080355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.080647 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1010/1935] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:34:21 2022] POST /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c/action => generated 1495 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:34:22.086452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.087081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 343c0bd3-0da0-465c-aedc-8feadb8076f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.094164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.102330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.102330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.102330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.102330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.102330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.102330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.104312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.105034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.105736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.156684 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] HTTP exception thrown: Instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 could not be found. Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Request method failure captured: Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 HTTP/1.1 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrQzZ5FVEa0qr_1twL3RpO7XPgQx98bTlDvgnR4qsOebiK-8Go_AUFp_yqZMyKH4Vo4FFlHHtRcghATOjkIc7qmAn_3wfjIIPSazUdNYDj1O9hlOjwU7l782Vs-O_ZWSigaXp95sUCL3kM1ZmhmNq8DwO-ARAIiv7tqzo_9xKqlTw0 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0145760115bc47d188f32fca7793b863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0145760115bc47d188f32fca7793b863", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}] Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f331c1e3ee1442ad863d8909ca76020b Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 could not be found. Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '343c0bd3-0da0-465c-aedc-8feadb8076f2'} Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 could not be found. Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 could not be found. Aug 29 15:34:22.161821 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 could not be found. Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Returning 404 to user: Instance 343c0bd3-0da0-465c-aedc-8feadb8076f2 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-01002342-3dda-4e9a-b985-c641ad00a980 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2" status: 404 len: 111 microversion: 2.25 time: 0.083842 Aug 29 15:34:22.172055 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1011/1936] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/343c0bd3-0da0-465c-aedc-8feadb8076f2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:22.196092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.196738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.217673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.218098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.218543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.219266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.219726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.220155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.646813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.656006 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef810105-b50b-4f8d-bc67-de0ba12ef185 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.487455 Aug 29 15:34:22.656586 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1012/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.664535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.665359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.680342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.681035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.681641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.682495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.683253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.684531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.860897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.873486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.875539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.890856 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a83dfded-1ec5-40a6-bb0b-24c44d1f5fcc tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.230963 Aug 29 15:34:22.892560 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1013/1938] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:22.938341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.950588 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eba013d7-6b52-405e-ac69-edb2bbdc9c5f tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.905267 Aug 29 15:34:22.951594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 926/1939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:23.069199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.070674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.087641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.088164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.088614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.089729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.091504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.091946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.551872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.570557 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e0c4a9c7-59a6-4c9e-9a79-4eb4b744243b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.506154 Aug 29 15:34:23.585422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1014/1940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:23 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:23.683395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.684370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.695256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.696015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.696726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.697682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.698297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.700242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.726794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:23.924505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.925222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.941003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.957270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.967195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.968289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.968778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.969217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.252954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.265686 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1959594d-c33f-432d-b182-249844e4195f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.585098 Aug 29 15:34:24.268399 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 927/1941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:23 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:24.275291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.280839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.293242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.299716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.305142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.307070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.309106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.310812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.314325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.315348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.316022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.334221 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce1aa319-29cd-45b2-abc0-3e315c9d93e1 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.413896 Aug 29 15:34:24.334959 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1015/1942] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:23 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:24.598090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.599129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.617507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.619695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.620238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.622362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.624170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.626983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.687262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.703077 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f21f495-f325-4793-9424-0fc963b16f3d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.429744 Aug 29 15:34:24.704113 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 928/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:24.735735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:24.778933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0c85cc0c-c82a-424e-bcb5-bb704c2ccfb1 req-d566ba41-6091-4cfd-bfac-36ec8aabf863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73c9734-2c89-4c91-9fc7-62dcc39cbe49", "name": "network-vif-plugged", "status": "completed", "tag": "5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:24.807404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0c85cc0c-c82a-424e-bcb5-bb704c2ccfb1 req-d566ba41-6091-4cfd-bfac-36ec8aabf863 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.809439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0c85cc0c-c82a-424e-bcb5-bb704c2ccfb1 req-d566ba41-6091-4cfd-bfac-36ec8aabf863 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.812158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0c85cc0c-c82a-424e-bcb5-bb704c2ccfb1 req-d566ba41-6091-4cfd-bfac-36ec8aabf863 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.857362 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0c85cc0c-c82a-424e-bcb5-bb704c2ccfb1 req-d566ba41-6091-4cfd-bfac-36ec8aabf863 service nova] Creating event network-vif-plugged:5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d for instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 on n-h2-854882-3 Aug 29 15:34:24.871522 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0c85cc0c-c82a-424e-bcb5-bb704c2ccfb1 req-d566ba41-6091-4cfd-bfac-36ec8aabf863 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096089 Aug 29 15:34:24.887170 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 929/1944] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:25.289712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.290567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.300176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.300662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.301085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.306522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.308537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.309977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.633976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.643569 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c4038f7d-4436-4641-8501-8f09737632c2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 1.049823 Aug 29 15:34:25.644116 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1016/1945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:25.661957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.662784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.677011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.678316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.683108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.683938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.684426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.684867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.802136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=22 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:25.829558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.831566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.840184 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e56199d-40b1-4eca-8b4b-9b338540c699 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1316 microversion: 2.1 time: 0.554855 Aug 29 15:34:25.843180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.844286 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 930/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:25.847452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.853687 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7d2733ee-9e70-4238-95d8-fc48c1691921 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.208544 Aug 29 15:34:25.856811 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1017/1947] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:25.857873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.858699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.868728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.873771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.874432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.875550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.877935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.878559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.181863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:26.192850 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8a07467-043a-4c33-90d9-07f2ef56005e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.346151 Aug 29 15:34:26.195745 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 931/1948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:26.667600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:26.668334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:26.725500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.726215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.726676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.734045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.737364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.738249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.867819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:26.869700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:26.880630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.885917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.886752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.887731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.888421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.890535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.086781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.097286 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2d5823f-3df3-4bcb-9d75-a901b1518752 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.436399 Aug 29 15:34:27.100520 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1018/1949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:26 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:27.125098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.128431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.141944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.144909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.145612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.146544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.154248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.154987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.335950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.354520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.362294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.373876 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-804d2499-bc9f-461a-b123-2a9cab324e0d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.257252 Aug 29 15:34:27.398760 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1019/1950] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:27.407503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.408136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.421991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.424649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.425134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.425916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.426379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.429557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.604632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.617281 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4931e824-8f51-41bb-9bca-a3cd587098cf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1504 microversion: 2.1 time: 0.754296 Aug 29 15:34:27.629425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 932/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:26 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1504 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:27.644851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1834194409"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:27.645471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.655983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.656475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.656906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.660500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.661021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.661471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.930741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.947102 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4403b15e-87da-470f-abbf-9b180be5be4b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.547125 Aug 29 15:34:27.950706 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1020/1952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:28.003186 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.network.security_group_api [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Adding security group 6af1be51-8f30-4706-8543-3db7317e2a62 to port 5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d Aug 29 15:34:28.121655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:28.122478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:28.139511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.147081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.147804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.148573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.149031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.149885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.024154 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0f93923-9cf3-451d-8eba-04a994297879 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49/action" status: 202 len: 0 microversion: 2.1 time: 1.384150 Aug 29 15:34:29.025425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 933/1953] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:27 2022] POST /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49/action => generated 0 bytes in 1387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:29.031771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.032956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:29.051724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.052524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.055001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.055970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.058036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.075032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.182296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.214478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-32f796e2-3ece-4553-acf0-9b3fbc6216b0 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 1.092616 Aug 29 15:34:29.219376 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1021/1954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:28 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:29.229117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.230119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:29.244555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.248028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.248704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.249745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.250479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.250618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.267714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.281834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.283675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.288952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:29.307307 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-84d6daa9-ab47-4a7a-bc50-122648a49983 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.279138 Aug 29 15:34:29.307942 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 934/1955] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:29 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:29.319596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5838548c-5578-42ce-8491-cb2e04c30b4c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e3b5aee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.827516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.844055 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f9c3352-36ab-474d-b4ce-8c71312ed5f6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.623121 Aug 29 15:34:29.845758 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1022/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:29 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:29.855721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0e7e2245-5b5c-4fc5-ab86-20136464a106 req-50f2eee4-0539-49e3-94c8-8b0e96c6e440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73c9734-2c89-4c91-9fc7-62dcc39cbe49", "tag": "5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:29.908091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0e7e2245-5b5c-4fc5-ab86-20136464a106 req-50f2eee4-0539-49e3-94c8-8b0e96c6e440 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.912779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0e7e2245-5b5c-4fc5-ab86-20136464a106 req-50f2eee4-0539-49e3-94c8-8b0e96c6e440 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.915803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0e7e2245-5b5c-4fc5-ab86-20136464a106 req-50f2eee4-0539-49e3-94c8-8b0e96c6e440 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.940413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0e7e2245-5b5c-4fc5-ab86-20136464a106 req-50f2eee4-0539-49e3-94c8-8b0e96c6e440 service nova] Creating event network-changed:5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d for instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 on n-h2-854882-3 Aug 29 15:34:29.945147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-5838548c-5578-42ce-8491-cb2e04c30b4c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use.", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:29.946201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-5838548c-5578-42ce-8491-cb2e04c30b4c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use. Aug 29 15:34:29.946201 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-b2416234-6ee8-4302-b2de-42c32ce4774f'] Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5838548c-5578-42ce-8491-cb2e04c30b4c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62 HTTP/1.1 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: exception: Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use. Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-b2416234-6ee8-4302-b2de-42c32ce4774f'] Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6af1be51-8f30-4706-8543-3db7317e2a62'} Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:29.948761 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use. Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2416234-6ee8-4302-b2de-42c32ce4774f'] Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use. Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2416234-6ee8-4302-b2de-42c32ce4774f'] Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use. Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2416234-6ee8-4302-b2de-42c32ce4774f'] Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use. Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2416234-6ee8-4302-b2de-42c32ce4774f'] Aug 29 15:34:29.954613 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:29.959994 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0e7e2245-5b5c-4fc5-ab86-20136464a106 req-50f2eee4-0539-49e3-94c8-8b0e96c6e440 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101925 Aug 29 15:34:29.959994 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1023/1957] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:29.959994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.962493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5838548c-5578-42ce-8491-cb2e04c30b4c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 400 to user: Security Group 6af1be51-8f30-4706-8543-3db7317e2a62 in use. Aug 29 15:34:29.962493 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-b2416234-6ee8-4302-b2de-42c32ce4774f'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:29.962754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:29.962860 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5838548c-5578-42ce-8491-cb2e04c30b4c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62" status: 400 len: 185 microversion: 2.1 time: 0.652277 Aug 29 15:34:29.962860 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 935/1958] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:29 2022] DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62 => generated 185 bytes in 653 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:29.974754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:29.979683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.980252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.981187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.982238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.982825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.983261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.984206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.005859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.011734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.012485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.013464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.014107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.014787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.023411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:30.198612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa8ed68c-8b9c-417e-aff5-0091153c48a6 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 204 len: 0 microversion: 2.25 time: 0.245046 Aug 29 15:34:30.201653 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1024/1959] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:29 2022] DELETE /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:30.202334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f750f2b-de8f-465f-a0ad-70d52c93c6b7 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49/action" status: 202 len: 0 microversion: 2.1 time: 0.234833 Aug 29 15:34:30.203327 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 936/1960] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:29 2022] POST /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:34:30.211441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.212157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.219408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.220118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.240342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.242097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.243583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.244897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.245581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.246372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.246660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.247169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.247605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.248632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.249274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.250018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.453720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.464193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.466300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.468400 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c3251107-6503-48a6-b4cb-1f387376be32 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1730 microversion: 2.25 time: 0.261507 Aug 29 15:34:30.480361 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1025/1961] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:30.493051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.493861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.501510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.502129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.503366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.504148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.504822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.505533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.830585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.852574 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6b90289-6267-4ff7-b481-6491cf82269b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.369811 Aug 29 15:34:30.854262 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1026/1962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:30.865195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.866110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.875815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.890086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.890545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.895943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.896449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.898487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.983590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.002155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.004352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.012645 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-90abfff6-d9b6-45d8-b46f-1e7801404b2c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.155691 Aug 29 15:34:31.014525 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1027/1963] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:31.142330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.166214 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5d2050c-57a5-436f-a6b6-1362f7b0957f tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1575 microversion: 2.1 time: 0.951226 Aug 29 15:34:31.167093 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 937/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1575 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:31.171953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.179538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.188481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.189176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.189644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.190467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.191054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.191674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.298361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f73b0972-94f5-4822-a4bb-703cab9bbebb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Action: 'create', calling method: .version_select at 0x7fb0e2d3bca0>, body: {"keypair": {"name": "tempest-keypair-1676725989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPldCp+aCkkF1JT8LMinuk3ZuMzPmOyJtMnNFAK8AHGEElgqLaPoVMTOjQv66dnsfd+06a5SE2iy2u0Zjw3Y4BB3O4Oh3UUJ0kYKpuQFZkw5ePSaSQErcPLzNDdnldB2/w=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:31.340570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-f73b0972-94f5-4822-a4bb-703cab9bbebb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Getting quotas for project fb4265e2a96c4b9ba49452d382cc413c. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:31.350381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:31.355812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-f73b0972-94f5-4822-a4bb-703cab9bbebb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Getting quotas for user 736591425d2d40cda2331153600f20df and project fb4265e2a96c4b9ba49452d382cc413c. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:31.415056 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f73b0972-94f5-4822-a4bb-703cab9bbebb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.399374 Aug 29 15:34:31.416303 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1028/1965] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:34:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:31.503820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.504886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.518074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.519788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.525739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.526918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.528804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.529814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.549783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.565953 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e54856af-c011-4be9-824e-1cc596cd6082 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.395903 Aug 29 15:34:31.584268 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 938/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:31.861948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.876281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.877152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.886745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.890963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.894918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.895674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.895842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-00bfa9b5-b297-448b-9209-faf6cbb4b08f tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1730 microversion: 2.25 time: 0.402189 Aug 29 15:34:31.896433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.898178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.898970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.899379 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1029/1967] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1730 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:31.899775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.058080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.060698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.069067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.070193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.071915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.073839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.074860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.076697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.686788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.699536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.704575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.731804 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9b38c6d-0e08-4c9f-8b94-c8245090f948 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.688914 Aug 29 15:34:32.733176 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1030/1968] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:32.743102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.747357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.762181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.762931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.764835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.765908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.767182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.769790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.077318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.093308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7484f61f-e7c7-46fe-af9c-2fe078965484 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 1.219033 Aug 29 15:34:33.105486 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 939/1969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:33.105486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.105486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.126093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.127068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.127770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.130165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.131134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.132692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.198776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.215816 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3697c501-4080-4044-837b-456690244a91 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1575 microversion: 2.1 time: 0.480053 Aug 29 15:34:33.222026 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1031/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1575 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:33.250516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.262653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.279347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.286208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.286654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.293830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.299599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.300001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.394920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.397707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.398889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.400045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lazy-loading 'fault' on Instance uuid 704fa114-40c8-4d26-bd16-838f3a8dcb5f {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:33.589696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.603610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.609538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.613579 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b97731ea-169f-49ca-9945-dd3a9c49a2c3 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 200 len: 1374 microversion: 2.25 time: 0.376618 Aug 29 15:34:33.616031 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1032/1971] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 1374 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:33.626930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-85b20d4f-a48c-4257-af16-04582e54ea2b req-20904daf-53e6-43fc-bcc2-336a93581259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704fa114-40c8-4d26-bd16-838f3a8dcb5f", "name": "network-vif-deleted", "tag": "082f5e62-9263-4994-b619-d36cc2fcb932"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:33.658764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-85b20d4f-a48c-4257-af16-04582e54ea2b req-20904daf-53e6-43fc-bcc2-336a93581259 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.660449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-85b20d4f-a48c-4257-af16-04582e54ea2b req-20904daf-53e6-43fc-bcc2-336a93581259 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.662221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-85b20d4f-a48c-4257-af16-04582e54ea2b req-20904daf-53e6-43fc-bcc2-336a93581259 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.702342 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-85b20d4f-a48c-4257-af16-04582e54ea2b req-20904daf-53e6-43fc-bcc2-336a93581259 service nova] Creating event network-vif-deleted:082f5e62-9263-4994-b619-d36cc2fcb932 for instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f on n-h2-854882-3 Aug 29 15:34:33.718053 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-85b20d4f-a48c-4257-af16-04582e54ea2b req-20904daf-53e6-43fc-bcc2-336a93581259 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095842 Aug 29 15:34:33.718878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1033/1972] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:33.734638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-602a8261-35bc-492d-86f4-15536d72f0d3 req-0e3759aa-e069-4675-a607-2a246ba4d5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff74d1c6-a399-41f7-a310-236875d7fb53", "name": "network-vif-plugged", "status": "completed", "tag": "46016059-a1ff-46a2-b1bc-f801e570e627"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:33.769316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-602a8261-35bc-492d-86f4-15536d72f0d3 req-0e3759aa-e069-4675-a607-2a246ba4d5fe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.769842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-602a8261-35bc-492d-86f4-15536d72f0d3 req-0e3759aa-e069-4675-a607-2a246ba4d5fe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.770278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-602a8261-35bc-492d-86f4-15536d72f0d3 req-0e3759aa-e069-4675-a607-2a246ba4d5fe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.799800 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-602a8261-35bc-492d-86f4-15536d72f0d3 req-0e3759aa-e069-4675-a607-2a246ba4d5fe service nova] Creating event network-vif-plugged:46016059-a1ff-46a2-b1bc-f801e570e627 for instance ff74d1c6-a399-41f7-a310-236875d7fb53 on n-h1-854882-3 Aug 29 15:34:33.809790 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-602a8261-35bc-492d-86f4-15536d72f0d3 req-0e3759aa-e069-4675-a607-2a246ba4d5fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086246 Aug 29 15:34:33.810397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1034/1973] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:33.826138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.827118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.845585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.849415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.850186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.852821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.863918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.864666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.027513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.038685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.047316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.059459 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a1e17fa8-032a-4d17-b392-f97a7b835a9a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.243275 Aug 29 15:34:34.074116 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1035/1974] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:34.120738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.121373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.132644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.132644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.135252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.135586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.136060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.137689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.373993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.394887 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e4fbed6-3870-4f39-a940-60a8f67ad5cb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 1.299284 Aug 29 15:34:34.400083 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 940/1975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:34.409100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.410025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.433738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.436680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.437217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.438027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.439639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.440097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.683788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.696225 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c58a0124-9085-4dc7-9b61-1be0785405df tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.579489 Aug 29 15:34:34.696625 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1036/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:34.718989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.719676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 704fa114-40c8-4d26-bd16-838f3a8dcb5f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.744517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.745023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.747185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.750176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.750705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.751152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.796314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] HTTP exception thrown: Instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f could not be found. Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Request method failure captured: Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f HTTP/1.1 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrQzZ5FVEa0qr_1twL3RpO7XPgQx98bTlDvgnR4qsOebiK-8Go_AUFp_yqZMyKH4Vo4FFlHHtRcghATOjkIc7qmAn_3wfjIIPSazUdNYDj1O9hlOjwU7l782Vs-O_ZWSigaXp95sUCL3kM1ZmhmNq8DwO-ARAIiv7tqzo_9xKqlTw0 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0145760115bc47d188f32fca7793b863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0145760115bc47d188f32fca7793b863", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}] Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f331c1e3ee1442ad863d8909ca76020b Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f could not be found. Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '704fa114-40c8-4d26-bd16-838f3a8dcb5f'} Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f could not be found. Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f could not be found. Aug 29 15:34:34.798424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f could not be found. Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:34.806173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Returning 404 to user: Instance 704fa114-40c8-4d26-bd16-838f3a8dcb5f could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:34.807203 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5072c886-65c9-4ee2-9d66-983925bdc426 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f" status: 404 len: 111 microversion: 2.25 time: 0.093647 Aug 29 15:34:34.807203 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1037/1977] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/704fa114-40c8-4d26-bd16-838f3a8dcb5f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:34.818197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3229b10-a8f7-4c62-9187-5c6b3f241d74 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '.version_select at 0x7fb0e35348b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.897746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3229b10-a8f7-4c62-9187-5c6b3f241d74 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-520662627" status: 204 len: 0 microversion: 2.25 time: 0.078006 Aug 29 15:34:34.898717 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1038/1978] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Aug 29 15:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-520662627 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:35.060327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.072029 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e40d6f00-b028-40e4-b17e-4db03ef65714 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1575 microversion: 2.1 time: 0.670710 Aug 29 15:34:35.091586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.092205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:35.101565 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 941/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1575 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:35.113820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.114329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.114768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.115491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.115945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.116924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.365731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.390949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.393246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.404241 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-126b8906-a93e-4600-afd6-70dd9925afbf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.319021 Aug 29 15:34:35.423017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.423017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:35.425831 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1039/1980] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:35.443559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.444076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.445041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.445804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.446417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.446903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.724633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.725266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:35.751859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.752513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.752963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.753726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.755088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.755737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.153944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.174015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ba98b849-d19d-4279-b3ee-ef0039882b36 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1313 microversion: 2.1 time: 0.757508 Aug 29 15:34:36.174605 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 942/1981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1313 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:36.180138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.195167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.211999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.217670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.218350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.219253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.219859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.227756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.308416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.327980 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-052c262f-bc14-4ebc-bded-d5a5cf9ba9e7 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1390 microversion: 2.1 time: 0.614840 Aug 29 15:34:36.329208 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1040/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1390 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:36.334217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-356417d3-76fc-4f75-b83f-55c20e91b1ea tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Action: 'create', calling method: .version_select at 0x7fb0e2f8b160>, body: {"keypair": {"name": "tempest-keypair-547540489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCZU4+9aAVXwRGEBipIgElZPq9GfFBb+L540R3COrzUxTkAKMTPEfRCh125VSzfwgTNlXd4SGnfbK6x+s2uPqs4MOAg7EpQr4eRvng7JR3u6E/Ixmv4U4YdH9hs3iKBKQ=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:36.375622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-356417d3-76fc-4f75-b83f-55c20e91b1ea tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Getting quotas for project dfce36a97ee446a5a79d91b67b855558. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:36.392412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-356417d3-76fc-4f75-b83f-55c20e91b1ea tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Getting quotas for user 33daa615bc42447b9056611bc563e131 and project dfce36a97ee446a5a79d91b67b855558. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:36.441646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-356417d3-76fc-4f75-b83f-55c20e91b1ea tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.110790 Aug 29 15:34:36.446347 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1041/1983] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:34:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:34:36.462902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.463746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.476698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.481780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.482649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.484957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.485656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.486324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.733749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.750258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:36.754939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.773866 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ea258897-2045-47c8-aa75-38bcca3f12f9 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1575 microversion: 2.1 time: 0.596970 Aug 29 15:34:36.775833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.778433 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 943/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1575 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:36.801447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.843339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc8ddb7b-30bc-44b2-92b0-40c3d55d0071 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.395030 Aug 29 15:34:36.845953 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1042/1985] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:37.175507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.176257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.184152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.184956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.185657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.186824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.187505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.188156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.198264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.199620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.212560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.213071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.213557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.214316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.214781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.215239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.245875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:37.275496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:37.385371 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30b278e6-ee99-4b96-93df-8e9d60865173 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 204 len: 0 microversion: 2.25 time: 0.214951 Aug 29 15:34:37.386385 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 944/1986] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:37 2022] DELETE /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:37.403122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.406315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.415978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.416582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.417106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.417956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.418503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.419006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.474366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.492728 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6c9f03b9-6368-4406-8391-8d6dcaa318f7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1462 microversion: 2.1 time: 0.301598 Aug 29 15:34:37.493601 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1043/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1462 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:37.499518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.500365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.507233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.507946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.508743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.509686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.510320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.510910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.669172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.678458 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ff87aa46-9aeb-46ce-8ea8-56847d4946a8 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1380 microversion: 2.1 time: 0.290448 Aug 29 15:34:37.690376 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 945/1988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1380 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:37.807379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.816375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.824646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.826167 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4dde3050-f40f-4828-8a04-100b75402dbe tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 200 len: 1548 microversion: 2.25 time: 0.331455 Aug 29 15:34:37.826911 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1044/1989] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 1548 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:37.845142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc76c09f-7e12-423e-8188-018d5d2ea3ce tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '.version_select at 0x7fb0e2d3b430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.849284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc76c09f-7e12-423e-8188-018d5d2ea3ce tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.850074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc76c09f-7e12-423e-8188-018d5d2ea3ce tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.850734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc76c09f-7e12-423e-8188-018d5d2ea3ce tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.862461 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc76c09f-7e12-423e-8188-018d5d2ea3ce tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.034332 Aug 29 15:34:37.867577 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1045/1990] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:37.888252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.889147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.899723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.900414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.901194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.902043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.903500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.903935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.914075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.923914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Searching by: {'deleted': False, 'project_id': '0fc33da4b2d542c1a13a626c080cd25a'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:37.940693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.947664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.949256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.950689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.951305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.951902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.031950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee7aa2ed-aa7a-4624-8e9f-b921fd63c81a tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.340326 Aug 29 15:34:38.037625 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 946/1991] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:34:38.060140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.060805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.072779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:38.077065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.077818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.080699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.081923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.082407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.082837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.230824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.249348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.250878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.265921 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc338aed-92a5-4ef6-8a59-62c133741604 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.226654 Aug 29 15:34:38.266891 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 947/1992] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:38.276494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.277134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.283150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.283636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.284259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.285414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.286041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.286818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.399624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.409168 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-78d20e8e-086a-4318-aa2e-3a67a885fae6 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1573 microversion: 2.1 time: 0.539563 Aug 29 15:34:38.425900 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1046/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1573 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:38.439673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.455194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Searching by: {'deleted': False} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:38.476027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.476517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.476962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.477728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.486900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.487181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.564100 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55d278da-77ca-41db-abea-96ba2f4fc798 tempest-LiveMigrationTest-1118143683 tempest-LiveMigrationTest-1118143683-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1531 microversion: 2.1 time: 0.295979 Aug 29 15:34:38.567719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 948/1994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1531 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:38.574086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-350546413"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:38.575213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.602275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.602766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.603201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.603925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.604334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.604750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.803311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Listed batch of 15 results from cell out of 1000 limit. Returned 15 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:38.923201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.network.security_group_api [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Adding security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 to port 5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d Aug 29 15:34:38.972612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.973246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.988641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.909276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c02bc332-4841-43d7-a025-d84ff5407109 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 24733 microversion: 2.1 time: 1.490529 Aug 29 15:34:39.913575 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1047/1995] 10.222.0.16 () {58 vars in 1171 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 24733 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:34:39.918678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:39.919189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:39.933724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.934222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.934663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.935380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.935839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.936267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.987486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:40.123980 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ca687e7-d7c2-4e1b-8ec9-58bc1ecefc3e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 204 len: 0 microversion: 2.1 time: 0.207671 Aug 29 15:34:40.128039 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1048/1996] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:39 2022] DELETE /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:34:40.148561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.149718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: d9a18289-bd6c-4503-a954-36e1aaa0c110] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.156758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.157621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.158972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.160191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.161429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.162107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.196235 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] HTTP exception thrown: Instance d9a18289-bd6c-4503-a954-36e1aaa0c110 could not be found. Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Request method failure captured: Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 HTTP/1.1 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrQzZ5FVEa0qr_1twL3RpO7XPgQx98bTlDvgnR4qsOebiK-8Go_AUFp_yqZMyKH4Vo4FFlHHtRcghATOjkIc7qmAn_3wfjIIPSazUdNYDj1O9hlOjwU7l782Vs-O_ZWSigaXp95sUCL3kM1ZmhmNq8DwO-ARAIiv7tqzo_9xKqlTw0 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0145760115bc47d188f32fca7793b863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0145760115bc47d188f32fca7793b863", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}] Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f331c1e3ee1442ad863d8909ca76020b Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance d9a18289-bd6c-4503-a954-36e1aaa0c110 could not be found. Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'd9a18289-bd6c-4503-a954-36e1aaa0c110'} Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a18289-bd6c-4503-a954-36e1aaa0c110 could not be found. Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a18289-bd6c-4503-a954-36e1aaa0c110 could not be found. Aug 29 15:34:40.198200 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a18289-bd6c-4503-a954-36e1aaa0c110 could not be found. Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:40.203881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Returning 404 to user: Instance d9a18289-bd6c-4503-a954-36e1aaa0c110 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:40.204803 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ee00bc40-505f-43c4-8f96-5fce745b8ff4 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110" status: 404 len: 111 microversion: 2.25 time: 0.071607 Aug 29 15:34:40.206023 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1049/1997] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/d9a18289-bd6c-4503-a954-36e1aaa0c110 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:40.210459 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ebef9ab2-3c39-4e62-8e29-7201ef49645e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49/action" status: 202 len: 0 microversion: 2.1 time: 1.640707 Aug 29 15:34:40.211075 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 949/1998] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:38 2022] POST /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49/action => generated 0 bytes in 1643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:40.213801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a1527594-b420-40ba-8eff-b227893a8a6c req-4b435962-63e7-4b2b-91d6-53d52f3f56f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a18289-bd6c-4503-a954-36e1aaa0c110", "name": "network-vif-deleted", "tag": "0dcba184-a55c-4388-8169-12ea22b34d6f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:40.217594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.218207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.229330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a1527594-b420-40ba-8eff-b227893a8a6c req-4b435962-63e7-4b2b-91d6-53d52f3f56f0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.229991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a1527594-b420-40ba-8eff-b227893a8a6c req-4b435962-63e7-4b2b-91d6-53d52f3f56f0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.230526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a1527594-b420-40ba-8eff-b227893a8a6c req-4b435962-63e7-4b2b-91d6-53d52f3f56f0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.242426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.243022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.243843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.245249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.245745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.246170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.249995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a1527594-b420-40ba-8eff-b227893a8a6c req-4b435962-63e7-4b2b-91d6-53d52f3f56f0 service nova] Creating event network-vif-deleted:0dcba184-a55c-4388-8169-12ea22b34d6f for instance d9a18289-bd6c-4503-a954-36e1aaa0c110 on n-h1-854882-3 Aug 29 15:34:40.257166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a1527594-b420-40ba-8eff-b227893a8a6c req-4b435962-63e7-4b2b-91d6-53d52f3f56f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049686 Aug 29 15:34:40.258176 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1050/1999] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:40.263527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1466372141", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4ede07aa-a0de-432e-89f6-20cd28f9b72a"}, {"port": "7e6e0494-afe5-4c77-abff-4dbe391df468", "tag": "port-1"}, {"port": "f0a6706f-723c-4dd5-84bd-8f5e99f29ba3", "tag": "port-2"}, {"uuid": "8876630d-e702-41a3-98fc-b1e5c1e8719e", "tag": "net-1"}, {"uuid": "8876630d-e702-41a3-98fc-b1e5c1e8719e"}, {"uuid": "e3fcddaa-8113-4b21-a908-7c9c2c2ddf80", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e3fcddaa-8113-4b21-a908-7c9c2c2ddf80", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9245dcbf-d2ae-488e-b05c-4deaca691d38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "87083b05-42b7-49a9-a66c-d7eb6e78db69", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f59e70a0-361a-41a8-92db-2b20eda100d7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1517280837"}], "key_name": "tempest-keypair-547540489", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:40.358135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:40.381180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:40.393673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:40.407981 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7af62412-3da2-4c2f-ab8a-5a506abce89d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.194253 Aug 29 15:34:40.411705 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 950/2000] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:40.426867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.432263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Searching by: {'deleted': False, 'project_id': '0fc33da4b2d542c1a13a626c080cd25a'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:40.447026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.448576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.449550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.451762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.453611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.457140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.463901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] validate_networks() for [('4ede07aa-a0de-432e-89f6-20cd28f9b72a', None, None, None, None, None), (None, None, '7e6e0494-afe5-4c77-abff-4dbe391df468', None, None, None), (None, None, 'f0a6706f-723c-4dd5-84bd-8f5e99f29ba3', None, None, None), ('8876630d-e702-41a3-98fc-b1e5c1e8719e', None, None, None, None, None), ('8876630d-e702-41a3-98fc-b1e5c1e8719e', None, None, None, None, None), ('e3fcddaa-8113-4b21-a908-7c9c2c2ddf80', '10.2.2.100', None, None, None, None), ('e3fcddaa-8113-4b21-a908-7c9c2c2ddf80', '10.2.2.200', None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:40.556453 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4dd24791-7e1e-4420-99a3-2b589588e89b tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=c785a2ff808848958fa8e54ac1db2fdb" status: 200 len: 15 microversion: 2.1 time: 0.142035 Aug 29 15:34:40.559463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 951/2001] 10.222.0.16 () {58 vars in 1231 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/detail?tenant_id=c785a2ff808848958fa8e54ac1db2fdb => generated 15 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:34:40.567293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.568828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.603154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.606421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.608656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.609496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.609986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.610426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.050401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:41.071601 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76ffa602-b8dc-4fc5-99d8-9d2d320fa5d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1386 microversion: 2.1 time: 0.509961 Aug 29 15:34:41.074353 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 952/2002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1386 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:41.084704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:41.085902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:41.104388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.104890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.105327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.114333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.114845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.115289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.185781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:41.355208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3709d2ed-faac-4c68-bb26-8de33eb72753 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 204 len: 0 microversion: 2.25 time: 0.277572 Aug 29 15:34:41.358384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 953/2003] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:41 2022] DELETE /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:41.372898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-34685476-b0fa-414e-a332-99a384fc3b52 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e3cbd820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:41.667155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-34685476-b0fa-414e-a332-99a384fc3b52 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use.", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:41.667934 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-34685476-b0fa-414e-a332-99a384fc3b52 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use. Aug 29 15:34:41.667934 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-815f5c43-685b-42bc-8fe0-a9cb5659b86a'] Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-34685476-b0fa-414e-a332-99a384fc3b52 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555 HTTP/1.1 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: exception: Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use. Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-815f5c43-685b-42bc-8fe0-a9cb5659b86a'] Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a35b1fd6-2c25-455e-a6cd-2dd000d25555'} Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:41.670039 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use. Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-815f5c43-685b-42bc-8fe0-a9cb5659b86a'] Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use. Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-815f5c43-685b-42bc-8fe0-a9cb5659b86a'] Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use. Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-815f5c43-685b-42bc-8fe0-a9cb5659b86a'] Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use. Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-815f5c43-685b-42bc-8fe0-a9cb5659b86a'] Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-34685476-b0fa-414e-a332-99a384fc3b52 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 400 to user: Security Group a35b1fd6-2c25-455e-a6cd-2dd000d25555 in use. Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-815f5c43-685b-42bc-8fe0-a9cb5659b86a'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:41.675646 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-34685476-b0fa-414e-a332-99a384fc3b52 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555" status: 400 len: 185 microversion: 2.1 time: 0.305867 Aug 29 15:34:41.679711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 954/2004] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:41 2022] DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555 => generated 185 bytes in 319 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:41.694409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:41.708588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Searching by: {'tenant_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'deleted': False} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:41.715615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.716188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.717224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.718105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.718788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.719509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.759958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:41.857669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.858159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.858599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.339499 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f955effa-f423-4af0-9220-b4395a0d5482 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c785a2ff808848958fa8e54ac1db2fdb" status: 200 len: 4823 microversion: 2.1 time: 0.658890 Aug 29 15:34:42.341094 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 955/2005] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:34:41 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c785a2ff808848958fa8e54ac1db2fdb => generated 4823 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:42.348829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:42.349850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:42.358232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.359481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.360181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.361604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.362307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.363043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.792191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.807325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.819962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.821732 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9abc20e-9066-4c2d-9cf9-50526bd55425 tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1564 microversion: 2.25 time: 0.478864 Aug 29 15:34:42.822917 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 956/2006] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:42 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1564 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:42.838149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:42.839162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:42.845788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.846617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.847421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.848632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.849570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.850212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.964905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.976368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.980849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.000442 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-10745583-9722-437c-8093-e2c772e230ce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.174726 Aug 29 15:34:43.003077 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 957/2007] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:42 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:43.015423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.016950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.030675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.031578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.033889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.035303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.036024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.037542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.098617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:43.205093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:43.285815 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40b941e9-93d5-4efc-a1fb-7920c2578896 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 204 len: 0 microversion: 2.1 time: 0.280253 Aug 29 15:34:43.286775 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 958/2008] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:43 2022] DELETE /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:34:43.295182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.296270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.304124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.304614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.305047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.306008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.306622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.307060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.386076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.394336 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d3ac16b-9048-4f1c-be53-d357d6cf3903 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1183 microversion: 2.1 time: 0.105869 Aug 29 15:34:43.396643 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 959/2009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:43.402384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d46de9e2-96de-4bd9-9e28-cbab21860655 req-7dd53c0d-6b82-4567-9f8c-cec6db341b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73c9734-2c89-4c91-9fc7-62dcc39cbe49", "tag": "5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:43.422789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d46de9e2-96de-4bd9-9e28-cbab21860655 req-7dd53c0d-6b82-4567-9f8c-cec6db341b32 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.423520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d46de9e2-96de-4bd9-9e28-cbab21860655 req-7dd53c0d-6b82-4567-9f8c-cec6db341b32 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.424056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d46de9e2-96de-4bd9-9e28-cbab21860655 req-7dd53c0d-6b82-4567-9f8c-cec6db341b32 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.437829 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d46de9e2-96de-4bd9-9e28-cbab21860655 req-7dd53c0d-6b82-4567-9f8c-cec6db341b32 service nova] Creating event network-changed:5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d for instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 on n-h2-854882-3 Aug 29 15:34:43.448602 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d46de9e2-96de-4bd9-9e28-cbab21860655 req-7dd53c0d-6b82-4567-9f8c-cec6db341b32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049950 Aug 29 15:34:43.452643 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 960/2010] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:43.458396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.466045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Searching by: {'tenant_id': '0fc33da4b2d542c1a13a626c080cd25a', 'deleted': False} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:43.472584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.473203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.473728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.474597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.475951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.476455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.544001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e388d832-6000-4748-b521-554e9903db58 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0fc33da4b2d542c1a13a626c080cd25a" status: 200 len: 15 microversion: 2.1 time: 0.089855 Aug 29 15:34:43.557415 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 961/2011] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0fc33da4b2d542c1a13a626c080cd25a => generated 15 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:34:43.557415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.557415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.562772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.562772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.562772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.562772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.562772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.562772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.793869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.808070 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac782140-72ab-409b-a8c9-940f638f0a13 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1647 microversion: 2.1 time: 0.261713 Aug 29 15:34:43.809696 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 962/2012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1647 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:43.816274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eab4f8f5-36cd-4e69-9353-76a8f71776f7 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.822496 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eab4f8f5-36cd-4e69-9353-76a8f71776f7 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011623 Aug 29 15:34:43.823544 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 963/2013] 10.222.0.16 () {58 vars in 1189 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:34:43.847631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.848241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.854584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.855064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.855491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.856183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.856631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.857043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.891566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.892047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.892612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.893065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lazy-loading 'fault' on Instance uuid 5131cda1-4999-4c3e-b1dc-88a941e779f2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:43.940339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.950778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.959308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.961021 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f34b8727-e88f-4915-b01a-1fc7e0b423bf tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1352 microversion: 2.25 time: 0.118394 Aug 29 15:34:43.962191 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 964/2014] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:43.968646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:43.970940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.978181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.978768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.979302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.980096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.980659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.981176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.116744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-647c4bee-d80e-44d5-aae5-875579d15461 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action" status: 202 len: 0 microversion: 2.1 time: 0.151405 Aug 29 15:34:44.118413 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 965/2015] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:43 2022] POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:44.129047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.131207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.144177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.146811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.148580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.149423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.150781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.152120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.255314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:44.255874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:44.256324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:44.256583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:44.257579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:44.276055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.276837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.277467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.278717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.279477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.280093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.304695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.306193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Getting quotas for project dfce36a97ee446a5a79d91b67b855558. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:44.313841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Getting quotas for user 33daa615bc42447b9056611bc563e131 and project dfce36a97ee446a5a79d91b67b855558. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:44.316657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.318279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.324966 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-70938ec1-7016-4f78-a402-2651247a4451 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.204672 Aug 29 15:34:44.326141 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 966/2016] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:44.340732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.345843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.347027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:44.353111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.353641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.354080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.354801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.355248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.355669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.468431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:44.504392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:44.508269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9245dcbf-d2ae-488e-b05c-4deaca691d38',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='87083b05-42b7-49a9-a66c-d7eb6e78db69',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f59e70a0-361a-41a8-92db-2b20eda100d7',volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:44.543207 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7b8a6c75-5953-4e6e-b9ae-2a59c50efaa9 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.215667 Aug 29 15:34:44.543808 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 967/2017] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:44.555831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.557007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.575278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.576195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.577125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.578075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.578927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.579417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.724023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.735844 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b3aa34d9-f898-4c9f-81d3-bec47023c1ea tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1183 microversion: 2.1 time: 0.189830 Aug 29 15:34:44.737264 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 968/2018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:44.752568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:44.792113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.810654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.811156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.811711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.812433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.812937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.813358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.946161 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-33bbe556-e6f0-4942-bf9d-3ba53cdaa5a9 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action" status: 202 len: 0 microversion: 2.1 time: 0.207321 Aug 29 15:34:44.951839 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 969/2019] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:44 2022] POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:44.979376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.982270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.992643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.993653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.994093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.994954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.995525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.996057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.033965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71b73040-f603-4b33-80a3-b38d7eb87ab7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.774508 Aug 29 15:34:45.035595 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1051/2020] 10.222.0.16 () {62 vars in 1189 bytes} [Mon Aug 29 15:34:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 4777 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:34:45.040526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.041410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.072156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.072750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.073356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.074206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.074671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.075101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.291094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.300823 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75d8b3cb-d502-432a-bdab-97d54bc9457c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1647 microversion: 2.1 time: 0.345162 Aug 29 15:34:45.313495 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 970/2021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1647 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:45.313495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.313495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.314364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.314867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.315320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.316007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.318697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.318697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.415375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.416272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.417215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.418165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lazy-loading 'fault' on Instance uuid 5131cda1-4999-4c3e-b1dc-88a941e779f2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:45.479488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.489183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.498081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f331c1e3ee1442ad863d8909ca76020b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0145760115bc47d188f32fca7793b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.499497 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c41b306b-1e8c-41a7-8d2c-4cec5f975eba tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 200 len: 1352 microversion: 2.25 time: 0.197036 Aug 29 15:34:45.502712 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 971/2022] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 1352 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:45.514522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-059f587f-1546-4c8c-9d7c-2f55d7a5f971 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.515143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-059f587f-1546-4c8c-9d7c-2f55d7a5f971 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.617175 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c6fe98b9-fe2e-4802-bc96-ffed97a7e622 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1613 microversion: 2.1 time: 0.578601 Aug 29 15:34:45.618441 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1052/2023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1613 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:45.631231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.633702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.639447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:45.652262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.656908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.657577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.658529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.661277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.662101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.718649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-059f587f-1546-4c8c-9d7c-2f55d7a5f971 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.745659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-059f587f-1546-4c8c-9d7c-2f55d7a5f971 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.755625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-059f587f-1546-4c8c-9d7c-2f55d7a5f971 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.763394 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-059f587f-1546-4c8c-9d7c-2f55d7a5f971 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1285 microversion: 2.42 time: 0.259345 Aug 29 15:34:45.778631 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 972/2024] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:45.799053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-974118b5-f42c-4266-b0d1-b030c67c99ea req-550a6791-347b-43ab-9450-092ac5ee96d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde51b61-25cf-403a-8eb7-6959df2ee9d0", "name": "network-vif-deleted", "tag": "f3f3212e-6a1f-4949-accf-c8ae53f03049"}, {"server_uuid": "5131cda1-4999-4c3e-b1dc-88a941e779f2", "name": "network-vif-deleted", "tag": "7c99c417-1046-45bc-92f5-5793a47e0139"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:45.840336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-974118b5-f42c-4266-b0d1-b030c67c99ea req-550a6791-347b-43ab-9450-092ac5ee96d0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.840823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-974118b5-f42c-4266-b0d1-b030c67c99ea req-550a6791-347b-43ab-9450-092ac5ee96d0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.841261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-974118b5-f42c-4266-b0d1-b030c67c99ea req-550a6791-347b-43ab-9450-092ac5ee96d0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.879493 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-974118b5-f42c-4266-b0d1-b030c67c99ea req-550a6791-347b-43ab-9450-092ac5ee96d0 service nova] Creating event network-vif-deleted:f3f3212e-6a1f-4949-accf-c8ae53f03049 for instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 on n-h1-854882-3 Aug 29 15:34:45.880023 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-974118b5-f42c-4266-b0d1-b030c67c99ea req-550a6791-347b-43ab-9450-092ac5ee96d0 service nova] Creating event network-vif-deleted:7c99c417-1046-45bc-92f5-5793a47e0139 for instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 on n-h2-854882-3 Aug 29 15:34:45.896930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-974118b5-f42c-4266-b0d1-b030c67c99ea req-550a6791-347b-43ab-9450-092ac5ee96d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116921 Aug 29 15:34:45.911363 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 973/2025] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:45.932004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.935123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.954132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.954629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.955067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.955785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.956243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.956921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.110492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.127802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.131083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.155821 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4827ab2f-ea01-4812-9c4e-b95df36f4756 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.535439 Aug 29 15:34:46.158494 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1053/2026] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:46.184832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.186467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.219043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.219569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.220017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.220752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.221223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.221678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.367799 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c350576e-c8ac-4fe4-a52a-4785966684ad tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1613 microversion: 2.1 time: 0.452172 Aug 29 15:34:46.369800 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 974/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1613 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.375400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-cff224a8-f3aa-45a1-9577-4eaa0657fd77 req-296b22ed-c1e2-4ea9-a59c-d996aa6376eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73c9734-2c89-4c91-9fc7-62dcc39cbe49", "name": "network-vif-deleted", "tag": "5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:46.408542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cff224a8-f3aa-45a1-9577-4eaa0657fd77 req-296b22ed-c1e2-4ea9-a59c-d996aa6376eb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.415432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cff224a8-f3aa-45a1-9577-4eaa0657fd77 req-296b22ed-c1e2-4ea9-a59c-d996aa6376eb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.416291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cff224a8-f3aa-45a1-9577-4eaa0657fd77 req-296b22ed-c1e2-4ea9-a59c-d996aa6376eb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.448027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.457511 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-cff224a8-f3aa-45a1-9577-4eaa0657fd77 req-296b22ed-c1e2-4ea9-a59c-d996aa6376eb service nova] Creating event network-vif-deleted:5ff2abf7-b6a4-4b1f-9f25-a3d715a5d86d for instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 on n-h2-854882-3 Aug 29 15:34:46.466039 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a35c5c0-c252-410f-b40b-96c2a532509e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1183 microversion: 2.1 time: 0.305016 Aug 29 15:34:46.468101 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1054/2028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.470097 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-cff224a8-f3aa-45a1-9577-4eaa0657fd77 req-296b22ed-c1e2-4ea9-a59c-d996aa6376eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098558 Aug 29 15:34:46.472665 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 975/2029] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:46.485051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.495261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.496188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.499366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Searching by: {'host': 'n-h1-854882-3', 'deleted': False} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:46.524722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.525278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.525758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.527466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.530808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.531336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.548398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.551874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.554377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.555556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.556315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.557022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.666562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.667136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.670123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.672090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lazy-loading 'fault' on Instance uuid b73c9734-2c89-4c91-9fc7-62dcc39cbe49 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:46.680927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:46.716788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:46.747907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.759556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d724bd0-7c84-448f-a36b-8e0e5ea75e06 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 200 len: 1306 microversion: 2.1 time: 0.287415 Aug 29 15:34:46.761063 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1055/2030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 1306 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.766921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.767886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] [instance: 5131cda1-4999-4c3e-b1dc-88a941e779f2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.776356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.777002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.777478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.778637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.779822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.780262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.800411 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] HTTP exception thrown: Instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 could not be found. Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Request method failure captured: Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 HTTP/1.1 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrQzZ5FVEa0qr_1twL3RpO7XPgQx98bTlDvgnR4qsOebiK-8Go_AUFp_yqZMyKH4Vo4FFlHHtRcghATOjkIc7qmAn_3wfjIIPSazUdNYDj1O9hlOjwU7l782Vs-O_ZWSigaXp95sUCL3kM1ZmhmNq8DwO-ARAIiv7tqzo_9xKqlTw0 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0145760115bc47d188f32fca7793b863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0145760115bc47d188f32fca7793b863", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0145760115bc47d188f32fca7793b863"}]}] Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0145760115bc47d188f32fca7793b863 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975 Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f331c1e3ee1442ad863d8909ca76020b Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1459110975-project Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 could not be found. Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '5131cda1-4999-4c3e-b1dc-88a941e779f2'} Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 could not be found. Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 could not be found. Aug 29 15:34:46.802285 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 could not be found. Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] Returning 404 to user: Instance 5131cda1-4999-4c3e-b1dc-88a941e779f2 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:46.807990 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ded8367b-bdf4-45cd-ad8e-857cf073278c tempest-LiveAutoBlockMigrationV225Test-1459110975 tempest-LiveAutoBlockMigrationV225Test-1459110975-project] 10.222.0.16 "GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2" status: 404 len: 111 microversion: 2.25 time: 0.041197 Aug 29 15:34:46.808919 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1056/2031] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/5131cda1-4999-4c3e-b1dc-88a941e779f2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:46.816220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.817875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.845332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.845849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.846293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.846990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.847437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.847855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.868903 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-952ef90d-e25a-4ab2-9f0a-cdc87a5e38dd tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h1-854882-3&all_tenants=1" status: 200 len: 2624 microversion: 2.1 time: 0.394528 Aug 29 15:34:46.869851 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 976/2032] 10.222.0.16 () {58 vars in 1190 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers?host=n-h1-854882-3&all_tenants=1 => generated 2624 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.885680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.907681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:46.915541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.916211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.916750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.917687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.918560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.919098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.963702 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8538784a-5342-4dd0-8199-a7ea782f60b6 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.084634 Aug 29 15:34:46.964795 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 977/2033] 10.222.0.16 () {58 vars in 1196 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:34:46.979546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:46.989898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.001223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.006686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.007480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.008809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.013083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.013898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.052062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.068557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.070439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.072254 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8fed94d-2b4e-4ab4-ac18-ea56e85a9ea7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1519 microversion: 2.42 time: 0.262839 Aug 29 15:34:47.073378 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1057/2034] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:47.155480 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-56b61b22-afed-4eb1-899e-00e6484763e3 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action" status: 202 len: 0 microversion: 2.1 time: 0.180680 Aug 29 15:34:47.156760 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 978/2035] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:46 2022] POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:47.168007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:47.173457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.182871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.183632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.188100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.191227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.194588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.195448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.195946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.196356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.199786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.200279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.200718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.201427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.202147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.202572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.312964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:47.313576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:47.314237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:47.314750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:47.315273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:47.370175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:47.385096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.395280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.397061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.404022 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e155fd1-084c-42c3-b6b6-c8a12f929a6c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.225591 Aug 29 15:34:47.405253 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 979/2036] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:47.405799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.414239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.415099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.415892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.416847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.418855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.419725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.489924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.490750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.515886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.516374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.521497 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56588ef3-e639-4af4-b4bf-4c396828ae6c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action" status: 202 len: 1066 microversion: 2.1 time: 0.359972 Aug 29 15:34:47.526210 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1058/2037] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:47 2022] POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action => generated 1066 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:34:47.538012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.538012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.538012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.538012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.547428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.548491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.578436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.578990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.579449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.580210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.584620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.586343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.761459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.772821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fedf7359-ce47-471e-8bdf-0e6d5386f804 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1183 microversion: 2.1 time: 0.284824 Aug 29 15:34:47.773979 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 980/2038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:47.783173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.783783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.802528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.804118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.805265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.806841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.813251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.813988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.844901 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 HTTP/1.1 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b73c9734-2c89-4c91-9fc7-62dcc39cbe49'} Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:47.847299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.852311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:47.852311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:47.852311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:47.852311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:47.852311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:47.852311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:47.852311 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.854369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:47.855889 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45d57fc2-52ee-4ccf-9777-a49ecfd788d3 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 404 len: 111 microversion: 2.1 time: 0.076741 Aug 29 15:34:47.856969 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 981/2039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:47.870328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8358b42-b1c4-4da9-8b42-73edda600084 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e32738b0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.890924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.902002 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7cfe9aaf-c642-4d44-b63e-2d70ff280e4e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.362336 Aug 29 15:34:47.903652 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1059/2040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:48.098504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.099448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.115965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.116549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.116994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.117838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.119657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.121529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.310660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.332515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.340742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.344232 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-62835757-b010-4b20-ab9b-526c763e51e5 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1583 microversion: 2.42 time: 0.249760 Aug 29 15:34:48.362855 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1060/2041] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1583 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:48.374845 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8358b42-b1c4-4da9-8b42-73edda600084 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62" status: 202 len: 0 microversion: 2.1 time: 0.511695 Aug 29 15:34:48.375431 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 982/2042] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:47 2022] DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:48.385217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d07ad907-d0f8-4093-847a-289f1f4ad41b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e3534040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.438592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.439319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.441703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:48.455765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.464924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.466109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.467525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.468370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.469148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.693835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.707618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.710396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.727757 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76c8935f-3925-42fb-bcab-a36b636424cf tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.293292 Aug 29 15:34:48.728818 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 983/2043] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:48.803281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.804097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.810151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.810634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.811065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.811805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.812735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.813282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.948087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.958117 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-94f18fb0-aaca-462d-a312-fb1bccd9bf2c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1183 microversion: 2.1 time: 0.158855 Aug 29 15:34:48.959469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 984/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:48.964242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.965086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.972110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.977471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.978224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.979261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.980024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.980629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.133293 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d07ad907-d0f8-4093-847a-289f1f4ad41b tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555" status: 202 len: 0 microversion: 2.1 time: 0.753263 Aug 29 15:34:49.134834 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1061/2045] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:48 2022] DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:49.152842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e878b38-5d00-4adf-841f-bb9c80be4980 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'create', calling method: .version_select at 0x7fb0e2de85e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1789131651", "description": "tempest-description-1623548864"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:49.528584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:49.542299 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee974928-d109-4a01-975f-37294ca48e66 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.581458 Aug 29 15:34:49.544358 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 985/2046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:49.550807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:49.551412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:49.564225 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e878b38-5d00-4adf-841f-bb9c80be4980 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.417392 Aug 29 15:34:49.565500 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1062/2047] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:34:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:34:49.573338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e7b9afb-a80a-4275-883d-42dedbf2e22b"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:49.577710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:49.584106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.584701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.585150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.589487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.590386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.592866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.593479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.594489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.594951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.595120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.595435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.595921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.277998 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2248a2a8-314f-434d-afae-f3088881e107 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709783 Aug 29 15:34:50.282371 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1063/2048] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:34:49 2022] POST /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:50.302253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c77088b-36ca-48ba-8986-224e6bf11e4e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Action: 'update', calling method: .version_select at 0x7fb0e35348b0>, body: {"security_group": {"name": "tempest-sg-hth-1489176843", "description": "tempest-description-hth-1707161127"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:50.557603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.574220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.579429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.581702 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a80dbb77-83b1-4ab7-871e-883a373e4e34 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1661 microversion: 2.42 time: 1.034743 Aug 29 15:34:50.607097 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 986/2049] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:49 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1661 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:50.630863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:50.634172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:50.662843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.663514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.664074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.664968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.670922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.671556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.955865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.972488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.981619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.997607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a28971a-abca-4f36-9270-cf0b96756520 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.388203 Aug 29 15:34:51.014574 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 987/2050] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:50 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:51.023427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.024344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.031038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.031801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.032428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.033322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.034047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.034642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.098306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.098747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.099357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.099973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lazy-loading 'fault' on Instance uuid fde51b61-25cf-403a-8eb7-6959df2ee9d0 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:51.282378 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c77088b-36ca-48ba-8986-224e6bf11e4e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/95f1914d-2dc2-4b5c-bc13-b0688bc1a839" status: 200 len: 218 microversion: 2.1 time: 0.996441 Aug 29 15:34:51.290293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1064/2051] 10.222.0.16 () {60 vars in 1290 bytes} [Mon Aug 29 15:34:50 2022] PUT /compute/v2.1/os-security-groups/95f1914d-2dc2-4b5c-bc13-b0688bc1a839 => generated 218 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:51.290293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.297269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.317720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.318226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.318673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.319372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.319842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.320460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.321615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.328552 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-00d59e8f-d934-4db4-b740-09d1aa7274aa tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 200 len: 1142 microversion: 2.1 time: 0.312805 Aug 29 15:34:51.332300 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 988/2052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 1142 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:51.340578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c465c342-aa85-49df-b01d-98329cc8232c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5a68b0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.568169 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c465c342-aa85-49df-b01d-98329cc8232c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/95f1914d-2dc2-4b5c-bc13-b0688bc1a839" status: 200 len: 218 microversion: 2.1 time: 0.234412 Aug 29 15:34:51.570320 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 989/2053] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/os-security-groups/95f1914d-2dc2-4b5c-bc13-b0688bc1a839 => generated 218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:51.589432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-287ab681-03c8-4299-9a5e-8ec1d6c4020e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb64a430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.794875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.808785 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d41278b6-b6be-4f46-88f7-44de96c1750e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.524134 Aug 29 15:34:51.834488 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1065/2054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:51.840522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.845118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.866589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.867087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.869480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.874482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.875216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.876214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.205853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.218409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.222047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.224824 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13e72f25-75d4-45b9-a3d7-423df9f4e56e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1661 microversion: 2.42 time: 0.388816 Aug 29 15:34:52.225572 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1066/2055] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1661 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:52.234093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.234725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.261523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.262040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.262494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.263227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.263686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.264120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.408185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.423985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.428833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.438997 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52f5b964-26b5-4358-a299-5597a54037d7 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.208605 Aug 29 15:34:52.440546 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1067/2056] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:52.446922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.447767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: fde51b61-25cf-403a-8eb7-6959df2ee9d0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.459100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.459885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.460438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.461296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.461938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.462465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.491910 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] HTTP exception thrown: Instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 could not be found. Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Request method failure captured: Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 HTTP/1.1 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrS51DZBoH5dzvOmTXL0cTsun97oQ55iHiKg94VPJq2xHGOwLWHRXzxUDvtyldqzWc3MRg89vpH9MHeUpq3gMHbzldCKofQQfiFSPIoM33KXuXbjOuQIxvqZBlGvlFjHQmJj_SPpspQC_tn3CUDfM0fnJ9xZMzhloxsMwcm5QR8_jA Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74754c19f05f41428bc6d499aac1f9e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}] Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveMigrationTest-1204386624 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveMigrationTest-1204386624-project Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e7e71fcf6711470db5a71ddc74ff709c Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveMigrationTest-1204386624-project Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 could not be found. Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'fde51b61-25cf-403a-8eb7-6959df2ee9d0'} Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 could not be found. Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 could not be found. Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:52.493999 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 could not be found. Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Returning 404 to user: Instance fde51b61-25cf-403a-8eb7-6959df2ee9d0 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:52.499405 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d296c80-a8ff-4d51-9f26-7a62c21ea564 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0" status: 404 len: 111 microversion: 2.1 time: 0.055466 Aug 29 15:34:52.507958 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1068/2057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/fde51b61-25cf-403a-8eb7-6959df2ee9d0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:52.843890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.845040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.869086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.870389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.871642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.872728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.873461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.874410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.909514 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-287ab681-03c8-4299-9a5e-8ec1d6c4020e tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/95f1914d-2dc2-4b5c-bc13-b0688bc1a839" status: 202 len: 0 microversion: 2.1 time: 1.327834 Aug 29 15:34:52.910435 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 990/2058] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:51 2022] DELETE /compute/v2.1/os-security-groups/95f1914d-2dc2-4b5c-bc13-b0688bc1a839 => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:52.918758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.919577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.943015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.944683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.945437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.947021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.948983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.950145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.975323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 HTTP/1.1 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b73c9734-2c89-4c91-9fc7-62dcc39cbe49'} Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:52.977416 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:52.982468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.989437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:52.992045 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65645c48-5e6c-4f40-9d19-93e5cde16b42 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 404 len: 111 microversion: 2.1 time: 0.077285 Aug 29 15:34:52.995174 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 991/2059] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:52 2022] DELETE /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:34:53.006121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.010570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: b73c9734-2c89-4c91-9fc7-62dcc39cbe49] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.016574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.017057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.017562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.018558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.019028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.019860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.057968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 HTTP/1.1 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b73c9734-2c89-4c91-9fc7-62dcc39cbe49'} Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.059530 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.064270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Instance b73c9734-2c89-4c91-9fc7-62dcc39cbe49 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:53.067042 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b81608e5-e724-4a3a-9489-a5b975965031 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49" status: 404 len: 111 microversion: 2.1 time: 0.063929 Aug 29 15:34:53.076193 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 992/2060] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/b73c9734-2c89-4c91-9fc7-62dcc39cbe49 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:53.085492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5656f49f-f778-4ff6-9421-0ba9da54a5de tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e338eb80>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.131141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-5656f49f-f778-4ff6-9421-0ba9da54a5de tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:53.132335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-5656f49f-f778-4ff6-9421-0ba9da54a5de tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 not found {{(pid=130001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:34:53.132845 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-5656f49f-f778-4ff6-9421-0ba9da54a5de tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist Aug 29 15:34:53.132845 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-3339d7da-6d2c-425a-bc65-3dfb90af2855'] Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5656f49f-f778-4ff6-9421-0ba9da54a5de tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555 HTTP/1.1 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: exception: Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-3339d7da-6d2c-425a-bc65-3dfb90af2855'] Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a35b1fd6-2c25-455e-a6cd-2dd000d25555'} Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:53.137370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3339d7da-6d2c-425a-bc65-3dfb90af2855'] Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3339d7da-6d2c-425a-bc65-3dfb90af2855'] Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3339d7da-6d2c-425a-bc65-3dfb90af2855'] Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3339d7da-6d2c-425a-bc65-3dfb90af2855'] Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5656f49f-f778-4ff6-9421-0ba9da54a5de tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group a35b1fd6-2c25-455e-a6cd-2dd000d25555 does not exist Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-3339d7da-6d2c-425a-bc65-3dfb90af2855'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5656f49f-f778-4ff6-9421-0ba9da54a5de tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555" status: 404 len: 194 microversion: 2.1 time: 0.062258 Aug 29 15:34:53.144254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 993/2061] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:53 2022] DELETE /compute/v2.1/os-security-groups/a35b1fd6-2c25-455e-a6cd-2dd000d25555 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:53.158786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a93a1603-0937-47a5-9414-0fd100b75ba2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5efd30>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.189407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-a93a1603-0937-47a5-9414-0fd100b75ba2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:53.191208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-a93a1603-0937-47a5-9414-0fd100b75ba2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group 6af1be51-8f30-4706-8543-3db7317e2a62 not found {{(pid=130001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:34:53.191939 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-a93a1603-0937-47a5-9414-0fd100b75ba2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist Aug 29 15:34:53.191939 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-c73d3925-fc33-4889-b25b-ea68cc1b5393'] Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a93a1603-0937-47a5-9414-0fd100b75ba2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62 HTTP/1.1 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: exception: Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-c73d3925-fc33-4889-b25b-ea68cc1b5393'] Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6af1be51-8f30-4706-8543-3db7317e2a62'} Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:53.195997 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c73d3925-fc33-4889-b25b-ea68cc1b5393'] Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c73d3925-fc33-4889-b25b-ea68cc1b5393'] Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c73d3925-fc33-4889-b25b-ea68cc1b5393'] Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c73d3925-fc33-4889-b25b-ea68cc1b5393'] Aug 29 15:34:53.201764 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.210451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a93a1603-0937-47a5-9414-0fd100b75ba2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group 6af1be51-8f30-4706-8543-3db7317e2a62 does not exist Aug 29 15:34:53.210451 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-c73d3925-fc33-4889-b25b-ea68cc1b5393'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:53.212354 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a93a1603-0937-47a5-9414-0fd100b75ba2 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62" status: 404 len: 194 microversion: 2.1 time: 0.064669 Aug 29 15:34:53.213152 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 994/2062] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:53 2022] DELETE /compute/v2.1/os-security-groups/6af1be51-8f30-4706-8543-3db7317e2a62 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:53.224737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8943ab0-00b3-4007-8f54-defe1944533c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e3c34550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.261679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-f8943ab0-00b3-4007-8f54-defe1944533c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:53.263466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-f8943ab0-00b3-4007-8f54-defe1944533c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group ae767af6-9f51-45e5-af32-f2de9e78af17 not found {{(pid=130001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:34:53.264870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f8943ab0-00b3-4007-8f54-defe1944533c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:34:53.264870 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-d224ad03-0539-4dca-8cc6-b1a0ec25729f'] Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8943ab0-00b3-4007-8f54-defe1944533c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17 HTTP/1.1 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: exception: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-d224ad03-0539-4dca-8cc6-b1a0ec25729f'] Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ae767af6-9f51-45e5-af32-f2de9e78af17'} Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:53.266806 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d224ad03-0539-4dca-8cc6-b1a0ec25729f'] Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d224ad03-0539-4dca-8cc6-b1a0ec25729f'] Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d224ad03-0539-4dca-8cc6-b1a0ec25729f'] Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d224ad03-0539-4dca-8cc6-b1a0ec25729f'] Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8943ab0-00b3-4007-8f54-defe1944533c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group ae767af6-9f51-45e5-af32-f2de9e78af17 does not exist Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-d224ad03-0539-4dca-8cc6-b1a0ec25729f'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8943ab0-00b3-4007-8f54-defe1944533c tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17" status: 404 len: 194 microversion: 2.1 time: 0.050199 Aug 29 15:34:53.275797 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 995/2063] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:53 2022] DELETE /compute/v2.1/os-security-groups/ae767af6-9f51-45e5-af32-f2de9e78af17 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:53.283294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.283294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.286288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.286934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.287377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.288692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.289348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.289946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.413548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.422085 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4090c6d7-9d64-4d80-8d4f-adef41c70d74 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.587248 Aug 29 15:34:53.423025 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1069/2064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:53.427982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75fa5715-2d10-44ca-a9c3-2bcd2cd67423 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5b3a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.461671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.475876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.478071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.479574 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8c79e35-0fef-4338-bdf8-732b35b06836 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1708 microversion: 2.42 time: 0.207417 Aug 29 15:34:53.481639 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 996/2065] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:53 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1708 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:53.487464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.488292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.496192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.496992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.497771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.498655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.499311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.499909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.561332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-75fa5715-2d10-44ca-a9c3-2bcd2cd67423 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b9d2d369-6350-4932-b636-359972510900 does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:53.561960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-75fa5715-2d10-44ca-a9c3-2bcd2cd67423 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group b9d2d369-6350-4932-b636-359972510900 not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:34:53.563501 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-75fa5715-2d10-44ca-a9c3-2bcd2cd67423 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:34:53.563501 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-327cb747-bfe7-4e09-8096-059bdb23fcc4'] Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75fa5715-2d10-44ca-a9c3-2bcd2cd67423 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900 HTTP/1.1 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-327cb747-bfe7-4e09-8096-059bdb23fcc4'] Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b9d2d369-6350-4932-b636-359972510900'} Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:53.566108 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-327cb747-bfe7-4e09-8096-059bdb23fcc4'] Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-327cb747-bfe7-4e09-8096-059bdb23fcc4'] Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-327cb747-bfe7-4e09-8096-059bdb23fcc4'] Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-327cb747-bfe7-4e09-8096-059bdb23fcc4'] Aug 29 15:34:53.571084 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.576789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75fa5715-2d10-44ca-a9c3-2bcd2cd67423 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group b9d2d369-6350-4932-b636-359972510900 does not exist Aug 29 15:34:53.576789 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-327cb747-bfe7-4e09-8096-059bdb23fcc4'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:53.578007 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75fa5715-2d10-44ca-a9c3-2bcd2cd67423 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900" status: 404 len: 194 microversion: 2.1 time: 0.153793 Aug 29 15:34:53.579339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1070/2066] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:53 2022] DELETE /compute/v2.1/os-security-groups/b9d2d369-6350-4932-b636-359972510900 => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:53.588057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dfa45ec3-0905-4319-9f5b-aab2b5bcd6be tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0e35343a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.595303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.607222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.609577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.615376 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16c32bdf-0ce0-4592-a73c-8e9699eec421 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.132154 Aug 29 15:34:53.617027 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 997/2067] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:53 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:53.639871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-dfa45ec3-0905-4319-9f5b-aab2b5bcd6be tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:53.640721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-dfa45ec3-0905-4319-9f5b-aab2b5bcd6be tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group 61ba41e1-57a4-4027-9d77-655eb9383626 not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:34:53.641758 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-dfa45ec3-0905-4319-9f5b-aab2b5bcd6be tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:34:53.641758 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-7ace8998-24cd-41e0-ad73-473cbd76709c'] Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dfa45ec3-0905-4319-9f5b-aab2b5bcd6be tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626 HTTP/1.1 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-7ace8998-24cd-41e0-ad73-473cbd76709c'] Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '61ba41e1-57a4-4027-9d77-655eb9383626'} Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:53.644502 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ace8998-24cd-41e0-ad73-473cbd76709c'] Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ace8998-24cd-41e0-ad73-473cbd76709c'] Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ace8998-24cd-41e0-ad73-473cbd76709c'] Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ace8998-24cd-41e0-ad73-473cbd76709c'] Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dfa45ec3-0905-4319-9f5b-aab2b5bcd6be tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group 61ba41e1-57a4-4027-9d77-655eb9383626 does not exist Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-7ace8998-24cd-41e0-ad73-473cbd76709c'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:53.649070 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dfa45ec3-0905-4319-9f5b-aab2b5bcd6be tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626" status: 404 len: 194 microversion: 2.1 time: 0.064214 Aug 29 15:34:53.655433 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1071/2068] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:53 2022] DELETE /compute/v2.1/os-security-groups/61ba41e1-57a4-4027-9d77-655eb9383626 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:53.665002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab94f178-e360-450b-984b-56424046638a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb629790>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.697924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-ab94f178-e360-450b-984b-56424046638a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:34:53.698778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-ab94f178-e360-450b-984b-56424046638a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Neutron security group 6c38af0d-453e-489e-8611-157888f2230f not found {{(pid=130001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:34:53.699517 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-ab94f178-e360-450b-984b-56424046638a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:34:53.699517 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-752d54d6-99ab-4a0e-99c5-684435aca71b'] Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab94f178-e360-450b-984b-56424046638a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f HTTP/1.1 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: exception: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-752d54d6-99ab-4a0e-99c5-684435aca71b'] Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6c38af0d-453e-489e-8611-157888f2230f'} Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:34:53.701870 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752d54d6-99ab-4a0e-99c5-684435aca71b'] Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752d54d6-99ab-4a0e-99c5-684435aca71b'] Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752d54d6-99ab-4a0e-99c5-684435aca71b'] Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-752d54d6-99ab-4a0e-99c5-684435aca71b'] Aug 29 15:34:53.706345 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:34:53.710567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab94f178-e360-450b-984b-56424046638a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Security group 6c38af0d-453e-489e-8611-157888f2230f does not exist Aug 29 15:34:53.710567 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-752d54d6-99ab-4a0e-99c5-684435aca71b'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:53.711299 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab94f178-e360-450b-984b-56424046638a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f" status: 404 len: 194 microversion: 2.1 time: 0.057824 Aug 29 15:34:53.715177 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 998/2069] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:53 2022] DELETE /compute/v2.1/os-security-groups/6c38af0d-453e-489e-8611-157888f2230f => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:53.721252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.721791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.730301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.730813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.731262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.732238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.732704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.733142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.766230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:53.964668 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac7f0f92-0828-48f0-9d21-67593dd014ea tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 204 len: 0 microversion: 2.1 time: 0.247359 Aug 29 15:34:53.969097 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1072/2070] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:53 2022] DELETE /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:34:53.981719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.982886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.011811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.012581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.015641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.016742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.019305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.021316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.433283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.445745 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6a52350-8f1d-4ceb-a0c8-54bd999f12d5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1648 microversion: 2.1 time: 0.471917 Aug 29 15:34:54.445953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.446665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.446979 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 999/2071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:53 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1648 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:54.453519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:54.454560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=16 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:54.456330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.456994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.457633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.458659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.459308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.460080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.509269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.510291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.523299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.530480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.531025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.531839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.532491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.533452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.573337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:54.663241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.674330 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-576b95c5-dfdc-4720-b235-aa0819a549e7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.233614 Aug 29 15:34:54.675162 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1073/2072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:54.680369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.681316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.690258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.690712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.691145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.692096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.692754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.693191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.768881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.783757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.785662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.803338 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5d9d06f-5951-41c0-a596-80b0a028f571 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.126587 Aug 29 15:34:54.806821 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1074/2073] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:54.942252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.956246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.959123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.961204 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4740b1e1-d5cb-4ff6-b7dc-02dc786c8314 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1755 microversion: 2.42 time: 0.459627 Aug 29 15:34:54.983762 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1000/2074] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1755 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:55.470441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.471992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.480585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.481410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.482038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.482965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.483745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.484345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.698706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.700527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.718665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.720541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.722130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.726976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.727750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.729510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.760344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:55.816584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:55.830115 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f1546786-a8f3-4fec-ac0d-5e3ccc38362a tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1648 microversion: 2.1 time: 0.364765 Aug 29 15:34:55.834831 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1075/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1648 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:55.842402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.843349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.869659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.871064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.873246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.875141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.876478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.878173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.066128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.071976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.081852 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4625b822-b25d-40f3-9eca-e077b3a7380e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.389368 Aug 29 15:34:56.082672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.085016 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1001/2076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:56.086415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.096460 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d764f1f5-64c4-45f3-ac4a-67829d94cf2b tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.258050 Aug 29 15:34:56.098472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:56.099165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:56.102065 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1076/2077] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:56.128283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.130300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.131243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.132791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.133810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.134401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.714766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.718148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6fe7dc25-12e5-4138-80a1-2f1c94f7c813 req-970e1e2e-fa59-4437-8aff-39dccdf4bb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca689ad-3753-428b-8f23-832b03e57bd8", "name": "network-vif-deleted", "tag": "912152b7-14d9-485e-a66f-ee071e97f5d7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:56.739026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6fe7dc25-12e5-4138-80a1-2f1c94f7c813 req-970e1e2e-fa59-4437-8aff-39dccdf4bb92 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.740030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6fe7dc25-12e5-4138-80a1-2f1c94f7c813 req-970e1e2e-fa59-4437-8aff-39dccdf4bb92 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.740709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6fe7dc25-12e5-4138-80a1-2f1c94f7c813 req-970e1e2e-fa59-4437-8aff-39dccdf4bb92 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.753866 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6fe7dc25-12e5-4138-80a1-2f1c94f7c813 req-970e1e2e-fa59-4437-8aff-39dccdf4bb92 service nova] Creating event network-vif-deleted:912152b7-14d9-485e-a66f-ee071e97f5d7 for instance 7ca689ad-3753-428b-8f23-832b03e57bd8 on n-h2-854882-3 Aug 29 15:34:56.760531 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6fe7dc25-12e5-4138-80a1-2f1c94f7c813 req-970e1e2e-fa59-4437-8aff-39dccdf4bb92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046372 Aug 29 15:34:56.761891 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1077/2078] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:34:56.800013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.810062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.811697 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b099ae1-f602-41e5-975c-9505e7f6ee6b tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1802 microversion: 2.42 time: 0.724179 Aug 29 15:34:56.820570 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1002/2079] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:56 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1802 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:56.852717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:56.853364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:56.868050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.868555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.869005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.869753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.870223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.870659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.880917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:56.957034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.958979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.960358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.961071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lazy-loading 'fault' on Instance uuid 7ca689ad-3753-428b-8f23-832b03e57bd8 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:57.107483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:57.107998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:57.110057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=14 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:57.131197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d36e55c8ad494eb6260410fdecd1a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628dcd53a614a4589eb526ba20c291c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.132714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.134791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.136418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.140524 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd105ae8-363b-4e76-b648-76291bc358a4 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 200 len: 1305 microversion: 2.1 time: 0.292747 Aug 29 15:34:57.143985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.145695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.148635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.156153 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1078/2080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:56 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 1305 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:57.172041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:57.173203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:57.194169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.205002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.223653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.228982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.229444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.229900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.598736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.610839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ae12cb6-12bc-4385-9acf-1e2dc212cf73 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.507183 Aug 29 15:34:57.616646 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1003/2081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:57 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:57.717943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.727676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.733375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.747427 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-991f9592-f036-4dbb-bb6c-ef46bf434b3d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.589526 Aug 29 15:34:57.751139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1079/2082] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:57 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:57.843414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:57.844035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:57.856800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.857329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.857928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.860501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.861048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.861514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.170680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:58.171448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] [instance: 7ca689ad-3753-428b-8f23-832b03e57bd8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:58.181287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.185540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.187651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.188871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.190336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.194985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.230923 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] HTTP exception thrown: Instance 7ca689ad-3753-428b-8f23-832b03e57bd8 could not be found. Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Request method failure captured: Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 HTTP/1.1 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNwywm32fKUORycI1QmELcMQK7xgqWY_EU4eNxtbrS-DVN2vrHRhSCn-q7Cx1EwV7CfFksDNQcQKnsS4ivYtIFC7lldshj5EKiETYQG2SFLKRsIIfjpNbPKgoqq_mN6gCPdBrXzTMGuQd5VgJput-tkC2SPoyJzwTiMgDQhc4CYaSD8 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5628dcd53a614a4589eb526ba20c291c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5628dcd53a614a4589eb526ba20c291c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5628dcd53a614a4589eb526ba20c291c"}]}] Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 5628dcd53a614a4589eb526ba20c291c Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697659713 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 59d36e55c8ad494eb6260410fdecd1a1 Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupsTestJSON-1697659713-project Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 7ca689ad-3753-428b-8f23-832b03e57bd8 could not be found. Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '7ca689ad-3753-428b-8f23-832b03e57bd8'} Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca689ad-3753-428b-8f23-832b03e57bd8 could not be found. Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca689ad-3753-428b-8f23-832b03e57bd8 could not be found. Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:58.232817 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca689ad-3753-428b-8f23-832b03e57bd8 could not be found. Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:34:58.238733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Returning 404 to user: Instance 7ca689ad-3753-428b-8f23-832b03e57bd8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:58.239479 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf7aaff2-6a3c-4e56-929c-cf900e7cf8d1 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8" status: 404 len: 111 microversion: 2.1 time: 0.073089 Aug 29 15:34:58.239479 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1080/2083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:58 2022] GET /compute/v2.1/servers/7ca689ad-3753-428b-8f23-832b03e57bd8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:58.254425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-61884de8-a7d3-444b-a39b-69b77d9000bf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5b3a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:58.548239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.559167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.563360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.566855 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe35f975-79e8-4c41-9f36-a6c749246eb0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1802 microversion: 2.42 time: 0.727398 Aug 29 15:34:58.569347 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1004/2084] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:57 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1802 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:58.642108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:58.655845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:58.684119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.684723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.685170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.685940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.689446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.689446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.767599 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-61884de8-a7d3-444b-a39b-69b77d9000bf tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7b6d32bb-0fc2-4810-91bd-e31105cba6e0" status: 202 len: 0 microversion: 2.1 time: 0.522716 Aug 29 15:34:58.770052 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1081/2085] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:58 2022] DELETE /compute/v2.1/os-security-groups/7b6d32bb-0fc2-4810-91bd-e31105cba6e0 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:58.780248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3dda40df-5422-4a14-83d5-05b212aacfe5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] Calling method '.version_select at 0x7fb0eb5b3af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.099356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.112565 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1055c780-513a-4754-a14e-835caaae66a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1470 microversion: 2.1 time: 0.474832 Aug 29 15:34:59.119796 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1005/2086] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:58 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1470 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:59.140482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.141635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:59.155624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.156988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.172134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.173239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.173892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.174605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.229671 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3dda40df-5422-4a14-83d5-05b212aacfe5 tempest-SecurityGroupsTestJSON-1697659713 tempest-SecurityGroupsTestJSON-1697659713-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/10115a73-7af0-4b79-a793-e49714661a80" status: 202 len: 0 microversion: 2.1 time: 0.452781 Aug 29 15:34:59.230304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1082/2087] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:34:58 2022] DELETE /compute/v2.1/os-security-groups/10115a73-7af0-4b79-a793-e49714661a80 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:59.327553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.339479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.342649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.363279 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e4601d31-c830-4912-ae8a-0663c51b1ce5 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.232020 Aug 29 15:34:59.377711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1006/2088] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:59 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:59.598553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.599535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:59.628565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.632675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.633417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.634487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.635112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.635723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.144818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:00.145605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:00.164094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.164935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.165723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.166389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.167667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.169242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.171985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.181073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.185014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.190644 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d3d6976-ea1a-4645-afac-4fef5273db0c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1849 microversion: 2.42 time: 0.601065 Aug 29 15:35:00.192691 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1083/2089] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:59 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1849 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:00.392801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:00.393450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:00.410377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.410881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.411325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.451830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.451830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.451830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.652256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.662295 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-99434ba3-354d-458b-98ac-cccd7e018835 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1476 microversion: 2.1 time: 0.521997 Aug 29 15:35:00.677423 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1007/2090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:00 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1476 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:00.677867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.689884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.691553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.703741 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab1c44d8-1b79-4d4f-aba1-373ce515b1c0 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.316772 Aug 29 15:35:00.706467 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1084/2091] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:00 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:00.727839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-91729698-32d4-4a41-ae84-8122fdd5bd52 req-0d3c3fde-04a4-43fc-85bf-5ffd19e20203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "09a9e65a-b239-4c6f-9543-78a3c4be399a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:00.748819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91729698-32d4-4a41-ae84-8122fdd5bd52 req-0d3c3fde-04a4-43fc-85bf-5ffd19e20203 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.749318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91729698-32d4-4a41-ae84-8122fdd5bd52 req-0d3c3fde-04a4-43fc-85bf-5ffd19e20203 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.749773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91729698-32d4-4a41-ae84-8122fdd5bd52 req-0d3c3fde-04a4-43fc-85bf-5ffd19e20203 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.784448 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-91729698-32d4-4a41-ae84-8122fdd5bd52 req-0d3c3fde-04a4-43fc-85bf-5ffd19e20203 service nova] Creating event network-changed:09a9e65a-b239-4c6f-9543-78a3c4be399a for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:00.791829 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-91729698-32d4-4a41-ae84-8122fdd5bd52 req-0d3c3fde-04a4-43fc-85bf-5ffd19e20203 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071705 Aug 29 15:35:00.792986 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1008/2092] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:01.215376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:01.216000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:01.233774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.234492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.235075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.235942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.236565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.237137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.689795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:01.690500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:01.708548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.709895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.710545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.715967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.716652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.717234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.780826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:01.792388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:01.802153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:01.803451 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6cb5283-1b9a-4773-909c-78d6d83f8e6c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1849 microversion: 2.42 time: 0.592031 Aug 29 15:35:01.811242 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1085/2093] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:01 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1849 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:01.817086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:01.822252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:01.836711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.838100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.838724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.840770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.841950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.843384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.039513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.055332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.057513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.069833 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-740fb7d0-b454-4fb4-beda-3fb7fc8dacfd tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.257024 Aug 29 15:35:02.073144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1086/2094] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:01 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:02.324858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.332935 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-108151f9-2dc3-44ce-970a-cde0e96851e6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1476 microversion: 2.1 time: 0.647377 Aug 29 15:35:02.340352 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1009/2095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:01 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1476 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:02.826488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:02.830170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:02.846157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.847476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.852977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.854157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.856795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.857552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.098886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:03.099471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:03.119449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.123881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.125211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.127000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.128613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.129991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.318634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:03.333305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:03.337039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:03.349637 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45e45237-a563-4387-bdb5-d3e0e461879e tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1447 microversion: 2.75 time: 0.254905 Aug 29 15:35:03.367095 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1010/2096] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:03 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:03.378106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-46e1c118-4a5e-4f42-ae51-090aeec91e11 req-df01b056-ecd5-4e92-9ed5-cb55bae24a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "7e6e0494-afe5-4c77-abff-4dbe391df468"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:03.392276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-46e1c118-4a5e-4f42-ae51-090aeec91e11 req-df01b056-ecd5-4e92-9ed5-cb55bae24a2b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.393086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-46e1c118-4a5e-4f42-ae51-090aeec91e11 req-df01b056-ecd5-4e92-9ed5-cb55bae24a2b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.393761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-46e1c118-4a5e-4f42-ae51-090aeec91e11 req-df01b056-ecd5-4e92-9ed5-cb55bae24a2b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.408477 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-46e1c118-4a5e-4f42-ae51-090aeec91e11 req-df01b056-ecd5-4e92-9ed5-cb55bae24a2b service nova] Creating event network-changed:7e6e0494-afe5-4c77-abff-4dbe391df468 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:03.416613 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-46e1c118-4a5e-4f42-ae51-090aeec91e11 req-df01b056-ecd5-4e92-9ed5-cb55bae24a2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046181 Aug 29 15:35:03.420502 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1011/2097] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:03.433434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:03.434372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:03.447894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.448605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.449404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.450257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.450906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.451465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.679556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:03.688649 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc9a057d-280a-4bea-b442-a2bb10fe0fa6 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1476 microversion: 2.1 time: 0.266781 Aug 29 15:35:03.697219 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1012/2098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:03 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1476 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:03.987996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.018129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.025914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.029124 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e137fe7d-8f16-4ed8-b699-6a12cb606a94 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1870 microversion: 2.42 time: 1.206409 Aug 29 15:35:04.037276 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1087/2099] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:02 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1870 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:04.380110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:04.380715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:04.398277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.402107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.403490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.411541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.412394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.413620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.649380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.659220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.671912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.690170 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-457b2374-c6a6-4db6-af48-34363f34ba14 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1465 microversion: 2.75 time: 0.314514 Aug 29 15:35:04.712039 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1013/2100] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:04 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1465 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:04.720023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:04.721056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:04.730352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.731151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.731792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.732899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.733598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.734247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.827676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-09286681-4aa0-4f66-b18a-23fd5ffe0e1b req-dbc8b4f0-133b-40d9-9409-7034ee053f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190b045a-6f51-4011-950e-5ca4150a647b", "name": "network-vif-plugged", "status": "completed", "tag": "271365e6-dc68-453b-9b42-c69b0118f270"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:04.849425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-09286681-4aa0-4f66-b18a-23fd5ffe0e1b req-dbc8b4f0-133b-40d9-9409-7034ee053f99 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.851446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-09286681-4aa0-4f66-b18a-23fd5ffe0e1b req-dbc8b4f0-133b-40d9-9409-7034ee053f99 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.852102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-09286681-4aa0-4f66-b18a-23fd5ffe0e1b req-dbc8b4f0-133b-40d9-9409-7034ee053f99 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.882554 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-09286681-4aa0-4f66-b18a-23fd5ffe0e1b req-dbc8b4f0-133b-40d9-9409-7034ee053f99 service nova] Creating event network-vif-plugged:271365e6-dc68-453b-9b42-c69b0118f270 for instance 190b045a-6f51-4011-950e-5ca4150a647b on n-h1-854882-3 Aug 29 15:35:04.890338 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-09286681-4aa0-4f66-b18a-23fd5ffe0e1b req-dbc8b4f0-133b-40d9-9409-7034ee053f99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067245 Aug 29 15:35:04.897568 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1014/2101] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:35:05.057220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:05.059695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:05.072301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.078848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.079647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.080600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.081253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.081913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.248331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.264427 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-76ef18b1-374e-4f1e-accb-a38ce99da334 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1476 microversion: 2.1 time: 0.548179 Aug 29 15:35:05.277838 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1088/2102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:04 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1476 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:05.586937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.606031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.610494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.613187 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d41dd83-698a-4136-ad16-d0058b83e34e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1870 microversion: 2.42 time: 0.560716 Aug 29 15:35:05.622621 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1015/2103] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:05 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1870 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:35:05.719521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:05.721200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:05.735802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.736815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.747163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.749071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.749764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.750524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.185750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.195774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.201321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.220043 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8120113-fcd7-4b9e-8b6c-b71a799499b8 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1453 microversion: 2.75 time: 0.504809 Aug 29 15:35:06.234118 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1089/2104] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:05 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1453 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:06.292340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:06.293337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:06.305502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.306486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.307150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.308138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.308769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.309368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.619306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.632304 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-526dc0e9-998f-4240-bc3c-5921bc044d9c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1476 microversion: 2.1 time: 0.343898 Aug 29 15:35:06.646627 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1016/2105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:06 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1476 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:06.652456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:06.654495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:06.676822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.677939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.678900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.680242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.681143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.681882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.250300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:07.251137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:07.260612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.265783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.266521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.267453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.268066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.268636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.401024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.415691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.417965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.426607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fea1b519-cea6-44f3-98a5-182f0d7125f4 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1453 microversion: 2.75 time: 0.180237 Aug 29 15:35:07.427833 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1017/2106] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:07 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:35:07.515359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3bc4e841-57fa-4c8b-834c-c9be8d885eee req-52920a9f-e676-4786-b67e-3760ee60744e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "f0a6706f-723c-4dd5-84bd-8f5e99f29ba3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:07.535345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3bc4e841-57fa-4c8b-834c-c9be8d885eee req-52920a9f-e676-4786-b67e-3760ee60744e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.536835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3bc4e841-57fa-4c8b-834c-c9be8d885eee req-52920a9f-e676-4786-b67e-3760ee60744e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.538100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3bc4e841-57fa-4c8b-834c-c9be8d885eee req-52920a9f-e676-4786-b67e-3760ee60744e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.559454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.569058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.569832 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3bc4e841-57fa-4c8b-834c-c9be8d885eee req-52920a9f-e676-4786-b67e-3760ee60744e service nova] Creating event network-changed:f0a6706f-723c-4dd5-84bd-8f5e99f29ba3 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:07.578541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.580006 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-958023b9-b121-4fea-aea3-28062856e242 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.933844 Aug 29 15:35:07.581045 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1090/2107] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:06 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:35:07.590847 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3bc4e841-57fa-4c8b-834c-c9be8d885eee req-52920a9f-e676-4786-b67e-3760ee60744e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067982 Aug 29 15:35:07.594099 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1018/2108] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:07.657179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:07.658728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:07.672757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.673284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.674800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.675710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.676177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.679365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.358956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:08.370326 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d997b5c1-465a-4d50-b665-a02e8ece35ba tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1476 microversion: 2.1 time: 0.715473 Aug 29 15:35:08.373778 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1091/2109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:07 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1476 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:08.457140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:08.458508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:08.473529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.474286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.476015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.476893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.481190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.481992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.609849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:08.610597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:08.619842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.623877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.624456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.625616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.626195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.626870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.761502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:08.764355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:08.775973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:08.780457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:08.795481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-44452462-3ff5-4e77-9d57-760e07938d1a tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1438 microversion: 2.75 time: 0.342691 Aug 29 15:35:08.796420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1019/2110] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:08 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1438 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:09.125698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:09.142415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:09.145376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:09.146692 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6856d0b-60e4-4579-9fba-d74912963c32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.545013 Aug 29 15:35:09.147313 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1092/2111] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:08 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:09.202604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:09.205686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:09.213651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.214328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.214912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.215787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.216392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.216966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.354488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-265243746", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f4ff46ef-83cd-4ba3-8dde-98e3dadc9c63"}], "security_groups": [{"name": "tempest-securitygroup--1900978084"}], "key_name": "tempest-keypair-1676725989", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "fafc604f-f0af-434d-9796-5675b5467b79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:09.372870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:09.373294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:09.373815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:09.374225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:09.382960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:09.560608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:09.576075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.577259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.580210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.581241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.584749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.585436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.924394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] validate_networks() for [('f4ff46ef-83cd-4ba3-8dde-98e3dadc9c63', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:10.525361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:10.574712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d57758f-7f01-4242-9eff-344d5cd07bcc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c/action" status: 202 len: 1942 microversion: 2.75 time: 1.753168 Aug 29 15:35:10.585342 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1020/2112] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:35:08 2022] POST /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c/action => generated 1942 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:35:10.591808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:10.598423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:10.624356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.625049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.626263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.627129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.627740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.628331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.145850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.162540 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-18ab9d88-1189-416e-a227-2b669ef9941e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1462 microversion: 2.1 time: 0.575408 Aug 29 15:35:11.163321 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1021/2113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:10 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1462 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:11.172630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:11.178027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:11.194697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.195686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.196894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.202353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.203774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.204720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.451438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:11.471692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Getting quotas for project fb4265e2a96c4b9ba49452d382cc413c. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:11.481838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Getting quotas for user 736591425d2d40cda2331153600f20df and project fb4265e2a96c4b9ba49452d382cc413c. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:11.505437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:11.507592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:11.508117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:11.509920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:11.510719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:11.524353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.525365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.526046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.527984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.529075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.529756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.570248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Getting quotas for project fb4265e2a96c4b9ba49452d382cc413c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:11.578755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Getting quotas for user 736591425d2d40cda2331153600f20df and project fb4265e2a96c4b9ba49452d382cc413c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:11.690074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:11.694241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fafc604f-f0af-434d-9796-5675b5467b79',volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:11.811742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.824344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.830034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.840098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d4a689d5-1ecc-49fa-b665-fe8aee82fb8f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.674103 Aug 29 15:35:11.873297 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1022/2114] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:11 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:11.885937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-6dcb8208-e216-4d09-a6d7-e5d0f06b959e req-832020f4-01b2-40b9-ab56-be203df69b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "57038e85-109c-491a-b297-19b2ca678e6c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:11.921762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6dcb8208-e216-4d09-a6d7-e5d0f06b959e req-832020f4-01b2-40b9-ab56-be203df69b1e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.924443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6dcb8208-e216-4d09-a6d7-e5d0f06b959e req-832020f4-01b2-40b9-ab56-be203df69b1e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.926309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6dcb8208-e216-4d09-a6d7-e5d0f06b959e req-832020f4-01b2-40b9-ab56-be203df69b1e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.973246 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6dcb8208-e216-4d09-a6d7-e5d0f06b959e req-832020f4-01b2-40b9-ab56-be203df69b1e service nova] Creating event network-changed:57038e85-109c-491a-b297-19b2ca678e6c for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:11.988772 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-6dcb8208-e216-4d09-a6d7-e5d0f06b959e req-832020f4-01b2-40b9-ab56-be203df69b1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112549 Aug 29 15:35:11.994853 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1023/2115] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:12.026194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.033497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.055519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.060633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.063138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.064746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.070199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.072334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.164875 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-07f75bfa-40f8-472e-be16-4d9807d66b97 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.815476 Aug 29 15:35:12.165569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1093/2116] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:09 2022] POST /compute/v2.1/servers => generated 407 bytes in 2817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:12.192067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.192709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.231697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.232363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.235498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.236488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.242587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.243201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.610310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:12.656775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-742711b6-5d0f-40f5-a21b-e4703ae8f676 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.648989 Aug 29 15:35:12.659553 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1024/2117] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:11 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:12.672141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.674932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.689350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.690211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.691615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.693287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:12.696965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.697647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.698242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.702002 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8299ac6-bcfb-4465-a538-9db76ab1465b tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1462 microversion: 2.1 time: 0.530819 Aug 29 15:35:12.713949 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1094/2118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:12 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1462 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:12.713949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd45f09d-d956-4180-8477-0b9acf215aa3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.713949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd45f09d-d956-4180-8477-0b9acf215aa3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.814393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:12.908189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd45f09d-d956-4180-8477-0b9acf215aa3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:12.926910 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd45f09d-d956-4180-8477-0b9acf215aa3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1121 microversion: 2.1 time: 0.209425 Aug 29 15:35:12.947166 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1095/2119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:12 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1121 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:12.952878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:12.963618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.997117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.997885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.997885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.002121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.002776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.019090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.058812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:13.114258 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1304a52-5740-4379-8673-141e2ab599cb tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 204 len: 0 microversion: 2.1 time: 0.442282 Aug 29 15:35:13.119260 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1025/2120] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:12 2022] DELETE /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:13.131947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:13.137975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:13.168042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.168860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.169996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.172583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.173280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.174380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.291923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:13.293131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:13.293809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:13.294379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:13.294980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:13.407891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:13.418835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.419506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.420395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.421174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.422578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.423033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.468473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:13.476299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56aa3b78-92ea-4301-99cc-ffd87894ae41 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action" status: 202 len: 1066 microversion: 2.1 time: 0.527141 Aug 29 15:35:13.477144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1096/2121] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:12 2022] POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action => generated 1066 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:35:13.483129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:13.483961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:13.493449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.494287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.494932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.495840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.496822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.499461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.068755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:14.078942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:14.080370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:14.081559 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f792ada-ed40-4b89-aae3-5ecec0633774 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.960776 Aug 29 15:35:14.082118 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1026/2122] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:13 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:14.101266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:14.101918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:14.120305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.120793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.121223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.121959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.122399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.125955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.313280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:14.328596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7607c2be-18ab-472b-a610-ec24bdf243ba tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1667 microversion: 2.1 time: 0.848342 Aug 29 15:35:14.347641 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1097/2123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:13 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1667 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:14.357613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:14.360486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:14.375880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.376731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.380840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.384595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.386051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.386511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.778059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:14.815212 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96f3fe09-e750-4b97-9510-d0ec4d017712 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.465862 Aug 29 15:35:14.816362 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1098/2124] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:14 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:14.823802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:14.824611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:14.843944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.844213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.844760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.845859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.846439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.846935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.004136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:15.013698 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ae5377b-d250-4213-9ec2-4edabb25dba0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.930498 Aug 29 15:35:15.014291 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1027/2125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:14 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:15.032133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-02ce4980-9d6f-4abc-962c-1698f5f96d5d req-f40a4c54-c333-4738-bf32-14b17fa2f1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "c803e1ce-a2da-489e-8ede-123c5aefbdb5"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:15.072631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-02ce4980-9d6f-4abc-962c-1698f5f96d5d req-f40a4c54-c333-4738-bf32-14b17fa2f1a9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:15.073924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-02ce4980-9d6f-4abc-962c-1698f5f96d5d req-f40a4c54-c333-4738-bf32-14b17fa2f1a9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:15.085924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-02ce4980-9d6f-4abc-962c-1698f5f96d5d req-f40a4c54-c333-4738-bf32-14b17fa2f1a9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.103476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:15.110700 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-02ce4980-9d6f-4abc-962c-1698f5f96d5d req-f40a4c54-c333-4738-bf32-14b17fa2f1a9 service nova] Creating event network-changed:c803e1ce-a2da-489e-8ede-123c5aefbdb5 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:15.112836 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9ab9518-a12c-4d4d-be2d-7ed7683a03f1 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1237 microversion: 2.1 time: 0.295114 Aug 29 15:35:15.129417 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1099/2126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:14 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1237 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:15.129417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:15.143926 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-02ce4980-9d6f-4abc-962c-1698f5f96d5d req-f40a4c54-c333-4738-bf32-14b17fa2f1a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117173 Aug 29 15:35:15.144726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:15.149760 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1028/2127] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:15.162214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:15.165289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:15.173815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:15.175930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:15.177252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.182616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:15.185919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:15.186291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:15.187159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:15.187575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.187943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.188842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:15.189750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:15.192030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.266723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'flavor' on Instance uuid 647883af-6f80-4e9c-8f48-d0e4ba4edef3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:16.375125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:16.385971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:16.387537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:16.388854 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55772206-b8b1-4a52-8d29-0ef86ff8d477 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 1.237502 Aug 29 15:35:16.389352 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1029/2128] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:15 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:16.403133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:16.404065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:16.413300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.414108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.414266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.414940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.415545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.415967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.725275 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9057b67b-310d-40c0-8a1e-fe1bd96f11f7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/action" status: 200 len: 32 microversion: 2.1 time: 1.606782 Aug 29 15:35:16.726506 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1100/2129] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:15 2022] POST /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/action => generated 32 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:35:16.734242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:16.735402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:16.744878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.746070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.746687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.747720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.748266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.748704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.871297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:16.896964 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85760575-17db-43a5-b019-db32ce761a2c tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.168471 Aug 29 15:35:16.897845 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1101/2130] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:16 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:16.921316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:16.922009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:16.929751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.930508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.931145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.932073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.932706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.933323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.103464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.113248 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8758fe15-0145-4dd2-b9bf-5c934de8400b tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1667 microversion: 2.1 time: 0.722504 Aug 29 15:35:17.116514 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1030/2131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:16 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1667 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:17.121868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.122491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.140346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.140847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.141524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.144704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.145211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.145636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.218687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.253107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e33ab0ab-e07a-49f0-8b6d-e236196e44b0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.341515 Aug 29 15:35:17.270558 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1102/2132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:16 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:17.277258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.278194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.290979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.293011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.293613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.294496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.296304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.297708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.461982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.478838 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e3a0dbf-abba-454f-8044-80a5384ecd25 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1237 microversion: 2.1 time: 0.355682 Aug 29 15:35:17.490084 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1031/2133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1237 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:17.508463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0f311a76-cc4c-4173-a939-d187feb22add req-3e3e12e9-1c9d-43c0-ba9f-caba85599e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "d0f1fece-2d8a-470c-beed-2ff768e1d636"}, {"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "a0716183-eb1a-4c5d-8847-69ba90609326"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:17.518938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0f311a76-cc4c-4173-a939-d187feb22add req-3e3e12e9-1c9d-43c0-ba9f-caba85599e9f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.519609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0f311a76-cc4c-4173-a939-d187feb22add req-3e3e12e9-1c9d-43c0-ba9f-caba85599e9f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.520180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0f311a76-cc4c-4173-a939-d187feb22add req-3e3e12e9-1c9d-43c0-ba9f-caba85599e9f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.527729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.533148 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0f311a76-cc4c-4173-a939-d187feb22add req-3e3e12e9-1c9d-43c0-ba9f-caba85599e9f service nova] Creating event network-changed:d0f1fece-2d8a-470c-beed-2ff768e1d636 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:17.539795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9f3e84d6-4a61-4f5c-959e-53d037e969c8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.266232 Aug 29 15:35:17.539795 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1103/2134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:17.540420 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0f311a76-cc4c-4173-a939-d187feb22add req-3e3e12e9-1c9d-43c0-ba9f-caba85599e9f service nova] Creating event network-changed:a0716183-eb1a-4c5d-8847-69ba90609326 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:17.546028 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0f311a76-cc4c-4173-a939-d187feb22add req-3e3e12e9-1c9d-43c0-ba9f-caba85599e9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054486 Aug 29 15:35:17.547384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1032/2135] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:17.557596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.558307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.569161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.569751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.570201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.571469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.571469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.572232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.830975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.844011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.846119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.847543 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6bb4b66c-83af-4a6f-bee0-2f2ad06b24df tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.296973 Aug 29 15:35:17.848656 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1104/2136] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:17.928983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.930303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.944423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.944986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.945331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.947932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.951027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.951595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.135254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.135885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:18.145140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:18.150119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.150718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.151194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.151914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.152509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.152856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.158841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:18.180813 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-210acf14-5a05-4a7a-909c-71a00a4b5bcf tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.257752 Aug 29 15:35:18.182082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1033/2137] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:18.292512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:18.308527 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-752e0736-0c6b-4e13-811d-4e0c4c73c739 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1599 microversion: 2.1 time: 0.176543 Aug 29 15:35:18.315580 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1105/2138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:18 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1599 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:18.326954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.327741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:18.336823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.337512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.338088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.339268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.340012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.341269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.360374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.362754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.363244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.363671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.364400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.364849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.365271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.401355 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-64c1b8a9-8e80-42ad-8d48-9ea260d00b5e tempest-AZV2TestJSON-115256530 tempest-AZV2TestJSON-115256530-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.215134 Aug 29 15:35:18.402854 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1034/2139] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Aug 29 15:35:18 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:35:18.508417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.509121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:18.524390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.524886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.525330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.526967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.527427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.527856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.534812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:18.548038 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-306636a0-5350-463f-89ff-4d4e2a5628a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.231186 Aug 29 15:35:18.550040 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1106/2140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:18 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:18.567601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.568483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:18.575433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.576419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.577513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.578414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.579024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.579622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.763102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:18.776912 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66094362-30c1-4adb-93db-64e80270f47a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.216235 Aug 29 15:35:18.778363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1107/2141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:18 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:18.878150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.879741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:18.887236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.888473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.889124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.890467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.891126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.891890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.001264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:19.009039 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f48e6cb-00b7-423d-a969-f638c9345b68 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1237 microversion: 2.1 time: 0.509024 Aug 29 15:35:19.009647 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1035/2142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:18 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1237 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:19.217817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:19.218638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:19.233216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.233909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.234479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.235339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.235954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.236511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.343026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:19.357474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:19.365357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:19.367303 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cc6bca58-eef7-471b-b467-d6f7fcdbd9ee tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.495353 Aug 29 15:35:19.367908 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1108/2143] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:18 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:35:19.379609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:19.380240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:19.409505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.415203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.415893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.416802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.419619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.420323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.483029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:19.523729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-713cdf42-cedc-433f-a88f-33fb2b7835e7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.309585 Aug 29 15:35:19.524339 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1036/2144] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:19 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:35:19.572325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:19.574296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:19.575005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:19.592659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.593350 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e24a633-bac7-4405-985d-35ed98e87a71 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1599 microversion: 2.1 time: 0.224341 Aug 29 15:35:19.605476 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1109/2145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:19 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:19.605713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.605713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.605713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.605713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.605713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.804718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:19.807027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:19.829275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.834104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.836008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.837960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.839695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.840228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.188216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.203949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:20.207970 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-36b60a29-d9a4-42ed-a571-7e5df3cae896 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.411403 Aug 29 15:35:20.210202 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1110/2146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:19 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:20.220286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-38be18c9-9538-4229-9c3d-dce4a7a79a5b req-37efe388-ca9b-4919-9be3-fb8966a03fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784f3eba-97c4-48b4-aa04-db77584cbee7", "name": "network-vif-deleted", "tag": "e81c2643-3312-407a-9390-e39c02caff49"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:20.238665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38be18c9-9538-4229-9c3d-dce4a7a79a5b req-37efe388-ca9b-4919-9be3-fb8966a03fd8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.239086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38be18c9-9538-4229-9c3d-dce4a7a79a5b req-37efe388-ca9b-4919-9be3-fb8966a03fd8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.240313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38be18c9-9538-4229-9c3d-dce4a7a79a5b req-37efe388-ca9b-4919-9be3-fb8966a03fd8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.261370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-38be18c9-9538-4229-9c3d-dce4a7a79a5b req-37efe388-ca9b-4919-9be3-fb8966a03fd8 service nova] Creating event network-vif-deleted:e81c2643-3312-407a-9390-e39c02caff49 for instance 784f3eba-97c4-48b4-aa04-db77584cbee7 on n-h1-854882-3 Aug 29 15:35:20.274413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-38be18c9-9538-4229-9c3d-dce4a7a79a5b req-37efe388-ca9b-4919-9be3-fb8966a03fd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060194 Aug 29 15:35:20.275651 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1111/2147] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:20.283231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.283960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.293473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.294936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.294936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.295150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.295488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.295919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.381891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.399943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ff33c50c-ae6a-41e6-a3c9-2f463698ffcd tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.827922 Aug 29 15:35:20.401064 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1037/2148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:19 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:20.409168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.412048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.427027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.429976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.430776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.434302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.435950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.437677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.525041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.549728 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6bad8c23-a671-4db3-97fc-9ab8ac2e3098 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1305 microversion: 2.1 time: 0.269341 Aug 29 15:35:20.553954 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1112/2149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1305 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:20.580249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.580850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.591482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.592759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.594757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.595983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.596464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.597776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.735485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:20.762160 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-138257cf-157a-412a-8c7a-8b874c464015 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.194085 Aug 29 15:35:20.763387 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1113/2150] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:20.768804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.769454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.776450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.776883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.777328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.778163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.778630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.779228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.835102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.837510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.838164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.838664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lazy-loading 'fault' on Instance uuid 784f3eba-97c4-48b4-aa04-db77584cbee7 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:20.917285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.931070 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-97660a30-d19a-430e-acdf-e100f63f8ed2 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 200 len: 1323 microversion: 2.1 time: 0.166553 Aug 29 15:35:20.931970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1114/2151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:21.232843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:21.233692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:21.250373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.250873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.251316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.256754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.257327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.257824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.282639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:21.299689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:21.301181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:21.306276 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27d06b61-55c9-4940-9ec0-24b285dafdcd tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.903666 Aug 29 15:35:21.306877 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1038/2152] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:21.425146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:21.426084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:21.432770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.433764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.434576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.435539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.436196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.437627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.550093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:21.633330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:21.667461 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df925b22-e174-498f-ae9b-28961c33cdec tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.440123 Aug 29 15:35:21.671222 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1115/2153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:21 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:21.689214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:21.690216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:21.708194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.708728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.711955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.712744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.713228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.718508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.028149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:22.043591 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d7d28bb7-2a82-4455-907f-663e9f1db1a8 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.622701 Aug 29 15:35:22.044726 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1039/2154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:21 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:22.074487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:22.077613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:22.094526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.098806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.099472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.103051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.103978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.105999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.284962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:22.296204 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8aa5143-d36b-4975-a79e-72f922e13813 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1305 microversion: 2.1 time: 0.623623 Aug 29 15:35:22.297354 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1116/2155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:21 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1305 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:22.315861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:22.316719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 784f3eba-97c4-48b4-aa04-db77584cbee7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:22.329214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.329978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.330847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.332384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.333035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.333743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.366406 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] HTTP exception thrown: Instance 784f3eba-97c4-48b4-aa04-db77584cbee7 could not be found. Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Request method failure captured: Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 HTTP/1.1 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNrS51DZBoH5dzvOmTXL0cTsun97oQ55iHiKg94VPJq2xHGOwLWHRXzxUDvtyldqzWc3MRg89vpH9MHeUpq3gMHbzldCKofQQfiFSPIoM33KXuXbjOuQIxvqZBlGvlFjHQmJj_SPpspQC_tn3CUDfM0fnJ9xZMzhloxsMwcm5QR8_jA Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74754c19f05f41428bc6d499aac1f9e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}] Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-LiveMigrationTest-1204386624-project Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e7e71fcf6711470db5a71ddc74ff709c Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-LiveMigrationTest-1204386624-project Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 784f3eba-97c4-48b4-aa04-db77584cbee7 could not be found. Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '784f3eba-97c4-48b4-aa04-db77584cbee7'} Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784f3eba-97c4-48b4-aa04-db77584cbee7 could not be found. Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784f3eba-97c4-48b4-aa04-db77584cbee7 could not be found. Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:22.368622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:22.372620 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:22.372620 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:22.372620 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:22.372620 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:22.372620 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:22.372620 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784f3eba-97c4-48b4-aa04-db77584cbee7 could not be found. Aug 29 15:35:22.372620 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:22.374590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Returning 404 to user: Instance 784f3eba-97c4-48b4-aa04-db77584cbee7 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:22.375848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a30d38a5-0e63-4ba6-be51-7383f4343a7e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7" status: 404 len: 111 microversion: 2.1 time: 0.077394 Aug 29 15:35:22.376624 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1117/2156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:22 2022] GET /compute/v2.1/servers/784f3eba-97c4-48b4-aa04-db77584cbee7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:22.385937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:22.386816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:22.398050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.398856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.400178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.402848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.404808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.405481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.779623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:22.790090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:22.791564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:22.792771 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2f40372-c802-4f3f-be64-1f2ebdf29b08 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.411649 Aug 29 15:35:22.801451 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1118/2157] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:22 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:22.814575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d162491e-2cdb-4a1b-aa29-75cdbe3ca66e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '.version_select at 0x7fb0eb5d2430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:22.834439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:22.877839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d768c7f8-4aee-4eea-b8f8-ea0d75b3c59b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.822656 Aug 29 15:35:22.889411 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d162491e-2cdb-4a1b-aa29-75cdbe3ca66e tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435751087" status: 202 len: 0 microversion: 2.1 time: 0.075836 Aug 29 15:35:22.889411 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1119/2158] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:35:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435751087 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:22.889411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:22.889950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:22.890634 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1040/2159] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:22 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:22.912555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:22.914847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.915774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.916459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.918049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:22.918752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:22.922335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.069946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:23.074607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:23.085077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.085933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.088183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.099780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.101356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.102429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.251489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:23.264842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21755199-9f33-4ca9-b6ce-4609f0dc093d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.382183 Aug 29 15:35:23.267397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1120/2160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:22 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:23.318509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:23.320121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:23.336690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.337436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.338026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.339032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.339643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.340208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.476320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:23.489036 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8673da4a-56d8-401b-a8ba-be2e51f98ede tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.427678 Aug 29 15:35:23.507250 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1041/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:23 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:23.804503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-dbb8879a-ee21-49ee-89eb-b4913e4b01da req-d0cfb0aa-b4e8-4886-9f6a-150f84874954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e2c2cf-4748-4e72-a697-6079333133bf", "tag": "44db1ef2-f32e-46d8-a8ba-9a9fff6f2390"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:23.823905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dbb8879a-ee21-49ee-89eb-b4913e4b01da req-d0cfb0aa-b4e8-4886-9f6a-150f84874954 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.824753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dbb8879a-ee21-49ee-89eb-b4913e4b01da req-d0cfb0aa-b4e8-4886-9f6a-150f84874954 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.825446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dbb8879a-ee21-49ee-89eb-b4913e4b01da req-d0cfb0aa-b4e8-4886-9f6a-150f84874954 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.849288 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-dbb8879a-ee21-49ee-89eb-b4913e4b01da req-d0cfb0aa-b4e8-4886-9f6a-150f84874954 service nova] Creating event network-changed:44db1ef2-f32e-46d8-a8ba-9a9fff6f2390 for instance 47e2c2cf-4748-4e72-a697-6079333133bf on n-h2-854882-3 Aug 29 15:35:23.866728 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-dbb8879a-ee21-49ee-89eb-b4913e4b01da req-d0cfb0aa-b4e8-4886-9f6a-150f84874954 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065921 Aug 29 15:35:23.869765 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1042/2162] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:35:23.879996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:23.886783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:23.902791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:23.906482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.907324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.907932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.908784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.910580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.913854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.916525 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51110bbb-e282-4f28-98b9-20fb348a5bae tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1305 microversion: 2.1 time: 0.603541 Aug 29 15:35:23.917144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1121/2163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:23 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1305 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:23.946241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:23.946930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:23.963051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.963798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.965931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.967298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.967982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.968470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.246007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:24.276816 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-80952959-a86e-4ba1-9d22-9a3a5e285c44 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.342189 Aug 29 15:35:24.288565 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1122/2164] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:23 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:24.311642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:24.313215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:24.322640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.324278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.324952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.329092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.329906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.330446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.682353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:24.699617 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2e284d06-4a5f-4dd2-a38f-2e58bac806df tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.405459 Aug 29 15:35:24.702702 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1123/2165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:24 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:24.718166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:24.719070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:24.727621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:24.731965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.732284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.736037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.737660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.737778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.738564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.056605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:25.074360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:25.076154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:25.080076 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f09097e-a775-4f0a-8d04-cbd85e772592 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 1.208997 Aug 29 15:35:25.080830 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1043/2166] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:23 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:25.093789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.094623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.101656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.108845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.109542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.116912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.117643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.118221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.190627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:25.203002 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b2e43035-ec64-4b63-ac1c-aef6a7b1f90d tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.496911 Aug 29 15:35:25.204544 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1124/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:24 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:25.316160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.316993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.329866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.331067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.332611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.336378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.337235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.337986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.432729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:25.455439 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9d7cd1a-6e0d-4ad9-9a65-6482bf67821b tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.142665 Aug 29 15:35:25.470549 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1125/2168] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:25 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:25.531865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.533293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.546627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.549636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.551619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.553347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.555286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.558592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.614481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:25.693378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:25.702769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:25.718449 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-98a8be17-ce4c-4d27-a673-5e39a8da99bc tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1305 microversion: 2.1 time: 0.628062 Aug 29 15:35:25.720795 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1044/2169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:25 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1305 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:25.749071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.753630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.765744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95d8f8b4-b206-4e59-ab80-e9d75a50e362 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 204 len: 0 microversion: 2.1 time: 0.245982 Aug 29 15:35:25.766567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1126/2170] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:25 2022] DELETE /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:35:25.768606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.769798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.770396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.771257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.772417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.772991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.783650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.784376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.794067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.794560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.794996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.795710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.796159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.796581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.088887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.101853 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-20947ef9-82ec-420d-a610-08ac0828e338 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1484 microversion: 2.1 time: 0.330832 Aug 29 15:35:26.115108 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1127/2171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:25 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1484 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:26.122210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:26.123068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:26.132678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.137859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.139810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.140784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.141422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.141997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.380798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.397634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0381e0d2-ad92-4917-a456-c623fe4f84c0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.660521 Aug 29 15:35:26.410986 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1045/2172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:25 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:26.426497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:26.428168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:26.466169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.471412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.472053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.473330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.475981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.478445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.648084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.661577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.664342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.665934 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cdee7e64-3f67-4917-8945-7fb574c4fd6d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.547792 Aug 29 15:35:26.667031 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1128/2173] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:26 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:26.672151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:26.673029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:26.683930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.684822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.685512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.686441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.687118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.687733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.925368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:26.989511 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-988143e5-880c-4694-bf9f-2178a11353ce tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.321075 Aug 29 15:35:26.993594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1129/2174] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:26 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:27.003778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.005205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:27.013476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.014198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.015257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.016170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.016762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.017316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.487816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:27.508208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e86e54b-8f32-45b9-8580-37273e472a47 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 1.090716 Aug 29 15:35:27.509897 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1046/2175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:26 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:27.514560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.515992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:27.522490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.523205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.523780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.524618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.525737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.526303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.691905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:27.707581 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71f75878-f6a3-484e-8720-3989b850a78e tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1305 microversion: 2.1 time: 0.712119 Aug 29 15:35:27.709629 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1130/2176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:26 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1305 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:27.715062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.715844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:27.728164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.731425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.732219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.733085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.733868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.734388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.060884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.067804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.079917 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-840bee5d-4080-4111-9875-e429b08b091c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 200 len: 1484 microversion: 2.1 time: 0.568803 Aug 29 15:35:28.080534 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a06a4c91-da02-44e9-8725-13c92a39abf0 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.369488 Aug 29 15:35:28.084666 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1047/2177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:27 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 1484 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:28.090210 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1131/2178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:27 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:28.102738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:28.110525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.110718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:28.111324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.122488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.124952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.125703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.126286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.126545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.127319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.127791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.129588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.130086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.130537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.130705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.131986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.333926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:28.373447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:28.382188 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-32ab616b-6b4a-42ac-a7ef-91d034086770 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.289049 Aug 29 15:35:28.387808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1132/2179] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:28 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:28.593176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1315811628", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "233c726f-bcd9-46a9-a17b-52ab8ae450d1"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:28.684963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] validate_networks() for [('233c726f-bcd9-46a9-a17b-52ab8ae450d1', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:28.871877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.881216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.883075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.884550 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1eeb50d8-97d9-461e-bcdb-16bcd110b55d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1891 microversion: 2.42 time: 0.798532 Aug 29 15:35:28.885263 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1048/2180] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:28 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1891 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:28.916682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:28.918006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.925663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.926378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.926981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.928318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.928921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.929533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.205833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:29.214441 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-01ef75f3-85ce-4374-b21e-3ba04d7c2676 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1471 microversion: 2.1 time: 0.304849 Aug 29 15:35:29.215038 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1049/2181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:28 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:29.234008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:29.234926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:29.242469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.243126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.243760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.246025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.246627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.247195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.886236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:29.895444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:29.899302 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-db6f2b5d-1484-4553-a050-78ea8d2de77b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.669220 Aug 29 15:35:29.900051 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1050/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:29 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:29.908608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0ebe9880-341e-4f17-98a9-adba49e5f40a req-e7f51a1a-0f58-45ae-9ae0-cb11a27c4ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c", "name": "network-vif-deleted", "tag": "0b2683e6-b468-4488-a8ef-755f005fa2bb"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:29.926433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0ebe9880-341e-4f17-98a9-adba49e5f40a req-e7f51a1a-0f58-45ae-9ae0-cb11a27c4ef6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.927685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0ebe9880-341e-4f17-98a9-adba49e5f40a req-e7f51a1a-0f58-45ae-9ae0-cb11a27c4ef6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.928299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0ebe9880-341e-4f17-98a9-adba49e5f40a req-e7f51a1a-0f58-45ae-9ae0-cb11a27c4ef6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.943903 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0ebe9880-341e-4f17-98a9-adba49e5f40a req-e7f51a1a-0f58-45ae-9ae0-cb11a27c4ef6 service nova] Creating event network-vif-deleted:0b2683e6-b468-4488-a8ef-755f005fa2bb for instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c on n-h2-854882-3 Aug 29 15:35:29.949380 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0ebe9880-341e-4f17-98a9-adba49e5f40a req-e7f51a1a-0f58-45ae-9ae0-cb11a27c4ef6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047968 Aug 29 15:35:29.951144 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1051/2183] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:29.957991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:29.959899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:29.967458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.968313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.968898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.969993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.970929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.971529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.259376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:30.260508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:30.261169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:30.261773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:30.262337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:30.278515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.279012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.279465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.280207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.280666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.281094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.325330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Getting quotas for project ef312cb51a84470d8c0d38c9c2a65b79. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:30.347068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Getting quotas for user d844cb81667346a6aaf07c288c6918be and project ef312cb51a84470d8c0d38c9c2a65b79. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:30.369465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:30.371712 n-d-854882-3 devstack@n-api.service[130002]: WARNING nova.utils [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1315811628 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-131581162 Aug 29 15:35:30.372483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:30.390125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:30.428539 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cee30997-a63d-48ef-933a-0f81eeedc62e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.473597 Aug 29 15:35:30.429874 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1052/2184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:29 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:30.442912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:30.444649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:30.448860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa32b46f-7d3a-4ca6-9686-a2fad198623b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059498 Aug 29 15:35:30.449563 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1133/2185] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:30.456164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.457090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.457775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.458445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.459265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.459847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.462761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:30.466257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:30.482543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.483245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.483856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.484718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.485322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.485931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.519355 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] HTTP exception thrown: Instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c could not be found. Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Request method failure captured: Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c HTTP/1.1 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrS51DZBoH5dzvOmTXL0cTsun97oQ55iHiKg94VPJq2xHGOwLWHRXzxUDvtyldqzWc3MRg89vpH9MHeUpq3gMHbzldCKofQQfiFSPIoM33KXuXbjOuQIxvqZBlGvlFjHQmJj_SPpspQC_tn3CUDfM0fnJ9xZMzhloxsMwcm5QR8_jA Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74754c19f05f41428bc6d499aac1f9e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}] Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-LiveMigrationTest-1204386624-project Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e7e71fcf6711470db5a71ddc74ff709c Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-LiveMigrationTest-1204386624-project Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c could not be found. Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c'} Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c could not be found. Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c could not be found. Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:30.521315 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:30.525021 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:30.525021 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:30.525021 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:30.525021 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:30.525021 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:30.525021 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c could not be found. Aug 29 15:35:30.525021 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:30.528868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Returning 404 to user: Instance 71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:30.530119 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13aabce4-5f80-4a3b-b9d0-7927fb0d9b94 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c" status: 404 len: 111 microversion: 2.1 time: 0.099044 Aug 29 15:35:30.534083 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1053/2186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:30 2022] GET /compute/v2.1/servers/71e9c2dc-fd20-4ece-bdbc-dcc7db6fe12c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:30.541648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:30.542934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:30.549964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.550610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.551271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.552110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.553214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.553812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.755804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:30.793872 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b27812d-6fd6-439c-b813-abde2858fbdc tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.343156 Aug 29 15:35:30.800827 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1134/2187] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:30 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:30.810169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:30.810796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:30.827058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.828390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.831792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.832815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.833478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.834102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.188783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.200976 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1782cf56-2616-42bb-b136-1d2047efac1e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.399019 Aug 29 15:35:31.204036 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1135/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:30 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:31.214875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7d708e11-82af-4fb4-84a1-df93301b05ab tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:31.216700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7d708e11-82af-4fb4-84a1-df93301b05ab tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:31.327125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d708e11-82af-4fb4-84a1-df93301b05ab tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.333774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.335913 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7d708e11-82af-4fb4-84a1-df93301b05ab tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1232 microversion: 2.1 time: 0.130600 Aug 29 15:35:31.345305 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1136/2189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:31 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1232 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:31.362972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.364657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:31.365175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:31.368482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.372459 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c4edf01f-714c-488e-b3f1-c3c1d8837606 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.836881 Aug 29 15:35:31.380799 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1054/2190] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:30 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:31.391632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:31.392258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:31.406259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.408344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.409829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.414546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.415415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.415914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.416350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.425271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.425815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.426265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.431009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.431944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.482987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:31.746380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5910497e-e870-4a05-9b3c-025692851a82 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 204 len: 0 microversion: 2.1 time: 0.397573 Aug 29 15:35:31.751881 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1137/2191] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:31 2022] DELETE /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:31.765363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:31.775295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:31.783189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.783831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.784275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.784993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.785846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.786421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.895287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.919492 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-74a0250b-2187-498d-93ce-d3f7d5746824 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.537114 Aug 29 15:35:31.930182 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1055/2192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:31 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:31.963422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:31.964066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:31.977171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.985561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.986171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.986913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.987379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.987794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.120368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.129073 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-33109590-d272-4ddc-9032-c2bcb04a2cca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.376156 Aug 29 15:35:32.130315 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1138/2193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:31 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:32.135536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.136155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.145672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.146179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.146958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.147680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.148342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.148782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.281977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:32.303663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-716f049f-21dd-4e4c-91f4-ec6f4acdc6c7 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.171546 Aug 29 15:35:32.305013 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1139/2194] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:32.311398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.312327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.319033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.319740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.320323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.321193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.321826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.322391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.466805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.477094 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d7a6ce41-0946-495f-ab99-8c13ca3957d4 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1500 microversion: 2.1 time: 0.533272 Aug 29 15:35:32.478442 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1056/2195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:31 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1500 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:32.559884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1272051770", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:32.560107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.571153 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8870e2fa-4c1a-4948-b295-c9f301b5c0ea tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.264784 Aug 29 15:35:32.572253 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1140/2196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:32.577878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.578806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.585767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.586592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.587535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.589308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.589981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.590570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.652801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] validate_networks() for [('f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:32.677989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.687457 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e30e828-0ca4-4029-bc36-e6da6650ad83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1284 microversion: 2.1 time: 0.113814 Aug 29 15:35:32.701144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1141/2197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:32.701144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.701144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.707036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.707601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.708102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.708871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.709923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.710569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.716547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:32.976539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.986695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.987984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.989183 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9793ecdc-2a2f-4edf-b62a-c9be2885f9e4 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.299128 Aug 29 15:35:32.997204 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1142/2198] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:33.010478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.011521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.031952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.033299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.033790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.034532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.034997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.038671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.245283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.255138 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a22adb72-69b0-44f0-8b28-6a3af97a0016 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.256437 Aug 29 15:35:33.261668 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1143/2199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:33.265663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.266948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.274868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.275760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.276198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.277959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.278426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.279041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.415352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.423943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-638cd62c-5494-446a-b84b-3dff8571da90 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.165840 Aug 29 15:35:33.424879 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1144/2200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:33 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:33.431168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.432161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.439060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.439754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.440192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.440898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.441369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.441806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.528530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:33.557982 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c130554c-c93d-4497-9288-a7396968ae88 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.129285 Aug 29 15:35:33.558453 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1145/2201] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:33 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:33.565421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.566656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.575852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.576532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.577129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.578031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.578633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.579234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.656387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.665655 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1fb2e77f-b691-4d53-ab9e-4f651b169190 tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1458 microversion: 2.1 time: 0.105808 Aug 29 15:35:33.677424 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1146/2202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:33 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1458 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:33.677424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.677424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.680209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.682586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.682586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.682586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.682586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.682949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.848554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.862815 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db172af6-21bc-4016-95af-a302134c156e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.194803 Aug 29 15:35:33.877054 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1147/2203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:33 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:33.877054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.877054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.877054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.877537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.877853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.878383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.878842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.879276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.963429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.972619 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d3f125d-16e2-4167-b120-3436dafcdc73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1290 microversion: 2.1 time: 0.107689 Aug 29 15:35:33.988568 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1148/2204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:33 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:34.013259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.013930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.027812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.029804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.030327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.033337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.034301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.034426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.298519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:34.300005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:34.300800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:34.301418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:34.302124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:34.307243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:34.319618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:34.320460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.321138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.321758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.322045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:34.322545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.323001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.323425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.324134 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab872d38-f372-4ade-a215-1abde7501510 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.315927 Aug 29 15:35:34.325859 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1149/2205] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:35:34.331083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-58cbd126-9177-4789-8f7c-5562db2435ac req-3ef9dd73-cb2a-4841-926c-eebefd14f6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ea2f92-896a-47a6-b083-80d43213b701", "name": "network-vif-deleted", "tag": "d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:34.344045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-58cbd126-9177-4789-8f7c-5562db2435ac req-3ef9dd73-cb2a-4841-926c-eebefd14f6fd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.344891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-58cbd126-9177-4789-8f7c-5562db2435ac req-3ef9dd73-cb2a-4841-926c-eebefd14f6fd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.346752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-58cbd126-9177-4789-8f7c-5562db2435ac req-3ef9dd73-cb2a-4841-926c-eebefd14f6fd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.362487 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-58cbd126-9177-4789-8f7c-5562db2435ac req-3ef9dd73-cb2a-4841-926c-eebefd14f6fd service nova] Creating event network-vif-deleted:d21ef1f8-32ae-4fc4-b34c-bb0ce4c697b6 for instance e4ea2f92-896a-47a6-b083-80d43213b701 on n-h2-854882-3 Aug 29 15:35:34.369808 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-58cbd126-9177-4789-8f7c-5562db2435ac req-3ef9dd73-cb2a-4841-926c-eebefd14f6fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042469 Aug 29 15:35:34.370725 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1150/2206] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:34.371967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:34.376403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.377353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.379720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for user 065c5a92f9c04400be8a515e8233fb0d and project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:34.385272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.386003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.386717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.387645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.388300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.388929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.397092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:34.401886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:34.470772 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-abcffaef-46fc-468c-96e2-32f50aadd4ff tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991029 Aug 29 15:35:34.472076 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1057/2207] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:34.488971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.489965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.504146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.504711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.511134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.512420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.513048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.513681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.635644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:34.644862 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8baa9ade-9288-4af6-aa03-0448a7c35b31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.272747 Aug 29 15:35:34.658743 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1151/2208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:34.664927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-816f3627-b717-4755-92bf-ec24a3728340 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.666032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-816f3627-b717-4755-92bf-ec24a3728340 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.733272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-816f3627-b717-4755-92bf-ec24a3728340 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:34.747172 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-816f3627-b717-4755-92bf-ec24a3728340 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1215 microversion: 2.1 time: 0.086977 Aug 29 15:35:34.750224 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1152/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:34.755559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.756511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.762759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:34.765203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.766158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.767056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.767932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.768535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.769112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.916410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:34.931683 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c49c0baf-9cd4-461d-b1f8-e56385496830 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.455658 Aug 29 15:35:34.933695 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1058/2210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:34.945721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.948202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.962499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.963726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.966423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.967420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.967853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.969479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.978621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:35.020601 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a6ceea0b-a701-44d2-8c33-2fb9ecac61d1 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.267785 Aug 29 15:35:35.022178 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1153/2211] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:35.027414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.028266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.037346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.038135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.038749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.039626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.040232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.040966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.047630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.048247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.048770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.049322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lazy-loading 'fault' on Instance uuid e4ea2f92-896a-47a6-b083-80d43213b701 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:35.121003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e71fcf6711470db5a71ddc74ff709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74754c19f05f41428bc6d499aac1f9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.130054 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-17248cc2-9af5-44b1-bc0b-d3a8ebf3186c tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 200 len: 1301 microversion: 2.1 time: 0.194499 Aug 29 15:35:35.130751 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1059/2212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 1301 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:35.138793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.142459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.160224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.161276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.162034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.163495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.181931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.182655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.240680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.250109 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0c1e5132-8a98-4336-98ec-316bc9bd3019 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.226567 Aug 29 15:35:35.262960 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1154/2213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:35.352377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.353885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.364669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.366162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.368209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.371720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.372377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.372860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.424459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.434284 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d570264-6a59-43f1-8595-2914a5375ae1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.298869 Aug 29 15:35:35.447584 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1060/2214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:35.611704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.624694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.626379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.627778 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-237ffe0c-52c5-4f0a-a3e8-b06ccf1dbddc tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.280645 Aug 29 15:35:35.628509 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1155/2215] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:35.666478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.667094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.669492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:35.675106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.675837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.676255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.676954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.677431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.678534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.772772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.773566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.783919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.784159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.784847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.786214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.786774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.787373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.829187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.837943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c4311bef-1d30-4bed-a8f2-cc582849a8f6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.175582 Aug 29 15:35:35.838642 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1061/2216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:35.866382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.875367 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f6707f7-809e-4f33-9c69-cc35d4e6fc93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1267 microversion: 2.1 time: 0.107051 Aug 29 15:35:35.875991 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1156/2217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:35.955455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.956537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.963364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.963920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.964424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.965198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.965808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.966749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.052913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.053880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.060785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.061362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.061899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.062676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.063135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.063560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.120467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:36.129848 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4afa1e88-d4c4-420a-bcae-9f51cddc72c3 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.178304 Aug 29 15:35:36.138549 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1062/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:36.143515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:36.152416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.153050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] [instance: e4ea2f92-896a-47a6-b083-80d43213b701] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.160396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.161136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.161589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.162517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.162961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.166005 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-47fc9a16-0653-45a4-9fd6-54c41d97d630 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1929 microversion: 2.75 time: 0.118167 Aug 29 15:35:36.166857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.177419 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1157/2219] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1929 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:36.183999 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] HTTP exception thrown: Instance e4ea2f92-896a-47a6-b083-80d43213b701 could not be found. Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Request method failure captured: Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 HTTP/1.1 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNrS51DZBoH5dzvOmTXL0cTsun97oQ55iHiKg94VPJq2xHGOwLWHRXzxUDvtyldqzWc3MRg89vpH9MHeUpq3gMHbzldCKofQQfiFSPIoM33KXuXbjOuQIxvqZBlGvlFjHQmJj_SPpspQC_tn3CUDfM0fnJ9xZMzhloxsMwcm5QR8_jA Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74754c19f05f41428bc6d499aac1f9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74754c19f05f41428bc6d499aac1f9e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74754c19f05f41428bc6d499aac1f9e5"}]}] Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 74754c19f05f41428bc6d499aac1f9e5 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-LiveMigrationTest-1204386624 Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-LiveMigrationTest-1204386624-project Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e7e71fcf6711470db5a71ddc74ff709c Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-LiveMigrationTest-1204386624-project Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e4ea2f92-896a-47a6-b083-80d43213b701 could not be found. Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e4ea2f92-896a-47a6-b083-80d43213b701'} Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ea2f92-896a-47a6-b083-80d43213b701 could not be found. Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ea2f92-896a-47a6-b083-80d43213b701 could not be found. Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:36.185760 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ea2f92-896a-47a6-b083-80d43213b701 could not be found. Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] Returning 404 to user: Instance e4ea2f92-896a-47a6-b083-80d43213b701 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:36.191252 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b55b94f9-2434-4d94-afb1-0e4491d5672a tempest-LiveMigrationTest-1204386624 tempest-LiveMigrationTest-1204386624-project] 10.222.0.16 "GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701" status: 404 len: 111 microversion: 2.1 time: 0.039214 Aug 29 15:35:36.193910 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1063/2220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/e4ea2f92-896a-47a6-b083-80d43213b701 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:36.274797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.275339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.281829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.282333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.282779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.283529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.283996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.284436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.455201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.456252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.471409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.472530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.474232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.475608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.477794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.479519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.529317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:36.544832 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8916e2aa-d3c4-49d9-a383-3da46ed9a42a tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.274797 Aug 29 15:35:36.545784 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1158/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:36.652974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.653953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.666388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.670417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.673181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.674431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.679655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.680167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.764486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:37.117889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.131463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.134088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.136360 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2951d18-5317-4f0a-8ec5-b3d885df47cb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.487187 Aug 29 15:35:37.152054 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1159/2222] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:37.163601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.165227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.172905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.173651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.174301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.175299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.175964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.176614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.360375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.370873 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4cfad21c-219b-4546-8e95-bdbbff7cc670 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.919612 Aug 29 15:35:37.374396 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1064/2223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:37.390290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.391316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.418648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.419439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.419559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.420464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.421770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.422358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.468737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.482829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f341c76-a6df-4c22-b1e1-53874373a17d tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.326131 Aug 29 15:35:37.483633 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1160/2224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:37.492559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a2e38fdf-c3f0-4497-996e-5b765f4c7fa0 req-88dab85d-25e8-432d-91c5-14f04833f506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190b045a-6f51-4011-950e-5ca4150a647b", "name": "network-vif-plugged", "status": "completed", "tag": "271365e6-dc68-453b-9b42-c69b0118f270"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:37.517115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a2e38fdf-c3f0-4497-996e-5b765f4c7fa0 req-88dab85d-25e8-432d-91c5-14f04833f506 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.518144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a2e38fdf-c3f0-4497-996e-5b765f4c7fa0 req-88dab85d-25e8-432d-91c5-14f04833f506 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.518844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a2e38fdf-c3f0-4497-996e-5b765f4c7fa0 req-88dab85d-25e8-432d-91c5-14f04833f506 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.546003 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a2e38fdf-c3f0-4497-996e-5b765f4c7fa0 req-88dab85d-25e8-432d-91c5-14f04833f506 service nova] Creating event network-vif-plugged:271365e6-dc68-453b-9b42-c69b0118f270 for instance 190b045a-6f51-4011-950e-5ca4150a647b on n-h1-854882-3 Aug 29 15:35:37.551679 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a2e38fdf-c3f0-4497-996e-5b765f4c7fa0 req-88dab85d-25e8-432d-91c5-14f04833f506 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066593 Aug 29 15:35:37.552786 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1161/2225] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:37.560249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.564995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.571864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.572657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.573333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.574293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.574936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.575553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.622067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.632376 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a65ee72a-e73e-4211-971d-f7a835f375e0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1273 microversion: 2.1 time: 0.256570 Aug 29 15:35:37.633481 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1065/2226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:37.639069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.639801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.650480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.651336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.651986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.653637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.654468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.656749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.828027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:37.853241 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-102564d1-005c-4586-aad2-d18fa8be8810 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1935 microversion: 2.75 time: 0.218387 Aug 29 15:35:37.854346 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1066/2227] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1935 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:37.863769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.870659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.877060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.877713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.878386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.879346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.880186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.880870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.138174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.149195 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21b24d48-7af7-4563-87c6-6f86a47a5b55 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.594602 Aug 29 15:35:38.150053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1162/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:38.160233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.161115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.169614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.170328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.171550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.172454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.173074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.173688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.203622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.215219 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-413b78d3-eee6-410c-bccb-86e4280281be tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.359504 Aug 29 15:35:38.216125 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1067/2229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:38.276883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7e4e9987-50e3-47d8-8efd-f7afa9c7fcdf req-af9e2658-abb7-4003-9d2b-6e144740a6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3", "tag": "02dee68c-2667-4e73-acf1-ba7832a2debc"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:38.298760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7e4e9987-50e3-47d8-8efd-f7afa9c7fcdf req-af9e2658-abb7-4003-9d2b-6e144740a6b2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.299943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7e4e9987-50e3-47d8-8efd-f7afa9c7fcdf req-af9e2658-abb7-4003-9d2b-6e144740a6b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.300860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7e4e9987-50e3-47d8-8efd-f7afa9c7fcdf req-af9e2658-abb7-4003-9d2b-6e144740a6b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.319809 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7e4e9987-50e3-47d8-8efd-f7afa9c7fcdf req-af9e2658-abb7-4003-9d2b-6e144740a6b2 service nova] Creating event network-changed:02dee68c-2667-4e73-acf1-ba7832a2debc for instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 on n-h1-854882-3 Aug 29 15:35:38.334788 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7e4e9987-50e3-47d8-8efd-f7afa9c7fcdf req-af9e2658-abb7-4003-9d2b-6e144740a6b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063876 Aug 29 15:35:38.336056 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1068/2230] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:35:38.397123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.398268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.411276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.412051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.412722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.413697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.416201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.416848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.551978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.563082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.565653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.567055 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d7fc1bc1-e81e-4c76-a2cb-b85b0a6ec324 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.410728 Aug 29 15:35:38.568100 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1163/2231] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:38.596422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.598358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.612271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.613193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.613883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.614963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.616184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.616873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.644492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.658292 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-394c6e86-06f8-481e-a460-92998d6fa85c tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.265808 Aug 29 15:35:38.659298 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1069/2232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:38.664884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.665861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.672511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.673367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.674066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.675069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.675756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.676603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.683494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:39.007360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.020502 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2bb5f506-1145-4c4e-acb2-717565f9b64b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.450416 Aug 29 15:35:39.022056 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1164/2233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:39.030414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.031345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.040038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.040767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.041476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.043291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.044769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.045659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.113286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.124227 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-566e34e4-9cbf-4704-afb7-5233200a43ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.463334 Aug 29 15:35:39.137602 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1070/2234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:39.179440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.180479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.188728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.189358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.189892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.190970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.191537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.192131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.211065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:39.260448 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a3ef290-e126-407e-805a-8736aa6897fe tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1935 microversion: 2.75 time: 0.237160 Aug 29 15:35:39.262252 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1165/2235] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1935 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:39.275062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.275972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.289206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.289748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.290332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.291064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.291823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.292994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.580254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.602386 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2538d948-5488-4d9b-90f9-2b1c272d22aa tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.337502 Aug 29 15:35:39.616464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1166/2236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:39.621549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1cdb049b-a085-4c38-bd75-c5dcdae82b2f req-112c0b3f-8383-4463-94e1-ccf6889eca31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e2c2cf-4748-4e72-a697-6079333133bf", "name": "network-vif-plugged", "status": "completed", "tag": "44db1ef2-f32e-46d8-a8ba-9a9fff6f2390"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:39.644771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.651449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1cdb049b-a085-4c38-bd75-c5dcdae82b2f req-112c0b3f-8383-4463-94e1-ccf6889eca31 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.657439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1cdb049b-a085-4c38-bd75-c5dcdae82b2f req-112c0b3f-8383-4463-94e1-ccf6889eca31 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.657744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a3ea776a-18b7-4193-ab43-4b4fd495e26a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1736 microversion: 2.1 time: 0.485646 Aug 29 15:35:39.658158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1cdb049b-a085-4c38-bd75-c5dcdae82b2f req-112c0b3f-8383-4463-94e1-ccf6889eca31 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.677132 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1071/2237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1736 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:39.679407 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1cdb049b-a085-4c38-bd75-c5dcdae82b2f req-112c0b3f-8383-4463-94e1-ccf6889eca31 service nova] Creating event network-vif-plugged:44db1ef2-f32e-46d8-a8ba-9a9fff6f2390 for instance 47e2c2cf-4748-4e72-a697-6079333133bf on n-h2-854882-3 Aug 29 15:35:39.685208 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1cdb049b-a085-4c38-bd75-c5dcdae82b2f req-112c0b3f-8383-4463-94e1-ccf6889eca31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067214 Aug 29 15:35:39.686436 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1167/2238] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:39.694315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.695242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.700536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.701167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.703056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.703728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.704518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.705379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.706026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.706455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.722245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.724124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.725638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.727475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.728460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.729711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.950300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.965573 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eeaae54e-0333-45cf-8508-259accc57831 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.277601 Aug 29 15:35:39.967172 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1168/2239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.042980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.043836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.050157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.050650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.051091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.051873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.052333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.052986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.122868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.133801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.136061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.137582 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cabbc20e-6626-496a-afc7-926fbe97340e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.456051 Aug 29 15:35:40.138471 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1072/2240] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:40.162832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.164315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.170693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.171179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.171652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.172358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.172811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.173236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.242259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.251046 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0e9a25f-1509-4991-891a-b7daf23c2bdb tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1293 microversion: 2.1 time: 0.212516 Aug 29 15:35:40.277209 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1169/2241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1293 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.298073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.298892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.305165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:40.308201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.308702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.309138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.310085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.310712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.311288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.469890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:40.476949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.485726 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f806dbbc-4864-4b8f-bf2d-05696e93869b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.329992 Aug 29 15:35:40.486602 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1073/2242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.497829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d9f256d-624d-4363-95ad-99e7db02c6ae tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1935 microversion: 2.75 time: 0.205949 Aug 29 15:35:40.502807 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1170/2243] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1935 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:40.624061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.624749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.631573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-76ba22fc-3ee2-4787-a99b-1e42a12d3e8e req-26db9ce2-ecab-418b-98f7-597cf242b4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707dfc82-2388-462a-aefd-fb2a0a87d926", "tag": "970604c6-f807-482e-a06c-bb62fd75abd1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:40.636677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.637175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.637700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.638440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.639025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.639436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.650864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-76ba22fc-3ee2-4787-a99b-1e42a12d3e8e req-26db9ce2-ecab-418b-98f7-597cf242b4cf service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.653196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-76ba22fc-3ee2-4787-a99b-1e42a12d3e8e req-26db9ce2-ecab-418b-98f7-597cf242b4cf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.653842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-76ba22fc-3ee2-4787-a99b-1e42a12d3e8e req-26db9ce2-ecab-418b-98f7-597cf242b4cf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.675534 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-76ba22fc-3ee2-4787-a99b-1e42a12d3e8e req-26db9ce2-ecab-418b-98f7-597cf242b4cf service nova] Creating event network-changed:970604c6-f807-482e-a06c-bb62fd75abd1 for instance 707dfc82-2388-462a-aefd-fb2a0a87d926 on n-h2-854882-3 Aug 29 15:35:40.700825 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-76ba22fc-3ee2-4787-a99b-1e42a12d3e8e req-26db9ce2-ecab-418b-98f7-597cf242b4cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073498 Aug 29 15:35:40.703128 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1171/2244] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:40.713154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.714567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.721789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.722599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.723117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.723838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.724293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.725253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.854763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.867626 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7d68f919-a552-4ff2-9ae9-a0b1e0f33440 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1477 microversion: 2.1 time: 0.246439 Aug 29 15:35:40.871545 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1074/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.990600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.999290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.001525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.018325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.018943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.022464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.023326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.024144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.027144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf51b051-3f70-4319-a6a9-4bc262df073b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1716 microversion: 2.1 time: 0.321473 Aug 29 15:35:41.027962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.043086 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1172/2246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1716 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:41.170969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.172216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.189169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.192581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.193832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.201030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.204738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.205511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.731885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.747476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5aa432d5-1e83-4d26-aaee-20b0e88bdf1e tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.762836 Aug 29 15:35:41.748479 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1075/2247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:41.756538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.757977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.766695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.767482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.768104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.769065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.769726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.770579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.848670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.861610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.867609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.868834 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6c64f759-0e20-4023-97ae-18e45ca7aad1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.702020 Aug 29 15:35:41.873772 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1173/2248] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:41 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:41.878747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.880128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Cannot 'detach_volume' instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 while it is in vm_state rescued Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments/3e7b9afb-a80a-4275-883d-42dedbf2e22b HTTP/1.1 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot 'detach_volume' instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 while it is in vm_state rescued Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': '647883af-6f80-4e9c-8f48-d0e4ba4edef3', 'id': '3e7b9afb-a80a-4275-883d-42dedbf2e22b'} Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 while it is in vm_state rescued Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:41.883561 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:41.887461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:41.887461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:41.887461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:41.887461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:41.887461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 while it is in vm_state rescued Aug 29 15:35:41.887461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:41.887876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.892443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 409 to user: Cannot 'detach_volume' instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 while it is in vm_state rescued {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:41.893333 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-196a2d0e-e301-4fb6-8ab6-5f6450f05a09 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "DELETE /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments/3e7b9afb-a80a-4275-883d-42dedbf2e22b" status: 409 len: 152 microversion: 2.1 time: 0.143702 Aug 29 15:35:41.897344 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1076/2249] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:35:41 2022] DELETE /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments/3e7b9afb-a80a-4275-883d-42dedbf2e22b => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:35:41.902765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.903258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.903696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.904438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.904888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.905306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.906170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.906796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.917719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.918210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.918817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.919734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.920337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.920910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.222283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.232363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.240901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d69a14a-4eed-4e33-bf2a-3ec7d0cb5c31 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1484 microversion: 2.1 time: 0.365786 Aug 29 15:35:42.241529 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1174/2250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:41 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1484 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:42.244360 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0382db9c-220f-45c6-b0b0-e22d5873748d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.345634 Aug 29 15:35:42.245274 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1077/2251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:41 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:42.250128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.254281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.258053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.258693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.265837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.266352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.269942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.270453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.270884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.271673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.272134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.272563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.277246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.278257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.278921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.279601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.376529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] Lazy-loading 'services' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:42.397032 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8a97c1e-bf91-42f6-95c2-f1ab9557bf93 tempest-ServersAdmin275Test-1185564234 tempest-ServersAdmin275Test-1185564234-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1920 microversion: 2.75 time: 0.154397 Aug 29 15:35:42.397735 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1175/2252] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1920 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:42.403414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:42.403966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.410142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.411101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.411702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.412932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.413587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.414182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.484448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:42.519057 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-88ddc3d0-5ca4-4624-b5b4-522736aaf6c2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/action" status: 202 len: 0 microversion: 2.1 time: 0.119480 Aug 29 15:35:42.523179 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1176/2253] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:42 2022] POST /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:42.526649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.527250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.538202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.538703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.539148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.539890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.540312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.540998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.614530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.622960 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-84dd6072-74ab-405f-be1f-5c1ea867ef63 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1462 microversion: 2.1 time: 0.376311 Aug 29 15:35:42.623543 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1078/2254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1462 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:42.629223 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d03f319f-3bc4-4b95-a9ec-9f00dea721fe tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108117 Aug 29 15:35:42.630017 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1177/2255] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:42.640495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.641183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.648701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.649331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.649686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.650371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.650983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.651962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.652582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.653229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.661188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.661874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.662564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.663292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.663755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.664191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.687454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:42.810615 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f58d4472-38f3-4692-9b88-4f0d6a0a2bce tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 204 len: 0 microversion: 2.75 time: 0.184972 Aug 29 15:35:42.815107 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1079/2256] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:35:42 2022] DELETE /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:35:42.821601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:42.825427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.832242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.833336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.833870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.835901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.836362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.836786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.945702 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-112964b8-6948-40da-844e-ac47a087dfd8 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action" status: 202 len: 0 microversion: 2.1 time: 0.129082 Aug 29 15:35:42.949608 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1080/2257] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:42 2022] POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:42.952537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.953468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.963607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.964123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.964566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.965288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.966438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.967698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.012987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.022497 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cde2ad14-1cac-459e-91c2-51f25c4563a8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1724 microversion: 2.1 time: 0.387869 Aug 29 15:35:43.023090 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1178/2258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:43.027904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.028766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.035455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.036580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.037286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.038212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.038668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.039100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.155175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.164373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.165877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.171945 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b434836-a392-4b88-8845-ae39693263f6 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1444 microversion: 2.75 time: 0.147530 Aug 29 15:35:43.172735 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1179/2259] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:43.178251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.179763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.186512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.187313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.187895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.188960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.189620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.190182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.410253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.419173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55347214-7ad0-4bf3-b40c-e2a3be2ffd49 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.471533 Aug 29 15:35:43.420038 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1081/2260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:43.424531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.425147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.434990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.435486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.435913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.436627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.437078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.437524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.475380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.475861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.476293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.476745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lazy-loading 'fault' on Instance uuid 190b045a-6f51-4011-950e-5ca4150a647b {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:43.808986 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9937d7f5-dfa2-46c5-a9f8-616e8acd91ca tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1596 microversion: 2.1 time: 0.388080 Aug 29 15:35:43.810033 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1082/2261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1596 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:43.815357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.816191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.822514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.823226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.823834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.824749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.825207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.825663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.831525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:43.987244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.008755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.011159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.012584 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56a67b6d-3a26-4825-84a8-8984e012cecb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.838709 Aug 29 15:35:44.013316 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1180/2262] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:44.019490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:44.022361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.032204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.032864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.033502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.034430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.035183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.036158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.071702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.080509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6625fba6-794c-4d52-bb69-38d8f0801e88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.269082 Aug 29 15:35:44.081468 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1083/2263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:44.100574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.101282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.107993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.108970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.109545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.110489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.112747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.113281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.138806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-11670fd7-cd02-4aed-a2ba-6b80340a92d2 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action" status: 202 len: 0 microversion: 2.1 time: 0.123175 Aug 29 15:35:44.143469 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1181/2264] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:44 2022] POST /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:44.149110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.149827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.156764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.157580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.158031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.158926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.159523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.159951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.308956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.318116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-519afd27-6f17-4ee2-80cf-26777270bd71 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1724 microversion: 2.1 time: 0.223443 Aug 29 15:35:44.319436 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1084/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:44.338076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.338693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.345330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.345330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.345944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.346855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.347313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.347740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.371914 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af0a7795-f6cf-4e65-b236-fd8c75ad9036 tempest-ServersAdminTestJSON-1740322849 tempest-ServersAdminTestJSON-1740322849-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1613 microversion: 2.1 time: 0.227085 Aug 29 15:35:44.376825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:44.377768 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1182/2266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1613 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:44.391613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:44.397838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.398600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.405111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.406103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.406755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.407701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.408377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.409019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.438975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:44.465878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.477241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.479069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.486394 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-572fa875-b2e0-4396-82b1-8f3340f2532d tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1444 microversion: 2.75 time: 0.152714 Aug 29 15:35:44.508396 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1085/2267] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1444 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:44.515328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.515971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.522623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.523126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.523532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.524871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.525334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.525797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.580927 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f97e8c49-aad5-4805-8477-9509554a81da tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 204 len: 0 microversion: 2.1 time: 0.188029 Aug 29 15:35:44.582043 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1183/2268] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:44 2022] DELETE /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:35:44.588267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.589326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.596048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.596648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.597087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.597964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.598427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.598854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.745635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=10 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:44.801996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.807271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.811696 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85011ffc-25da-48ba-a82c-68494f699772 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1484 microversion: 2.1 time: 0.228158 Aug 29 15:35:44.812647 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1184/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1484 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:44.817581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b4a9c955-ce18-4d1b-9f33-b6e903d2d6bc req-05dbdb90-804e-4bd2-9750-281622c1230f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e2c2cf-4748-4e72-a697-6079333133bf", "tag": "44db1ef2-f32e-46d8-a8ba-9a9fff6f2390"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:44.826744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a636133d-d2e8-4815-9924-c051fae63b59 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.316210 Aug 29 15:35:44.827704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b4a9c955-ce18-4d1b-9f33-b6e903d2d6bc req-05dbdb90-804e-4bd2-9750-281622c1230f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.828189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b4a9c955-ce18-4d1b-9f33-b6e903d2d6bc req-05dbdb90-804e-4bd2-9750-281622c1230f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.828696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b4a9c955-ce18-4d1b-9f33-b6e903d2d6bc req-05dbdb90-804e-4bd2-9750-281622c1230f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.837479 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1086/2270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:44.846223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.846852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.852439 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b4a9c955-ce18-4d1b-9f33-b6e903d2d6bc req-05dbdb90-804e-4bd2-9750-281622c1230f service nova] Creating event network-changed:44db1ef2-f32e-46d8-a8ba-9a9fff6f2390 for instance 47e2c2cf-4748-4e72-a697-6079333133bf on n-h2-854882-3 Aug 29 15:35:44.857227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.857599 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b4a9c955-ce18-4d1b-9f33-b6e903d2d6bc req-05dbdb90-804e-4bd2-9750-281622c1230f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043658 Aug 29 15:35:44.857967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.858278 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1185/2271] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:44.858589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.860413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.861049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.861609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.037348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.038987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.048218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.048725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.049305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.050219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.050866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.051437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.348079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.359883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.361333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.362741 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71b1a9e5-14be-4f63-b937-d99abe6c9ea0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.330618 Aug 29 15:35:45.363504 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1186/2272] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:45.369038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.369891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.377487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.378292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.379175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.380199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.380995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.381599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.552719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.553170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.563455 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-494097d8-7f31-4cb4-b744-c40e2120f00e tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1468 microversion: 2.1 time: 0.724629 Aug 29 15:35:45.564686 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1087/2273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1468 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:45.568023 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-817ca877-4783-4463-a00d-599e10968910 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.203294 Aug 29 15:35:45.569124 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1187/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:45.570185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.571032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.575688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.576447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.582831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.583347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.584299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.585023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.585505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.586619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.587077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.587802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.588566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.589648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.590361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.590985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.663485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.674927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.676449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.682136 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cdfdc17b-27ac-489d-9b0c-0058b8c75590 tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1444 microversion: 2.75 time: 0.111094 Aug 29 15:35:45.682735 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1188/2275] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:45.851152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.852170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.860218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.861419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.861983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.862721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.863448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.863879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.017754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.028374 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-696dad1c-29e1-45d7-9ed9-f4df7f87b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.182255 Aug 29 15:35:46.029497 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1189/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:46.077331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.087539 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-26144814-ef26-468c-972b-52a1c96b626e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1724 microversion: 2.1 time: 0.521301 Aug 29 15:35:46.088989 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1088/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:46.388138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:46.388586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:46.400306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.400865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.401521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.402439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.402836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.405867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.585867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:46.587326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:46.602532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.606155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.606866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.608049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.610044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.610673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.935953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.943073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:46.956107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.957645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.968663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ea5f710-ecf8-4368-9ca4-b3b38e7a63eb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.575961 Aug 29 15:35:46.969351 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1190/2278] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:46 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:46.974366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:46.975037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:47.011247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.011910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.012354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.013084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.013580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.014015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.070274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.080146 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4bb15ba-1efb-4c4c-bce8-9af3f019c95c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1468 microversion: 2.1 time: 0.499791 Aug 29 15:35:47.085007 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1089/2279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:46 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1468 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:47.100391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:47.101193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:47.118116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.118911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.119573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.120482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.121129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.121812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.193871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.197601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.198302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.199112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lazy-loading 'fault' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:47.327557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.336224 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8018eb44-0373-4b51-8110-1452be44b41d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.365675 Aug 29 15:35:47.336742 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1191/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:46 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:47.344606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:47.345008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:47.363107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.363711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.364275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.365927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.367017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.367679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.481832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.502584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.511381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.544794 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a0def434-340e-4f2e-96b3-b7d4215a157c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1449 microversion: 2.75 time: 0.458443 Aug 29 15:35:47.545560 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1090/2281] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:47 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1449 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:47.551651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:47.560499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:47.582034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.583580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.585786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.586910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.590883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.591437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.829237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.843600 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3d63573-1a03-4e4d-8d2d-785c992e2dc9 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.505693 Aug 29 15:35:47.844683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1192/2282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:47 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:47.873276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f542a42d-a260-4e77-b8db-c0cc93eeccbf req-47bebe22-9aab-4d92-8c50-d44d86ef655b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707dfc82-2388-462a-aefd-fb2a0a87d926", "name": "network-vif-plugged", "status": "completed", "tag": "970604c6-f807-482e-a06c-bb62fd75abd1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:47.914264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:47.948188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f542a42d-a260-4e77-b8db-c0cc93eeccbf req-47bebe22-9aab-4d92-8c50-d44d86ef655b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.949049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f542a42d-a260-4e77-b8db-c0cc93eeccbf req-47bebe22-9aab-4d92-8c50-d44d86ef655b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.949965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f542a42d-a260-4e77-b8db-c0cc93eeccbf req-47bebe22-9aab-4d92-8c50-d44d86ef655b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.978469 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f542a42d-a260-4e77-b8db-c0cc93eeccbf req-47bebe22-9aab-4d92-8c50-d44d86ef655b service nova] Creating event network-vif-plugged:970604c6-f807-482e-a06c-bb62fd75abd1 for instance 707dfc82-2388-462a-aefd-fb2a0a87d926 on n-h2-854882-3 Aug 29 15:35:47.984444 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f542a42d-a260-4e77-b8db-c0cc93eeccbf req-47bebe22-9aab-4d92-8c50-d44d86ef655b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138000 Aug 29 15:35:47.986631 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1193/2283] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:47.993426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5ee0f38f-6681-4d6e-b575-68c99e6bd3b3 req-1c95bbb8-31ac-470b-ab14-9d0ffd902af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff74d1c6-a399-41f7-a310-236875d7fb53", "name": "network-vif-deleted", "tag": "46016059-a1ff-46a2-b1bc-f801e570e627"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:48.004608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ee0f38f-6681-4d6e-b575-68c99e6bd3b3 req-1c95bbb8-31ac-470b-ab14-9d0ffd902af2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.006269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ee0f38f-6681-4d6e-b575-68c99e6bd3b3 req-1c95bbb8-31ac-470b-ab14-9d0ffd902af2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.006934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ee0f38f-6681-4d6e-b575-68c99e6bd3b3 req-1c95bbb8-31ac-470b-ab14-9d0ffd902af2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.008417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.018366 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ecbb294f-cc2e-4f38-a2f8-65552d1f965f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1724 microversion: 2.1 time: 0.469978 Aug 29 15:35:48.019160 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1091/2284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:47 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:48.020679 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5ee0f38f-6681-4d6e-b575-68c99e6bd3b3 req-1c95bbb8-31ac-470b-ab14-9d0ffd902af2 service nova] Creating event network-vif-deleted:46016059-a1ff-46a2-b1bc-f801e570e627 for instance ff74d1c6-a399-41f7-a310-236875d7fb53 on n-h1-854882-3 Aug 29 15:35:48.024672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:48.025522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.036353 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5ee0f38f-6681-4d6e-b575-68c99e6bd3b3 req-1c95bbb8-31ac-470b-ab14-9d0ffd902af2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047492 Aug 29 15:35:48.040878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1194/2285] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:48.048201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.048972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.049728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.051562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.052327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.052966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.116269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:48.117298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.128158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.131258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.132923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.139293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.139973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.141072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.182437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.183095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.184910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.185549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lazy-loading 'fault' on Instance uuid ff74d1c6-a399-41f7-a310-236875d7fb53 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:48.249225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.264131 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a5fa93b4-b8fb-42b5-9755-e0d4595942d1 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1303 microversion: 2.1 time: 0.151999 Aug 29 15:35:48.269078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1195/2286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:48 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1303 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:48.356928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.358927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:48.359539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.366498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.366998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.367443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.368825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.369292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.369754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.371042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.372943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.379154 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-619f04cf-21bb-4b2f-bafc-1381bb0027b1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.358766 Aug 29 15:35:48.391762 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1092/2287] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:48 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:48.582417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:48.583965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.606075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.607519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.607963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.608568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.612866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.613419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.613871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.645733 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e04598b-f138-4a3a-908d-9b006fc81df8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.289795 Aug 29 15:35:48.647355 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1196/2288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:48 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:48.875342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:48.876147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.886993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.892193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.897267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.898683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.899255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.899801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.977559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.978142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.978683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.980239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lazy-loading 'fault' on Instance uuid 2b76900e-b6fa-4b91-80fe-d56a4618994c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:49.071959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.111001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.116303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de7e02a3f8242ea85479c80821c0edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.127948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7dbd4ebe-574a-4d7b-8d3b-2376aea4d49c tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 200 len: 1449 microversion: 2.75 time: 0.551458 Aug 29 15:35:49.128591 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1093/2289] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:48 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 1449 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:49.134852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:49.135609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.145538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.146738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.147534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.148433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.149189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.149824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.185866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.196906 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-311027a7-777a-45f5-97a7-cd78ba586157 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.325109 Aug 29 15:35:49.212968 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1197/2290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:48 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:49.307577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:49.308325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.321404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.322626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.323140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.324132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.324815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.325310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.365118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.365698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.366222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.366884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lazy-loading 'fault' on Instance uuid ff74d1c6-a399-41f7-a310-236875d7fb53 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:49.384127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.438290 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f06bea93-28a1-41c0-a3bf-6f7eee206abc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1724 microversion: 2.1 time: 0.308136 Aug 29 15:35:49.439316 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1094/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:49 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:49.446819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:49.447839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.457561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.464134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.465476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.466033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.467294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.467977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.468535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.491382 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfcd9846-e201-4533-b8e2-366fb1e6aa24 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 200 len: 1303 microversion: 2.1 time: 0.183959 Aug 29 15:35:49.492888 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1198/2292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:49 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:49.669988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:49.670693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.677329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.682034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.682834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.686653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.688652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.689475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.991706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.992329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.007237 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-36e20766-a6f5-4547-8ea1-5bbfc6051bde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1315 microversion: 2.1 time: 0.341996 Aug 29 15:35:50.007882 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1199/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:49 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:50.008529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.014902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.016922 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-77e3c46c-c924-4d62-a598-12f1a1da4cc7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.575776 Aug 29 15:35:50.017662 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1095/2294] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:49 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:50.043923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-136bf5a2-13e1-4684-a624-bcc35adf030e req-e6f083ff-459f-4aa4-a9aa-ddc06b01efc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3", "name": "network-vif-plugged", "status": "completed", "tag": "02dee68c-2667-4e73-acf1-ba7832a2debc"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:50.056064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-136bf5a2-13e1-4684-a624-bcc35adf030e req-e6f083ff-459f-4aa4-a9aa-ddc06b01efc6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.056851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-136bf5a2-13e1-4684-a624-bcc35adf030e req-e6f083ff-459f-4aa4-a9aa-ddc06b01efc6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.058625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-136bf5a2-13e1-4684-a624-bcc35adf030e req-e6f083ff-459f-4aa4-a9aa-ddc06b01efc6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.079642 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-136bf5a2-13e1-4684-a624-bcc35adf030e req-e6f083ff-459f-4aa4-a9aa-ddc06b01efc6 service nova] Creating event network-vif-plugged:02dee68c-2667-4e73-acf1-ba7832a2debc for instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 on n-h1-854882-3 Aug 29 15:35:50.087559 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-136bf5a2-13e1-4684-a624-bcc35adf030e req-e6f083ff-459f-4aa4-a9aa-ddc06b01efc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047091 Aug 29 15:35:50.089533 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1200/2295] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:50.168038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.169048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] [instance: 2b76900e-b6fa-4b91-80fe-d56a4618994c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.194984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.203823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.206053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.206053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.206053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.206053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.222245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.222964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.234571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.235186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.235701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.236682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.237259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.237802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.242354 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] HTTP exception thrown: Instance 2b76900e-b6fa-4b91-80fe-d56a4618994c could not be found. Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Request method failure captured: Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c HTTP/1.1 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNx0yJsmquQ8lH222ReTmqnajK71Y-3YrnERhk0Cx7j0uArf_Ar4ComvQHG8EiQ5AI58VB_U-77LN3k949whT1FDSOiqzX-PuqyuQRSTnf41jyGG64RyEuAhvohRxdwaqRJk6CkDJPZgfVvc-lzhflz7sjrmXV6pDFl3xP5flO7S6f8 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.75 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 472ac27a5ec24dcbb2bacd4f2d2aed73 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersAdmin275Test-1606756533 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/472ac27a5ec24dcbb2bacd4f2d2aed73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/472ac27a5ec24dcbb2bacd4f2d2aed73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_472ac27a5ec24dcbb2bacd4f2d2aed73", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/472ac27a5ec24dcbb2bacd4f2d2aed73"}]}] Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersAdmin275Test-1606756533 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 472ac27a5ec24dcbb2bacd4f2d2aed73 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersAdmin275Test-1606756533 Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersAdmin275Test-1606756533-project Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 2de7e02a3f8242ea85479c80821c0edf Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersAdmin275Test-1606756533-project Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2b76900e-b6fa-4b91-80fe-d56a4618994c could not be found. Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2b76900e-b6fa-4b91-80fe-d56a4618994c'} Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b76900e-b6fa-4b91-80fe-d56a4618994c could not be found. Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b76900e-b6fa-4b91-80fe-d56a4618994c could not be found. Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:50.245630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.250399 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:50.250399 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:50.250399 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:50.250399 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:50.250399 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:50.250399 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b76900e-b6fa-4b91-80fe-d56a4618994c could not be found. Aug 29 15:35:50.250399 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.254073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] Returning 404 to user: Instance 2b76900e-b6fa-4b91-80fe-d56a4618994c could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:50.258827 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6167b3c2-aa35-4112-8cac-50dc149925ba tempest-ServersAdmin275Test-1606756533 tempest-ServersAdmin275Test-1606756533-project] 10.222.0.16 "GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c" status: 404 len: 111 microversion: 2.75 time: 0.106237 Aug 29 15:35:50.259771 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1096/2296] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/2b76900e-b6fa-4b91-80fe-d56a4618994c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:35:50.467630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.468704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.478838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.479336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.479782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.480509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.480968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.485930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.561266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.593154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce70c265-e01d-4b70-8d4a-2109aac45570 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.375941 Aug 29 15:35:50.595055 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1201/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:50.602132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.602915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: ff74d1c6-a399-41f7-a310-236875d7fb53] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.610514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.622281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.622989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.627183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.628019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.628623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.658885 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] HTTP exception thrown: Instance ff74d1c6-a399-41f7-a310-236875d7fb53 could not be found. Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Request method failure captured: Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 HTTP/1.1 Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNxFlejUIi2b5s3W51ZiEQ20sGfwkYPAFMLtRB2FaE7FkwUGgdkNEon_Tt3bFcCTbK6cmjDVJ036Jc26JubQgLpVjdkQXedPCd-OXbp_2aCjCfEYycynicqeboiny1XyDilLeNY5cOV9UJiMxHTmOYDrj11vsyfibfxVvY2uGK9U7oc Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: c785a2ff808848958fa8e54ac1db2fdb Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c785a2ff808848958fa8e54ac1db2fdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c785a2ff808848958fa8e54ac1db2fdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c785a2ff808848958fa8e54ac1db2fdb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c785a2ff808848958fa8e54ac1db2fdb"}]}] Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: c785a2ff808848958fa8e54ac1db2fdb Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminTestJSON-674895279-project Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a1ab26a46d314c97808cab66c3386ceb Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminTestJSON-674895279-project Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ff74d1c6-a399-41f7-a310-236875d7fb53 could not be found. Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ff74d1c6-a399-41f7-a310-236875d7fb53'} Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff74d1c6-a399-41f7-a310-236875d7fb53 could not be found. Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff74d1c6-a399-41f7-a310-236875d7fb53 could not be found. Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:50.662043 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.666443 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:50.666443 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:50.666443 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:50.666443 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:50.666443 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:50.666443 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff74d1c6-a399-41f7-a310-236875d7fb53 could not be found. Aug 29 15:35:50.666443 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:50.667737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Returning 404 to user: Instance ff74d1c6-a399-41f7-a310-236875d7fb53 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:50.668788 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7aeacd88-feca-4aea-ae3b-d6fa9f54c566 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53" status: 404 len: 111 microversion: 2.1 time: 0.071940 Aug 29 15:35:50.669986 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1202/2298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/ff74d1c6-a399-41f7-a310-236875d7fb53 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:50.679351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.680113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.687721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.688386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.689013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.690061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.690834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.691423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.741793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:50.857073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.875197 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a565c0c-da1f-4252-adbc-fb5487b86870 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1730 microversion: 2.1 time: 0.411787 Aug 29 15:35:50.875407 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1097/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1730 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:50.904040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.906130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.910304 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2cf2822b-ff77-4011-a8fb-87f7a75bfe15 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 204 len: 0 microversion: 2.1 time: 0.216937 Aug 29 15:35:50.912927 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1203/2300] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:50 2022] DELETE /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:50.923964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.924599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.925416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.926471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.927102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.927848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.928441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.930867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.947825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.956524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.957076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.957873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.958501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.958940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.072644 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f25d8c3c-e3a8-4ed5-b64f-fb5bd8bd0946 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179444 Aug 29 15:35:51.074373 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1098/2301] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:51.079545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.080538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.099931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.100749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.103408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.104857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.106731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.107955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.172093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.181589 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e3e3a5b1-384a-46e9-977f-55c67730442c tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1469 microversion: 2.1 time: 0.264345 Aug 29 15:35:51.183441 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1204/2302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:51.189495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.190348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.197368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.198264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.199040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.199972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.200538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.201199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.473653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.511844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.514883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.517610 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0891358b-9151-4035-9f24-b56f2a8df968 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.332745 Aug 29 15:35:51.522620 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1205/2303] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:51.532241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.541544 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8cfd881-d4b5-4bc5-ac08-c43202a01f03 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1502 microversion: 2.1 time: 0.465842 Aug 29 15:35:51.542719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1099/2304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1502 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:51.564045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.564832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.571736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.572233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.572805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.573612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.574336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.574846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.611395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:51.619635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.620628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.629710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.630606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.631820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.632852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.633507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.634117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.664160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:51.671671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:51.760453 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9807609-b60e-446a-b02c-ae61ca4a56b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 204 len: 0 microversion: 2.1 time: 0.200785 Aug 29 15:35:51.764704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1206/2305] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:51 2022] DELETE /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:51.771522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.772618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.781525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.782281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.782725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.783534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.784773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.785216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.980060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.990095 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-270fd375-6f43-4b84-84ac-72d89b1a7371 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1508 microversion: 2.1 time: 0.223499 Aug 29 15:35:51.990993 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1207/2306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:52.207170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:52.207802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:52.216937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.216937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.223904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.225405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.225930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.226372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.460363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.475377 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-46eb5611-9488-41e4-9999-fc13b8f9de42 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1332 microversion: 2.1 time: 0.859270 Aug 29 15:35:52.476435 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1100/2307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1332 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:52.549609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:52.550097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:52.557892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.558089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:52.560096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.561068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.561907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.563786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.564876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.565519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.570383 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1338d9b2-b0c1-48e3-9cdf-35e7c5e766b7 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1469 microversion: 2.1 time: 0.369512 Aug 29 15:35:52.573423 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1208/2308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:52 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1469 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:53.012684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:53.013479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:53.035021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.036284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.041998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.043738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.045212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.047588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.322627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.336753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.346626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.348028 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa2a3df5-b723-44a5-9396-e7066579d20c tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.805567 Aug 29 15:35:53.348619 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1101/2309] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:52 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:53.502755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:53.514035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:53.529147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.530005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.530654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.539968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.540886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.541534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.697496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.723930 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0dbacdf-9e0d-4481-b46e-7c67ed114b21 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1508 microversion: 2.1 time: 0.703945 Aug 29 15:35:53.742774 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1209/2310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:53 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1508 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:53.752795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:53.755129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:53.775860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.778203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.779059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.783163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.784932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.789500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.016968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.035107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-819e3f77-9c02-4657-b930-81f3abf604a0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 200 len: 1427 microversion: 2.1 time: 0.290813 Aug 29 15:35:54.045674 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1210/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:53 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 1427 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:54.045674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7083d90d-1a22-49f5-b5a6-3578cf2e165b req-757052d5-c0d7-4311-95ec-1190026a0388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6cdabb1-fbba-4bb6-b842-9997c68ae2c7", "name": "network-vif-deleted", "tag": "a0f0fda4-49b1-44d3-98b3-efea4f996472"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:54.075453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7083d90d-1a22-49f5-b5a6-3578cf2e165b req-757052d5-c0d7-4311-95ec-1190026a0388 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.075948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7083d90d-1a22-49f5-b5a6-3578cf2e165b req-757052d5-c0d7-4311-95ec-1190026a0388 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.076616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7083d90d-1a22-49f5-b5a6-3578cf2e165b req-757052d5-c0d7-4311-95ec-1190026a0388 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.095025 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7083d90d-1a22-49f5-b5a6-3578cf2e165b req-757052d5-c0d7-4311-95ec-1190026a0388 service nova] Creating event network-vif-deleted:a0f0fda4-49b1-44d3-98b3-efea4f996472 for instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 on n-h1-854882-3 Aug 29 15:35:54.121903 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7083d90d-1a22-49f5-b5a6-3578cf2e165b req-757052d5-c0d7-4311-95ec-1190026a0388 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079996 Aug 29 15:35:54.122850 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1211/2312] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:54.529096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-32b8f1c8-187d-454e-a9c2-b7473fea12d7 tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] Calling method '.version_select at 0x7fb0e3d72160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:54.586508 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-32b8f1c8-187d-454e-a9c2-b7473fea12d7 tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.264482 Aug 29 15:35:54.590367 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1212/2313] 10.222.0.16 () {60 vars in 1226 bytes} [Mon Aug 29 15:35:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:35:54.635223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:54.640111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:54.661869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.667721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.668255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.668797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.673342 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29a8e35e-0b2e-49dc-a455-1c414ab7ac0a tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1535 microversion: 2.1 time: 1.178235 Aug 29 15:35:54.674501 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1102/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:53 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1535 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:54.681377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.682197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.684390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.691433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57526cdc-f415-4edd-9252-e483185c8de1 tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] Action: 'update', calling method: .version_select at 0x7fb0eb55f160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:54.978566 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57526cdc-f415-4edd-9252-e483185c8de1 tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.302850 Aug 29 15:35:54.979817 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1103/2315] 10.222.0.16 () {62 vars in 1247 bytes} [Mon Aug 29 15:35:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:35:54.984944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c1a0b39-9c6e-4e75-b598-fd635b7b89e8 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'create', calling method: .version_select at 0x7fb0e30d4790>, body: {"pool": "cf6ce835-de3e-45d5-8a65-f02532b22898"} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:54.987853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.005412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.008862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.011140 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f84c02bd-2d3c-4015-8b1c-c3c426675a52 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.419181 Aug 29 15:35:55.025458 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1213/2316] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:54 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:55.031550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-17023974-56e0-4393-8149-a5269c2ea2ad req-8ae6a9a2-6682-41f8-b1dc-e630a21ffff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647883af-6f80-4e9c-8f48-d0e4ba4edef3", "tag": "5010f83a-6966-4d44-9e92-309b22d9c084"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:55.062880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-17023974-56e0-4393-8149-a5269c2ea2ad req-8ae6a9a2-6682-41f8-b1dc-e630a21ffff2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.067023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-17023974-56e0-4393-8149-a5269c2ea2ad req-8ae6a9a2-6682-41f8-b1dc-e630a21ffff2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.067904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-17023974-56e0-4393-8149-a5269c2ea2ad req-8ae6a9a2-6682-41f8-b1dc-e630a21ffff2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.092304 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-17023974-56e0-4393-8149-a5269c2ea2ad req-8ae6a9a2-6682-41f8-b1dc-e630a21ffff2 service nova] Creating event network-changed:5010f83a-6966-4d44-9e92-309b22d9c084 for instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 on n-h1-854882-3 Aug 29 15:35:55.098181 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-17023974-56e0-4393-8149-a5269c2ea2ad req-8ae6a9a2-6682-41f8-b1dc-e630a21ffff2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076831 Aug 29 15:35:55.099828 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1214/2317] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:55.106377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.107513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.115736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.116584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.117236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.118241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.119083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.119800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.259494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.281419 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d50d7b79-41cd-4f92-b9f3-ca5ff8043536 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 200 len: 1466 microversion: 2.1 time: 0.173307 Aug 29 15:35:55.283028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1215/2318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 1466 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:55.291851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b873392-efd1-4b7b-85e3-38e5900e889e tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] Calling method '.version_select at 0x7fb0eb6f83a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.351911 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b873392-efd1-4b7b-85e3-38e5900e889e tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.065619 Aug 29 15:35:55.363156 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1216/2319] 10.222.0.16 () {60 vars in 1226 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:35:55.377080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.378262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: e6cdabb1-fbba-4bb6-b842-9997c68ae2c7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.395914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.397335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.398110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.399101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.399780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.400507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.421841 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] HTTP exception thrown: Instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 could not be found. Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Request method failure captured: Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 HTTP/1.1 Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNxFlejUIi2b5s3W51ZiEQ20sGfwkYPAFMLtRB2FaE7FkwUGgdkNEon_Tt3bFcCTbK6cmjDVJ036Jc26JubQgLpVjdkQXedPCd-OXbp_2aCjCfEYycynicqeboiny1XyDilLeNY5cOV9UJiMxHTmOYDrj11vsyfibfxVvY2uGK9U7oc Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: c785a2ff808848958fa8e54ac1db2fdb Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c785a2ff808848958fa8e54ac1db2fdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c785a2ff808848958fa8e54ac1db2fdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c785a2ff808848958fa8e54ac1db2fdb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c785a2ff808848958fa8e54ac1db2fdb"}]}] Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: c785a2ff808848958fa8e54ac1db2fdb Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminTestJSON-674895279-project Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a1ab26a46d314c97808cab66c3386ceb Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminTestJSON-674895279-project Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 could not be found. Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'e6cdabb1-fbba-4bb6-b842-9997c68ae2c7'} Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 could not be found. Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 could not be found. Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:55.425002 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:55.428727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:55.428727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:55.428727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:55.428727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:55.428727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:55.428727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 could not be found. Aug 29 15:35:55.428727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:55.430990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Returning 404 to user: Instance e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:55.432105 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f08c8d06-3f13-4a99-92d2-23d7f60b8bd0 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7" status: 404 len: 111 microversion: 2.1 time: 0.067673 Aug 29 15:35:55.433760 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1217/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/servers/e6cdabb1-fbba-4bb6-b842-9997c68ae2c7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:55.441352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1914ecab-df58-44bb-9a3d-08179e7cc5ed tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] Action: 'update', calling method: .version_select at 0x7fb0eb6aadc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:55.578137 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1914ecab-df58-44bb-9a3d-08179e7cc5ed tempest-QuotaClassesAdmin257Test-1481721126 tempest-QuotaClassesAdmin257Test-1481721126-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.142631 Aug 29 15:35:55.586531 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1218/2321] 10.222.0.16 () {62 vars in 1247 bytes} [Mon Aug 29 15:35:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:35:55.602877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.603414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.617515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.618016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.622153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.623087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.623579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.624025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.675045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:55.846066 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-335d3302-9e4b-40fd-a796-91f4bf58fce5 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "DELETE /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 204 len: 0 microversion: 2.1 time: 0.264246 Aug 29 15:35:55.850911 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1219/2322] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:55 2022] DELETE /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:55.875499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.876246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.884878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.885667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.886263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.887192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.887810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.888380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.127547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:56.145369 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d0080c9f-4bf9-4665-9e51-8d85b7520178 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1468 microversion: 2.1 time: 0.285850 Aug 29 15:35:56.147034 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1220/2323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:56.160202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:56.163817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:56.182638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.183773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.186809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.188005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.194134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.194731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.567555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:56.579283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:56.580733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:56.583144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cc6b0fbf-f74c-4464-a9c6-b06a3a722032 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.432339 Aug 29 15:35:56.588243 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1221/2324] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:56 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:56.596686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:56.597309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:56.607623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.608129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.608570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.609296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.609790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.610215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.647842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 HTTP/1.1 Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '707dfc82-2388-462a-aefd-fb2a0a87d926'} Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:56.656408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:56.661500 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40ef583e-ab55-472c-b7bc-d8c1932493cb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 404 len: 111 microversion: 2.1 time: 0.069725 Aug 29 15:35:56.678331 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1222/2325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:56 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:56.845272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1565623703", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:57.367324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] validate_networks() for [('f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:57.502676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2c1a0b39-9c6e-4e75-b598-fd635b7b89e8 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.521087 Aug 29 15:35:57.503968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1104/2326] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:35:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:57.511978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c43846a9-575c-4fe5-89f9-a774fa4e126c req-6ee204c3-5b85-4b0b-a13e-69a241146764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647883af-6f80-4e9c-8f48-d0e4ba4edef3", "tag": "5010f83a-6966-4d44-9e92-309b22d9c084"}, {"server_uuid": "707dfc82-2388-462a-aefd-fb2a0a87d926", "name": "network-vif-deleted", "tag": "970604c6-f807-482e-a06c-bb62fd75abd1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:57.539569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c43846a9-575c-4fe5-89f9-a774fa4e126c req-6ee204c3-5b85-4b0b-a13e-69a241146764 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:57.540061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c43846a9-575c-4fe5-89f9-a774fa4e126c req-6ee204c3-5b85-4b0b-a13e-69a241146764 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:57.540494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c43846a9-575c-4fe5-89f9-a774fa4e126c req-6ee204c3-5b85-4b0b-a13e-69a241146764 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:57.557104 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c43846a9-575c-4fe5-89f9-a774fa4e126c req-6ee204c3-5b85-4b0b-a13e-69a241146764 service nova] Creating event network-changed:5010f83a-6966-4d44-9e92-309b22d9c084 for instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 on n-h1-854882-3 Aug 29 15:35:57.557878 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c43846a9-575c-4fe5-89f9-a774fa4e126c req-6ee204c3-5b85-4b0b-a13e-69a241146764 service nova] Creating event network-vif-deleted:970604c6-f807-482e-a06c-bb62fd75abd1 for instance 707dfc82-2388-462a-aefd-fb2a0a87d926 on n-h2-854882-3 Aug 29 15:35:57.568620 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c43846a9-575c-4fe5-89f9-a774fa4e126c req-6ee204c3-5b85-4b0b-a13e-69a241146764 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060663 Aug 29 15:35:57.570290 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1105/2327] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:57.584675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:57.586628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:57.596809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:57.597738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:57.598361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:57.599324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:57.599946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:57.600720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:57.882918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ab26a46d314c97808cab66c3386ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c785a2ff808848958fa8e54ac1db2fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:57.892231 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0929dacc-6ed8-4e32-a8ea-47e532d32853 tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 200 len: 1468 microversion: 2.1 time: 0.315085 Aug 29 15:35:57.893653 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1106/2328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:57 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:58.245268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-671773785", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:58.341873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:58.380154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:58.381122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:58.381789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:58.382385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:58.382955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:58.400684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.406082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.406799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.407804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.408465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.409063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.436553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=10 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:58.447626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:58.456794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for user 065c5a92f9c04400be8a515e8233fb0d and project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:58.473404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:58.477647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:58.573109 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe036858-ae2c-4d9b-a2f6-d91a2ecbc8a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731544 Aug 29 15:35:58.585758 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1223/2329] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:35:58.598535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.72"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:58.603085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:58.616347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.619941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.620745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.622085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.623216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.624048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.669571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:35:58.670785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquired lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:35:58.838035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:58.840452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:58.841161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:58.842680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:58.843224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:58.868556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.869280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.870733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.871744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.872777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.873357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.914503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:58.940689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:58.973149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:58.980183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:59.109766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-47b5d12f-2f4b-4bac-a934-8466ba8890ec tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212790 Aug 29 15:35:59.111137 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1107/2330] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:59.147109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:59.148246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:59.166407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.167224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.169376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.171519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.173010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.173010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.471677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.525206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.527785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.529775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08ba05fb-21ca-4e38-a8ca-0f2cdfb448e3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.392560 Aug 29 15:35:59.534521 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1108/2331] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:59 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:59.562722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:59.563810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:59.588531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.589092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.589830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.591501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.592618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.593501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.765304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.779481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd20d08b-ec8e-4e9e-b07c-0986f97bf3dd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1219 microversion: 2.1 time: 0.242973 Aug 29 15:35:59.780584 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1109/2332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:59 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1219 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:59.792520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-138a249f-e2aa-4682-a9e2-b68f355e6c2c req-7f9ae2b9-1051-4471-938d-53fbe54fe2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-plugged", "status": "completed", "tag": "d0f1fece-2d8a-470c-beed-2ff768e1d636"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:59.821874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-138a249f-e2aa-4682-a9e2-b68f355e6c2c req-7f9ae2b9-1051-4471-938d-53fbe54fe2a2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.823082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-138a249f-e2aa-4682-a9e2-b68f355e6c2c req-7f9ae2b9-1051-4471-938d-53fbe54fe2a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.824718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-138a249f-e2aa-4682-a9e2-b68f355e6c2c req-7f9ae2b9-1051-4471-938d-53fbe54fe2a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.852382 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-138a249f-e2aa-4682-a9e2-b68f355e6c2c req-7f9ae2b9-1051-4471-938d-53fbe54fe2a2 service nova] Creating event network-vif-plugged:d0f1fece-2d8a-470c-beed-2ff768e1d636 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:35:59.860092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-138a249f-e2aa-4682-a9e2-b68f355e6c2c req-7f9ae2b9-1051-4471-938d-53fbe54fe2a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077471 Aug 29 15:35:59.861755 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1110/2333] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:59.869873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:59.870858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] [instance: 190b045a-6f51-4011-950e-5ca4150a647b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:59.880622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.881115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.881829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.883797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.885069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.885776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.911700 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] HTTP exception thrown: Instance 190b045a-6f51-4011-950e-5ca4150a647b could not be found. Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Request method failure captured: Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b HTTP/1.1 Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNxFlejUIi2b5s3W51ZiEQ20sGfwkYPAFMLtRB2FaE7FkwUGgdkNEon_Tt3bFcCTbK6cmjDVJ036Jc26JubQgLpVjdkQXedPCd-OXbp_2aCjCfEYycynicqeboiny1XyDilLeNY5cOV9UJiMxHTmOYDrj11vsyfibfxVvY2uGK9U7oc Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c785a2ff808848958fa8e54ac1db2fdb Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c785a2ff808848958fa8e54ac1db2fdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c785a2ff808848958fa8e54ac1db2fdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c785a2ff808848958fa8e54ac1db2fdb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c785a2ff808848958fa8e54ac1db2fdb"}]}] Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c785a2ff808848958fa8e54ac1db2fdb Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersAdminTestJSON-674895279 Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersAdminTestJSON-674895279-project Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a1ab26a46d314c97808cab66c3386ceb Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersAdminTestJSON-674895279-project Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 190b045a-6f51-4011-950e-5ca4150a647b could not be found. Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '190b045a-6f51-4011-950e-5ca4150a647b'} Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 190b045a-6f51-4011-950e-5ca4150a647b could not be found. Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 190b045a-6f51-4011-950e-5ca4150a647b could not be found. Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:59.913993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 190b045a-6f51-4011-950e-5ca4150a647b could not be found. Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] Returning 404 to user: Instance 190b045a-6f51-4011-950e-5ca4150a647b could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:59.922027 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d2d0e95-3308-487e-9f8d-4be876b12bcb tempest-ServersAdminTestJSON-674895279 tempest-ServersAdminTestJSON-674895279-project] 10.222.0.16 "GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b" status: 404 len: 111 microversion: 2.1 time: 0.052990 Aug 29 15:35:59.923177 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1111/2334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:59 2022] GET /compute/v2.1/servers/190b045a-6f51-4011-950e-5ca4150a647b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:59.928775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-179572e4-2350-42ea-ba49-4fb2dc134e5d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:59.930626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-179572e4-2350-42ea-ba49-4fb2dc134e5d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:00.023763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-179572e4-2350-42ea-ba49-4fb2dc134e5d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.038932 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-179572e4-2350-42ea-ba49-4fb2dc134e5d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1216 microversion: 2.1 time: 0.114246 Aug 29 15:36:00.043000 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1112/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:59 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:00.057809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bd82c965-4f7e-48a7-8f87-0b3eb84016ca req-f7364566-9750-4f0f-bd75-13556e1bc933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190b045a-6f51-4011-950e-5ca4150a647b", "name": "network-vif-deleted", "tag": "271365e6-dc68-453b-9b42-c69b0118f270"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:00.077969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bd82c965-4f7e-48a7-8f87-0b3eb84016ca req-f7364566-9750-4f0f-bd75-13556e1bc933 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.081674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bd82c965-4f7e-48a7-8f87-0b3eb84016ca req-f7364566-9750-4f0f-bd75-13556e1bc933 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.082030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bd82c965-4f7e-48a7-8f87-0b3eb84016ca req-f7364566-9750-4f0f-bd75-13556e1bc933 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.116692 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bd82c965-4f7e-48a7-8f87-0b3eb84016ca req-f7364566-9750-4f0f-bd75-13556e1bc933 service nova] Creating event network-vif-deleted:271365e6-dc68-453b-9b42-c69b0118f270 for instance 190b045a-6f51-4011-950e-5ca4150a647b on n-h1-854882-3 Aug 29 15:36:00.124039 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bd82c965-4f7e-48a7-8f87-0b3eb84016ca req-f7364566-9750-4f0f-bd75-13556e1bc933 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078947 Aug 29 15:36:00.128115 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1113/2336] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:00.564528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:00.565246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:00.578684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.579247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.580946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.581904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.582676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.583259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.786237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Building network info cache for instance {{(pid=130002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:36:00.888858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.906054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.908333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.909966 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab650119-fda7-4503-85e8-a149093a6298 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.351397 Aug 29 15:36:00.929533 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1114/2337] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:00 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:00.947224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:00.948280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:00.967708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.970528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.973017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.975737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.983120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.996101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.184553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:01.195001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f561d9b-c7bc-480a-bdf2-a9ad7a115a9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1275 microversion: 2.1 time: 0.263080 Aug 29 15:36:01.214686 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1115/2338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:00 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:01.228614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1ecfd632-6f20-4ad4-96e2-e78b4a4d94e3 req-3c23789c-b98e-4a5d-a391-be67bda26ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3", "tag": "02dee68c-2667-4e73-acf1-ba7832a2debc"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:01.248497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1ecfd632-6f20-4ad4-96e2-e78b4a4d94e3 req-3c23789c-b98e-4a5d-a391-be67bda26ecc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.248996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1ecfd632-6f20-4ad4-96e2-e78b4a4d94e3 req-3c23789c-b98e-4a5d-a391-be67bda26ecc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.249493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1ecfd632-6f20-4ad4-96e2-e78b4a4d94e3 req-3c23789c-b98e-4a5d-a391-be67bda26ecc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.291493 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1ecfd632-6f20-4ad4-96e2-e78b4a4d94e3 req-3c23789c-b98e-4a5d-a391-be67bda26ecc service nova] Creating event network-changed:02dee68c-2667-4e73-acf1-ba7832a2debc for instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 on n-h1-854882-3 Aug 29 15:36:01.298837 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1ecfd632-6f20-4ad4-96e2-e78b4a4d94e3 req-3c23789c-b98e-4a5d-a391-be67bda26ecc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082666 Aug 29 15:36:01.301648 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1116/2339] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:01.309174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:01.317325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:01.330882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.331394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.332742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.344478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.345638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.345938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.423300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:01.434891 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e454486c-d352-4cfe-a329-e34dbd3e453b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1268 microversion: 2.1 time: 0.133150 Aug 29 15:36:01.449523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1117/2340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:01 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:01.967587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:01.971585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:01.998260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.999120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.000169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.008485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.009503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.021875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.439484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.452006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.453890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.455336 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59d6f8dc-be8f-4919-a003-96a6b67f5ea1 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.498750 Aug 29 15:36:02.470255 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1118/2341] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:01 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:02.479963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-plugged", "status": "completed", "tag": "09a9e65a-b239-4c6f-9543-78a3c4be399a"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-plugged", "status": "completed", "tag": "f0a6706f-723c-4dd5-84bd-8f5e99f29ba3"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-plugged", "status": "completed", "tag": "57038e85-109c-491a-b297-19b2ca678e6c"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-plugged", "status": "completed", "tag": "c803e1ce-a2da-489e-8ede-123c5aefbdb5"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:02.488069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Updating instance_info_cache with network_info: [{"id": "02dee68c-2667-4e73-acf1-ba7832a2debc", "address": "fa:16:3e:88:92:fe", "network": {"id": "233c726f-bcd9-46a9-a17b-52ab8ae450d1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-636988525-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef312cb51a84470d8c0d38c9c2a65b79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02dee68c-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:36:02.494260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.495390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.496207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.506495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Releasing lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:36:02.508158 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2594f9b-03ef-4c22-8bb4-584eefeabc4b tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action" status: 202 len: 0 microversion: 2.1 time: 3.921140 Aug 29 15:36:02.509146 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1224/2342] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:58 2022] POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action => generated 0 bytes in 3923 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:36:02.522349 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Creating event network-vif-plugged:09a9e65a-b239-4c6f-9543-78a3c4be399a for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:36:02.523030 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Creating event network-vif-plugged:f0a6706f-723c-4dd5-84bd-8f5e99f29ba3 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:36:02.523608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Creating event network-vif-plugged:57038e85-109c-491a-b297-19b2ca678e6c for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:36:02.524353 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] Creating event network-vif-plugged:c803e1ce-a2da-489e-8ede-123c5aefbdb5 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:36:02.525898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:02.528048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:02.532957 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8bdab6e3-44bd-4d1b-bc1d-9d87adcbac26 req-4b1be8bf-9765-4a7a-aa8e-9fff5a0835ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.059845 Aug 29 15:36:02.533834 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1119/2343] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:02.543677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.544267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.544788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.559092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.559897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.562699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.733029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7f799d09-6412-424e-8496-92033ecdbc02 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Calling method '.version_select at 0x7fb0e359d0d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:02.754526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.783259 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac685810-ebce-48e1-b6ef-cae3c15d7dc8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1273 microversion: 2.1 time: 0.270559 Aug 29 15:36:02.798367 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1225/2344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:02 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:02.815794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:02.817863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:02.828756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.829610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.830663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.832865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.833795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.834679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.866367 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7f799d09-6412-424e-8496-92033ecdbc02 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f" status: 200 len: 371 microversion: 2.1 time: 0.325899 Aug 29 15:36:02.867220 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1120/2345] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:02 2022] GET /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f => generated 371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:02.871105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:02.872574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bab7caf4-3a63-47b2-a328-eef5721bbcce tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'create', calling method: .version_select at 0x7fb0eb5a6dc0>, body: {"pool": "cf6ce835-de3e-45d5-8a65-f02532b22898"} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:02.993621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:03.009178 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-68cf7d41-9639-4d6f-8487-3a62772e9523 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1274 microversion: 2.1 time: 0.207584 Aug 29 15:36:03.028648 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1226/2346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:02 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:03.054201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e2f92700>, body: {"quota_set": {"ram": "5120"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:03.190098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.190424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.190931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.191691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.192397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.193745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.268702 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3584303-2d19-40be-a857-bd7e16b0f57d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f" status: 200 len: 328 microversion: 2.1 time: 0.238766 Aug 29 15:36:03.275799 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1227/2347] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:03 2022] PUT /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f => generated 328 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:03.286431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8922eda6-b5f4-4cb2-8e94-d149aed74d6e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:03.301454 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8922eda6-b5f4-4cb2-8e94-d149aed74d6e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f" status: 202 len: 0 microversion: 2.1 time: 0.023797 Aug 29 15:36:03.306712 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1228/2348] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:36:03 2022] DELETE /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:03.314831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d6af3de-5482-47dc-8385-8dca057cd4da tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Calling method '.version_select at 0x7fb0e2f929d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:03.706296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d6af3de-5482-47dc-8385-8dca057cd4da tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f" status: 200 len: 371 microversion: 2.1 time: 0.397145 Aug 29 15:36:03.707893 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1229/2349] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:03 2022] GET /compute/v2.1/os-quota-sets/f6f8e260178e44bdb1994f3f558bbb8f => generated 371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:03.722949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:03.723804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:03.733010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.733881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.734865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.736060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.736767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.737486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.067518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.090516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.092176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.100424 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8b5e446-14a7-40a7-a90e-630493f479a8 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.375802 Aug 29 15:36:04.102668 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1230/2350] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:03 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:04.113869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:04.119811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:04.134994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.135824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.136470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.137502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.138182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.139101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.375350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.387062 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0fcf08d9-6688-441c-9328-ed56e3b607e8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.281580 Aug 29 15:36:04.388099 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1231/2351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:04 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:04.407100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63ac9338-988a-454b-b42c-514a99446ef2 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Calling method '.version_select at 0x7fb0e362c430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:04.734045 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63ac9338-988a-454b-b42c-514a99446ef2 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.344669 Aug 29 15:36:04.746671 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1232/2352] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:36:04 2022] GET /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c/defaults => generated 371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:04.752339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:04.753491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:04.762262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.762968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.763612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.764711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.765540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.765979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.027445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.041802 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18746e8d-85d8-42d5-be49-46efd0359363 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.293127 Aug 29 15:36:05.058826 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1233/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:04 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:05.064114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4d755a77-8653-4bc0-8643-51c07ec89838 req-1cb713fa-84ff-4a69-826a-66c7405f445f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-plugged", "status": "completed", "tag": "7e6e0494-afe5-4c77-abff-4dbe391df468"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-plugged", "status": "completed", "tag": "a0716183-eb1a-4c5d-8847-69ba90609326"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:05.082749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d755a77-8653-4bc0-8643-51c07ec89838 req-1cb713fa-84ff-4a69-826a-66c7405f445f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.082749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d755a77-8653-4bc0-8643-51c07ec89838 req-1cb713fa-84ff-4a69-826a-66c7405f445f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.083132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d755a77-8653-4bc0-8643-51c07ec89838 req-1cb713fa-84ff-4a69-826a-66c7405f445f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.103367 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4d755a77-8653-4bc0-8643-51c07ec89838 req-1cb713fa-84ff-4a69-826a-66c7405f445f service nova] Creating event network-vif-plugged:7e6e0494-afe5-4c77-abff-4dbe391df468 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:36:05.103950 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4d755a77-8653-4bc0-8643-51c07ec89838 req-1cb713fa-84ff-4a69-826a-66c7405f445f service nova] Creating event network-vif-plugged:a0716183-eb1a-4c5d-8847-69ba90609326 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:36:05.111434 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4d755a77-8653-4bc0-8643-51c07ec89838 req-1cb713fa-84ff-4a69-826a-66c7405f445f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050577 Aug 29 15:36:05.112991 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1234/2354] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:05.130565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:05.131715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:05.159904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.164737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.168155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.172765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.174685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.175505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.578416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.590135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.591801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.593506 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef453142-8df2-4933-9db3-ebfbb37f57ba tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1879 microversion: 2.42 time: 0.467177 Aug 29 15:36:05.594518 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1235/2355] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:05 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1879 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:05.599946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Action: 'update', calling method: .version_select at 0x7fb0eb6f8310>, body: {"quota_set": {"ram": "5120"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:05.936775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.937449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.937776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.938847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.939568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.940251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.999608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-343b31f2-d8e4-4c92-a2dd-b289eae935c7 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9" status: 200 len: 328 microversion: 2.1 time: 0.403915 Aug 29 15:36:06.007017 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1236/2356] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:05 2022] PUT /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9 => generated 328 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:06.010748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:06.012047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:06.022563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.023171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.023509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.024232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.024688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.025118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.179622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:06.190585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14f3bd98-b96d-4134-8811-7889c133e9ee tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.187997 Aug 29 15:36:06.198736 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1237/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:06 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:06.203992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Calling method '.version_select at 0x7fb0e3ab93a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:06.452815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.453302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.453780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.454549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.455010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.455436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.475998 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52fb2949-c083-4970-8e84-976778f0ae64 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9/detail" status: 200 len: 916 microversion: 2.1 time: 0.276129 Aug 29 15:36:06.481605 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1238/2358] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:36:06 2022] GET /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9/detail => generated 916 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:06.481605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:06.481980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:06.494013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.494613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.495159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.495984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.496680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.497284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.704218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:06.713255 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d1a6a47d-a2f0-4c05-b138-cb17fb489998 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.235445 Aug 29 15:36:06.713950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1239/2359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:06 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:06.772657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-589095500", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:06.828047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:06.978157 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bab7caf4-3a63-47b2-a328-eef5721bbcce tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.109434 Aug 29 15:36:06.980666 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1121/2360] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:36:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:06.993704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-cf71b493-28fc-4051-b00f-9d61e37cd331 req-8236b8ec-0c24-4e26-adba-240ace2d1ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4e2cb7-3b60-47c9-a99a-c7bc0a907044", "tag": "b6a43967-16dd-4818-912f-165563c17a28"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:07.043851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cf71b493-28fc-4051-b00f-9d61e37cd331 req-8236b8ec-0c24-4e26-adba-240ace2d1ffa service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.044355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cf71b493-28fc-4051-b00f-9d61e37cd331 req-8236b8ec-0c24-4e26-adba-240ace2d1ffa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.044795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cf71b493-28fc-4051-b00f-9d61e37cd331 req-8236b8ec-0c24-4e26-adba-240ace2d1ffa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.065851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-cf71b493-28fc-4051-b00f-9d61e37cd331 req-8236b8ec-0c24-4e26-adba-240ace2d1ffa service nova] Creating event network-changed:b6a43967-16dd-4818-912f-165563c17a28 for instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 on n-h2-854882-3 Aug 29 15:36:07.073697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:07.074870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:07.075672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:07.076302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:07.077027 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-cf71b493-28fc-4051-b00f-9d61e37cd331 req-8236b8ec-0c24-4e26-adba-240ace2d1ffa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093741 Aug 29 15:36:07.077195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:07.078402 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1122/2361] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:07.089640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.089839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:07.090323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.090942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.091324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:07.091846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.092611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.093138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.101275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.101839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.102835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.103564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.104257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.105280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.112365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Getting quotas for project f64f2469ff0345d680db3cae9444d749. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:07.119727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Getting quotas for user 6b448f96ae8b4a6698169ff4ef319ae2 and project f64f2469ff0345d680db3cae9444d749. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:07.136251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:07.138812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:07.187765 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a178083-c343-4507-b9fc-613fb06991c3 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.472682 Aug 29 15:36:07.188480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1240/2362] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:36:07.194986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e2f920d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:07.284061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.284534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.284979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.290777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.291398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.291859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.334005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:07.344553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.345177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.345666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.346988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.347769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.348226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.426858 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-43164672-e07c-49ee-92a3-401ec98b029d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9?user_id=48848d15097b4fac9cc0ca7e110c43ca" status: 200 len: 328 microversion: 2.1 time: 0.237283 Aug 29 15:36:07.429250 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1241/2363] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:36:07 2022] PUT /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9?user_id=48848d15097b4fac9cc0ca7e110c43ca => generated 328 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:07.436194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.144"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:07.439083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:07.449159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.449735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.450227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.451010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.451526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.451953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.496799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:36:07.497253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquired lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:36:07.971106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:07.983774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:07.986073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:07.987681 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5e4b8667-9cfd-4e59-bcfe-269d18fcdcab tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2836 microversion: 2.42 time: 0.907350 Aug 29 15:36:07.989013 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1123/2364] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2836 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:08.004755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.006275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:08.014778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.015510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.015919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898.", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:36:08.016398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.016569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Releasing lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:36:08.017299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898. Aug 29 15:36:08.017299 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-a2baee5f-6c4a-4b6b-89ba-348d49467038'] Aug 29 15:36:08.017999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.018879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.019693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Request method failure captured: Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action HTTP/1.1 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 46 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzAowLRZu7i9uGq2M0yBiZXgYE1ve5M0yIx-H3NvrKz8iwJBvxZeeIse3byBvg3CQcSA4FmN0qk7Zh3F3SRZJZ4zzYjrKhM8P9Y6n6QBquruwMG95EJdgzN-0Tk6i5oJqoWQIMUTUTIwUfjRSHfBdiRDZBjmYDM03O4rHgCDXamlQA Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef312cb51a84470d8c0d38c9c2a65b79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}] Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d844cb81667346a6aaf07c288c6918be Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: {"addFloatingIp": {"address": "172.25.1.144"}} Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898. Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-a2baee5f-6c4a-4b6b-89ba-348d49467038'] Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3', 'body': {'addFloatingIp': {'address': '172.25.1.144'}}} Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:36:08.020561 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898. Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2baee5f-6c4a-4b6b-89ba-348d49467038'] Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898. Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2baee5f-6c4a-4b6b-89ba-348d49467038'] Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898. Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2baee5f-6c4a-4b6b-89ba-348d49467038'] Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898. Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2baee5f-6c4a-4b6b-89ba-348d49467038'] Aug 29 15:36:08.025669 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:08.031115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Returning 400 to user: Cannot associate floating IP 172.25.1.144 (acd4f660-ef8b-46d1-a23e-70c55c17d194) with port 02dee68c-2667-4e73-acf1-ba7832a2debc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network cf6ce835-de3e-45d5-8a65-f02532b22898. Aug 29 15:36:08.031115 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-a2baee5f-6c4a-4b6b-89ba-348d49467038'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:08.031115 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-011a0ab4-8b7a-458b-b246-c86ceac24bf3 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action" status: 400 len: 381 microversion: 2.1 time: 0.591626 Aug 29 15:36:08.031115 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1242/2365] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:07 2022] POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action => generated 381 bytes in 597 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:36:08.035069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.035777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:08.044065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.044620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.045222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.046059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.046527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.047060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.131283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.145120 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e46bfbf-d4ef-4f01-bdd3-7d9f36c23f97 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1209 microversion: 2.1 time: 0.153558 Aug 29 15:36:08.145752 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1124/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:08.152908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3959ef3e-4b12-4632-ab76-b0f658ee077d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Calling method '.version_select at 0x7fb0e359da60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.230953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.240852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92259ea7-db05-42c2-9b45-af55837b76f0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.210888 Aug 29 15:36:08.242069 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1243/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:08.247972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.248775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:08.255922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.256460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.256898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.257747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.258550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.259236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.264140 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3959ef3e-4b12-4632-ab76-b0f658ee077d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9?user_id=48848d15097b4fac9cc0ca7e110c43ca" status: 200 len: 370 microversion: 2.1 time: 0.116915 Aug 29 15:36:08.264777 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1125/2368] 10.222.0.16 () {58 vars in 1323 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/os-quota-sets/39761f1cdb904e5fa8d0cfb8616a2ab9?user_id=48848d15097b4fac9cc0ca7e110c43ca => generated 370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:08.269562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.270130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:08.277233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.277843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.278318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.279136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.279944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.280588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.437495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.447678 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c909973f-237e-401e-9ee5-6fa6dbc7a0bb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.203860 Aug 29 15:36:08.448420 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1244/2369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:08.457989 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b58d1ce5-fcc7-46ef-bb02-33ae47ce94d3 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.192053 Aug 29 15:36:08.459275 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1126/2370] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784/os-interface => generated 1830 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:08.464503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77c3f787-457f-44e5-a686-1314033a1b12 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '.version_select at 0x7fb0e3595f70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.643702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-90dc49c3-b68b-4c5c-b82d-bead457da2aa tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Calling method '.version_select at 0x7fb0e34d8d30>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.868630 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-90dc49c3-b68b-4c5c-b82d-bead457da2aa tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.228960 Aug 29 15:36:08.869829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1127/2371] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c/defaults => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:08.882140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e34d84c0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:08.898750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:08.956822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.957303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.957769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.958543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.958994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.959419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.991884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=7,nova_api:INSERT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:09.179697 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-68d67bff-e85d-449b-9fbc-9ed49d5c822d tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c" status: 200 len: 329 microversion: 2.1 time: 0.302019 Aug 29 15:36:09.186955 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1128/2372] 10.222.0.16 () {60 vars in 1263 bytes} [Mon Aug 29 15:36:08 2022] PUT /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c => generated 329 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:09.187132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-dcd1b14a-8685-4f90-8c30-c7072ae0eb32 req-4bcc2edf-a286-4b5e-b849-ed667753a181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4254c3c6-f8b5-44e4-b752-f8ee1828a748", "tag": "15dad3a3-b5ec-4256-b31c-0e0d601a9866"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:09.197663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dcd1b14a-8685-4f90-8c30-c7072ae0eb32 req-4bcc2edf-a286-4b5e-b849-ed667753a181 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.198391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dcd1b14a-8685-4f90-8c30-c7072ae0eb32 req-4bcc2edf-a286-4b5e-b849-ed667753a181 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.198828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dcd1b14a-8685-4f90-8c30-c7072ae0eb32 req-4bcc2edf-a286-4b5e-b849-ed667753a181 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.211806 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-dcd1b14a-8685-4f90-8c30-c7072ae0eb32 req-4bcc2edf-a286-4b5e-b849-ed667753a181 service nova] Creating event network-changed:15dad3a3-b5ec-4256-b31c-0e0d601a9866 for instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 on n-h2-854882-3 Aug 29 15:36:09.218343 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-dcd1b14a-8685-4f90-8c30-c7072ae0eb32 req-4bcc2edf-a286-4b5e-b849-ed667753a181 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036777 Aug 29 15:36:09.220350 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1129/2373] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:09.226872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:09.228254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:09.237181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.237708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.238147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.238896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.239411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.240856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.358289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:09.362854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:09.369331 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bdf40a4c-bcd9-48ff-9c03-cbc0beb33987 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1271 microversion: 2.1 time: 0.147563 Aug 29 15:36:09.383613 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1130/2374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:09 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:09.383613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e8cbab80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:09.455001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.455528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.455908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.456629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.457075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.457523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.758132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:INSERT=28,nova_api:SELECT=58,nova_api:UPDATE=14 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:09.773001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5afe29f0-e69d-4c1d-9763-c7b055422896 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c" status: 200 len: 329 microversion: 2.1 time: 0.402017 Aug 29 15:36:09.774128 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1131/2375] 10.222.0.16 () {60 vars in 1263 bytes} [Mon Aug 29 15:36:09 2022] PUT /compute/v2.1/os-quota-sets/24dcbd2a5cee479988d82645ca00535c => generated 329 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:09.779021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:09.779796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:09.786563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.787250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.787687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.788385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.788840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.789263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.954071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:09.963081 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-572764c4-8ad6-4036-9192-49b070b31d1f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.187887 Aug 29 15:36:09.963957 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1132/2376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:09 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:09.969177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:09.969829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:09.977319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.977845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.978280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.979002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.979453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.979999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.141140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:10.151461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8efc3b6a-6269-4ecb-a983-6f8f1ddbdc41 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.186246 Aug 29 15:36:10.158813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1133/2377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:09 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:10.391608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.392556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:10.409890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.410567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.413803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.416036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.416550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.418132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.572187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:10.580243 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b7719b7c-43c0-48b2-9eb6-15a3ec637d1d tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1271 microversion: 2.1 time: 0.193504 Aug 29 15:36:10.581018 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1134/2378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:10.837889 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77c3f787-457f-44e5-a686-1314033a1b12 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/acd4f660-ef8b-46d1-a23e-70c55c17d194" status: 202 len: 0 microversion: 2.1 time: 2.386927 Aug 29 15:36:10.839557 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1245/2379] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:36:08 2022] DELETE /compute/v2.1/os-floating-ips/acd4f660-ef8b-46d1-a23e-70c55c17d194 => generated 0 bytes in 2390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:10.847659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.72"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:10.989630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.991849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:11.001320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.003260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.005084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.006467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.007314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.008139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.217260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:11.224129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.224644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.225125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.230181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.230745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.231203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.486396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:11.496418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60a03e97-8de1-4cef-b119-bb4638f3ca6a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.516005 Aug 29 15:36:11.511325 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1246/2380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:11.516457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:11.517767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:11.525264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.526247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.526962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.527991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.528709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.529374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.838351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:11.858675 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70c8365e-262d-456a-a6da-561eec8393fa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.345887 Aug 29 15:36:11.859944 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1247/2381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:11 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:11.866271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7009258c-50f2-4b18-80d3-34303db86a0b req-1117d545-b675-4268-840f-ffafe44de725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "tag": "09a9e65a-b239-4c6f-9543-78a3c4be399a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:11.878554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7009258c-50f2-4b18-80d3-34303db86a0b req-1117d545-b675-4268-840f-ffafe44de725 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.879334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7009258c-50f2-4b18-80d3-34303db86a0b req-1117d545-b675-4268-840f-ffafe44de725 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.880012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7009258c-50f2-4b18-80d3-34303db86a0b req-1117d545-b675-4268-840f-ffafe44de725 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.895187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7009258c-50f2-4b18-80d3-34303db86a0b req-1117d545-b675-4268-840f-ffafe44de725 service nova] Creating event network-changed:09a9e65a-b239-4c6f-9543-78a3c4be399a for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:36:11.902613 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7009258c-50f2-4b18-80d3-34303db86a0b req-1117d545-b675-4268-840f-ffafe44de725 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040623 Aug 29 15:36:11.903900 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1248/2382] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:11.914928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:11.915977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:11.924740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.926341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.928022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.929070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.929839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.930571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.044886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:36:12.045558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquired lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:36:12.207270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.219042 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e4d5b68d-8b26-47a6-b4dc-e73c9b4bbfe2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1313 microversion: 2.1 time: 0.313359 Aug 29 15:36:12.220228 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1249/2383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:11 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:12.518507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:12.522721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:12.541777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.542663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.543561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.544492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.545133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.545941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.864189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.874765 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d50f9b6d-1b84-442f-af04-0e2f07e9ce2b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.360469 Aug 29 15:36:12.875945 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1250/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:12 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:12.883851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:12.884779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:12.891565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.892352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.893028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.894059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.894731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.895367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.277240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.289861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:13.296780 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2848d34-8159-484b-a73c-b213d86a17aa tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.419479 Aug 29 15:36:13.298623 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1251/2385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:12 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:13.305315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:13.306488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:13.321700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.322777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.323373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.324332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.324776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.325276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.575629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.586391 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ddc31322-c8da-425c-afef-9306ddb30ec9 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1313 microversion: 2.1 time: 0.286188 Aug 29 15:36:13.587250 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1252/2386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:13 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:13.896438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:13.897895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:13.905420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.905929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.906467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.907341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.907766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.908202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.954657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Building network info cache for instance {{(pid=130001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:36:14.094761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:14.104629 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bebc9b1e-dea0-4c1a-b00e-4e8e80651504 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.212502 Aug 29 15:36:14.106048 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1253/2387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:13 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:14.111100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-dbcce1f4-f0bb-412d-abc1-de13704dd948 req-ccc621b0-52b4-485a-996d-9d2ad4063601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3", "tag": "02dee68c-2667-4e73-acf1-ba7832a2debc"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:14.122296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dbcce1f4-f0bb-412d-abc1-de13704dd948 req-ccc621b0-52b4-485a-996d-9d2ad4063601 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.122795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dbcce1f4-f0bb-412d-abc1-de13704dd948 req-ccc621b0-52b4-485a-996d-9d2ad4063601 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.123232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dbcce1f4-f0bb-412d-abc1-de13704dd948 req-ccc621b0-52b4-485a-996d-9d2ad4063601 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.139112 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-dbcce1f4-f0bb-412d-abc1-de13704dd948 req-ccc621b0-52b4-485a-996d-9d2ad4063601 service nova] Creating event network-changed:02dee68c-2667-4e73-acf1-ba7832a2debc for instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 on n-h1-854882-3 Aug 29 15:36:14.144431 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-dbcce1f4-f0bb-412d-abc1-de13704dd948 req-ccc621b0-52b4-485a-996d-9d2ad4063601 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037105 Aug 29 15:36:14.146070 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1254/2388] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:14.153017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-317f67f4-b71f-4a79-ab30-ecd46000b025 req-c20bdd27-b184-4d7f-b016-00ecb6a491c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4925408f-28f7-4a69-baa0-b04c3c8b985a", "tag": "c9517e1c-b443-4dc3-b2f2-df95f57f5ec1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:14.166887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-317f67f4-b71f-4a79-ab30-ecd46000b025 req-c20bdd27-b184-4d7f-b016-00ecb6a491c5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.167573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-317f67f4-b71f-4a79-ab30-ecd46000b025 req-c20bdd27-b184-4d7f-b016-00ecb6a491c5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.169657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-317f67f4-b71f-4a79-ab30-ecd46000b025 req-c20bdd27-b184-4d7f-b016-00ecb6a491c5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.184321 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-317f67f4-b71f-4a79-ab30-ecd46000b025 req-c20bdd27-b184-4d7f-b016-00ecb6a491c5 service nova] Creating event network-changed:c9517e1c-b443-4dc3-b2f2-df95f57f5ec1 for instance 4925408f-28f7-4a69-baa0-b04c3c8b985a on n-h1-854882-3 Aug 29 15:36:14.190207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-317f67f4-b71f-4a79-ab30-ecd46000b025 req-c20bdd27-b184-4d7f-b016-00ecb6a491c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042465 Aug 29 15:36:14.190933 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1255/2389] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:14.319845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:14.320659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:14.332788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.333325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.333844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.335671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.336134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.338570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.712299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Updating instance_info_cache with network_info: [{"id": "02dee68c-2667-4e73-acf1-ba7832a2debc", "address": "fa:16:3e:88:92:fe", "network": {"id": "233c726f-bcd9-46a9-a17b-52ab8ae450d1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-636988525-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ef312cb51a84470d8c0d38c9c2a65b79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02dee68c-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:36:14.732700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Releasing lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:36:14.732987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:14.736292 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-359a1f9e-f11d-407c-9fb9-ad27f8a5fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action" status: 202 len: 0 microversion: 2.1 time: 3.892146 Aug 29 15:36:14.749433 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95927765-0caf-459e-91d4-16a3c235703e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.433900 Aug 29 15:36:14.750069 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1135/2390] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:10 2022] POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action => generated 0 bytes in 3897 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:36:14.751683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1256/2391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:14 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:14.759394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eeedc5df-2d0b-4919-920c-69e88bfb1220 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '.version_select at 0x7fb0e2d50940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:14.764115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:14.765843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:14.789421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.789421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.789421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.789421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.789421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.789421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.208958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:15.226847 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3157efcf-1099-4184-ac27-e0e0aca91b60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1313 microversion: 2.1 time: 0.475399 Aug 29 15:36:15.227781 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1136/2392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:14 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:15.423192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42ff937f-938c-4de8-ab87-dc246ffd675d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Calling method '.version_select at 0x7fb0e3cbd820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:15.501659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42ff937f-938c-4de8-ab87-dc246ffd675d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 371 microversion: 2.1 time: 0.272684 Aug 29 15:36:15.502883 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1137/2393] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:15 2022] GET /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:15.515912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-89869a9a-75ee-4b78-b576-45118479cd5f req-4e0be948-fbd4-4cbf-857d-dc1c5ee2e1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4254c3c6-f8b5-44e4-b752-f8ee1828a748", "name": "network-vif-plugged", "status": "completed", "tag": "15dad3a3-b5ec-4256-b31c-0e0d601a9866"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:15.529014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-89869a9a-75ee-4b78-b576-45118479cd5f req-4e0be948-fbd4-4cbf-857d-dc1c5ee2e1a5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.529895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-89869a9a-75ee-4b78-b576-45118479cd5f req-4e0be948-fbd4-4cbf-857d-dc1c5ee2e1a5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.530521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-89869a9a-75ee-4b78-b576-45118479cd5f req-4e0be948-fbd4-4cbf-857d-dc1c5ee2e1a5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.554689 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-89869a9a-75ee-4b78-b576-45118479cd5f req-4e0be948-fbd4-4cbf-857d-dc1c5ee2e1a5 service nova] Creating event network-vif-plugged:15dad3a3-b5ec-4256-b31c-0e0d601a9866 for instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 on n-h2-854882-3 Aug 29 15:36:15.561589 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-89869a9a-75ee-4b78-b576-45118479cd5f req-4e0be948-fbd4-4cbf-857d-dc1c5ee2e1a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057204 Aug 29 15:36:15.563070 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1138/2394] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:15.570866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:15.571879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:15.581534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.582729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.584807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.585841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.586633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.587269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.825601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:15.834476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bb961d0-2708-4279-bd67-c53981c39c0d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.267919 Aug 29 15:36:15.834994 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1139/2395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:15 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:15.839741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Action: 'update', calling method: .version_select at 0x7fb0eb5a6430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:15.905476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.906060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.906567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.907382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.907932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.908427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.940032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=98,nova_cell0:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:15.963416 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6baa69c8-2fac-4e81-b31a-3beef5692104 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 328 microversion: 2.1 time: 0.127351 Aug 29 15:36:15.973469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1140/2396] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:15 2022] PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:15.973469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:15.973469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:15.975012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.975496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.975991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.976697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.977155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.977607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.124510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:16.133420 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef2d8e15-ef62-401c-a57f-bf17b8a5fb0b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1316 microversion: 2.1 time: 0.168331 Aug 29 15:36:16.134113 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1141/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:15 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:16.187807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1057144721", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:16.243894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:16.310746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eeedc5df-2d0b-4919-920c-69e88bfb1220 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d554e350-78a3-4726-a5bd-c3097c16b5f0" status: 202 len: 0 microversion: 2.1 time: 1.557638 Aug 29 15:36:16.311420 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1257/2398] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:36:14 2022] DELETE /compute/v2.1/os-floating-ips/d554e350-78a3-4726-a5bd-c3097c16b5f0 => generated 0 bytes in 1559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:16.316718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:16.317593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.325233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.325828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.326344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.327155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.327688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.328190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.451320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:16.451744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:16.452218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:16.452630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:16.453205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:16.462227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.462706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.463148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.463881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.464334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.464817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.466823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:16.475317 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab81aa57-4f06-464d-b158-571f1653b5ea tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1313 microversion: 2.1 time: 0.162837 Aug 29 15:36:16.476348 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1258/2399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:16 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:16.481158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8771a4e8-3558-405f-a26a-246de8a72e95 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:16.483105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Getting quotas for project b8bc1721e94d41edb24ff9027d20490e. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8771a4e8-3558-405f-a26a-246de8a72e95 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Request method failure captured: Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action HTTP/1.1 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 34 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzAowLRZu7i9uGq2M0yBiZXgYE1ve5M0yIx-H3NvrKz8iwJBvxZeeIse3byBvg3CQcSA4FmN0qk7Zh3F3SRZJZ4zzYjrKhM8P9Y6n6QBquruwMG95EJdgzN-0Tk6i5oJqoWQIMUTUTIwUfjRSHfBdiRDZBjmYDM03O4rHgCDXamlQA Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef312cb51a84470d8c0d38c9c2a65b79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}] Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d844cb81667346a6aaf07c288c6918be Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: {"addFloatingIp": {"address": ""}} Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3', 'body': {'addFloatingIp': {'address': ''}}} Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi '' Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:36:16.485341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8771a4e8-3558-405f-a26a-246de8a72e95 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8771a4e8-3558-405f-a26a-246de8a72e95 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action" status: 400 len: 142 microversion: 2.1 time: 0.009677 Aug 29 15:36:16.490154 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1259/2400] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:16 2022] POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:36:16.494711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Getting quotas for user 3f22459d2aa34cd0a982bbd32afb1588 and project b8bc1721e94d41edb24ff9027d20490e. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:16.500406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:16.502780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.509503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.utils [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] cores quota exceeded for b8bc1721e94d41edb24ff9027d20490e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130001) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:36:16.509973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.510332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:16.510461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.510899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.511617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.512076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.512506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Request method failure captured: Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 145 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNztJ8SxC89S-NdyXPVmahgcIbQgR-CENpQGpDzOljVTEp7nw_g05Vr0gcdKCi8zdOWOU1djmMcFYdF7bnaSZITx3DS8OtazsMKioAIpi_KnuOwIaJzDRZ98DjakyubJ634d4xwpu0KimIp73CDTaS9ZnseMu7JjnobXO3GTdLlaKAc Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b8bc1721e94d41edb24ff9027d20490e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}] Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3f22459d2aa34cd0a982bbd32afb1588 Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1057144721", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1057144721', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452'}}} Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:36:16.521165 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.525676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:16.528087 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-52252217-f6e9-42e6-9cf8-44ec6041852d tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.390563 Aug 29 15:36:16.528087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1142/2401] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:16 2022] POST /compute/v2.1/servers => generated 111 bytes in 393 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:16.535495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Action: 'update', calling method: .version_select at 0x7fb0eb629700>, body: {"quota_set": {"cores": 20}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:16.540439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:36:16.540812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquired lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:36:16.599970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.600466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.600912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.602290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.602753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.603216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.640084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Releasing lock "refresh_cache-ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:36:16.641598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] HTTP exception thrown: floating IP not found Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Request method failure captured: Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action HTTP/1.1 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 41 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzAowLRZu7i9uGq2M0yBiZXgYE1ve5M0yIx-H3NvrKz8iwJBvxZeeIse3byBvg3CQcSA4FmN0qk7Zh3F3SRZJZ4zzYjrKhM8P9Y6n6QBquruwMG95EJdgzN-0Tk6i5oJqoWQIMUTUTIwUfjRSHfBdiRDZBjmYDM03O4rHgCDXamlQA Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef312cb51a84470d8c0d38c9c2a65b79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}] Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d844cb81667346a6aaf07c288c6918be Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: exception: floating IP not found Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 29 15:36:16.643496 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 29 15:36:16.648406 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.649720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Returning 404 to user: floating IP not found {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:16.650618 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e1c0a2c-d3ad-4676-9033-710b1ed96400 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action" status: 404 len: 67 microversion: 2.1 time: 0.154051 Aug 29 15:36:16.651335 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1260/2402] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:16 2022] POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action => generated 67 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:36:16.660283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da845c7c-2e78-4595-969b-5f37e6af1e83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:16.665192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-69153849-f5b9-4743-87a3-86aa01b0a636 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 329 microversion: 2.1 time: 0.133489 Aug 29 15:36:16.665817 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1143/2403] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:16 2022] PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 329 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:16.678920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1df94d57-394f-49d9-9f42-c18ad2f1ce0c tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Calling method '.version_select at 0x7fb0eb629c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:16.706105 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-da845c7c-2e78-4595-969b-5f37e6af1e83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da845c7c-2e78-4595-969b-5f37e6af1e83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Request method failure captured: Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action HTTP/1.1 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 44 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzAowLRZu7i9uGq2M0yBiZXgYE1ve5M0yIx-H3NvrKz8iwJBvxZeeIse3byBvg3CQcSA4FmN0qk7Zh3F3SRZJZ4zzYjrKhM8P9Y6n6QBquruwMG95EJdgzN-0Tk6i5oJqoWQIMUTUTIwUfjRSHfBdiRDZBjmYDM03O4rHgCDXamlQA Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef312cb51a84470d8c0d38c9c2a65b79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}] Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d844cb81667346a6aaf07c288c6918be Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: exception: Floating IP not found for address 0.0.0.0. Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 29 15:36:16.707712 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da845c7c-2e78-4595-969b-5f37e6af1e83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da845c7c-2e78-4595-969b-5f37e6af1e83 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action" status: 404 len: 88 microversion: 2.1 time: 0.052745 Aug 29 15:36:16.711808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1261/2404] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:16 2022] POST /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3/action => generated 88 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:36:16.718907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:16.719530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.728533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.729171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.729452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.730279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.730885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.731286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.752677 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1df94d57-394f-49d9-9f42-c18ad2f1ce0c tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 371 microversion: 2.1 time: 0.077664 Aug 29 15:36:16.753362 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1144/2405] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:16 2022] GET /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:16.761359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:16.764642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e3cbdc10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:16.828123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.828600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.829030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.829793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.830244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.830833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.841929 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9ac9c1f3-2c63-41fc-84be-2f1e6cb6ab73 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 204 len: 0 microversion: 2.1 time: 0.126504 Aug 29 15:36:16.842524 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1262/2406] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:16 2022] DELETE /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:16.852563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:16.853275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.859315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.859801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.860245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.860945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.861408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.861847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.885203 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b4bd4ed0-6202-4027-ae89-c46f7d10c93f tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 328 microversion: 2.1 time: 0.124342 Aug 29 15:36:16.886044 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1145/2407] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:16 2022] PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:16.895126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:16.895687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.902523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.903011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.903514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.904211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.904665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.905089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.006822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:17.015342 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0fbd223a-e3ec-4153-9fcb-64edc6a3dfc5 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1541 microversion: 2.1 time: 0.168143 Aug 29 15:36:17.016407 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1263/2408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:16 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1541 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:17.022036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-579957928", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:17.079136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:17.088329 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-938e37b6-5612-4847-8864-f7f378d3f5d7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.197757 Aug 29 15:36:17.089354 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1146/2409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:16 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:17.097147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:17.154460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:17.155599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:17.164202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.165192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.165916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.166823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.167519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.167940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.326345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:17.335538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4c1f9cb2-964e-4fb8-8467-ca1ce769a6b6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1466 microversion: 2.1 time: 0.185231 Aug 29 15:36:17.336122 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1147/2410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:17 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1466 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:17.347801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:17.348767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:17.349308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:17.349784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:17.350449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:17.356634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=51 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:17.361436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.361935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.362374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.363219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.363571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.364164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.368470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=15 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:17.386386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Getting quotas for project b8bc1721e94d41edb24ff9027d20490e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:17.392178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Getting quotas for user 3f22459d2aa34cd0a982bbd32afb1588 and project b8bc1721e94d41edb24ff9027d20490e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:17.408872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.utils [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] instances quota exceeded for b8bc1721e94d41edb24ff9027d20490e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130002) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:36:17.409339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Request method failure captured: Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 144 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNztJ8SxC89S-NdyXPVmahgcIbQgR-CENpQGpDzOljVTEp7nw_g05Vr0gcdKCi8zdOWOU1djmMcFYdF7bnaSZITx3DS8OtazsMKioAIpi_KnuOwIaJzDRZ98DjakyubJ634d4xwpu0KimIp73CDTaS9ZnseMu7JjnobXO3GTdLlaKAc Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b8bc1721e94d41edb24ff9027d20490e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}] Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3f22459d2aa34cd0a982bbd32afb1588 Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-579957928", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-579957928', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452'}}} Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:36:17.412614 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0cbcc2f5-42aa-4244-928f-6441c26c1a96 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.396669 Aug 29 15:36:17.416960 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1264/2411] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:17 2022] POST /compute/v2.1/servers => generated 119 bytes in 398 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:17.423957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e2bde790>, body: {"quota_set": {"instances": 10}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:17.471448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:17.472247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:17.478640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.479204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.479736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.480505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.481094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.481782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.504007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.504495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.504962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.506528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.507030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.507543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.574700 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-46e1442c-4eae-4149-aaf4-49938fb6fe83 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 329 microversion: 2.1 time: 0.154446 Aug 29 15:36:17.575750 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1265/2412] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:17 2022] PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 329 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:17.580375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:17.581038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:17.588384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.588873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.589312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.590168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.590855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.591052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.731997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:17.741005 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29b6d31a-fc95-4d24-81e4-87c89b6f7e57 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1313 microversion: 2.1 time: 0.164188 Aug 29 15:36:17.741796 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1266/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:17 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:17.742450 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-50803dc0-8f45-4daf-b508-80a02ea0951c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1617 microversion: 2.1 time: 0.390449 Aug 29 15:36:17.743104 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1148/2414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:17 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1617 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:17.747155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-322be2c4-7b38-440c-bdc9-3fe22c0c5242 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Calling method '.version_select at 0x7fb0eb532310>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:17.756753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1d5c7780-f011-483f-a4dc-6af6513dc1dd req-2969174a-6c34-46b4-9af4-d231a519b177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4e2cb7-3b60-47c9-a99a-c7bc0a907044", "name": "network-vif-plugged", "status": "completed", "tag": "b6a43967-16dd-4818-912f-165563c17a28"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:17.772282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1d5c7780-f011-483f-a4dc-6af6513dc1dd req-2969174a-6c34-46b4-9af4-d231a519b177 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.772763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1d5c7780-f011-483f-a4dc-6af6513dc1dd req-2969174a-6c34-46b4-9af4-d231a519b177 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.773194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1d5c7780-f011-483f-a4dc-6af6513dc1dd req-2969174a-6c34-46b4-9af4-d231a519b177 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.786676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1d5c7780-f011-483f-a4dc-6af6513dc1dd req-2969174a-6c34-46b4-9af4-d231a519b177 service nova] Creating event network-vif-plugged:b6a43967-16dd-4818-912f-165563c17a28 for instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 on n-h2-854882-3 Aug 29 15:36:17.792278 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1d5c7780-f011-483f-a4dc-6af6513dc1dd req-2969174a-6c34-46b4-9af4-d231a519b177 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047887 Aug 29 15:36:17.792944 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1149/2415] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:17.798178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae6f4c43-3011-424e-81f0-dbca1a185a3f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: .version_select at 0x7fb0eb5bc1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2034195013", "policies": ["affinity"]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:17.816739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ae6f4c43-3011-424e-81f0-dbca1a185a3f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:17.823702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ae6f4c43-3011-424e-81f0-dbca1a185a3f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:17.826687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:17.847723 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-322be2c4-7b38-440c-bdc9-3fe22c0c5242 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 371 microversion: 2.1 time: 0.104223 Aug 29 15:36:17.848448 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1267/2416] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:17 2022] GET /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:17.862186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e8c6c5e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:17.890024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ae6f4c43-3011-424e-81f0-dbca1a185a3f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:17.895832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ae6f4c43-3011-424e-81f0-dbca1a185a3f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:17.909170 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae6f4c43-3011-424e-81f0-dbca1a185a3f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.114811 Aug 29 15:36:17.909707 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1150/2417] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:36:17 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:17.940035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.940864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.941477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.942905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.943393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.943862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.984316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:17.999277 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83707909-a2de-44e3-9a05-afcae46150cd tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 325 microversion: 2.1 time: 0.143400 Aug 29 15:36:17.999972 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1268/2418] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:17 2022] PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 325 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:18.024424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1522299468", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1020dc48-0c68-4ad4-8dd0-2c1d2df7a846"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:18.037904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:18.038416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:18.045146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.045673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.046151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.046886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.047348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.047865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.088984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:18.187412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:18.195562 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8f153bda-95bc-475a-baf8-4b2432b1626d tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1541 microversion: 2.1 time: 0.162991 Aug 29 15:36:18.196141 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1269/2419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:18 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1541 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:18.200849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-370513354", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:18.253105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:18.309794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:18.310229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:18.310780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:18.311193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:18.311612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:18.337047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.337745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.338078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.338817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.339274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.339727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.359217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:18.364791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:18.377949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Going to run 2 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:18.380432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:18.430205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130001) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 15:36:18.454092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:18.459914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:18.506157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:18.511319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:18.526046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=3ffae3be-a9cf-4935-a2cc-ae3d02c78553,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:18.581328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:18.587013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:18.618376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:18.619044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:18.619700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:18.620292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:18.620813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:18.624923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:18.630289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.631152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:18.631270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.631270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.632124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.632775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.633413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.652240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Getting quotas for project b8bc1721e94d41edb24ff9027d20490e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:18.658066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Getting quotas for user 3f22459d2aa34cd0a982bbd32afb1588 and project b8bc1721e94d41edb24ff9027d20490e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:18.671881 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b83395b4-4343-4237-be58-3c669ee036fb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.651339 Aug 29 15:36:18.672397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.utils [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] ram quota exceeded for b8bc1721e94d41edb24ff9027d20490e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130002) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:36:18.672822 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1151/2420] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:18 2022] POST /compute/v2.1/servers => generated 32 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:36:18.673281 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Request method failure captured: Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 144 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNztJ8SxC89S-NdyXPVmahgcIbQgR-CENpQGpDzOljVTEp7nw_g05Vr0gcdKCi8zdOWOU1djmMcFYdF7bnaSZITx3DS8OtazsMKioAIpi_KnuOwIaJzDRZ98DjakyubJ634d4xwpu0KimIp73CDTaS9ZnseMu7JjnobXO3GTdLlaKAc Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b8bc1721e94d41edb24ff9027d20490e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}] Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3f22459d2aa34cd0a982bbd32afb1588 Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-370513354", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-370513354', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452'}}} Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:36:18.675743 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:18.679848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:18.682097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:18.682097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:18.682968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:18.684050 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5778e0b2-8be3-4697-81e7-8e1afccca268 tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.486907 Aug 29 15:36:18.684809 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1270/2421] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 488 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:18.689706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:18.690180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.690678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.691260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.691978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.692438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.693355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.700527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:18.701521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Searching by: {'deleted': False, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:36:18.723994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.724471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.724999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.725861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.726402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.726906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.792510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:36:18.834308 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e66cd892-4c18-4029-8cdf-f5853493da06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.147521 Aug 29 15:36:18.835590 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1271/2422] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:36:18 2022] GET /compute/v2.1/servers => generated 1003 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:18.840253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Action: 'update', calling method: .version_select at 0x7fb0e2be4940>, body: {"quota_set": {"ram": 51200}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:18.855471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:18.863644 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2114cb67-6788-4aa4-beb5-94442cc7a093 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1315 microversion: 2.1 time: 0.189730 Aug 29 15:36:18.865511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1152/2423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:18 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:18.868902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:18.869552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:18.876326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.876819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.877458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.878201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.878651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.879228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.962179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.962950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.963605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.964526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.965761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.966381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.044539 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce3f5177-61f2-467c-a072-a7f7a123ca08 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 200 len: 329 microversion: 2.1 time: 0.207634 Aug 29 15:36:19.045900 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1272/2424] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:18 2022] PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 329 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:19.051148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a610778-4741-43da-8c11-75ce2969d03b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.051857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a610778-4741-43da-8c11-75ce2969d03b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:19.064068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.085285 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4af4e9e7-a45c-406f-82cf-45feea7b7b0e tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1313 microversion: 2.1 time: 0.219837 Aug 29 15:36:19.085919 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1153/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:18 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:19.143152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a610778-4741-43da-8c11-75ce2969d03b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.154637 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a610778-4741-43da-8c11-75ce2969d03b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1219 microversion: 2.1 time: 0.105184 Aug 29 15:36:19.155628 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1273/2426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:19 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:19.161618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a9aa57c-7795-4b11-9c51-f3e31487f19e tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Action: 'update', calling method: .version_select at 0x7fb0eb715b80>, body: {"quota_set": {"ram": 0}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:19.169066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0a9aa57c-7795-4b11-9c51-f3e31487f19e tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '3f22459d2aa34cd0a982bbd32afb1588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bc1721e94d41edb24ff9027d20490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a9aa57c-7795-4b11-9c51-f3e31487f19e tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Request method failure captured: Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e HTTP/1.1 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 25 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNztJ8SxC89S-NdyXPVmahgcIbQgR-CENpQGpDzOljVTEp7nw_g05Vr0gcdKCi8zdOWOU1djmMcFYdF7bnaSZITx3DS8OtazsMKioAIpi_KnuOwIaJzDRZ98DjakyubJ634d4xwpu0KimIp73CDTaS9ZnseMu7JjnobXO3GTdLlaKAc Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b8bc1721e94d41edb24ff9027d20490e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b8bc1721e94d41edb24ff9027d20490e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8bc1721e94d41edb24ff9027d20490e"}]}] Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b8bc1721e94d41edb24ff9027d20490e Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1618855870 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3f22459d2aa34cd0a982bbd32afb1588 Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-QuotasAdminNegativeTest-1618855870-project Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: {"quota_set": {"ram": 0}} Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b8bc1721e94d41edb24ff9027d20490e', 'body': {'quota_set': {'ram': 0}}} Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:36:19.180233 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:36:19.184377 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.185575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a9aa57c-7795-4b11-9c51-f3e31487f19e tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:19.187521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a9aa57c-7795-4b11-9c51-f3e31487f19e tempest-QuotasAdminNegativeTest-1618855870 tempest-QuotasAdminNegativeTest-1618855870-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e" status: 403 len: 116 microversion: 2.1 time: 0.029357 Aug 29 15:36:19.188993 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1274/2427] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:19 2022] PUT /compute/v2.1/os-quota-sets/b8bc1721e94d41edb24ff9027d20490e => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:19.223494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.224952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:19.235109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3d27b8a9-ce19-4732-a7ce-419fa3df03b5 req-352a744d-0b1e-41f3-b623-3e50fc60ad9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3", "name": "network-vif-deleted", "tag": "02dee68c-2667-4e73-acf1-ba7832a2debc"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:19.249337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.251353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.251876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.253669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.257956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.258550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.277587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3d27b8a9-ce19-4732-a7ce-419fa3df03b5 req-352a744d-0b1e-41f3-b623-3e50fc60ad9a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.278639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3d27b8a9-ce19-4732-a7ce-419fa3df03b5 req-352a744d-0b1e-41f3-b623-3e50fc60ad9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.279854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3d27b8a9-ce19-4732-a7ce-419fa3df03b5 req-352a744d-0b1e-41f3-b623-3e50fc60ad9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.318591 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3d27b8a9-ce19-4732-a7ce-419fa3df03b5 req-352a744d-0b1e-41f3-b623-3e50fc60ad9a service nova] Creating event network-vif-deleted:02dee68c-2667-4e73-acf1-ba7832a2debc for instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 on n-h1-854882-3 Aug 29 15:36:19.331935 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3d27b8a9-ce19-4732-a7ce-419fa3df03b5 req-352a744d-0b1e-41f3-b623-3e50fc60ad9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233226 Aug 29 15:36:19.332588 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1154/2428] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:19.348904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.350507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.352578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.353825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lazy-loading 'fault' on Instance uuid ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:19.459624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd844cb81667346a6aaf07c288c6918be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef312cb51a84470d8c0d38c9c2a65b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.470615 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b66cc6d-3f7a-4ea7-b816-2b912cdcc583 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 200 len: 1322 microversion: 2.1 time: 0.256966 Aug 29 15:36:19.471704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1275/2429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:19 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:19.820858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-40c757cc-81ef-4047-aa2e-3737203b15e6 req-109581fc-5fb6-42b9-bc2d-84c554d3dc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4925408f-28f7-4a69-baa0-b04c3c8b985a", "name": "network-vif-plugged", "status": "completed", "tag": "c9517e1c-b443-4dc3-b2f2-df95f57f5ec1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:19.836827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-40c757cc-81ef-4047-aa2e-3737203b15e6 req-109581fc-5fb6-42b9-bc2d-84c554d3dc67 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.837584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-40c757cc-81ef-4047-aa2e-3737203b15e6 req-109581fc-5fb6-42b9-bc2d-84c554d3dc67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.838016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-40c757cc-81ef-4047-aa2e-3737203b15e6 req-109581fc-5fb6-42b9-bc2d-84c554d3dc67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.850766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-40c757cc-81ef-4047-aa2e-3737203b15e6 req-109581fc-5fb6-42b9-bc2d-84c554d3dc67 service nova] Creating event network-vif-plugged:c9517e1c-b443-4dc3-b2f2-df95f57f5ec1 for instance 4925408f-28f7-4a69-baa0-b04c3c8b985a on n-h1-854882-3 Aug 29 15:36:19.856105 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-40c757cc-81ef-4047-aa2e-3737203b15e6 req-109581fc-5fb6-42b9-bc2d-84c554d3dc67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042263 Aug 29 15:36:19.857252 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1155/2430] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:19.885976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.886889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:19.894062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.894567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.895015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.896252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.897034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.897655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.111976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:20.113313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:20.122902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:20.126151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.127296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.127912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.128780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.129520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.130127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.194185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:20.199113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.207833 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf5453a2-292f-4904-a0a4-e031b04e735b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1502 microversion: 2.1 time: 0.326602 Aug 29 15:36:20.210230 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1276/2431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:19 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:20.220331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:20.222138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:20.238917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.239564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.244378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.245780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.246541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.247177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.254493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:20.321907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.329976 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-843b4911-c035-4a20-a5cc-54e48efb6578 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1215 microversion: 2.1 time: 0.117992 Aug 29 15:36:20.330911 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1277/2432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:20 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:20.462707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.478353 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f3c47a4f-c811-4a74-92fd-f7cdcbf7e37c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1313 microversion: 2.1 time: 0.375012 Aug 29 15:36:20.479103 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1156/2433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:20 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:20.503135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:20.504003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] [instance: ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:20.518422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.519698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.520421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.523029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.523766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.524437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.545038 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] HTTP exception thrown: Instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 could not be found. Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Request method failure captured: Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 HTTP/1.1 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzAowLRZu7i9uGq2M0yBiZXgYE1ve5M0yIx-H3NvrKz8iwJBvxZeeIse3byBvg3CQcSA4FmN0qk7Zh3F3SRZJZ4zzYjrKhM8P9Y6n6QBquruwMG95EJdgzN-0Tk6i5oJqoWQIMUTUTIwUfjRSHfBdiRDZBjmYDM03O4rHgCDXamlQA Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef312cb51a84470d8c0d38c9c2a65b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef312cb51a84470d8c0d38c9c2a65b79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef312cb51a84470d8c0d38c9c2a65b79"}]}] Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ef312cb51a84470d8c0d38c9c2a65b79 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254 Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d844cb81667346a6aaf07c288c6918be Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 could not be found. Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3'} Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 could not be found. Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 could not be found. Aug 29 15:36:20.548094 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 could not be found. Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] Returning 404 to user: Instance ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:20.552555 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b2d4ed25-f61b-4352-a312-41ac2d881c26 tempest-FloatingIPsAssociationNegativeTestJSON-294346254 tempest-FloatingIPsAssociationNegativeTestJSON-294346254-project] 10.222.0.16 "GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3" status: 404 len: 111 microversion: 2.1 time: 0.058764 Aug 29 15:36:20.553914 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1278/2434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:20 2022] GET /compute/v2.1/servers/ccfdf0d7-9dc4-4459-9fdd-b95da7dba0f3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:21.357029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:21.357560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:21.366471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.367422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.368217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.369166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.370696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.371397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.466001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:21.501211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:21.502493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:21.511599 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6baa37ea-c824-4081-a44e-d624474a5971 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1271 microversion: 2.1 time: 0.149609 Aug 29 15:36:21.512553 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1157/2435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:21 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:21.527781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.529631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.532014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.536631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.537328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.537933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.739324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:21.763949 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8a5091f-f53b-4fbf-8a66-986e9270af60 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1462 microversion: 2.1 time: 0.266915 Aug 29 15:36:21.764868 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1279/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:21 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1462 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:21.768773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fbffb93-4e27-486b-8a8e-393c6b5cac03"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:21.771353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:21.783568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.784798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.785519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.787695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.788728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.789472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.354896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2fc49dbc-a759-4b34-8579-c5cecd9e0c55 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591840 Aug 29 15:36:22.356040 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1158/2437] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:36:21 2022] POST /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:22.456694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Calling method '.version_select at 0x7fb0e2d3b700>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:22.471926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.473662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.474920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.517238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.517950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.518844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.544601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:22.545317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:22.557032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.557560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.558028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.569660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.570263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.570701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.578571 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8171f47c-c436-4452-826c-2271b3495b3f tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/f64f2469ff0345d680db3cae9444d749?start=2022-08-28T15%3A36%3A21.779965&end=2022-08-30T15%3A36%3A21.779965" status: 200 len: 642 microversion: 2.1 time: 0.793612 Aug 29 15:36:22.582945 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1280/2438] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Aug 29 15:36:21 2022] GET /compute/v2.1/os-simple-tenant-usage/f64f2469ff0345d680db3cae9444d749?start=2022-08-28T15%3A36%3A21.779965&end=2022-08-30T15%3A36%3A21.779965 => generated 642 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:22.597811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '.version_select at 0x7fb0e2d3b550>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:22.618239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.618968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.619559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.643578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.644332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.644909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.662203 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23e9047f-6179-434c-91bb-d0f8d3ff19ae tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/f64f2469ff0345d680db3cae9444d749?start=2022-08-28T15%3A36%3A21.779965&end=2022-08-30T15%3A36%3A21.779965" status: 200 len: 698 microversion: 2.1 time: 0.068139 Aug 29 15:36:22.663373 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1281/2439] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Aug 29 15:36:22 2022] GET /compute/v2.1/os-simple-tenant-usage/f64f2469ff0345d680db3cae9444d749?start=2022-08-28T15%3A36%3A21.779965&end=2022-08-30T15%3A36%3A21.779965 => generated 698 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:22.677848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Calling method '.version_select at 0x7fb0eb766280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:22.690025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.690794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.691549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.709115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.709625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.710276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.734570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:22.751419 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8813164-3188-4e25-b9f0-92e4e37f0b0d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1277 microversion: 2.1 time: 0.210224 Aug 29 15:36:22.752066 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1159/2440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:22 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:22.885578 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a1c31d3-3460-4707-b966-c2761d4ecb03 tempest-TenantUsagesTestJSON-69747523 tempest-TenantUsagesTestJSON-69747523-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A36%3A21.779965&end=2022-08-30T15%3A36%3A21.779965&detailed=1" status: 200 len: 28442 microversion: 2.1 time: 0.211967 Aug 29 15:36:22.887072 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1282/2441] 10.222.0.16 () {58 vars in 1335 bytes} [Mon Aug 29 15:36:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A36%3A21.779965&end=2022-08-30T15%3A36%3A21.779965&detailed=1 => generated 28442 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:36:22.936433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:22.937277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:22.952032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.954934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.957232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.960717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.961963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.965479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.033821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:23.163986 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-deb330ab-e859-4612-8f1a-f0e148f193c2 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 204 len: 0 microversion: 2.1 time: 0.230893 Aug 29 15:36:23.165324 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1160/2442] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:22 2022] DELETE /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:23.175088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:23.175972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:23.187970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.192257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.193312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.194089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.194564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.199578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.641040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:23.655553 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-36b06ca3-105f-4ce4-95a8-00606313997c tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1468 microversion: 2.1 time: 0.483742 Aug 29 15:36:23.658460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1283/2443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:23 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1468 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:23.778605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:23.780067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:23.794428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.806097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.807700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.808928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.809639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.810240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.930579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:23.938029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:23.946769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Searching by: {'deleted': False, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:36:23.954233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.954881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.961998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.963184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.963974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.964675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.021470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:36:24.066427 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-577883ac-bce3-4e6f-83ae-397a4e6d98b4 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.140966 Aug 29 15:36:24.075667 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1284/2444] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:36:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:24.214894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1272462330", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:24.245818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.259609 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d669a7af-d4b7-49bd-b5e3-78783ba8e34b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1277 microversion: 2.1 time: 0.485944 Aug 29 15:36:24.260231 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1161/2445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:23 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1277 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:24.265269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:24.271634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.272855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Searching by: {'deleted': False, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:36:24.279012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.280105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.280755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.281963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.282627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.283266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.322610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:36:24.335003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:24.385720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.395625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.396656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.397311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.799790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:24.800332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:24.800620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:24.801034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:24.801489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:24.812092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.813003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.813722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.814717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.815402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.816052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.877049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Getting quotas for project 4e12170916e24a33ab0ad5309ac2ab21. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:24.881350 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a613040-4dbc-4136-835f-09f5d0c50dd2 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.619597 Aug 29 15:36:24.882014 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1162/2446] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:36:24 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:24.887223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:24.887847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:24.899061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Getting quotas for user 8b2f1d48248d45fdb39ed3c1ee4b2734 and project 4e12170916e24a33ab0ad5309ac2ab21. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:24.903937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.904435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.904875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.906123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.906123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.906452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.921804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:24.924114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:25.000470 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0afc4572-c7ad-4fa5-a62e-957d4fbe0bbe tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923508 Aug 29 15:36:25.001880 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1285/2447] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:36:25.007342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-721a3ff1-3dd9-450e-8bf6-98cecdcfe92f tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:25.016794 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-721a3ff1-3dd9-450e-8bf6-98cecdcfe92f tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013259 Aug 29 15:36:25.017752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1286/2448] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:36:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:25.050662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f23b419-33fc-4924-9d75-32adaee80fcb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:25.051347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f23b419-33fc-4924-9d75-32adaee80fcb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:25.217718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f23b419-33fc-4924-9d75-32adaee80fcb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:25.249271 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f23b419-33fc-4924-9d75-32adaee80fcb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1222 microversion: 2.1 time: 0.222329 Aug 29 15:36:25.251025 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1287/2449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:25 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:25.280908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:25.282112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:25.300495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.302845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.304522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.310785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.313478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.315014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.699499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:25.714734 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ebc3ae2-80bf-45ea-bf14-ef887fcb3102 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.437809 Aug 29 15:36:25.718330 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1288/2450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:25 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:25.757381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:25.757833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:25.774256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.774766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.775224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.775950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.776419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.776842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.951284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:25.970859 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8c193525-74a2-4ead-b71b-d1c78405e876 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1468 microversion: 2.1 time: 1.087754 Aug 29 15:36:25.988384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1163/2451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:24 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1468 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:26.009368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0ab9cb25-bad4-4453-9c99-19525c9cd90b req-1a1f5256-f03c-4f3c-aa96-f4f0325406dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ffae3be-a9cf-4935-a2cc-ae3d02c78553", "tag": "d2c95a43-5446-44fb-98e9-6950b9097c2a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:26.014225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'services' on Instance uuid 647883af-6f80-4e9c-8f48-d0e4ba4edef3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:26.038978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0ab9cb25-bad4-4453-9c99-19525c9cd90b req-1a1f5256-f03c-4f3c-aa96-f4f0325406dc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.044231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0ab9cb25-bad4-4453-9c99-19525c9cd90b req-1a1f5256-f03c-4f3c-aa96-f4f0325406dc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.044763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0ab9cb25-bad4-4453-9c99-19525c9cd90b req-1a1f5256-f03c-4f3c-aa96-f4f0325406dc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.070903 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0ab9cb25-bad4-4453-9c99-19525c9cd90b req-1a1f5256-f03c-4f3c-aa96-f4f0325406dc service nova] Creating event network-changed:d2c95a43-5446-44fb-98e9-6950b9097c2a for instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 on n-h1-854882-3 Aug 29 15:36:26.089285 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0ab9cb25-bad4-4453-9c99-19525c9cd90b req-1a1f5256-f03c-4f3c-aa96-f4f0325406dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084278 Aug 29 15:36:26.091411 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1164/2452] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:26.105971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:26.107693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:26.125461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.126491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.126952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.127682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.131202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.131672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.162961 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-221c234b-9585-4e76-8ceb-924b247cb5fc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "DELETE /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments/3e7b9afb-a80a-4275-883d-42dedbf2e22b" status: 202 len: 0 microversion: 2.1 time: 0.427725 Aug 29 15:36:26.167306 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1289/2453] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:36:25 2022] DELETE /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments/3e7b9afb-a80a-4275-883d-42dedbf2e22b => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:26.183290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:26.195852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:26.210430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:26.227569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.228447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.229066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.230883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.232380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.234222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.304322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c74889c-a606-49eb-bd52-8a7e9558c65b tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125458 Aug 29 15:36:26.305529 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1290/2454] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:26 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:26.310588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:26.313704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:26.332054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.332750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.333624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.334504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.335116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.335700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.374041 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab28e495-46fc-42b1-9d7d-62ce3c40c158 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 204 len: 0 microversion: 2.1 time: 0.277506 Aug 29 15:36:26.379704 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1165/2455] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:26 2022] DELETE /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:26.387406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:26.388399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:26.396563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.397533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.398168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.399098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.399777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.400568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.469611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:26.482073 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e610b86a-5a49-4d9f-aae0-8ddc475c90bb tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1218 microversion: 2.1 time: 0.174889 Aug 29 15:36:26.483013 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1291/2456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:26 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:26.748141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:26.753769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:26.781959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.782893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.783565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.784893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.785619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.786676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.017909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:27.028394 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-af238d85-f705-43e5-bb12-ef77f0816694 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1609 microversion: 2.1 time: 0.646230 Aug 29 15:36:27.028987 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1166/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:26 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1609 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:27.038866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:27.049543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:27.062632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.068516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.069163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.070079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.070685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.071396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.104642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:27.115174 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b84a782e-3a2d-45f9-be17-4ed4a215a79c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.377889 Aug 29 15:36:27.115768 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1292/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:26 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:27.126645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-269bd3a2-e97c-4257-a8a7-1ea583cf104f req-775dc017-875b-4813-a031-59a02dcd3ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4925408f-28f7-4a69-baa0-b04c3c8b985a", "name": "network-vif-deleted", "tag": "c9517e1c-b443-4dc3-b2f2-df95f57f5ec1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:27.153366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.153907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.154350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.154791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lazy-loading 'fault' on Instance uuid 4925408f-28f7-4a69-baa0-b04c3c8b985a {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:27.165440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-269bd3a2-e97c-4257-a8a7-1ea583cf104f req-775dc017-875b-4813-a031-59a02dcd3ee2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.165901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-269bd3a2-e97c-4257-a8a7-1ea583cf104f req-775dc017-875b-4813-a031-59a02dcd3ee2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.167643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-269bd3a2-e97c-4257-a8a7-1ea583cf104f req-775dc017-875b-4813-a031-59a02dcd3ee2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.196296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-269bd3a2-e97c-4257-a8a7-1ea583cf104f req-775dc017-875b-4813-a031-59a02dcd3ee2 service nova] Creating event network-vif-deleted:c9517e1c-b443-4dc3-b2f2-df95f57f5ec1 for instance 4925408f-28f7-4a69-baa0-b04c3c8b985a on n-h1-854882-3 Aug 29 15:36:27.210899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-269bd3a2-e97c-4257-a8a7-1ea583cf104f req-775dc017-875b-4813-a031-59a02dcd3ee2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093930 Aug 29 15:36:27.211697 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1293/2459] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:27.290360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:27.298991 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b7bebc6-07e6-43f9-ac8c-d5e5bcd1e445 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1303 microversion: 2.1 time: 0.264257 Aug 29 15:36:27.299841 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1167/2460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:27 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1303 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:27.320362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:27.322686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:27.329899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.330792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.331235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.331940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.332394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.332811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.368026 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-506e3fef-0a3e-4142-9e4a-088d764332c5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053761 Aug 29 15:36:27.368622 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1294/2461] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:27 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:27.515821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:27.516841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:27.547044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.547654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.548097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.548847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.549307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.549757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.592752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:27.644434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:27.653561 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96b2774a-4be5-4494-9635-6387e72f96e6 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1274 microversion: 2.1 time: 0.146147 Aug 29 15:36:27.656346 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1168/2462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:27 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:28.057479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:28.058323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:28.071806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.072657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.073525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.074912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.075879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.077875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.135834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:28.137847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:28.149320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.151623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.152400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.155536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.156002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.156428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.397785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.409059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7bc48a15-c4de-468c-b64d-2952a55a25d3 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1609 microversion: 2.1 time: 0.355634 Aug 29 15:36:28.409918 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1295/2463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:28 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1609 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:28.415236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.419201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:28.420202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:28.423208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a7f33387-122e-4559-b431-618c52be27c6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.291328 Aug 29 15:36:28.427761 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1169/2464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:28 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:28.430764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:28.436721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.438434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.439375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.440087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.440838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.441251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.444430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:28.452120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:28.468649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.469147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.470339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.473026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.473491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.474452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.479514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.480193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.480778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.481376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lazy-loading 'fault' on Instance uuid 4925408f-28f7-4a69-baa0-b04c3c8b985a {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:28.549957 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-04634591-3ece-445f-9ab8-14f7b80dfbf5 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118961 Aug 29 15:36:28.553454 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1170/2465] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:28 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:28.675281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:28.676226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:28.689091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.689984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.690974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.693683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.694424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.697530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.769042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b448f96ae8b4a6698169ff4ef319ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f2469ff0345d680db3cae9444d749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.783662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc0ad4dd-56da-40af-b08b-1dea55044003 tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 200 len: 1303 microversion: 2.1 time: 0.369068 Aug 29 15:36:28.799111 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1296/2466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:28 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 1303 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:28.960093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.971225 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-37a63540-5066-4c67-9640-27d4cb8ba55c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1274 microversion: 2.1 time: 0.300213 Aug 29 15:36:28.987013 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1171/2467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:28 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1274 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:29.274331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-50523a91-30b5-4a2c-9a98-b20223dc189a req-b648c0aa-71fe-4ed1-80f0-73d10cb1c11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f613e132-44b7-454b-86a5-5b0848aefc09", "tag": "136763a3-e42d-4f54-97fd-436a86ec757d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:29.295897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50523a91-30b5-4a2c-9a98-b20223dc189a req-b648c0aa-71fe-4ed1-80f0-73d10cb1c11c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.298913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50523a91-30b5-4a2c-9a98-b20223dc189a req-b648c0aa-71fe-4ed1-80f0-73d10cb1c11c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.299611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50523a91-30b5-4a2c-9a98-b20223dc189a req-b648c0aa-71fe-4ed1-80f0-73d10cb1c11c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.327443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-50523a91-30b5-4a2c-9a98-b20223dc189a req-b648c0aa-71fe-4ed1-80f0-73d10cb1c11c service nova] Creating event network-changed:136763a3-e42d-4f54-97fd-436a86ec757d for instance f613e132-44b7-454b-86a5-5b0848aefc09 on n-h1-854882-3 Aug 29 15:36:29.363548 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-50523a91-30b5-4a2c-9a98-b20223dc189a req-b648c0aa-71fe-4ed1-80f0-73d10cb1c11c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075230 Aug 29 15:36:29.366894 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1297/2468] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:29.432776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:29.433533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:29.452902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.453566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.453692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:29.454164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.454472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:29.456727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.457229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.460297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.465407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.467349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.468255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.469499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.470397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.471080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.680332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:29.693867 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0cda2438-a6da-4701-9109-e4c31ddcdaa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.244137 Aug 29 15:36:29.694999 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1298/2469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:29 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:29.711639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:29.714719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:29.722633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.723298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.724206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.725118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.725735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.726414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.729938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:29.770236 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-36d25090-bfae-4035-b106-8e1ef2bd50b9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073534 Aug 29 15:36:29.771410 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1299/2470] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:29 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:29.807776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:29.808957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] [instance: 4925408f-28f7-4a69-baa0-b04c3c8b985a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:29.827980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.829381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.830094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.830944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.831833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.832461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.854577 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] HTTP exception thrown: Instance 4925408f-28f7-4a69-baa0-b04c3c8b985a could not be found. Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Request method failure captured: Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a HTTP/1.1 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzljldau9EHrHt887JgT4tHQCbDB-D9W6g-a5PIv5_al8_wU-EvkSRbvsnrwwI6atAprEIG8T6JZ4H2QrCAsKSGAFE2HGnAJDCfm8ENmY-r-lwNb79e3uJS9JGSMrraVxMJ2cXLsUYOF2NAlLFCtLFn6XuGJKv5tYbWTutC89UtTnY Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f64f2469ff0345d680db3cae9444d749 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TenantUsagesTestJSON-1568283480 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f64f2469ff0345d680db3cae9444d749"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f64f2469ff0345d680db3cae9444d749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f64f2469ff0345d680db3cae9444d749", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f64f2469ff0345d680db3cae9444d749"}]}] Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TenantUsagesTestJSON-1568283480 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f64f2469ff0345d680db3cae9444d749 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1568283480 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TenantUsagesTestJSON-1568283480-project Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 6b448f96ae8b4a6698169ff4ef319ae2 Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TenantUsagesTestJSON-1568283480-project Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 4925408f-28f7-4a69-baa0-b04c3c8b985a could not be found. Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '4925408f-28f7-4a69-baa0-b04c3c8b985a'} Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4925408f-28f7-4a69-baa0-b04c3c8b985a could not be found. Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4925408f-28f7-4a69-baa0-b04c3c8b985a could not be found. Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:29.857849 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:29.862143 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:29.862143 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:29.862143 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:29.862143 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:29.862143 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:29.862143 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4925408f-28f7-4a69-baa0-b04c3c8b985a could not be found. Aug 29 15:36:29.862143 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:29.863426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] Returning 404 to user: Instance 4925408f-28f7-4a69-baa0-b04c3c8b985a could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:29.865168 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-42273a27-e9d4-4923-9ce4-8a60be97970a tempest-TenantUsagesTestJSON-1568283480 tempest-TenantUsagesTestJSON-1568283480-project] 10.222.0.16 "GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a" status: 404 len: 111 microversion: 2.1 time: 0.063062 Aug 29 15:36:29.866787 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1300/2471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:29 2022] GET /compute/v2.1/servers/4925408f-28f7-4a69-baa0-b04c3c8b985a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:36:29.993339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:29.994029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:30.012332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.013451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.015178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.016069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.017201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.017876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.178516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:30.191092 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea53e7a8-0477-4d57-8c2f-33f2f2273059 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1280 microversion: 2.1 time: 0.202050 Aug 29 15:36:30.211256 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1301/2472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:29 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:30.295437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:30.307824 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8596b94-1519-4450-a64d-8c77e2567666 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1609 microversion: 2.1 time: 0.879636 Aug 29 15:36:30.314450 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1172/2473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:29 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1609 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:30.715419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:30.716041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:30.732935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.733460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.733902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.734610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.735059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.735662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.782397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:30.784693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:30.803404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.812264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.812841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.813640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.814116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.814551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.920059 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f5f791e-f381-4145-bc0c-a8a1d84de6a9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141481 Aug 29 15:36:30.937838 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1173/2474] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:30 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:31.063644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:31.081279 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-20ee34a8-9814-47bf-ba1e-7a56b925395e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.369973 Aug 29 15:36:31.094692 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1302/2475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:30 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:31.219178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:31.220292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:31.231715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.233218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.234185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.235881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.236561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.237378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.339454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:31.340105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:31.354641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.355595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.356036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.356973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.357519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.358012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.491194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:31.510003 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6c5fafd-c688-4ebe-b950-580d87e37f1e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1280 microversion: 2.1 time: 0.295524 Aug 29 15:36:31.528064 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1174/2476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:31 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:31.568988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:31.578446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94e73f34-aa33-465e-ba49-e317e658ef85 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1541 microversion: 2.1 time: 0.244123 Aug 29 15:36:31.584237 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1303/2477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:31 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1541 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:31.935227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:31.938456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:31.952882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.959228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.960050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.961815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.962453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.963085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.039867 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a7abb023-c570-43db-bd43-958bc641a952 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110631 Aug 29 15:36:32.044472 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1175/2478] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:31 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:32.104113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:32.104730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:32.115919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.116411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.116849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.117589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.118042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.118465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.143542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-70447767-c209-4b8e-87ca-38fd847e3666 req-d239f894-bf33-4fc1-96fc-95430f0c03ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e2c2cf-4748-4e72-a697-6079333133bf", "name": "network-vif-deleted", "tag": "44db1ef2-f32e-46d8-a8ba-9a9fff6f2390"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:32.160677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-70447767-c209-4b8e-87ca-38fd847e3666 req-d239f894-bf33-4fc1-96fc-95430f0c03ba service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.162036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-70447767-c209-4b8e-87ca-38fd847e3666 req-d239f894-bf33-4fc1-96fc-95430f0c03ba service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.162623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-70447767-c209-4b8e-87ca-38fd847e3666 req-d239f894-bf33-4fc1-96fc-95430f0c03ba service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.207233 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-70447767-c209-4b8e-87ca-38fd847e3666 req-d239f894-bf33-4fc1-96fc-95430f0c03ba service nova] Creating event network-vif-deleted:44db1ef2-f32e-46d8-a8ba-9a9fff6f2390 for instance 47e2c2cf-4748-4e72-a697-6079333133bf on n-h2-854882-3 Aug 29 15:36:32.221014 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-70447767-c209-4b8e-87ca-38fd847e3666 req-d239f894-bf33-4fc1-96fc-95430f0c03ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081932 Aug 29 15:36:32.221584 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1176/2479] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:32.534451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:32.535185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:32.559032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.559532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.559972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.560700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.561161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.561654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.565845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:32.575274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba695a35-ae54-4b0e-b1e3-43b23762aa9d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.474828 Aug 29 15:36:32.575871 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1304/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:32 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:32.603886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:32.604126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:32.622311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.622871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.623527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.624263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.624729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.625161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.751668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:32.781641 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a36b876-9577-4329-851a-64126f57e059 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.182068 Aug 29 15:36:32.789976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1305/2481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:32 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:32.797967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81b6248c-c4ed-462b-9a4c-4b2b31338f73 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e38130d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:32.856694 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81b6248c-c4ed-462b-9a4c-4b2b31338f73 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df" status: 200 len: 637 microversion: 2.1 time: 0.065568 Aug 29 15:36:32.866798 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1306/2482] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:32 2022] GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df => generated 637 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:32.873043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9ae80e7f-b31f-4141-9d07-a1c16b0a5da2 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update_all', calling method: .version_select at 0x7fb0e2d3b820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:32.928049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:32.938817 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-87aa78dc-5eed-491d-ab24-04a75380ff4a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1322 microversion: 2.1 time: 0.408705 Aug 29 15:36:32.941297 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1177/2483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:32 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:32.960390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9ae80e7f-b31f-4141-9d07-a1c16b0a5da2 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:32.967820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9ae80e7f-b31f-4141-9d07-a1c16b0a5da2 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:33.053667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.056554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:33.083019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.083600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.096030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.097032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.097748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.098348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.181276 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4db84707-3d5d-46f3-bde4-d9b3eb75eea6 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128313 Aug 29 15:36:33.183348 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1178/2484] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:33 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:33.523316 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9ae80e7f-b31f-4141-9d07-a1c16b0a5da2 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 61 microversion: 2.1 time: 0.655082 Aug 29 15:36:33.525002 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1307/2485] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:32 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 61 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:33.548918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9d6b6d3b-488b-49dc-91cd-d3f3311f9cf4 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e3ca95e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.599153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.600785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:33.615893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.619883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.620732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.623152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.627127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.627777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.072152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:34.082507 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9c37348-6f35-416c-a925-8a569f188b0a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.487735 Aug 29 15:36:34.098612 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1308/2486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:33 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:34.159394 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9d6b6d3b-488b-49dc-91cd-d3f3311f9cf4 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "DELETE /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.628494 Aug 29 15:36:34.160058 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1179/2487] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Aug 29 15:36:33 2022] DELETE /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata/os_version => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:34.166450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:34.169808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:34.187648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.188215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.189036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.190573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.191048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.191478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.291663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:34.327597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:34.336516 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63e26130-9843-4dbe-a7d6-0e93013c028b tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.175300 Aug 29 15:36:34.353999 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1180/2488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:34 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:34.365762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:34.366668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:34.369826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f9b15df6-85cf-4602-bb0c-7f66f2442448 req-5d73a872-f3a9-4919-9a92-5525b408bf5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffae3be-a9cf-4935-a2cc-ae3d02c78553", "name": "network-vif-plugged", "status": "completed", "tag": "d2c95a43-5446-44fb-98e9-6950b9097c2a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:34.378861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.385072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.385563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.386506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.386974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.387868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.388247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9b15df6-85cf-4602-bb0c-7f66f2442448 req-5d73a872-f3a9-4919-9a92-5525b408bf5e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.388372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=58 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:34.388774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9b15df6-85cf-4602-bb0c-7f66f2442448 req-5d73a872-f3a9-4919-9a92-5525b408bf5e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.389217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9b15df6-85cf-4602-bb0c-7f66f2442448 req-5d73a872-f3a9-4919-9a92-5525b408bf5e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.419191 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f9b15df6-85cf-4602-bb0c-7f66f2442448 req-5d73a872-f3a9-4919-9a92-5525b408bf5e service nova] Creating event network-vif-plugged:d2c95a43-5446-44fb-98e9-6950b9097c2a for instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 on n-h1-854882-3 Aug 29 15:36:34.426117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f9b15df6-85cf-4602-bb0c-7f66f2442448 req-5d73a872-f3a9-4919-9a92-5525b408bf5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.325247 Aug 29 15:36:34.426778 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1309/2489] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:34.441320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-853d5c51-f6a8-4f44-837a-9ab578ecaebe tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e2e175e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:34.519294 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-853d5c51-f6a8-4f44-837a-9ab578ecaebe tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 37 microversion: 2.1 time: 0.086005 Aug 29 15:36:34.519891 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1310/2490] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:36:34 2022] GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 37 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:34.532203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:34.535777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:34.544287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.545540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.546176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.547103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.547732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.548430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.654075 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd38e4f9-70ed-41fe-ab55-184277d3fabb tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126171 Aug 29 15:36:34.658616 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1311/2491] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:34 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:34.668514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-bc57acb2-a0cb-419d-b6bb-cdbd2901a66e req-87e6706e-efa1-49d4-b7c7-20744a75373f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907919a0-6c91-40b3-a95d-481cdc27bfdf", "tag": "d8a92257-1ddf-4dbb-99bb-14e7b59d1a34"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:34.726184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bc57acb2-a0cb-419d-b6bb-cdbd2901a66e req-87e6706e-efa1-49d4-b7c7-20744a75373f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.728595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bc57acb2-a0cb-419d-b6bb-cdbd2901a66e req-87e6706e-efa1-49d4-b7c7-20744a75373f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.730485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bc57acb2-a0cb-419d-b6bb-cdbd2901a66e req-87e6706e-efa1-49d4-b7c7-20744a75373f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.785091 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bc57acb2-a0cb-419d-b6bb-cdbd2901a66e req-87e6706e-efa1-49d4-b7c7-20744a75373f service nova] Creating event network-changed:d8a92257-1ddf-4dbb-99bb-14e7b59d1a34 for instance 907919a0-6c91-40b3-a95d-481cdc27bfdf on n-h2-854882-3 Aug 29 15:36:34.807742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:34.816015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9286255-f883-4f92-b131-f19161dd5253 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1322 microversion: 2.1 time: 0.460804 Aug 29 15:36:34.816608 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1181/2492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:34 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:34.827204 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-bc57acb2-a0cb-419d-b6bb-cdbd2901a66e req-87e6706e-efa1-49d4-b7c7-20744a75373f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166525 Aug 29 15:36:34.827823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1312/2493] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:34.829765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-596704b7-1f1f-44f8-9107-017d2b338f55 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update_all', calling method: .version_select at 0x7fb0e3406940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:34.917292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-596704b7-1f1f-44f8-9107-017d2b338f55 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:34.932344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-596704b7-1f1f-44f8-9107-017d2b338f55 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:35.105435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.107244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:35.109306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=22 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:35.121945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.123771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.124451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.125746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.126681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.127495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.297935 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-596704b7-1f1f-44f8-9107-017d2b338f55 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 61 microversion: 2.1 time: 0.477695 Aug 29 15:36:35.298540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1182/2494] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:34 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 61 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:35.308163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-760f0133-2084-459e-b9cb-e826f0f4a498 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e32681f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.367681 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-760f0133-2084-459e-b9cb-e826f0f4a498 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.063304 Aug 29 15:36:35.369515 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1183/2495] 10.222.0.16 () {58 vars in 1290 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata/os_distro => generated 33 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:36:35.381791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.382425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:35.397787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.398925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.399768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.401221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.402730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.404743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:35.405209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.419561 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4955e4ac-1b1f-449a-953b-bc6c90180612 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.319664 Aug 29 15:36:35.420604 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1313/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:35.427082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1e2a11f4-aa97-4c5e-90f2-7d6f3a53ce21 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update_all', calling method: .version_select at 0x7fb0e2b3aee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:35.507534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1e2a11f4-aa97-4c5e-90f2-7d6f3a53ce21 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:35.511047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:35.520268 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ec8f57f1-f6ad-47af-9465-60313e9e5760 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.148474 Aug 29 15:36:35.521576 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1184/2497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:35.522949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1e2a11f4-aa97-4c5e-90f2-7d6f3a53ce21 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:35.669862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.673114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:35.690607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.695924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.696591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.697673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.698413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.702393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.735133 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1e2a11f4-aa97-4c5e-90f2-7d6f3a53ce21 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 61 microversion: 2.1 time: 0.312238 Aug 29 15:36:35.736647 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1314/2498] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:35 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 61 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:35.747361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-463c662f-aedd-4d29-aeeb-e941a823f27e tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e2aa0940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.765605 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6abab1d9-24e2-4065-a5ed-5ca023aee6cc tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103251 Aug 29 15:36:35.772347 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1185/2499] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:36:35.805200 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-463c662f-aedd-4d29-aeeb-e941a823f27e tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 61 microversion: 2.1 time: 0.061955 Aug 29 15:36:35.806126 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1315/2500] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 61 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:36:35.817998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39f956a0-73bc-41e0-bed1-a08cd2304c73 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update_all', calling method: .version_select at 0x7fb0e2f39670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:35.842726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.843514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:35.861731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.863484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.864168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.866191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.868145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.871593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.915161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-39f956a0-73bc-41e0-bed1-a08cd2304c73 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:35.922987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-39f956a0-73bc-41e0-bed1-a08cd2304c73 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:36.210297 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39f956a0-73bc-41e0-bed1-a08cd2304c73 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 61 microversion: 2.1 time: 0.396230 Aug 29 15:36:36.212700 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1186/2501] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:35 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 61 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:36.223873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-686baa7f-49ec-44c7-8630-df1382ef87f5 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update_all', calling method: .version_select at 0x7fb0e32a64c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:36.322476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-686baa7f-49ec-44c7-8630-df1382ef87f5 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:36.340238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-686baa7f-49ec-44c7-8630-df1382ef87f5 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:36.341219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:36.355058 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fef563d7-17cf-45e3-88b7-a6ccee8f4db0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1322 microversion: 2.1 time: 0.518761 Aug 29 15:36:36.360525 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1316/2502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:36.450957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:36.452236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:36.468145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.469178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.473374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.475885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.478693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.482532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.830368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:36.867536 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-121e5f34-7fb4-4307-b2f1-da48f95e7428 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.424827 Aug 29 15:36:36.871809 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1317/2503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:36 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:36.892602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:36.897213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:36.914191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.918697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.919259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.920095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.933199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.934084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.948944 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-686baa7f-49ec-44c7-8630-df1382ef87f5 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 64 microversion: 2.1 time: 0.730470 Aug 29 15:36:36.954222 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1187/2504] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:36 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 64 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:36.964520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-27f41e0d-9352-420a-b5e1-8e63f4ad9af9 req-c7220056-3c7b-4e8d-9533-30a126ec997a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f613e132-44b7-454b-86a5-5b0848aefc09", "name": "network-vif-plugged", "status": "completed", "tag": "136763a3-e42d-4f54-97fd-436a86ec757d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:37.004027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-27f41e0d-9352-420a-b5e1-8e63f4ad9af9 req-c7220056-3c7b-4e8d-9533-30a126ec997a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.004648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-27f41e0d-9352-420a-b5e1-8e63f4ad9af9 req-c7220056-3c7b-4e8d-9533-30a126ec997a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.008503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-27f41e0d-9352-420a-b5e1-8e63f4ad9af9 req-c7220056-3c7b-4e8d-9533-30a126ec997a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.024432 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-27f41e0d-9352-420a-b5e1-8e63f4ad9af9 req-c7220056-3c7b-4e8d-9533-30a126ec997a service nova] Creating event network-vif-plugged:136763a3-e42d-4f54-97fd-436a86ec757d for instance f613e132-44b7-454b-86a5-5b0848aefc09 on n-h1-854882-3 Aug 29 15:36:37.035329 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-27f41e0d-9352-420a-b5e1-8e63f4ad9af9 req-c7220056-3c7b-4e8d-9533-30a126ec997a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079443 Aug 29 15:36:37.036132 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1188/2505] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:37.044318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ddd04989-cd37-46a3-a3e0-885e99f86b8a tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e3aa4430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:37.059884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:37.087699 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86e282e9-7bc3-4170-9c47-78409db40e60 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.212335 Aug 29 15:36:37.098058 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1318/2506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:36 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:37.139172 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ddd04989-cd37-46a3-a3e0-885e99f86b8a tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 64 microversion: 2.1 time: 0.101473 Aug 29 15:36:37.139904 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1189/2507] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:36:37 2022] GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 64 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:37.150928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6a4189b-d7b2-421d-8cb1-5daca26a653f tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update_all', calling method: .version_select at 0x7fb0e2b3a4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:37.246359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d6a4189b-d7b2-421d-8cb1-5daca26a653f tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:37.253561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d6a4189b-d7b2-421d-8cb1-5daca26a653f tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:37.376794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:37.377568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:37.391777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.394694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.397343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.398295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.398910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.399522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.685915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:37.717551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da24f308-db5b-473f-8154-fcb130739252 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1322 microversion: 2.1 time: 0.342459 Aug 29 15:36:37.727969 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1190/2508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:37 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:37.744855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:37.751436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:37.767916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.769984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.771777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.772962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.773735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.774860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.880349 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6a4189b-d7b2-421d-8cb1-5daca26a653f tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 61 microversion: 2.1 time: 0.733510 Aug 29 15:36:37.884183 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1319/2509] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:37 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 61 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:37.890107 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Cannot 'reboot' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:37.899200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:37.900234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action HTTP/1.1 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 28 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: {"reboot": {"type": "HARD"}} Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot 'reboot' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '80404306-3d1e-4411-a8e8-b7d2ae05d982', 'body': {'reboot': {'type': 'HARD'}}} Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:36:37.910433 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:37.915954 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:37.917515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 409 to user: Cannot 'reboot' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:37.918900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.920253 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8002c34-ec4f-469e-ae0f-1283b736eb16 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action" status: 409 len: 145 microversion: 2.1 time: 0.191144 Aug 29 15:36:37.932199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.933523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1191/2510] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:37 2022] POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action => generated 145 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:36:37.938344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.940878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.942731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.943471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.957110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-43e96713-d6bc-4db7-979d-169f2f0794ad tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update', calling method: .version_select at 0x7fb0e35d1700>, body: {"meta": {"os_version": "alt"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:38.046815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:38.059916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-43e96713-d6bc-4db7-979d-169f2f0794ad tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:38.071613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-43e96713-d6bc-4db7-979d-169f2f0794ad tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:38.274157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:38.289058 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f8b05a2-361d-43b1-8d2f-dab953cdae2f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1319 microversion: 2.1 time: 0.396565 Aug 29 15:36:38.289936 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1320/2511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:37 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:38.303305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:38.306806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:38.317727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.322417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.322875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.323635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.324099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.334304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.369001 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Cannot 'rebuild' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action HTTP/1.1 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 65 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'rebuild' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '80404306-3d1e-4411-a8e8-b7d2ae05d982', 'body': {'rebuild': {'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab'}}} Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:38.371503 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued Aug 29 15:36:38.375096 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:38.377761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 409 to user: Cannot 'rebuild' instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 while it is in vm_state rescued {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:38.378903 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3db8dff9-68e0-4229-b2a8-ce4f77603a0d tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action" status: 409 len: 146 microversion: 2.1 time: 0.087904 Aug 29 15:36:38.380036 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1321/2512] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:38 2022] POST /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982/action => generated 146 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:36:38.385292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:38.386111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:38.393593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.394302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.394914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.396084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.396720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.397333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.466034 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-43e96713-d6bc-4db7-979d-169f2f0794ad tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.526220 Aug 29 15:36:38.471784 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1192/2513] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Aug 29 15:36:37 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata/os_version => generated 31 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:38.475888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:38.477182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:38.494874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.496832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.497580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.503796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.504241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.505724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.548344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:38.550986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:38.563262 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c92e63d0-3563-4c49-b230-2bf7b957e0c0 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.181937 Aug 29 15:36:38.563858 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1322/2514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:38 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:38.591749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-571941d6-95ae-4e77-81f1-2e479a11e257 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e2d6a5e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:38.593666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:38.666368 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-571941d6-95ae-4e77-81f1-2e479a11e257 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 58 microversion: 2.1 time: 0.101416 Aug 29 15:36:38.666979 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1323/2515] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:36:38 2022] GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 58 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:38.683290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-668e005e-a9a8-42cc-9c47-98f5da1291fc tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'update_all', calling method: .version_select at 0x7fb0e2aa8e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:38.766030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-668e005e-a9a8-42cc-9c47-98f5da1291fc tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:38.780364 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-62458d7a-2d49-4ff3-aa48-dd50a8dbf0ce tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "DELETE /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 204 len: 0 microversion: 2.1 time: 0.311116 Aug 29 15:36:38.781350 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1193/2516] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:38 2022] DELETE /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:38.783785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-668e005e-a9a8-42cc-9c47-98f5da1291fc tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:38.789222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:38.789998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:38.798259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.798996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.799878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.800272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.800725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.801263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.062149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:39.075476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96e826d9-76eb-48a5-9a2c-3c76775cdd50 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1322 microversion: 2.1 time: 0.292413 Aug 29 15:36:39.076714 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1194/2517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:38 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:39.082104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:39.085347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:39.095046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.095843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.096474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.098011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.098673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.099260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.242015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-668e005e-a9a8-42cc-9c47-98f5da1291fc tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 61 microversion: 2.1 time: 0.566819 Aug 29 15:36:39.243373 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1324/2518] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:38 2022] PUT /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 61 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:36:39.254176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13d6b86c-4c0e-4b11-bf13-0a136a25c775 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Action: 'create', calling method: .version_select at 0x7fb0e362e700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:39.342701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-13d6b86c-4c0e-4b11-bf13-0a136a25c775 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:39.361132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-13d6b86c-4c0e-4b11-bf13-0a136a25c775 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Getting quotas for user 23d02b0782134c01b8b987efd175f6c4 and project 7b6d552efe0040308b2314fabedb7a4e. Resources: dict_keys(['metadata_items']) {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:39.516420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:39.545737 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a65f168-9258-471a-b673-2664ba8e9f48 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1690 microversion: 2.1 time: 0.467553 Aug 29 15:36:39.546654 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1195/2519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:39 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1690 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:39.559465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:39.563825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:39.605438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.606283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.611233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.617413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.619525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.620155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.851423 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13d6b86c-4c0e-4b11-bf13-0a136a25c775 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "POST /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 85 microversion: 2.1 time: 0.602168 Aug 29 15:36:39.852928 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1325/2520] 10.222.0.16 () {60 vars in 1281 bytes} [Mon Aug 29 15:36:39 2022] POST /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 85 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:36:39.862068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:39.862833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:39.872538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.873141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.873861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.874786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.875463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.876089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.980236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:40.000322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f7a0f71-862a-4a03-b591-57889b48ce94 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.145981 Aug 29 15:36:40.003170 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1326/2521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:39 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:40.018830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3519ef54-a19a-4638-b115-d09f1086e7ea req-b3dc730b-b5a2-416f-b184-64fd0074e017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907919a0-6c91-40b3-a95d-481cdc27bfdf", "name": "network-vif-plugged", "status": "completed", "tag": "d8a92257-1ddf-4dbb-99bb-14e7b59d1a34"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:40.035182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3519ef54-a19a-4638-b115-d09f1086e7ea req-b3dc730b-b5a2-416f-b184-64fd0074e017 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.035858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3519ef54-a19a-4638-b115-d09f1086e7ea req-b3dc730b-b5a2-416f-b184-64fd0074e017 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.037205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3519ef54-a19a-4638-b115-d09f1086e7ea req-b3dc730b-b5a2-416f-b184-64fd0074e017 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.038368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:40.042365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:40.048459 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3fb2b5b9-23fb-4ced-b473-b065d48b5ffd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1469 microversion: 2.1 time: 0.500516 Aug 29 15:36:40.049324 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1196/2522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:39 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1469 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:40.055712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67452b47-3aa8-4029-9d2c-5aad4661a0a0 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] Calling method '.version_select at 0x7fb0e3406940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:40.085752 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3519ef54-a19a-4638-b115-d09f1086e7ea req-b3dc730b-b5a2-416f-b184-64fd0074e017 service nova] Creating event network-vif-plugged:d8a92257-1ddf-4dbb-99bb-14e7b59d1a34 for instance 907919a0-6c91-40b3-a95d-481cdc27bfdf on n-h2-854882-3 Aug 29 15:36:40.104741 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67452b47-3aa8-4029-9d2c-5aad4661a0a0 tempest-ImagesMetadataTestJSON-337600784 tempest-ImagesMetadataTestJSON-337600784-project] 10.222.0.16 "GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata" status: 200 len: 85 microversion: 2.1 time: 0.053888 Aug 29 15:36:40.105528 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3519ef54-a19a-4638-b115-d09f1086e7ea req-b3dc730b-b5a2-416f-b184-64fd0074e017 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095401 Aug 29 15:36:40.105878 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1197/2523] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:36:40 2022] GET /compute/v2.1/images/3947d24c-f952-4e2d-a0eb-9f31bbdca5df/metadata => generated 85 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:36:40.106490 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1327/2524] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:40.120865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:40.121935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:40.132392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:40.133017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:40.144445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.145307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.147624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.148933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.151433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.151903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.152032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.152509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.153128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.153246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.154678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.159995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.469641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:40.490124 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-839449ca-0ea0-4617-b46e-69e9a39a8290 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1322 microversion: 2.1 time: 0.381177 Aug 29 15:36:40.503918 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1328/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:40 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:40.569692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:40.570370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:40.582324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.584060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.584766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.590100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.590675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.591214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.876098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:40.888614 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-051e9d1d-663b-4aba-9e51-d70d4835ac9c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1690 microversion: 2.1 time: 0.324169 Aug 29 15:36:40.890052 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1329/2526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:40 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1690 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:41.022096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:41.024770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:41.054891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.057863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.058796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.062420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.069345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.075160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.227809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:41.237210 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-84d224cd-a01e-49ac-b0de-1174444a8d6c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.219130 Aug 29 15:36:41.238590 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1330/2527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:41 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:41.371893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:41.380788 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-06cb4687-97c7-495f-b624-6817bf156247 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553" status: 200 len: 1468 microversion: 2.1 time: 1.273491 Aug 29 15:36:41.381414 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1198/2528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:40 2022] GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 => generated 1468 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:41.402470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:41.415036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:41.416048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Searching by: {'reservation_id': 'r-x8owwf0z', 'deleted': False, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:36:41.436019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.442346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.443319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.444752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.446304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.447050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.512528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:41.513379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:41.526840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.528878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.535393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.537188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.538120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.538735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.721785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:36:41.872602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:41.886261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.886741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.887354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.170248 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14726158-9d89-4670-b973-b429a73c0691 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-x8owwf0z" status: 200 len: 2930 microversion: 2.1 time: 0.772318 Aug 29 15:36:42.171045 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1331/2529] 10.222.0.16 () {58 vars in 1197 bytes} [Mon Aug 29 15:36:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-x8owwf0z => generated 2930 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:42.176062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:42.176822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:42.193191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.195609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.196136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.198779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.199506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.200139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.374356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:42.412334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29ad25f5-adb7-4b9c-9c6e-caf7f7b67c38 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1322 microversion: 2.1 time: 0.900555 Aug 29 15:36:42.416927 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1199/2530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:41 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:42.435419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:42.444801 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a69f1f03-b33b-40ac-b972-c13690b90ae7 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1690 microversion: 2.1 time: 0.272315 Aug 29 15:36:42.445267 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1332/2531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:42 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1690 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:42.450726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:42.451660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:42.458596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:42.458791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-074425d9-75f8-4a35-a2de-5ab3dc691df4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:42.460731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.461826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.462584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.463539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.464223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.464981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.500699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.server_groups [None req-074425d9-75f8-4a35-a2de-5ab3dc691df4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Querying cell f444391f-7036-4697-bac9-7a9b7c940a18(cell1) for 2 instances {{(pid=130001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:36:42.501455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-074425d9-75f8-4a35-a2de-5ab3dc691df4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.501946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-074425d9-75f8-4a35-a2de-5ab3dc691df4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.502381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-074425d9-75f8-4a35-a2de-5ab3dc691df4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.569509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-074425d9-75f8-4a35-a2de-5ab3dc691df4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/1020dc48-0c68-4ad4-8dd0-2c1d2df7a846" status: 200 len: 266 microversion: 2.1 time: 0.130389 Aug 29 15:36:42.573798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1200/2532] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:36:42 2022] GET /compute/v2.1/os-server-groups/1020dc48-0c68-4ad4-8dd0-2c1d2df7a846 => generated 266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:42.584672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:42.586089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:42.600295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.600791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.601230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.601990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.602448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.608154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.615157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:42.624744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6c7c2ae-b804-4a25-9f48-2d11b65338d6 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.177966 Aug 29 15:36:42.625791 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1333/2533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:42 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:43.003571 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee13fb5e-5a55-48c5-a304-b46c82802be0 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553" status: 200 len: 1619 microversion: 2.1 time: 0.424666 Aug 29 15:36:43.004203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1201/2534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:42 2022] GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 => generated 1619 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:43.024631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:43.025829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:43.032710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.033596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.034274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.035196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.036058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.036955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.214893 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c68b3eb3-bc06-4976-9ecd-df4365aa88d4 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 200 len: 1620 microversion: 2.1 time: 0.194644 Aug 29 15:36:43.219248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1334/2535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:43 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 1620 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:43.247330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-258030d4-67d7-4739-839d-21eba7006d4a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: .version_select at 0x7fb0e380a940>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-340830674", "policies": ["anti-affinity"]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:43.287718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-258030d4-67d7-4739-839d-21eba7006d4a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:43.294199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-258030d4-67d7-4739-839d-21eba7006d4a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:43.364904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-258030d4-67d7-4739-839d-21eba7006d4a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:43.372472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-258030d4-67d7-4739-839d-21eba7006d4a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:43.393676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-258030d4-67d7-4739-839d-21eba7006d4a tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.150918 Aug 29 15:36:43.394735 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1202/2536] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:36:43 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:43.441495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:43.442303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:43.455999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.456727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.457658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.461002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.462834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.464551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.465996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:43.466619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:43.492936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.493730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.494766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.496819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.509482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.510478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.772483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:43.784412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-07de4adc-7d3a-4492-8343-cebddea84868 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1471 microversion: 2.1 time: 0.348879 Aug 29 15:36:43.785328 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1335/2537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:43 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:43.791085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1268142263", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7645b9b4-d145-4c76-aacf-96def6708411"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:43.855917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:44.158306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:44.173499 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd834206-eedc-4912-8ffc-eb67ebe5775f tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1690 microversion: 2.1 time: 0.707121 Aug 29 15:36:44.174489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1203/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:43 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1690 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:44.193759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:44.200368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:44.209831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:44.210712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:44.211390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:44.212374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:44.213065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:44.213742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:44.242465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:44.243901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:44.245149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:44.246279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:44.247859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:44.321303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:44.321835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:44.324685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:44.327062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:44.327821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:44.328274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:44.374425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:44.388842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:44.441638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Going to run 2 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:44.456387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:44.466188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:44.478037 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a429b18d-8291-4aee-b33c-24a8098bb834 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1252 microversion: 2.1 time: 0.276471 Aug 29 15:36:44.478833 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1204/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:44 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1252 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:44.581438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130002) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 15:36:44.634421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:44.651113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:44.809619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:44.826281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:44.875301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:45.074924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:45.095452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:45.265140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:45.291023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:45.342563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a386687-b221-4a32-b7b3-852cf4f3168b tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:45.343144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a386687-b221-4a32-b7b3-852cf4f3168b tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] [instance: ee4e560f-f1c1-4218-a535-66b884c2fc3e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:45.362495 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-3a386687-b221-4a32-b7b3-852cf4f3168b tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] HTTP exception thrown: Instance ee4e560f-f1c1-4218-a535-66b884c2fc3e could not be found. Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a386687-b221-4a32-b7b3-852cf4f3168b tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Request method failure captured: Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/ee4e560f-f1c1-4218-a535-66b884c2fc3e/action HTTP/1.1 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 15 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNz3_Z2qaeecTfeKitMNSu738m0JER2RayV-8htWOaAh2uq1a_mNKHW9LhOhcAW6L-G9OqoKSo9HPfr_IIxeuM2A-I-mkK62aw7xEnGUGVzaj9YWx_40KwFM2C9wwhgoo1mqL-DNF6cX8ZDuA1EHEzJwTHruqt2k9ZLMPao1REag2G8 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/27712ebbd794448681471a673a8de9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_27712ebbd794448681471a673a8de9da", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}] Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b2bfb928bb804952a9051449e1489cd4 Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: {"migrate": {}} Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ee4e560f-f1c1-4218-a535-66b884c2fc3e could not be found. Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ee4e560f-f1c1-4218-a535-66b884c2fc3e', 'body': {'migrate': {}}} Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4e560f-f1c1-4218-a535-66b884c2fc3e could not be found. Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4e560f-f1c1-4218-a535-66b884c2fc3e could not be found. Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:45.377751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4e560f-f1c1-4218-a535-66b884c2fc3e could not be found. Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a386687-b221-4a32-b7b3-852cf4f3168b tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Returning 404 to user: Instance ee4e560f-f1c1-4218-a535-66b884c2fc3e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a386687-b221-4a32-b7b3-852cf4f3168b tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/ee4e560f-f1c1-4218-a535-66b884c2fc3e/action" status: 404 len: 111 microversion: 2.1 time: 0.899562 Aug 29 15:36:45.381879 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1205/2540] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:44 2022] POST /compute/v2.1/servers/ee4e560f-f1c1-4218-a535-66b884c2fc3e/action => generated 111 bytes in 901 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:45.396727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:45.398470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:45.433058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.442221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.442943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.443868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.444473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.445073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.447996 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2328da0b-5916-44c1-b9dc-83b2733ad744 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.661544 Aug 29 15:36:45.461727 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1336/2541] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1676 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:36:45.481957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:45.482653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:45.507148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.511151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.511979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.518608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.521916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.522537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.553675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:45.646130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.646130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.646130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.646504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'fault' on Instance uuid 647883af-6f80-4e9c-8f48-d0e4ba4edef3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:45.726413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:45.738848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-501e9f62-07ba-48ec-b7da-7c271f7d3980 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 200 len: 1336 microversion: 2.1 time: 0.275850 Aug 29 15:36:45.739737 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1337/2542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:45 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 1336 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:45.775463 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e256edb-b886-422f-9c19-754690243cef tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 204 len: 0 microversion: 2.1 time: 0.393734 Aug 29 15:36:45.776709 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1206/2543] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:45 2022] DELETE /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:45.785816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:45.804275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:45.805203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Searching by: {'deleted': False, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:36:45.835383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.835868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.836320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.846614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.847102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.847546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.919447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:36:45.986108 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-92aee300-ec4e-49c1-b7f3-745d42665feb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.207618 Aug 29 15:36:45.992798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1207/2544] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:36:45 2022] GET /compute/v2.1/servers => generated 1665 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:45.998437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:45.999697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:46.007252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.007909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.008692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.009599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.010195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.010763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.055849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.056332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.056766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.057217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lazy-loading 'fault' on Instance uuid 47e2c2cf-4748-4e72-a697-6079333133bf {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:46.203660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:46.216322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-de85fc05-0fcb-43be-99be-6efaaa081ee5 req-5544d08e-bebe-4b2c-b477-c20794b5a42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647883af-6f80-4e9c-8f48-d0e4ba4edef3", "name": "network-vif-deleted", "tag": "5010f83a-6966-4d44-9e92-309b22d9c084"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:46.218926 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36a3177d-031c-455e-b02e-57924e57a809 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1257 microversion: 2.1 time: 0.224758 Aug 29 15:36:46.219658 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1208/2545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:45 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1257 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:46.224444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-730264681", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:46.240232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-de85fc05-0fcb-43be-99be-6efaaa081ee5 req-5544d08e-bebe-4b2c-b477-c20794b5a42e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.242246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-de85fc05-0fcb-43be-99be-6efaaa081ee5 req-5544d08e-bebe-4b2c-b477-c20794b5a42e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.246149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-de85fc05-0fcb-43be-99be-6efaaa081ee5 req-5544d08e-bebe-4b2c-b477-c20794b5a42e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.286333 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-de85fc05-0fcb-43be-99be-6efaaa081ee5 req-5544d08e-bebe-4b2c-b477-c20794b5a42e service nova] Creating event network-vif-deleted:5010f83a-6966-4d44-9e92-309b22d9c084 for instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 on n-h1-854882-3 Aug 29 15:36:46.313052 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-de85fc05-0fcb-43be-99be-6efaaa081ee5 req-5544d08e-bebe-4b2c-b477-c20794b5a42e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.572033 Aug 29 15:36:46.317845 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1338/2546] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:46.337476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:46.348753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:46.352063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:46.358346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.359238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.359876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.361761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.362693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.363409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.611457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:46.624466 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2cae9655-b38c-48d0-9b2d-e180e9ce4746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1554 microversion: 2.1 time: 0.303559 Aug 29 15:36:46.626923 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1339/2547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:46 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1554 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:46.633630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-570b71ac-b990-4437-aa02-c1e13bd282da tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:46.634671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-570b71ac-b990-4437-aa02-c1e13bd282da tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:46.731696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-570b71ac-b990-4437-aa02-c1e13bd282da tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:46.741320 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-570b71ac-b990-4437-aa02-c1e13bd282da tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1219 microversion: 2.1 time: 0.113003 Aug 29 15:36:46.757672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1340/2548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:46 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:46.788406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:46.789301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 647883af-6f80-4e9c-8f48-d0e4ba4edef3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:46.799054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.799560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.800005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.800694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.801143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.801640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.821256 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 could not be found. Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 HTTP/1.1 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 could not be found. Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '647883af-6f80-4e9c-8f48-d0e4ba4edef3'} Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 could not be found. Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 could not be found. Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:46.824782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 could not be found. Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 404 to user: Instance 647883af-6f80-4e9c-8f48-d0e4ba4edef3 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:46.829827 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-31cac582-4082-4272-8ebd-41edd75888ca tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3" status: 404 len: 111 microversion: 2.1 time: 0.054167 Aug 29 15:36:46.831845 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1341/2549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:46 2022] GET /compute/v2.1/servers/647883af-6f80-4e9c-8f48-d0e4ba4edef3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:46.837710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab7d61d1-c6b6-4062-95bb-eab5786c9293 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '.version_select at 0x7fb0e29f59d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:46.862382 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab7d61d1-c6b6-4062-95bb-eab5786c9293 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776601346" status: 202 len: 0 microversion: 2.1 time: 0.028706 Aug 29 15:36:46.864018 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1342/2550] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:36:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776601346 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:47.247504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:47.249485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:47.264610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.265536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.266308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.267193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.267904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.277570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.405362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:47.405927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:47.406517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:47.407067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:47.407724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:47.433358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.433886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.434339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.441065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.444558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.445017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.499151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.505989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.506992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.512702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lazy-loading 'fault' on Instance uuid 47e2c2cf-4748-4e72-a697-6079333133bf {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:47.539501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Getting quotas for project 4e12170916e24a33ab0ad5309ac2ab21. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:47.564528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Getting quotas for user 8b2f1d48248d45fdb39ed3c1ee4b2734 and project 4e12170916e24a33ab0ad5309ac2ab21. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:47.609987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:47.621018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:47.679903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736591425d2d40cda2331153600f20df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4265e2a96c4b9ba49452d382cc413c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:47.696578 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5fd0b4bb-b3f9-4a13-b252-b051b8c6f16c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 200 len: 1257 microversion: 2.1 time: 0.456978 Aug 29 15:36:47.700612 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1343/2551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:47 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 1257 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:47.705933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee504d9e-2ebc-4e7f-9f80-48203b610a9b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.485172 Aug 29 15:36:47.716203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1209/2552] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:36:47.716494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:47.720871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:47.726734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9d818cb4-6308-4b4a-bfd1-55cb4971d821 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:47.728031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9d818cb4-6308-4b4a-bfd1-55cb4971d821 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:47.731887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:47.742738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.747544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.749876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.751675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.753360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.757555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.063457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9d818cb4-6308-4b4a-bfd1-55cb4971d821 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:48.074255 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9d818cb4-6308-4b4a-bfd1-55cb4971d821 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1221 microversion: 2.1 time: 0.356468 Aug 29 15:36:48.076842 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1210/2553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:47 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1221 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:48.090031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.092646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:48.108326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.109969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.112158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.113936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.115495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.117909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.135660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:48.319864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:48.342822 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96f8b243-1538-4847-85b9-a3ef684e04e7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1271 microversion: 2.1 time: 0.263809 Aug 29 15:36:48.343551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1211/2554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:48 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:48.525577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:48.550061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-acf25bd4-9093-4e75-bdd9-b99c757dd908 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1554 microversion: 2.1 time: 0.847875 Aug 29 15:36:48.553765 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1344/2555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:47 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1554 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:48.720505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.721138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] [instance: 47e2c2cf-4748-4e72-a697-6079333133bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:48.723179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:48.739818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.740321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.740761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.744770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.747625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.748281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.784656 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] HTTP exception thrown: Instance 47e2c2cf-4748-4e72-a697-6079333133bf could not be found. Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Request method failure captured: Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf HTTP/1.1 Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNyG4NR0bAZgt1NwYP0LSdoV2stx4lHJr0YLjjXt1J-n6DTV2LIay4dBXszEzpZ54gTEAnlEkfIMRXbHWlvF-9Ci6tM7pDmWaYTFC6FQTH3Cw111D6POPVQAWAs7FtOM-kuhSmKTjEW_g61N0nJbb4ptgSBbMPlKCNU1WgM3NR4iOAo Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fb4265e2a96c4b9ba49452d382cc413c Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestBootFromVolume-1040423535 Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fb4265e2a96c4b9ba49452d382cc413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fb4265e2a96c4b9ba49452d382cc413c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fb4265e2a96c4b9ba49452d382cc413c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fb4265e2a96c4b9ba49452d382cc413c"}]}] Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestBootFromVolume-1040423535 Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fb4265e2a96c4b9ba49452d382cc413c Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1040423535 Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestBootFromVolume-1040423535-project Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 736591425d2d40cda2331153600f20df Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestBootFromVolume-1040423535-project Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 47e2c2cf-4748-4e72-a697-6079333133bf could not be found. Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '47e2c2cf-4748-4e72-a697-6079333133bf'} Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e2c2cf-4748-4e72-a697-6079333133bf could not be found. Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e2c2cf-4748-4e72-a697-6079333133bf could not be found. Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:48.787385 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:48.791721 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:48.791721 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:48.791721 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:48.791721 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:48.791721 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:48.791721 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e2c2cf-4748-4e72-a697-6079333133bf could not be found. Aug 29 15:36:48.791721 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:36:48.799695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Returning 404 to user: Instance 47e2c2cf-4748-4e72-a697-6079333133bf could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:48.800913 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-941afb67-7e3a-48dc-adce-a8a182e7c820 tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf" status: 404 len: 111 microversion: 2.1 time: 0.084442 Aug 29 15:36:48.802719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1212/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:48 2022] GET /compute/v2.1/servers/47e2c2cf-4748-4e72-a697-6079333133bf => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:48.811738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd94fad9-a6a6-4c1c-aa30-60682e3e2f3c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] Calling method '.version_select at 0x7fb0e2994e50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.844791 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd94fad9-a6a6-4c1c-aa30-60682e3e2f3c tempest-ServersTestBootFromVolume-1040423535 tempest-ServersTestBootFromVolume-1040423535-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676725989" status: 202 len: 0 microversion: 2.1 time: 0.037287 Aug 29 15:36:48.849679 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1345/2557] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:36:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676725989 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:49.101895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.103086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:49.117143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.120879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.121623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.128718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.129508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.132441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.364753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.365683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:49.391453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.394099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.398233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.399386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.400497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.401153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.808046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:49.820849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-685aec1f-3bc5-4f52-8d0e-832244a18544 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1217 microversion: 2.1 time: 0.724334 Aug 29 15:36:49.822903 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1213/2558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:49 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1217 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:49.837444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.838418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:49.851810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.855653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.856552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.857578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.858077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.858507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:50.272527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:50.294143 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-718f0c20-7c11-4086-a42d-ca4479b6f345 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1289 microversion: 2.1 time: 0.933707 Aug 29 15:36:50.295913 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1346/2559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:49 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1289 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:50.683712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:50.696941 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-245b1eff-3bf9-4052-ba9a-6e80051a95eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1554 microversion: 2.1 time: 0.872940 Aug 29 15:36:50.699236 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1214/2560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:49 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1554 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:50.845998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:50.846795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:50.863778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:50.870927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:50.871656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:50.872653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:50.873496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:50.876037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:51.315049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:51.316401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:51.330395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:51.333831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:51.337223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:51.338819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:51.340873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:51.341592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:51.606571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:51.618736 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c94ecd7-705f-4dee-bddb-6d1141a40647 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1277 microversion: 2.1 time: 0.307469 Aug 29 15:36:51.622538 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1215/2561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:51 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1277 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:51.677109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:51.695186 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c8748fd-c653-4026-869f-34b42d89d366 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1279 microversion: 2.1 time: 0.855544 Aug 29 15:36:51.696356 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1347/2562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:50 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1279 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:51.732183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:51.732814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:51.746001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:51.746339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:51.746779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:51.754108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:51.755229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:51.755688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.656728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:52.657539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:52.673975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:52.687881 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c487a0ac-7fb4-4040-954e-01181a32cf52 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1512 microversion: 2.1 time: 0.959594 Aug 29 15:36:52.701494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.701494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.701494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.702540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.703265 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1216/2563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:51 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1512 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:52.704988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.704988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.721591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:52.729869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:52.732477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:52.758782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.760838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.762815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.763808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.767364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.769802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.946420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:52.967682 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8d1cc99-7e40-49cb-a14b-3f386d991be9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1277 microversion: 2.1 time: 0.324451 Aug 29 15:36:52.972194 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1348/2564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:52 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:53.087364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-43574365-d5e4-41f9-a70a-a769b8a13bd9 req-4c54e927-e7e5-4b77-bd88-fc5e568925b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4e2cb7-3b60-47c9-a99a-c7bc0a907044", "name": "network-vif-deleted", "tag": "b6a43967-16dd-4818-912f-165563c17a28"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:53.114944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43574365-d5e4-41f9-a70a-a769b8a13bd9 req-4c54e927-e7e5-4b77-bd88-fc5e568925b7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.116262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43574365-d5e4-41f9-a70a-a769b8a13bd9 req-4c54e927-e7e5-4b77-bd88-fc5e568925b7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.116865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43574365-d5e4-41f9-a70a-a769b8a13bd9 req-4c54e927-e7e5-4b77-bd88-fc5e568925b7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.171488 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-43574365-d5e4-41f9-a70a-a769b8a13bd9 req-4c54e927-e7e5-4b77-bd88-fc5e568925b7 service nova] Creating event network-vif-deleted:b6a43967-16dd-4818-912f-165563c17a28 for instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 on n-h2-854882-3 Aug 29 15:36:53.196328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-43574365-d5e4-41f9-a70a-a769b8a13bd9 req-4c54e927-e7e5-4b77-bd88-fc5e568925b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116569 Aug 29 15:36:53.201531 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1349/2565] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:53.372442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:53.384571 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dfaa28b4-f26e-4075-8ff2-1d29e154f52b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1279 microversion: 2.1 time: 0.670004 Aug 29 15:36:53.389726 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1217/2566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:52 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1279 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:53.713015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:53.713662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:53.728055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.732095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.733207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.734166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.737119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.741344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.996588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:53.999013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:54.021512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:54.025778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:54.026273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:54.026273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:54.026273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:54.032656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:54.349909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:54.507180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:54.515952 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e6b88b4-ba94-40a1-8877-30ca0cee65a9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1346 microversion: 2.1 time: 0.807042 Aug 29 15:36:54.527053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1350/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:53 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1346 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:54.546973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:54.552645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:54.580968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:54.587471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:54.587934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:54.588733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:54.589196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:54.589654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:55.464977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:55.480613 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf563b89-c4af-44f3-addb-132856a8233b tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.951930 Aug 29 15:36:55.481327 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1351/2568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:54 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:55.542910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:55.543732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:55.559469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:55.561809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:55.562308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:55.566097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:55.566583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:55.567546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:55.714659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:55.726224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1e5486e-bacd-45e7-8592-e51efd6b5e7d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 1.737199 Aug 29 15:36:55.727868 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1218/2569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:53 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:56.303417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:56.321657 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a67238bd-dd8d-4d79-80fa-9f08693eb21b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1346 microversion: 2.1 time: 0.780212 Aug 29 15:36:56.327146 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1352/2570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:55 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1346 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:56.507411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:56.508400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:56.532359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.533006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.533661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.534523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.535221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.535916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.746042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=93 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:56.750675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:56.751512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:56.772841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.773587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.774176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.775057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.775692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.776269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.160568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:57.178847 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b7d4cc93-2de1-4b8e-8ab2-02828bafe856 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 0.434248 Aug 29 15:36:57.184511 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1353/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:56 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:57.352669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:57.353292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:57.377695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.378246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.378693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.383061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.383750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.389054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.503135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:57.590588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:57.607385 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cbbf4878-b020-4b58-8350-5f1b3832ba07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1346 microversion: 2.1 time: 0.260480 Aug 29 15:36:57.609328 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1354/2572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:57 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1346 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:57.894404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:57.903607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9af5075e-a88a-4a62-9584-f4f4f5e9f957 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 1.401322 Aug 29 15:36:57.907163 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1219/2573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:56 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:58.215787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:58.226515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:58.278966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.279841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.280642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.294062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.294881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.295529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.628152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:58.629682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:58.633708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=32 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:58.642522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.649254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.650340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.651302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.651971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.652628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:59.096321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:59.122118 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79b194b8-89b3-4239-b2c9-2d00cf140996 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1346 microversion: 2.1 time: 0.497663 Aug 29 15:36:59.130398 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1220/2574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:58 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1346 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:59.150462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:59.153603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:59.175529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:59.176545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:59.177745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:59.178729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:59.179420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:59.180059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:59.186740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:59.198518 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-747e5966-e229-407c-ade8-77a25b618e94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 0.997693 Aug 29 15:36:59.199298 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1355/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:58 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:59.216805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1bdbbc47-688d-4e55-9f10-0f3b02129e95 req-8b099541-b4bb-4acf-ae47-292b543566df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0d07cd-dda9-476b-9988-bbaa9ef5d43d", "tag": "9cc7dd2f-c953-486b-baf4-f3bc94eceb3c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:59.250623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1bdbbc47-688d-4e55-9f10-0f3b02129e95 req-8b099541-b4bb-4acf-ae47-292b543566df service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:59.265997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1bdbbc47-688d-4e55-9f10-0f3b02129e95 req-8b099541-b4bb-4acf-ae47-292b543566df service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:59.266699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1bdbbc47-688d-4e55-9f10-0f3b02129e95 req-8b099541-b4bb-4acf-ae47-292b543566df service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:59.288033 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1bdbbc47-688d-4e55-9f10-0f3b02129e95 req-8b099541-b4bb-4acf-ae47-292b543566df service nova] Creating event network-changed:9cc7dd2f-c953-486b-baf4-f3bc94eceb3c for instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d on n-h2-854882-3 Aug 29 15:36:59.307331 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1bdbbc47-688d-4e55-9f10-0f3b02129e95 req-8b099541-b4bb-4acf-ae47-292b543566df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105813 Aug 29 15:36:59.308229 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1356/2576] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:59.708058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:59.715871 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3713f55-7997-458c-9edb-8c09590f24e2 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.580964 Aug 29 15:36:59.722883 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1221/2577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:59 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:00.158013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:00.160140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:00.194986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.209117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.210395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.213576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.214325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.215224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.226638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:00.227365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:00.247521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.248191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.248740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.249754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.251530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.252219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.629121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:00.642549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60c6eb80-c49d-4323-ab45-53c90c11dc91 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1346 microversion: 2.1 time: 0.495254 Aug 29 15:37:00.647280 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1357/2578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:00 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1346 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:00.736482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:00.738004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:00.752037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.752907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.753791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.756662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.757876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.761472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.922356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:00.936892 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-66075dce-8652-49c3-a5e4-a0272a94791b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 0.714696 Aug 29 15:37:00.950115 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1222/2579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:00 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:01.138496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:01.150275 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7874c484-0f78-451e-9961-164b860a7819 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.417905 Aug 29 15:37:01.158805 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1358/2580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:00 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:01.424633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-08606d34-4f43-4d1c-9a85-f82f952d648b req-9b0c0f99-c915-43cd-b5c2-0f3087b9a66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a875b95-41d0-42ad-ab26-fda6f5cc6156", "tag": "85f1630a-c1ec-48ea-a46c-7043cf2b12dc"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:01.440375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-08606d34-4f43-4d1c-9a85-f82f952d648b req-9b0c0f99-c915-43cd-b5c2-0f3087b9a66e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.441019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-08606d34-4f43-4d1c-9a85-f82f952d648b req-9b0c0f99-c915-43cd-b5c2-0f3087b9a66e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.441616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-08606d34-4f43-4d1c-9a85-f82f952d648b req-9b0c0f99-c915-43cd-b5c2-0f3087b9a66e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.467729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-08606d34-4f43-4d1c-9a85-f82f952d648b req-9b0c0f99-c915-43cd-b5c2-0f3087b9a66e service nova] Creating event network-changed:85f1630a-c1ec-48ea-a46c-7043cf2b12dc for instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 on n-h1-854882-3 Aug 29 15:37:01.477519 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-08606d34-4f43-4d1c-9a85-f82f952d648b req-9b0c0f99-c915-43cd-b5c2-0f3087b9a66e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073121 Aug 29 15:37:01.478444 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1223/2581] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:01.668830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:01.669762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:01.683853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.687284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.688213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.690313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.692854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.693565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.868760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:01.893144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03b946fd-9a8c-499c-bcdb-5ddaf53b6789 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1346 microversion: 2.1 time: 0.229336 Aug 29 15:37:01.899432 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1359/2582] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:01 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1346 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:01.940328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-80f38015-210c-4cd1-ab5a-cfc9d51d7e2f req-3669e468-59ee-430f-bf8a-d84b48ea625b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd", "tag": "6b7330d8-a1b7-4828-a8ba-8fe66cf84c25"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:01.968666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-80f38015-210c-4cd1-ab5a-cfc9d51d7e2f req-3669e468-59ee-430f-bf8a-d84b48ea625b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.969621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-80f38015-210c-4cd1-ab5a-cfc9d51d7e2f req-3669e468-59ee-430f-bf8a-d84b48ea625b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.970376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-80f38015-210c-4cd1-ab5a-cfc9d51d7e2f req-3669e468-59ee-430f-bf8a-d84b48ea625b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.973052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:01.974023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:01.983117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.983630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.984117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.984898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.985456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.985875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.010907 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-80f38015-210c-4cd1-ab5a-cfc9d51d7e2f req-3669e468-59ee-430f-bf8a-d84b48ea625b service nova] Creating event network-changed:6b7330d8-a1b7-4828-a8ba-8fe66cf84c25 for instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd on n-h1-854882-3 Aug 29 15:37:02.034976 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-80f38015-210c-4cd1-ab5a-cfc9d51d7e2f req-3669e468-59ee-430f-bf8a-d84b48ea625b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098607 Aug 29 15:37:02.035589 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1224/2583] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:02.180683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:02.181433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:02.192544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.198384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.199092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.200799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.204132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.204793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.229128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:02.245625 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-976ad754-f847-442a-a074-e50af445a9db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 0.277964 Aug 29 15:37:02.259404 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1360/2584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:01 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:02.930167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:02.931563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:02.948419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.949179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.952885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.954329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.956798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.957302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.024783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:03.033139 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-05206df7-fa64-4751-be7d-9f50e517b39a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.857469 Aug 29 15:37:03.038028 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1225/2585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:02 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:03.052908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.053825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.054481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.055558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lazy-loading 'fault' on Instance uuid 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:03.186898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:03.222722 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2d776e31-86b6-4fe6-8827-0eb6bcfc3710 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 200 len: 1351 microversion: 2.1 time: 0.306527 Aug 29 15:37:03.231023 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1361/2586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:02 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 1351 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:03.266765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:03.267388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:03.283059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.283550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.283984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.284688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.285139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.285632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.592818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:03.593656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:03.619960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.620464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.622242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.622992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.623441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.624266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.687538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:03.853353 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0618ff3e-d659-4ea3-bea7-3aa111b4fbb2 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "DELETE /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 204 len: 0 microversion: 2.1 time: 0.263891 Aug 29 15:37:03.854155 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1362/2587] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:03 2022] DELETE /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:03.867172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:03.867876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:03.886610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.887108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.887547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.888254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.888705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.889155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.168955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:04.179385 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3f3977a-65ae-4c3e-a00a-2a9ea1081792 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 0.916425 Aug 29 15:37:04.190137 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1226/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:03 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:04.213953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:04.214941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:04.234749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.235411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.236230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.237287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.237987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.238626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.471386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:04.481497 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-05319a81-fb5d-4f92-8930-e884b835e52d tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.289787 Aug 29 15:37:04.495271 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1227/2589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:04 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:04.506354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:04.507271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:04.523582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.524460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.525947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.526871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.530493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.531397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.572243 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 HTTP/1.1 Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5d4e2cb7-3b60-47c9-a99a-c7bc0a907044'} Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:04.577226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.582814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:04.582814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:04.582814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:04.582814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:04.582814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:04.582814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.582814 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.583745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:04.588081 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97aa7ed3-4a8f-4a21-8c5d-204aeef3f019 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 404 len: 111 microversion: 2.1 time: 0.089688 Aug 29 15:37:04.589346 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1228/2590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:04 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:04.880422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:04.883052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:04.898142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.899022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.901844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.902880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.906992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:04.920053 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b89ea680-717a-4efd-b036-aed948c15e6c tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1508 microversion: 2.1 time: 1.057166 Aug 29 15:37:04.928557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.929928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.945933 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1363/2591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:03 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1508 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:04.976092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044/os-volume_attachments HTTP/1.1 Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': '5d4e2cb7-3b60-47c9-a99a-c7bc0a907044'} Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:04.978062 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:37:04.982415 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:04.984652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:04.985858 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6bb7fd18-e718-42e9-98f6-e3855390c85e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.109561 Aug 29 15:37:04.987147 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1229/2592] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:37:04 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044/os-volume_attachments => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:37:05.215602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:05.216409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:05.228278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.228930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.234072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.235132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.235716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.236273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.241342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:05.433808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1101711075", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:05.549657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] validate_networks() for [('f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:05.918844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:05.960852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd363f47-4fb0-4cf1-8f58-912a9f1b913b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 0.746449 Aug 29 15:37:05.963220 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1364/2593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:05 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:05.972580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:05.973524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:05.988134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.989785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.990647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.993259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.994690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.995371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:06.985922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:06.995349 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51a2b94b-29b9-44b5-a3ad-dab354d01075 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 1.030450 Aug 29 15:37:06.996071 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1365/2594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:05 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:07.002776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:07.004314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:07.034782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.036256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.038814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.039752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.040353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.040902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.189092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:07.191001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:07.191799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:07.192430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:07.193138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:07.236721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.237652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.239862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.248054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.250022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.252886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.295535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:07.302128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for user 065c5a92f9c04400be8a515e8233fb0d and project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:07.317796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:07.321102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:07.415637 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cbc9db90-f1da-4151-91a4-d121765791b2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.981447 Aug 29 15:37:07.419645 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1230/2595] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:37:07.432816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:07.433471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:07.447251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.447745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.448177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.448878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.449327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.449775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.529497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:07.558605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:07.565276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:07.570533 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4c1c3763-545f-4bca-896e-c47138ec2ced tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2955 microversion: 2.42 time: 0.572673 Aug 29 15:37:07.571492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1366/2596] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:06 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2955 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:07.580032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f2cba57c-2909-4ef4-a591-9558196f4506 req-c794a438-c3a9-4113-bdf8-262d8554b26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0d07cd-dda9-476b-9988-bbaa9ef5d43d", "name": "network-vif-plugged", "status": "completed", "tag": "9cc7dd2f-c953-486b-baf4-f3bc94eceb3c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:07.610253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f2cba57c-2909-4ef4-a591-9558196f4506 req-c794a438-c3a9-4113-bdf8-262d8554b26c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.610900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f2cba57c-2909-4ef4-a591-9558196f4506 req-c794a438-c3a9-4113-bdf8-262d8554b26c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.611526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f2cba57c-2909-4ef4-a591-9558196f4506 req-c794a438-c3a9-4113-bdf8-262d8554b26c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.639455 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f2cba57c-2909-4ef4-a591-9558196f4506 req-c794a438-c3a9-4113-bdf8-262d8554b26c service nova] Creating event network-vif-plugged:9cc7dd2f-c953-486b-baf4-f3bc94eceb3c for instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d on n-h2-854882-3 Aug 29 15:37:07.655425 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f2cba57c-2909-4ef4-a591-9558196f4506 req-c794a438-c3a9-4113-bdf8-262d8554b26c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082452 Aug 29 15:37:07.656772 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1367/2597] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:07.684900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:07.689612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:07.703390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.704948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.705610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.706599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.707256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.708717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.018730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:08.025206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:08.108025 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-627a2c30-9c31-444a-bc72-f0cc79c637c9 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1466 microversion: 2.1 time: 0.682781 Aug 29 15:37:08.108494 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1231/2598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:07 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1466 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:08.175687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf1ca509-0293-4bd3-96b2-2fd96b60ff3c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:08.186496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf1ca509-0293-4bd3-96b2-2fd96b60ff3c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:08.466752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bf1ca509-0293-4bd3-96b2-2fd96b60ff3c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:08.479446 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf1ca509-0293-4bd3-96b2-2fd96b60ff3c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 200 len: 1215 microversion: 2.1 time: 0.361150 Aug 29 15:37:08.481081 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1232/2599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:08 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 1215 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:08.492962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:08.493896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:08.511870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.512366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.512801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.513534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.514017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.522134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.761569 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b621c12b-0008-46ff-b306-5ca99103cb15 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.278558 Aug 29 15:37:08.766412 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1233/2600] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:37:08 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784/os-interface => generated 1830 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:08.776612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:08.779734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:08.804101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.806783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.808440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.811185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.813007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.814532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.862011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:08.886351 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-321fe816-5038-49a2-a31c-649cf2438e2e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 1.224648 Aug 29 15:37:08.893252 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1368/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:07 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:08.931184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a0b7067b-8a54-43d9-abff-f813e2ef6abf req-23ece506-d58f-4205-b7c7-f0001e4004f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80404306-3d1e-4411-a8e8-b7d2ae05d982", "name": "network-vif-deleted", "tag": "ca2fc60d-9008-40e4-b525-a958f71c63da"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:08.961820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a0b7067b-8a54-43d9-abff-f813e2ef6abf req-23ece506-d58f-4205-b7c7-f0001e4004f7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.961974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a0b7067b-8a54-43d9-abff-f813e2ef6abf req-23ece506-d58f-4205-b7c7-f0001e4004f7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.972818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a0b7067b-8a54-43d9-abff-f813e2ef6abf req-23ece506-d58f-4205-b7c7-f0001e4004f7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.013627 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a0b7067b-8a54-43d9-abff-f813e2ef6abf req-23ece506-d58f-4205-b7c7-f0001e4004f7 service nova] Creating event network-vif-deleted:ca2fc60d-9008-40e4-b525-a958f71c63da for instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 on n-h2-854882-3 Aug 29 15:37:09.046469 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a0b7067b-8a54-43d9-abff-f813e2ef6abf req-23ece506-d58f-4205-b7c7-f0001e4004f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137843 Aug 29 15:37:09.052709 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1369/2602] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:09.085905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.101133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.130436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.134062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.134910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.137021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.138876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.141411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.205575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:09.261245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:09.274280 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d25908c-0b45-4f73-b72d-7849c41939a3 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.505686 Aug 29 15:37:09.282063 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1234/2603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:08 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:09.298949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.299651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.309340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.310193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.310845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.311756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.312855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.313521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.352472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.353350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.354232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.354912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'fault' on Instance uuid 80404306-3d1e-4411-a8e8-b7d2ae05d982 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:09.407260 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2c37615-fd39-4d0b-bb64-5a54c7dbd5ad tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 204 len: 0 microversion: 2.1 time: 0.351039 Aug 29 15:37:09.409147 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1370/2604] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:09 2022] DELETE /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:09.487277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:09.514588 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-60a1f51e-fa4c-4763-b058-c87b3223dedd tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 200 len: 1312 microversion: 2.1 time: 0.230163 Aug 29 15:37:09.515275 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1235/2605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:09 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:09.547227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.548025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.561155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1013158386", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5c089729-15d8-41d3-a996-e24ac0861c49"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:09.562790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.564524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.564981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.567357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.570034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.571248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.710200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:09.726620 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-26bbfdce-dc2c-41eb-87c0-cdabfdd66cf5 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 200 len: 1273 microversion: 2.1 time: 0.195143 Aug 29 15:37:09.728058 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1236/2606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:09 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:09.758788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-feb990a5-6fc9-49bb-b0e8-c07f2c634571 req-a131cf0a-db1f-48ea-ba02-167e1b536e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a875b95-41d0-42ad-ab26-fda6f5cc6156", "name": "network-vif-plugged", "status": "completed", "tag": "85f1630a-c1ec-48ea-a46c-7043cf2b12dc"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:09.770811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] validate_networks() for [('5c089729-15d8-41d3-a996-e24ac0861c49', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:09.792611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-feb990a5-6fc9-49bb-b0e8-c07f2c634571 req-a131cf0a-db1f-48ea-ba02-167e1b536e2f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.794016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-feb990a5-6fc9-49bb-b0e8-c07f2c634571 req-a131cf0a-db1f-48ea-ba02-167e1b536e2f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.794446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-feb990a5-6fc9-49bb-b0e8-c07f2c634571 req-a131cf0a-db1f-48ea-ba02-167e1b536e2f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.876953 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-feb990a5-6fc9-49bb-b0e8-c07f2c634571 req-a131cf0a-db1f-48ea-ba02-167e1b536e2f service nova] Creating event network-vif-plugged:85f1630a-c1ec-48ea-a46c-7043cf2b12dc for instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 on n-h1-854882-3 Aug 29 15:37:09.909576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-feb990a5-6fc9-49bb-b0e8-c07f2c634571 req-a131cf0a-db1f-48ea-ba02-167e1b536e2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153571 Aug 29 15:37:09.916973 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1237/2607] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:09.937209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.947827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.987063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.987669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.991421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.994376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.998499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.999038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.795282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:10.814437 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b1eea83-50df-4521-b7aa-dffc565334cd tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1319 microversion: 2.1 time: 0.888527 Aug 29 15:37:10.831204 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1238/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:09 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1319 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:10.842165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:10.847001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:10.864425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.866359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.868004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.869974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.870738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.872514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.271062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:11.282557 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-022218b9-4244-4e19-ba9f-fad68e68561f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.451791 Aug 29 15:37:11.303467 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1239/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:10 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:11.309903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.311009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: 80404306-3d1e-4411-a8e8-b7d2ae05d982] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.325181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.329285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.331108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.332758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.333929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.338410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.375379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 could not be found. Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 HTTP/1.1 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 could not be found. Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '80404306-3d1e-4411-a8e8-b7d2ae05d982'} Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 could not be found. Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 could not be found. Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:11.379243 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 could not be found. Aug 29 15:37:11.383246 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:11.385076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 404 to user: Instance 80404306-3d1e-4411-a8e8-b7d2ae05d982 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:11.386158 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b27f390a-d08a-43b1-97ec-45cc664f2aba tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982" status: 404 len: 111 microversion: 2.1 time: 0.081609 Aug 29 15:37:11.390971 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1240/2610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:11 2022] GET /compute/v2.1/servers/80404306-3d1e-4411-a8e8-b7d2ae05d982 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:11.398304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.400588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.411489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.412802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.414047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.415347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.416047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.417006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.553718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:11.555424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:11.556093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:11.556670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:11.557238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:11.569226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.570026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.570704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.571642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.572363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.572957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.591692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:11.594216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:11.601176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for user c631f558d99f40feb637f376bac1cffa and project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:11.602812 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e1a3424-54a2-4714-9563-5dedeb401d26 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 200 len: 1217 microversion: 2.1 time: 0.210334 Aug 29 15:37:11.610134 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1241/2611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:11 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:11.616126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.617009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.624461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.625350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.626141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.627248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.627982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.628758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.637207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:11.639657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:11.664657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:11.757113 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-25e7a8c0-442a-4ebe-b543-9c3c2836a02e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.341865 Aug 29 15:37:11.759225 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1371/2612] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:11.776755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3f6937a7-a18d-4da9-b575-5f4a02666070 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.780377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3f6937a7-a18d-4da9-b575-5f4a02666070 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.807728 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6754a1a3-4e4f-4c55-9503-e1c16783296a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 204 len: 0 microversion: 2.1 time: 0.195013 Aug 29 15:37:11.808556 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1242/2613] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:11 2022] DELETE /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:11.818914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.819629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.826475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.826965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.827399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.828096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.828548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.829037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.015736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3f6937a7-a18d-4da9-b575-5f4a02666070 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:12.025196 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3f6937a7-a18d-4da9-b575-5f4a02666070 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1208 microversion: 2.1 time: 0.258991 Aug 29 15:37:12.028121 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1372/2614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:11 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1208 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:12.043141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:12.045643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:12.079118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.080472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.082275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.085341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.086917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.089320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.325912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:12.344424 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75d3c58e-efdf-4efe-8381-c35cd751c547 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.529901 Aug 29 15:37:12.365421 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1243/2615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:11 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:12.377326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:12.378127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:12.404939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.407233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.411388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.415031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.415544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.415994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.923729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:12.963237 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-21b50673-d9f8-4f99-b9ce-981bdfafbb3a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 0.595861 Aug 29 15:37:12.977404 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1244/2616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:12 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:12.977404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:12.977404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:12.993777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.994285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.994730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.995451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.998189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.998775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.186252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:13.199622 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08d00e4b-ee3b-4d34-b37c-e312f02af108 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 200 len: 1217 microversion: 2.1 time: 0.228496 Aug 29 15:37:13.200425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1245/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:12 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:13.226138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:13.226847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:13.255860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.256857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.257458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.265068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.265604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.266445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.432118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:13.464830 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0784b13f-d1b5-4aba-8b54-2b356057cc5d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1260 microversion: 2.1 time: 0.251630 Aug 29 15:37:13.466366 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1246/2618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:13 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:13.487518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:13.508812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:13.541715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.547115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.548261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.550204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.554292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.557335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.636753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:13.656702 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f66f0a8-81fb-4a4e-9a28-411059ee04ef tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1469 microversion: 2.1 time: 1.626572 Aug 29 15:37:13.677491 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1373/2619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:12 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1469 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:13.684269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:13.709804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:13.726399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.727075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.728183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.742596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.746536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.747405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.927175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:13.949910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1cdf036-d305-4661-bc94-72bcfea2645e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.482032 Aug 29 15:37:13.951087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1247/2620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:13 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:13.955984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9e78d0aa-72d1-481e-a07d-e1261e96d01e req-cdef4bc7-d4a2-49db-ac78-932ca96e002e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd", "name": "network-vif-plugged", "status": "completed", "tag": "6b7330d8-a1b7-4828-a8ba-8fe66cf84c25"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:13.967953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e78d0aa-72d1-481e-a07d-e1261e96d01e req-cdef4bc7-d4a2-49db-ac78-932ca96e002e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.969097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e78d0aa-72d1-481e-a07d-e1261e96d01e req-cdef4bc7-d4a2-49db-ac78-932ca96e002e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.969618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e78d0aa-72d1-481e-a07d-e1261e96d01e req-cdef4bc7-d4a2-49db-ac78-932ca96e002e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.985983 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9e78d0aa-72d1-481e-a07d-e1261e96d01e req-cdef4bc7-d4a2-49db-ac78-932ca96e002e service nova] Creating event network-vif-plugged:6b7330d8-a1b7-4828-a8ba-8fe66cf84c25 for instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd on n-h1-854882-3 Aug 29 15:37:13.993921 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9e78d0aa-72d1-481e-a07d-e1261e96d01e req-cdef4bc7-d4a2-49db-ac78-932ca96e002e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041524 Aug 29 15:37:13.995418 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1248/2621] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:14.014813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:14.044047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:14.109543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.110936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.114979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.117305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.119204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.122829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.589306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:14.603807 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a4245d33-7210-4de6-a93d-ed7cba37cf06 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 200 len: 1319 microversion: 2.1 time: 0.924941 Aug 29 15:37:14.623587 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1374/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:13 2022] GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 1319 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:14.635336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:14.637728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:14.659169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.660984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.661704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.663204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.666439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.667143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.814729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:14.827157 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d47c9603-abd1-4d84-9377-a24ca07483ec tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 200 len: 1217 microversion: 2.1 time: 0.202105 Aug 29 15:37:14.834470 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1375/2623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:14 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:14.883263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:14.887508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:14.920220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.921055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.921758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.922700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.923370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.924047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.223380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:15.236731 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0db6286b-3b1e-4dde-a452-dcd8812269ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1278 microversion: 2.1 time: 0.400789 Aug 29 15:37:15.239389 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1376/2624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:14 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1278 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:15.256130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:15.258824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:15.278035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.279000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.280073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.281094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.281967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.282711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.764423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:15.786582 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c99941aa-ca18-4a57-ab69-56803ffcb90a tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1521 microversion: 2.1 time: 0.540493 Aug 29 15:37:15.788416 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1377/2625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:15 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:15.811040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:15.815252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:15.822132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:15.853447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.858176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:15.866852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:15.871585 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c206a9ce-b6fb-4cfc-a621-12ffa0a9919c tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1321 microversion: 2.1 time: 1.874731 Aug 29 15:37:15.872535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.873197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.883702 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1249/2626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:13 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1321 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:15.890885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.893793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.896665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.904261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:15.910083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:15.924495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:15.927161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.929994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.930624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.931615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.932627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.938237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.167261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:16.175093 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-995bb257-9f9f-4dd7-8d3f-7ba30f322045 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 200 len: 1219 microversion: 2.1 time: 0.288946 Aug 29 15:37:16.181885 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1250/2627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:15 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 1219 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:16.186731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-080bcee5-23c3-45ee-b334-8018540b556d req-b912473d-9cb2-444c-b433-e0578767377f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4", "name": "network-vif-deleted", "tag": "36e84c6f-e1ee-42d7-8b5e-71c53794e0ba"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:16.215150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-080bcee5-23c3-45ee-b334-8018540b556d req-b912473d-9cb2-444c-b433-e0578767377f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.215888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-080bcee5-23c3-45ee-b334-8018540b556d req-b912473d-9cb2-444c-b433-e0578767377f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.216478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-080bcee5-23c3-45ee-b334-8018540b556d req-b912473d-9cb2-444c-b433-e0578767377f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.245631 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-080bcee5-23c3-45ee-b334-8018540b556d req-b912473d-9cb2-444c-b433-e0578767377f service nova] Creating event network-vif-deleted:36e84c6f-e1ee-42d7-8b5e-71c53794e0ba for instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 on n-h1-854882-3 Aug 29 15:37:16.275230 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-080bcee5-23c3-45ee-b334-8018540b556d req-b912473d-9cb2-444c-b433-e0578767377f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074510 Aug 29 15:37:16.280222 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1251/2628] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:16.291843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:16.292830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:16.310073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.310565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.311081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.311720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.312212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.324449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.476202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:16.513790 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e284b23-b3ed-479b-9a2e-3e72e51efc55 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 200 len: 1319 microversion: 2.1 time: 0.723378 Aug 29 15:37:16.517743 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1378/2629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:15 2022] GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 1319 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:16.718290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:16.729752 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8d1dd6f-99e4-4213-8c6d-877a06e8e5ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1266 microversion: 2.1 time: 0.447011 Aug 29 15:37:16.730186 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1252/2630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:16 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:16.818311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:16.818949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:16.837251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.837843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.838457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.839484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.840123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.840728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.902488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:16.903110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:16.915831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.916339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.916781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.930026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.932027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.932712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.039564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.042080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.044216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.045888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lazy-loading 'fault' on Instance uuid ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:17.269259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a675ad19db254271ba12d2812d0732e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '505ab4f3173b48559a5c25611af86fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:17.281648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:17.286351 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc00ecfb-0d44-4a89-a4b0-d36e4b096f7e tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 200 len: 1311 microversion: 2.1 time: 0.472430 Aug 29 15:37:17.286975 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1379/2631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:16 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 1311 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:17.298022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.314909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.331158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.333045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.334902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.337355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:17.337541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.337938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.338377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.347628 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd5e0a65-a44a-47e1-bfa5-da1d3e8b2116 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1471 microversion: 2.1 time: 0.448960 Aug 29 15:37:17.351782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1253/2632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:16 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:17.379859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:17.380818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.409260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.410675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.411665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.414799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.415585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba HTTP/1.1 Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c17a8278-64cc-420a-8852-58214e841bba'} Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:17.417622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:17.421956 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:17.421956 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:17.421956 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:17.421956 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:17.421956 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:17.421956 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:37:17.421956 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:17.422447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.423367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:17.423504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.425145 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-492fe16e-70b5-4583-886a-6f9a6b3c2038 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 404 len: 111 microversion: 2.1 time: 0.133977 Aug 29 15:37:17.435349 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1380/2633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:17.470191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lazy-loading 'flavor' on Instance uuid 0a875b95-41d0-42ad-ab26-fda6f5cc6156 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:17.551650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.552344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.565865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.570532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.571064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.573991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.577132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.578343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.623857 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-26c2ff13-76b7-45d9-b409-d0d7ccd61595 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156/action" status: 202 len: 0 microversion: 2.1 time: 0.249442 Aug 29 15:37:17.628973 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1254/2634] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:17 2022] POST /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:17.636689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.637973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.647486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.648502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.649503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.650593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.651485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.652224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.011527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.021583 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6753af32-1c3e-492c-8e34-9a4d004a82a9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 200 len: 1468 microversion: 2.1 time: 0.475550 Aug 29 15:37:18.032545 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1381/2635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 1468 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:18.046299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:18.049194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:18.057514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.058005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.058620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.059536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.060153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.060577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.081815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:18.166201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b14faa67-101c-416e-8110-7c64fd29b625 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1630 microversion: 2.1 time: 0.534853 Aug 29 15:37:18.171403 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1255/2636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1630 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:18.184244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1076003330", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:18.352315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] validate_networks() for [('f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:18.416362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.425997 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9ad73b23-3864-4f63-9b59-67813147fc74 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 0.392031 Aug 29 15:37:18.439650 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1382/2637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:18 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:18.466543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:18.474211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:18.487077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.488027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Searching by: {'reservation_id': 'r-0hvy7q34', 'deleted': False, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:37:18.522458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.522961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.523412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.524163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.524618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.525048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.783270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:37:18.922641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.939380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.941011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.946076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.515944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:19.516535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:19.516965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:19.517666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:19.518391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:19.548058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.553633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.554766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.563044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.565618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.568561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.630883 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-67426f18-35dc-4791-a3e5-57421fceb3a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-0hvy7q34" status: 200 len: 2930 microversion: 2.1 time: 1.182084 Aug 29 15:37:19.632488 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1383/2638] 10.222.0.16 () {58 vars in 1197 bytes} [Mon Aug 29 15:37:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0hvy7q34 => generated 2930 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:19.638577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:19.639425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] [instance: ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:19.662521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:19.664502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.666852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.676131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.677910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.678597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.679259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.686945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for user 065c5a92f9c04400be8a515e8233fb0d and project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:19.726144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] HTTP exception thrown: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 could not be found. Aug 29 15:37:19.740850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:19.743547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Request method failure captured: Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 HTTP/1.1 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNvHvvIOu6yVCsV4nerbe4Ra49_x0nYY2zK7TmHC_d_4eMl0WvNcLywdTd235QxnrWnb8B7gOHsCL72d-Z9oJbdir9q328sNgfMHRfdcdltF-rXqcg2SEEMyWxXrXH0SPg_KCW1s2l1Occ10uZZoC4mC3WnT8Jr_YgtAsRqRQbrmEWs Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/505ab4f3173b48559a5c25611af86fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_505ab4f3173b48559a5c25611af86fc7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/505ab4f3173b48559a5c25611af86fc7"}]}] Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 505ab4f3173b48559a5c25611af86fc7 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671004101 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a675ad19db254271ba12d2812d0732e3 Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671004101-project Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 could not be found. Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4'} Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 could not be found. Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 could not be found. Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:19.748308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 could not be found. Aug 29 15:37:19.752179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:19.766650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] Returning 404 to user: Instance ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:19.768585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-775c30e1-ab01-45d5-b505-3b78880b3fc8 tempest-ServerRescueNegativeTestJSON-671004101 tempest-ServerRescueNegativeTestJSON-671004101-project] 10.222.0.16 "GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4" status: 404 len: 111 microversion: 2.1 time: 0.134891 Aug 29 15:37:19.774273 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1384/2639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:19 2022] GET /compute/v2.1/servers/ffdcc0c3-d084-49dc-82a2-0f2a26a7d4e4 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:19.787039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:19.790206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:19.809889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.810706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.811399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.812351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.813961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.815840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.847366 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-030d41db-3824-4224-9b6c-31092f65f0cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.674542 Aug 29 15:37:19.849271 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1256/2640] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:19.865840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:19.866667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:19.880843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.882050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.883335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.885363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.888749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.889371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.332527 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52c9ac28-4903-45b7-9f32-74c367304c23 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1613 microversion: 2.1 time: 0.556720 Aug 29 15:37:20.333604 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1385/2641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:19 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1613 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:20.362594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2a65d1b-e319-47b6-afc5-508cb2a352a0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:20.478512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.server_groups [None req-f2a65d1b-e319-47b6-afc5-508cb2a352a0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Querying cell f444391f-7036-4697-bac9-7a9b7c940a18(cell1) for 2 instances {{(pid=130002) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:37:20.481799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a65d1b-e319-47b6-afc5-508cb2a352a0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.482694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a65d1b-e319-47b6-afc5-508cb2a352a0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.483385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2a65d1b-e319-47b6-afc5-508cb2a352a0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.581864 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2a65d1b-e319-47b6-afc5-508cb2a352a0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/7645b9b4-d145-4c76-aacf-96def6708411" status: 200 len: 270 microversion: 2.1 time: 0.236943 Aug 29 15:37:20.582995 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1386/2642] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:37:20 2022] GET /compute/v2.1/os-server-groups/7645b9b4-d145-4c76-aacf-96def6708411 => generated 270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:20.604382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8b0b471a-c9cd-427f-9209-0815ae579f3a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:20.606116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b0b471a-c9cd-427f-9209-0815ae579f3a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:20.771579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8b0b471a-c9cd-427f-9209-0815ae579f3a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:20.780182 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8b0b471a-c9cd-427f-9209-0815ae579f3a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1215 microversion: 2.1 time: 0.190020 Aug 29 15:37:20.798173 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1387/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:20 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:20.811246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:20.812096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:20.842849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.843358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.843798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.844518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.844990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.845381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.849819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:20.862861 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bcaa343-92b3-4c1c-98d7-3bdb4778442f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 1.012128 Aug 29 15:37:20.863513 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1257/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:19 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:20.884022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:20.884691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:20.919477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.920295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.924031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.925016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.929914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.931051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.986855 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] HTTP exception thrown: Cannot 'migrate' instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 while it is in vm_state suspended Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Request method failure captured: Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156/action HTTP/1.1 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 15 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNz3_Z2qaeecTfeKitMNSu738m0JER2RayV-8htWOaAh2uq1a_mNKHW9LhOhcAW6L-G9OqoKSo9HPfr_IIxeuM2A-I-mkK62aw7xEnGUGVzaj9YWx_40KwFM2C9wwhgoo1mqL-DNF6cX8ZDuA1EHEzJwTHruqt2k9ZLMPao1REag2G8 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/27712ebbd794448681471a673a8de9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_27712ebbd794448681471a673a8de9da", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}] Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b2bfb928bb804952a9051449e1489cd4 Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: {"migrate": {}} Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'migrate' instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 while it is in vm_state suspended Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '0a875b95-41d0-42ad-ab26-fda6f5cc6156', 'body': {'migrate': {}}} Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 in vm_state suspended. Cannot resize while the instance is in this state. Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:20.988727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 while it is in vm_state suspended Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 while it is in vm_state suspended Aug 29 15:37:20.993218 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:20.994336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Returning 409 to user: Cannot 'migrate' instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 while it is in vm_state suspended {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:20.996026 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1cd23787-677a-453d-b1be-1bc76fed1d27 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156/action" status: 409 len: 148 microversion: 2.1 time: 0.195441 Aug 29 15:37:21.006770 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1388/2645] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:20 2022] POST /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156/action => generated 148 bytes in 208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:37:21.018458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-357f4b7a-85b6-4462-b3fc-a29e3774c078 req-88177781-0be0-4bfd-af7b-525893a85f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cafb04-bcb7-4394-9ef5-207dee46d2e8", "tag": "43aaef2d-3096-46ec-8f0f-6cdc431d1a78"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:21.052610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-357f4b7a-85b6-4462-b3fc-a29e3774c078 req-88177781-0be0-4bfd-af7b-525893a85f7b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.054192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-357f4b7a-85b6-4462-b3fc-a29e3774c078 req-88177781-0be0-4bfd-af7b-525893a85f7b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.055832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-357f4b7a-85b6-4462-b3fc-a29e3774c078 req-88177781-0be0-4bfd-af7b-525893a85f7b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.075297 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-357f4b7a-85b6-4462-b3fc-a29e3774c078 req-88177781-0be0-4bfd-af7b-525893a85f7b service nova] Creating event network-changed:43aaef2d-3096-46ec-8f0f-6cdc431d1a78 for instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 on n-h2-854882-3 Aug 29 15:37:21.084847 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-357f4b7a-85b6-4462-b3fc-a29e3774c078 req-88177781-0be0-4bfd-af7b-525893a85f7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076259 Aug 29 15:37:21.086494 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1389/2646] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:21.094150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94818c2c-ba25-4afe-8cf2-0a5b976a0863 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94818c2c-ba25-4afe-8cf2-0a5b976a0863 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Request method failure captured: Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf/action HTTP/1.1 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 39 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNz3_Z2qaeecTfeKitMNSu738m0JER2RayV-8htWOaAh2uq1a_mNKHW9LhOhcAW6L-G9OqoKSo9HPfr_IIxeuM2A-I-mkK62aw7xEnGUGVzaj9YWx_40KwFM2C9wwhgoo1mqL-DNF6cX8ZDuA1EHEzJwTHruqt2k9ZLMPao1REag2G8 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/27712ebbd794448681471a673a8de9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_27712ebbd794448681471a673a8de9da", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}] Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b2bfb928bb804952a9051449e1489cd4 Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: {"os-resetState": {"state": "invalid"}} Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '907919a0-6c91-40b3-a95d-481cdc27bfdf', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:37:21.099607 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94818c2c-ba25-4afe-8cf2-0a5b976a0863 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94818c2c-ba25-4afe-8cf2-0a5b976a0863 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf/action" status: 400 len: 144 microversion: 2.1 time: 0.012682 Aug 29 15:37:21.107175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1390/2647] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:21 2022] POST /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:37:21.141024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd278087-1594-419a-979b-84f54caaf498 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd278087-1594-419a-979b-84f54caaf498 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Request method failure captured: Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf/action HTTP/1.1 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 31 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNz3_Z2qaeecTfeKitMNSu738m0JER2RayV-8htWOaAh2uq1a_mNKHW9LhOhcAW6L-G9OqoKSo9HPfr_IIxeuM2A-I-mkK62aw7xEnGUGVzaj9YWx_40KwFM2C9wwhgoo1mqL-DNF6cX8ZDuA1EHEzJwTHruqt2k9ZLMPao1REag2G8 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/27712ebbd794448681471a673a8de9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_27712ebbd794448681471a673a8de9da", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}] Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b2bfb928bb804952a9051449e1489cd4 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: {"os-resetState": {"state": 1}} Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '907919a0-6c91-40b3-a95d-481cdc27bfdf', 'body': {'os-resetState': {'state': 1}}} Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 1 Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:37:21.149806 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:37:21.154364 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.164448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd278087-1594-419a-979b-84f54caaf498 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:21.165730 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cd278087-1594-419a-979b-84f54caaf498 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf/action" status: 400 len: 120 microversion: 2.1 time: 0.058355 Aug 29 15:37:21.172962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1391/2648] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:21 2022] POST /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf/action => generated 120 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:37:21.186412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd98864e-f300-411f-937f-b9cc838c3c84 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:21.189182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cd98864e-f300-411f-937f-b9cc838c3c84 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Failed to fetch instance by id 999 {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:37:21.196951 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-cd98864e-f300-411f-937f-b9cc838c3c84 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd98864e-f300-411f-937f-b9cc838c3c84 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Request method failure captured: Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 37 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNz3_Z2qaeecTfeKitMNSu738m0JER2RayV-8htWOaAh2uq1a_mNKHW9LhOhcAW6L-G9OqoKSo9HPfr_IIxeuM2A-I-mkK62aw7xEnGUGVzaj9YWx_40KwFM2C9wwhgoo1mqL-DNF6cX8ZDuA1EHEzJwTHruqt2k9ZLMPao1REag2G8 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/27712ebbd794448681471a673a8de9da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_27712ebbd794448681471a673a8de9da", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/27712ebbd794448681471a673a8de9da"}]}] Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 27712ebbd794448681471a673a8de9da Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2065534641 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b2bfb928bb804952a9051449e1489cd4 Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2065534641-project-admin Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: {"os-resetState": {"state": "error"}} Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 999 could not be found. Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:21.207138 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:21.212382 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:21.212382 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 15:37:21.212382 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:21.216608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd98864e-f300-411f-937f-b9cc838c3c84 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:21.217868 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cd98864e-f300-411f-937f-b9cc838c3c84 tempest-ServersAdminNegativeTestJSON-2065534641 tempest-ServersAdminNegativeTestJSON-2065534641-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.043469 Aug 29 15:37:21.224603 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1392/2649] 10.222.0.16 () {60 vars in 1179 bytes} [Mon Aug 29 15:37:21 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:37:21.230748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:21.234673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:21.249881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.252390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.253131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.255461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.256514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.257835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.338646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:21.533238 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b52a379-ed20-4719-b74c-cf8f8eae3480 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 200 len: 1619 microversion: 2.1 time: 0.666484 Aug 29 15:37:21.571585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1258/2650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:20 2022] GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 1619 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:21.585767 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-07c0e120-5b23-4be0-ba90-155c1fae6a35 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 204 len: 0 microversion: 2.1 time: 0.348313 Aug 29 15:37:21.585767 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1393/2651] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:21 2022] DELETE /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:21.595159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:21.595840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:21.603192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:21.605128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:21.608808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.609313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.610824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.612043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.615756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.617687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.644107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.645592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.646706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.648222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.648946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.649703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.064939 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83af6405-3f14-402d-8d49-50911bd56d50 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1620 microversion: 2.1 time: 0.471217 Aug 29 15:37:22.085958 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1394/2652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:21 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1620 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:22.108171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:22.108806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:22.128608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.134090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.134865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.135863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.137041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.137752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.366444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:22.377743 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e739b0e-fc5c-47f0-9d0b-6017f6f1e5f4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1267 microversion: 2.1 time: 0.289884 Aug 29 15:37:22.388808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1395/2653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:22 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:22.433433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:22.435734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:22.439513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:22.448440 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c4786ea-5e25-406c-a1e1-6f086b6cefa0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1468 microversion: 2.1 time: 0.867713 Aug 29 15:37:22.453375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.460200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.461426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.462006 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1259/2654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:21 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1468 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:22.463425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.474368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.477243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.483942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-466328624", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "4254c3c6-f8b5-44e4-b752-f8ee1828a748"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:22.636825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:23.024131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:23.032616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c105269d-3691-4930-9d6b-0c73e5988d42 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 0.638523 Aug 29 15:37:23.037671 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1396/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:22 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:23.412667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:23.414233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:23.430731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.432608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.434190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.436902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.437736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.438712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.627953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:23.643380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af0911c4-328a-4bc7-8b07-fbc589cb9039 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1275 microversion: 2.1 time: 0.234423 Aug 29 15:37:23.646618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1397/2656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:23 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:23.655738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:23.657004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:23.675634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.679796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.680526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.681774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.685949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.686939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.861003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:23.861604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:23.861936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:23.862497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:23.862921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:23.883991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.884490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.884933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.885701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.886163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.886597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.938828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:23.950779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:23.973744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:23.977707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:24.076188 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0be40181-5397-4f66-ad7a-78aebaed28dc tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.612925 Aug 29 15:37:24.084352 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1260/2657] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:24.102784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.104987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.123761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.125703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.126348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.131919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.132853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.133528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.331827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:24.340929 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-917d9975-467d-406e-94cf-697c9189fae9 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1468 microversion: 2.1 time: 0.691957 Aug 29 15:37:24.341546 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1398/2658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:23 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1468 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:24.377715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-98eeea18-d9ff-42c1-b58e-2f50327bdf54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.381051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-98eeea18-d9ff-42c1-b58e-2f50327bdf54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.669235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-98eeea18-d9ff-42c1-b58e-2f50327bdf54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:24.677892 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-98eeea18-d9ff-42c1-b58e-2f50327bdf54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1216 microversion: 2.1 time: 0.313993 Aug 29 15:37:24.689693 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1399/2659] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:24 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1216 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:24.704581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.706948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.728195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.728879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.731857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.735586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.736348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.745230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.120302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.136031 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-245329e0-6bae-4b84-abbc-9aba6f69712c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 1.049023 Aug 29 15:37:25.138114 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1261/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:24 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:25.367936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:25.368901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.380701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.381490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.385188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.386232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.386885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.387476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.765283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.799480 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e3c8f98b-d747-42c1-a207-396a4ab26618 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 1.101252 Aug 29 15:37:25.805498 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1400/2661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:24 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:25.841924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:25.846238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.885422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.888755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.892059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.893416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.894110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.895306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.119073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.142664 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-37c4ee01-fd43-4283-9d9a-a30a8dac4a2a tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1426 microversion: 2.1 time: 0.780954 Aug 29 15:37:26.158230 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1262/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:25 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1426 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:26.166776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.172164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.186808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.188901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.189559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.190694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.194107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.194742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.422814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.438301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca5be30c-304b-4bfe-9dbb-ab129f533ea6 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1268 microversion: 2.1 time: 0.630893 Aug 29 15:37:26.441870 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1401/2663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:25 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1268 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:26.458872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-ef36804a-6438-4191-94fd-2416f298cdaf req-ece250ba-3c34-4ba1-8b27-07dd7cd1ffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a875b95-41d0-42ad-ab26-fda6f5cc6156", "name": "network-vif-deleted", "tag": "85f1630a-c1ec-48ea-a46c-7043cf2b12dc"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:26.499816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ef36804a-6438-4191-94fd-2416f298cdaf req-ece250ba-3c34-4ba1-8b27-07dd7cd1ffb5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.500309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ef36804a-6438-4191-94fd-2416f298cdaf req-ece250ba-3c34-4ba1-8b27-07dd7cd1ffb5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.500749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ef36804a-6438-4191-94fd-2416f298cdaf req-ece250ba-3c34-4ba1-8b27-07dd7cd1ffb5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.554836 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-ef36804a-6438-4191-94fd-2416f298cdaf req-ece250ba-3c34-4ba1-8b27-07dd7cd1ffb5 service nova] Creating event network-vif-deleted:85f1630a-c1ec-48ea-a46c-7043cf2b12dc for instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 on n-h1-854882-3 Aug 29 15:37:26.572551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-ef36804a-6438-4191-94fd-2416f298cdaf req-ece250ba-3c34-4ba1-8b27-07dd7cd1ffb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124999 Aug 29 15:37:26.574288 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1402/2664] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:26.827296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.828253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.842495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.843255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.843952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.845069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.846569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.847314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.115092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:27.161401 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-66a8f6a4-323f-48ab-a6a5-f00f0487a60a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 1.001840 Aug 29 15:37:27.170385 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1263/2665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:26 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:27.178020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:27.179588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:27.189968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.190894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.192950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.193928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.196859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.198260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.313660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.314145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.314884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.315795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lazy-loading 'fault' on Instance uuid 0a875b95-41d0-42ad-ab26-fda6f5cc6156 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:27.564134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:27.585725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9ae7b58-de73-47cc-b407-661d5e9d50a1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 0.763830 Aug 29 15:37:27.586690 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1403/2666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:26 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:27.591681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:27.592558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:27.611325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.612200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.613925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.614888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.615698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.616379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.647312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:27.730581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:27.740228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0cefe76d-2b8e-4a82-a1c9-229dca28b19f tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 200 len: 1311 microversion: 2.1 time: 0.567576 Aug 29 15:37:27.741431 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1264/2667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:27 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 1311 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:27.816846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:27.825126 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2252c4fe-dae8-462d-bb06-59778e64dac9 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1274 microversion: 2.1 time: 0.237216 Aug 29 15:37:27.828912 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1404/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:27 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:28.190801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:28.191924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:28.249993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.250599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.251136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.251951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.252521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.253187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.608159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:28.609046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:28.621198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.630534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.631281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.632205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.632828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.633473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.677683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:29.082072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.099137 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3b43f287-ffb6-4ffc-9233-2f4a4b8f63bd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 0.494776 Aug 29 15:37:29.111371 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1405/2669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:28 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:29.131282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:29.131981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 0a875b95-41d0-42ad-ab26-fda6f5cc6156] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:29.138805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.139313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.139758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.140539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.141010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.141495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.157060 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] HTTP exception thrown: Instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 could not be found. Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Request method failure captured: Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 HTTP/1.1 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNz2dPXZYjUprsbwTFQumO6ew5I95zAOM_kjZ96ZCrBuwjteb_x8dEXAWhWZK5V0TeTl4MhTz4KZ4JwRVuwPJ3peRG2SqYT9jnS9qCrypDJ65GkTWUQ2N4lr05v8dOmj8aEJTJnNdZW56f4TwX-T-dLJrj5vZ4YZoqT0CLgQj4ycICM Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 4e12170916e24a33ab0ad5309ac2ab21 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1723785450 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4e12170916e24a33ab0ad5309ac2ab21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4e12170916e24a33ab0ad5309ac2ab21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4e12170916e24a33ab0ad5309ac2ab21", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4e12170916e24a33ab0ad5309ac2ab21"}]}] Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1723785450 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 4e12170916e24a33ab0ad5309ac2ab21 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1723785450 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminNegativeTestJSON-1723785450-project Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8b2f1d48248d45fdb39ed3c1ee4b2734 Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1723785450-project Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 could not be found. Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '0a875b95-41d0-42ad-ab26-fda6f5cc6156'} Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 could not be found. Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 could not be found. Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.159004 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 could not be found. Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Returning 404 to user: Instance 0a875b95-41d0-42ad-ab26-fda6f5cc6156 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:29.164280 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-204dc2f4-542d-4d3f-b89b-613f03b44743 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156" status: 404 len: 111 microversion: 2.1 time: 0.047692 Aug 29 15:37:29.165442 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1406/2670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:29 2022] GET /compute/v2.1/servers/0a875b95-41d0-42ad-ab26-fda6f5cc6156 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:29.170785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:29.171783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:29.179436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.180558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.181461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.182919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.184198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.184951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.291048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.299186 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-72d2f965-5bc0-4be4-b0e4-c4438084bfe8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1274 microversion: 2.1 time: 0.132405 Aug 29 15:37:29.299783 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1407/2671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:29 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:29.320367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:29.324286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:29.340637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.348625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.352786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.355016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.362780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.366688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.412781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:29.489124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.509413 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-95535a48-33cf-43c1-8137-81841cada192 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 1.322832 Aug 29 15:37:29.523395 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1265/2672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:28 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:29.560157 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a9cde68-61eb-47c1-b70e-a54bb236f285 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "DELETE /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 204 len: 0 microversion: 2.1 time: 0.254483 Aug 29 15:37:29.561191 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1408/2673] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:29 2022] DELETE /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:29.573008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d5dc68f5-13cc-4fdd-a91a-e270e1f88095 req-b91384f8-effa-491d-85f3-7700eadc6c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759c3df5-e807-49a4-b5e9-fb983aa5345d", "tag": "5ed30206-e088-498b-80c0-62ec51d5e69c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:29.578212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:29.587214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:29.601826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.602318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.602763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.603477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.603939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.604369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.634566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d5dc68f5-13cc-4fdd-a91a-e270e1f88095 req-b91384f8-effa-491d-85f3-7700eadc6c6c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.635469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d5dc68f5-13cc-4fdd-a91a-e270e1f88095 req-b91384f8-effa-491d-85f3-7700eadc6c6c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.641861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d5dc68f5-13cc-4fdd-a91a-e270e1f88095 req-b91384f8-effa-491d-85f3-7700eadc6c6c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.682276 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d5dc68f5-13cc-4fdd-a91a-e270e1f88095 req-b91384f8-effa-491d-85f3-7700eadc6c6c service nova] Creating event network-changed:5ed30206-e088-498b-80c0-62ec51d5e69c for instance 759c3df5-e807-49a4-b5e9-fb983aa5345d on n-h1-854882-3 Aug 29 15:37:29.699178 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d5dc68f5-13cc-4fdd-a91a-e270e1f88095 req-b91384f8-effa-491d-85f3-7700eadc6c6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144317 Aug 29 15:37:29.700880 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1266/2674] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:30.068828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:30.089627 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73cd8f72-4b79-45d5-810d-fafcdd160e32 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1477 microversion: 2.1 time: 0.523893 Aug 29 15:37:30.106336 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1409/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:29 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1477 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:30.135933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.139087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.155708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.156518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.158421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.159628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.162704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.163666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.251069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1e42916a-b1c7-46ff-b305-49d936294712 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'create', calling method: .version_select at 0x7fb0e320b4c0>, body: {"keypair": {"name": "tempest-keypair-659300762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEYtVDkcITkPBV95Dwj96L03BSOzrwWkffW0qZuwt4wtC1FRPAisrOr8Wx0qI9+vPJk/9UsGQysDxlR/lVc8ENRUs1FiPOjBDQGMSRcmXqEoK4TpWQpQSDfShGerpUJIg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:30.297118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-1e42916a-b1c7-46ff-b305-49d936294712 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for project 069a60f32d554f05b34f429706187490. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:30.308906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-1e42916a-b1c7-46ff-b305-49d936294712 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for user 48a7b8433888412abc328cbc3aea214b and project 069a60f32d554f05b34f429706187490. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:30.389430 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1e42916a-b1c7-46ff-b305-49d936294712 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.501483 Aug 29 15:37:30.390118 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1267/2676] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:37:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:30.404188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.404935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.429867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.430355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.430785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.439706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.440204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.440732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.447132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:31.009405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:31.024091 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-346cd324-d7f4-4aa3-96fa-192287d80f7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 0.902097 Aug 29 15:37:31.026658 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1410/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:31.039826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.040713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.058950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.059596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.060053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.061927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.062423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.065152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.304829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:31.317894 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b0e7ced3-095a-4a7d-9c02-b6f628d0ef30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 0.918075 Aug 29 15:37:31.338350 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1268/2678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:31.343736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.344536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.362047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.366899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.367851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.370764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.373283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.375533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.431042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:31.439033 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51ae57d4-50a4-465a-a7f7-81926271dcde tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 0.410393 Aug 29 15:37:31.439630 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1411/2679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:31 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:31.636917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-ecdea535-02b2-4549-97b0-c9d5694e58e5 req-c6ba3839-3f4d-45ba-b48c-a87411f7a050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cafb04-bcb7-4394-9ef5-207dee46d2e8", "name": "network-vif-plugged", "status": "completed", "tag": "43aaef2d-3096-46ec-8f0f-6cdc431d1a78"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:31.656145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ecdea535-02b2-4549-97b0-c9d5694e58e5 req-c6ba3839-3f4d-45ba-b48c-a87411f7a050 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.658899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ecdea535-02b2-4549-97b0-c9d5694e58e5 req-c6ba3839-3f4d-45ba-b48c-a87411f7a050 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.659612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ecdea535-02b2-4549-97b0-c9d5694e58e5 req-c6ba3839-3f4d-45ba-b48c-a87411f7a050 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.693990 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-ecdea535-02b2-4549-97b0-c9d5694e58e5 req-c6ba3839-3f4d-45ba-b48c-a87411f7a050 service nova] Creating event network-vif-plugged:43aaef2d-3096-46ec-8f0f-6cdc431d1a78 for instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 on n-h2-854882-3 Aug 29 15:37:31.705625 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-ecdea535-02b2-4549-97b0-c9d5694e58e5 req-c6ba3839-3f4d-45ba-b48c-a87411f7a050 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074538 Aug 29 15:37:31.708161 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1412/2680] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:31.940146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:31.955443 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cdd8a841-edf4-4c0a-8fe0-cada7f31fb9e tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1477 microversion: 2.1 time: 0.615734 Aug 29 15:37:31.956668 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1269/2681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:31 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1477 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:32.052522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:32.053349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:32.082663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.084357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.084967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.089784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.094519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.095114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.343449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:32.344761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:32.357144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.358515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.363301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.364136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.364675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.365208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.887226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:32.895589 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-afb21ec5-97a4-4ab3-8786-fdceddfea868 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 0.848929 Aug 29 15:37:32.908563 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1413/2682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:32 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:32.908563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:32.908563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:32.909495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.910672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.911359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.912183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.913003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.913589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.940221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:32.953198 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae3a5e04-615e-4e68-92b2-2a097ed12566 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 0.612157 Aug 29 15:37:32.957212 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1270/2683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:32 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:32.966867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-74502424-a68c-4900-872b-33652f564ef5 req-5ddf947b-2152-4d61-8f4c-466c4e4e4313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a", "tag": "48839336-0125-4454-ad50-7b3e665d3faf"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:32.995599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-74502424-a68c-4900-872b-33652f564ef5 req-5ddf947b-2152-4d61-8f4c-466c4e4e4313 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.996558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-74502424-a68c-4900-872b-33652f564ef5 req-5ddf947b-2152-4d61-8f4c-466c4e4e4313 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.998824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-74502424-a68c-4900-872b-33652f564ef5 req-5ddf947b-2152-4d61-8f4c-466c4e4e4313 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.011849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-74502424-a68c-4900-872b-33652f564ef5 req-5ddf947b-2152-4d61-8f4c-466c4e4e4313 service nova] Creating event network-changed:48839336-0125-4454-ad50-7b3e665d3faf for instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a on n-h1-854882-3 Aug 29 15:37:33.018342 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-74502424-a68c-4900-872b-33652f564ef5 req-5ddf947b-2152-4d61-8f4c-466c4e4e4313 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059069 Aug 29 15:37:33.019342 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1271/2684] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:33.024949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:33.026055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:33.035751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:33.036513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:33.037179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.038451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:33.039119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:33.039958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.540785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:33.553308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1dbf1fd4-ba29-4009-9cfe-604c9ae0bdb0 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1477 microversion: 2.1 time: 0.532439 Aug 29 15:37:33.560409 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1272/2685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:33 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1477 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:33.712755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:33.722025 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3b59b840-eaf3-4af5-a031-1df5af8d87bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1308 microversion: 2.1 time: 0.824261 Aug 29 15:37:33.725333 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1414/2686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:32 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1308 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:33.917902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:33.918936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:33.922686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:33.933329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:33.934224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:33.934892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.935859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:33.937208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:33.939134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.978571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:33.980039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:33.992348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:33.995699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:33.996417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.999716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.000476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.004649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.244654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:34.252658 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b771d3f8-170d-4659-949f-14c9a35766ca tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 0.339459 Aug 29 15:37:34.253249 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1273/2687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:33 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:34.431348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:34.440980 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16fcb9e6-72bd-48f1-8d3a-b1add4fb68f8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 0.467886 Aug 29 15:37:34.444807 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1415/2688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:33 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:34.580814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:34.581423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:34.596378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.597173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.598160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.599201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.599663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.600086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.667550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.668004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.671880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.672518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lazy-loading 'fault' on Instance uuid 907919a0-6c91-40b3-a95d-481cdc27bfdf {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:34.745567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:34.746488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:34.754015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:34.764891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.765804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.766431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.767949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.768627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.769241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.820667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2f1d48248d45fdb39ed3c1ee4b2734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e12170916e24a33ab0ad5309ac2ab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:34.831263 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0af7f7a9-0aa8-44ee-9b27-74de89143f81 tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 200 len: 1312 microversion: 2.1 time: 0.254623 Aug 29 15:37:34.833833 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1274/2689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:34 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 1312 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:35.097641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-47a0d941-8e3a-4c7a-aee9-67ba29cf195f req-8f6fe2a1-704c-4e6d-9bc3-f549cfd59ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907919a0-6c91-40b3-a95d-481cdc27bfdf", "name": "network-vif-deleted", "tag": "d8a92257-1ddf-4dbb-99bb-14e7b59d1a34"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:35.118051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47a0d941-8e3a-4c7a-aee9-67ba29cf195f req-8f6fe2a1-704c-4e6d-9bc3-f549cfd59ea2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.119094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47a0d941-8e3a-4c7a-aee9-67ba29cf195f req-8f6fe2a1-704c-4e6d-9bc3-f549cfd59ea2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.119799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47a0d941-8e3a-4c7a-aee9-67ba29cf195f req-8f6fe2a1-704c-4e6d-9bc3-f549cfd59ea2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.147361 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-47a0d941-8e3a-4c7a-aee9-67ba29cf195f req-8f6fe2a1-704c-4e6d-9bc3-f549cfd59ea2 service nova] Creating event network-vif-deleted:d8a92257-1ddf-4dbb-99bb-14e7b59d1a34 for instance 907919a0-6c91-40b3-a95d-481cdc27bfdf on n-h2-854882-3 Aug 29 15:37:35.157210 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-47a0d941-8e3a-4c7a-aee9-67ba29cf195f req-8f6fe2a1-704c-4e6d-9bc3-f549cfd59ea2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063482 Aug 29 15:37:35.158363 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1275/2690] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:35.276697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:35.277592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:35.289058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.289971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.290646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.302536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.303405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.304058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.524083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:35.533299 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-85718fe5-5886-436f-8bc5-f8bc9825a8da tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 0.260587 Aug 29 15:37:35.544982 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1276/2691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:35 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:35.550380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:35.551296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:35.562666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.563430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.564056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.565037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.565711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.566313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.751589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:35.784377 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-87c112f8-b179-475a-b4e1-3504503b66d4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 0.235955 Aug 29 15:37:35.786550 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1277/2692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:35 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:35.880117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:35.880847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] [instance: 907919a0-6c91-40b3-a95d-481cdc27bfdf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:35.890645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.895020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.896606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.897765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.899087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.899755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.958136 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] HTTP exception thrown: Instance 907919a0-6c91-40b3-a95d-481cdc27bfdf could not be found. Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Request method failure captured: Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf HTTP/1.1 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNz2dPXZYjUprsbwTFQumO6ew5I95zAOM_kjZ96ZCrBuwjteb_x8dEXAWhWZK5V0TeTl4MhTz4KZ4JwRVuwPJ3peRG2SqYT9jnS9qCrypDJ65GkTWUQ2N4lr05v8dOmj8aEJTJnNdZW56f4TwX-T-dLJrj5vZ4YZoqT0CLgQj4ycICM Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 4e12170916e24a33ab0ad5309ac2ab21 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1723785450 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4e12170916e24a33ab0ad5309ac2ab21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4e12170916e24a33ab0ad5309ac2ab21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4e12170916e24a33ab0ad5309ac2ab21", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4e12170916e24a33ab0ad5309ac2ab21"}]}] Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1723785450 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 4e12170916e24a33ab0ad5309ac2ab21 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1723785450 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersAdminNegativeTestJSON-1723785450-project Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 8b2f1d48248d45fdb39ed3c1ee4b2734 Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1723785450-project Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 907919a0-6c91-40b3-a95d-481cdc27bfdf could not be found. Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '907919a0-6c91-40b3-a95d-481cdc27bfdf'} Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907919a0-6c91-40b3-a95d-481cdc27bfdf could not be found. Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907919a0-6c91-40b3-a95d-481cdc27bfdf could not be found. Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:35.970573 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907919a0-6c91-40b3-a95d-481cdc27bfdf could not be found. Aug 29 15:37:35.978254 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:35.979226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:35.983240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] Returning 404 to user: Instance 907919a0-6c91-40b3-a95d-481cdc27bfdf could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:35.987850 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bfa965a5-bf4e-4085-9eca-2daf685b62fa tempest-ServersAdminNegativeTestJSON-1723785450 tempest-ServersAdminNegativeTestJSON-1723785450-project] 10.222.0.16 "GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf" status: 404 len: 111 microversion: 2.1 time: 0.112206 Aug 29 15:37:35.990825 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a98548be-960e-4d51-ad81-e8fa60f25cda tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1489 microversion: 2.1 time: 1.249335 Aug 29 15:37:35.991755 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1416/2693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:34 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1489 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:35.992616 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1278/2694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:35 2022] GET /compute/v2.1/servers/907919a0-6c91-40b3-a95d-481cdc27bfdf => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:37:36.015079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:36.016485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:36.023302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.023717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.024157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.024924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.025411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.026327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.100662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1d08e5ea-868f-4d4c-9927-5b082781e194 req-9fc3c88e-349b-4d02-9cc4-bda249987adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759c3df5-e807-49a4-b5e9-fb983aa5345d", "name": "network-vif-plugged", "status": "completed", "tag": "5ed30206-e088-498b-80c0-62ec51d5e69c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:36.125888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:36.159083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1d08e5ea-868f-4d4c-9927-5b082781e194 req-9fc3c88e-349b-4d02-9cc4-bda249987adc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.161666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1d08e5ea-868f-4d4c-9927-5b082781e194 req-9fc3c88e-349b-4d02-9cc4-bda249987adc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.162112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1d08e5ea-868f-4d4c-9927-5b082781e194 req-9fc3c88e-349b-4d02-9cc4-bda249987adc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.190417 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-779e515b-9d6a-4440-a31c-369f06f0706b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8/action" status: 202 len: 0 microversion: 2.1 time: 0.179170 Aug 29 15:37:36.198511 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1417/2695] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:36 2022] POST /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:36.218245 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1d08e5ea-868f-4d4c-9927-5b082781e194 req-9fc3c88e-349b-4d02-9cc4-bda249987adc service nova] Creating event network-vif-plugged:5ed30206-e088-498b-80c0-62ec51d5e69c for instance 759c3df5-e807-49a4-b5e9-fb983aa5345d on n-h1-854882-3 Aug 29 15:37:36.224974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:36.227484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:36.236502 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1d08e5ea-868f-4d4c-9927-5b082781e194 req-9fc3c88e-349b-4d02-9cc4-bda249987adc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138219 Aug 29 15:37:36.240675 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1279/2696] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:36.250333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.253128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.253791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.256328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.262727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.263549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.566647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:36.567365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:36.593118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.594186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.599135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.600060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.600738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.603687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.920156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:36.943081 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-10429598-011f-4c5d-b49e-61566c7879cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1494 microversion: 2.1 time: 0.742831 Aug 29 15:37:36.947444 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1418/2697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:36 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1494 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:36.954877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:36.956344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:36.984458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.985045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.985380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.986116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.986562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.986988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:37.007850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:37.017293 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f285975-a498-4dc9-8a05-7411240c4395 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1315 microversion: 2.1 time: 0.454876 Aug 29 15:37:37.031181 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1280/2698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:36 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:37.739104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:37.741561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:37.752525 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-17fc3382-a45f-413d-88f7-bd019d648b94 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 0.803210 Aug 29 15:37:37.753820 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1419/2699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:36 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:37.968308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:37.973454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:37.999208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.027297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.027297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.027297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.027297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.027297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.043573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:38.054019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:38.067608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:38.077694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.079799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.085121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.086196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.089185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.090061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.282909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:38.292593 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3d984fe8-9e1c-46ca-b0dd-1fb737dcdb2c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 200 len: 1474 microversion: 2.1 time: 0.328204 Aug 29 15:37:38.293908 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1281/2700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:37 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:38.330791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1957317823", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "320eb5e1-4f5f-4d0e-ade5-53d1634464aa"}], "security_groups": [{"name": "tempest-securitygroup--785706564"}], "key_name": "tempest-keypair-659300762", "user_data": "}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:38.425544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:38.435845 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f1eca637-22b0-486c-9b12-886c40069b89 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1502 microversion: 2.1 time: 0.398655 Aug 29 15:37:38.439996 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1420/2701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:38 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1502 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:38.447163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1678635879"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:38.450540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:38.467178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.468230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.470704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.472426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.474312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.476008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.564729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] validate_networks() for [('320eb5e1-4f5f-4d0e-ade5-53d1634464aa', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:38.866142 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a4281f8d-a811-40e9-9cea-4ddbe44d4526 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8/action" status: 202 len: 0 microversion: 2.1 time: 0.424348 Aug 29 15:37:38.867829 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1421/2702] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:38 2022] POST /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:37:38.888673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:38.889748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:38.898285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.899180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.899812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.900895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.901618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.902306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.022701 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7b88286a-b466-410f-8c88-08633466c77c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d/action" status: 202 len: 0 microversion: 2.1 time: 0.152587 Aug 29 15:37:39.023645 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1422/2703] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:38 2022] POST /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:39.030329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:39.031335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:39.041287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.042020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.042757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.043755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.044995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.045780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.242039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:39.256332 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a55b03e1-648e-4156-aed6-7931179aea7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 0.229704 Aug 29 15:37:39.257476 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1423/2704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:39 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:39.264478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5deb198a-9d64-4e7a-bbf7-1661717fb4fb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e28139d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:39.333232 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5deb198a-9d64-4e7a-bbf7-1661717fb4fb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.073638 Aug 29 15:37:39.342649 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1424/2705] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:39 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:39.350488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:39.351551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:39.359001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.359801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.360479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.361418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.362087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.363165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.581147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:39.598746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26f12a5a-07c8-4a72-b588-7c4fb9831865 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1487 microversion: 2.1 time: 0.255163 Aug 29 15:37:39.601935 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1425/2706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:39 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:39.619525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:39.620408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:39.633671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.642978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.643788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.645503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.646198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.646901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.705350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:39.855109 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db255852-405f-4bd0-a08b-5ddd8ed84fda tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 204 len: 0 microversion: 2.1 time: 0.239197 Aug 29 15:37:39.859073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1426/2707] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:39 2022] DELETE /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:37:39.864766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:39.873916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:39.885772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.895856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.896734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.897675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.898294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.898896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.942252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:39.942743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:39.943575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:39.944000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:39.944413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:39.961881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.962694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.963417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.964468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.965235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.965893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.993810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for project 069a60f32d554f05b34f429706187490. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:40.001449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for user 48a7b8433888412abc328cbc3aea214b and project 069a60f32d554f05b34f429706187490. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:40.018553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:40.023346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:40.116513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8401e306-d6d0-4244-a809-5535098db543 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.821068 Aug 29 15:37:40.118427 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1282/2708] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:40.129846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bce3a9ed-50b8-4d9d-8ec0-727e1df4ef25 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:40.130459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bce3a9ed-50b8-4d9d-8ec0-727e1df4ef25 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:40.150217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:40.158651 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab4c4d2a-a588-43da-a125-30505290a882 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1493 microversion: 2.1 time: 0.298086 Aug 29 15:37:40.159233 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1427/2709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:39 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1493 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:40.180619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b118e42d-9326-45f4-93e4-e863cb7cf237 req-6a4e77bf-3453-43a5-9456-e9d0ab2d3f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a", "name": "network-vif-plugged", "status": "completed", "tag": "48839336-0125-4454-ad50-7b3e665d3faf"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:40.230143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b118e42d-9326-45f4-93e4-e863cb7cf237 req-6a4e77bf-3453-43a5-9456-e9d0ab2d3f52 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:40.231004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b118e42d-9326-45f4-93e4-e863cb7cf237 req-6a4e77bf-3453-43a5-9456-e9d0ab2d3f52 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:40.231951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b118e42d-9326-45f4-93e4-e863cb7cf237 req-6a4e77bf-3453-43a5-9456-e9d0ab2d3f52 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:40.250208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bce3a9ed-50b8-4d9d-8ec0-727e1df4ef25 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:40.260552 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bce3a9ed-50b8-4d9d-8ec0-727e1df4ef25 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1237 microversion: 2.1 time: 0.133465 Aug 29 15:37:40.261699 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1283/2710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:40 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1237 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:40.279074 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b118e42d-9326-45f4-93e4-e863cb7cf237 req-6a4e77bf-3453-43a5-9456-e9d0ab2d3f52 service nova] Creating event network-vif-plugged:48839336-0125-4454-ad50-7b3e665d3faf for instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a on n-h1-854882-3 Aug 29 15:37:40.286931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:40.288470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:40.294750 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b118e42d-9326-45f4-93e4-e863cb7cf237 req-6a4e77bf-3453-43a5-9456-e9d0ab2d3f52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123577 Aug 29 15:37:40.298780 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1428/2711] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:40.303711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:40.304604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:40.305245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:40.306586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:40.307282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:40.308084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:40.350929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-802ec9c5-f4f6-4a31-adf7-df90c76ccc8e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2988940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:40.473064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-802ec9c5-f4f6-4a31-adf7-df90c76ccc8e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.128198 Aug 29 15:37:40.481808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1429/2712] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:40 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:40.601587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:40.612795 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ece9276a-e7ec-45ca-8865-6608c650c311 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 0.338724 Aug 29 15:37:40.616177 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1284/2713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:40 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:41.182750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:41.183668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:41.211832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.215062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.219635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:41.220704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.221488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.222139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:41.283846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:41.284478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:41.297229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.308328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.308811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:41.309607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.310088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.310517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:41.651478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:41.663976 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59cf3c98-502f-4fed-b108-10f4800145d1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1233 microversion: 2.1 time: 0.384415 Aug 29 15:37:41.667454 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1285/2714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:41 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1233 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:41.681604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab8b2045-3abd-4653-8434-014cf84220ad tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e33505e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:41.769937 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab8b2045-3abd-4653-8434-014cf84220ad tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.101014 Aug 29 15:37:41.771586 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1286/2715] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:41 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:41.785588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:41.786809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:41.805702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.806515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.807271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:41.807992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.810405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.810883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:41.828592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:41.840241 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1245a870-9ecb-4427-aca1-402a91d93a88 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1493 microversion: 2.1 time: 0.664099 Aug 29 15:37:41.843752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1430/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:41 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1493 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:42.687735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:42.689074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:42.700198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:42.705284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:42.706971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:42.712521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:42.714849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:42.715467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.114189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:43.150922 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1e26a9a-ee34-411c-b394-d12420857c69 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1295 microversion: 2.1 time: 0.466043 Aug 29 15:37:43.156772 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1431/2717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:42 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1295 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:43.181721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da4b577f-2e2a-49bb-9b1f-b5dbec04a4de tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2988040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:43.385375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:43.396113 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-715c50a2-dbb7-4500-8ce5-bad5a35aa591 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1316 microversion: 2.1 time: 1.621258 Aug 29 15:37:43.414205 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1287/2718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:41 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1316 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:43.422915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:43.429675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:43.442130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:43.443518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:43.444381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.445501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:43.446168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:43.446794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.843990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:43.858224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3440c561-2f6d-4957-a153-341169573736 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 200 len: 1493 microversion: 2.1 time: 0.437965 Aug 29 15:37:43.859196 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1288/2719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:43 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 1493 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:44.178495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:44.179125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:44.203463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.203967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.204412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:44.205129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.205618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.206050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:44.462745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:44.465303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:44.478515 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9a9ce66-84b0-4555-8e5e-f212baaa3302 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1295 microversion: 2.1 time: 0.304924 Aug 29 15:37:44.479137 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1289/2720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:44 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1295 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:44.499823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1c13c3db-1ba8-4cc3-b4cb-59e506202e92 req-48ed5fbe-eecc-4bd3-b1f7-cd5c789e29c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759c3df5-e807-49a4-b5e9-fb983aa5345d", "name": "network-vif-deleted", "tag": "5ed30206-e088-498b-80c0-62ec51d5e69c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:44.534903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c13c3db-1ba8-4cc3-b4cb-59e506202e92 req-48ed5fbe-eecc-4bd3-b1f7-cd5c789e29c6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.544339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c13c3db-1ba8-4cc3-b4cb-59e506202e92 req-48ed5fbe-eecc-4bd3-b1f7-cd5c789e29c6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.545096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c13c3db-1ba8-4cc3-b4cb-59e506202e92 req-48ed5fbe-eecc-4bd3-b1f7-cd5c789e29c6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:44.564538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1c13c3db-1ba8-4cc3-b4cb-59e506202e92 req-48ed5fbe-eecc-4bd3-b1f7-cd5c789e29c6 service nova] Creating event network-vif-deleted:5ed30206-e088-498b-80c0-62ec51d5e69c for instance 759c3df5-e807-49a4-b5e9-fb983aa5345d on n-h1-854882-3 Aug 29 15:37:44.599545 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1c13c3db-1ba8-4cc3-b4cb-59e506202e92 req-48ed5fbe-eecc-4bd3-b1f7-cd5c789e29c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119139 Aug 29 15:37:44.600185 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1290/2721] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:44.615690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:44.616411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:44.665191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.665876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.667125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:44.671278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.671850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.672360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.080653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:46.104749 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ce3df06-fd11-44fd-92af-512d39e78054 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1466 microversion: 2.1 time: 1.503328 Aug 29 15:37:46.105366 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1291/2722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:44 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1466 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:46.131146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:46.131779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:46.177079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.178014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.178630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.180328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.182662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.189233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.236379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d HTTP/1.1 Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '759c3df5-e807-49a4-b5e9-fb983aa5345d'} Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:46.241123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:46.245018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:46.245018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:46.245018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:46.245018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:46.245018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:46.245018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:37:46.245018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:37:46.252233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:46.253524 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0820b540-0785-4147-b1d9-65c024921605 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 404 len: 111 microversion: 2.1 time: 0.147165 Aug 29 15:37:46.256437 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1292/2723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:46 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:46.271586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:46.276172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:46.291013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.296100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.297101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.300088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.303776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.304498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.864682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:46.887300 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1ffc0bf-5938-4df4-9e33-56f9626f892f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1362 microversion: 2.1 time: 0.627707 Aug 29 15:37:46.889918 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1293/2724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:46 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1362 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:46.904389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4bff595a-67a2-4b39-8d77-92ea8ce7dfd5 req-bec821ef-0f3d-47e2-91db-165de7d191bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cafb04-bcb7-4394-9ef5-207dee46d2e8", "name": "network-vif-plugged", "status": "completed", "tag": "43aaef2d-3096-46ec-8f0f-6cdc431d1a78"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:46.942899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4bff595a-67a2-4b39-8d77-92ea8ce7dfd5 req-bec821ef-0f3d-47e2-91db-165de7d191bf service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.943407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4bff595a-67a2-4b39-8d77-92ea8ce7dfd5 req-bec821ef-0f3d-47e2-91db-165de7d191bf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.943847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4bff595a-67a2-4b39-8d77-92ea8ce7dfd5 req-bec821ef-0f3d-47e2-91db-165de7d191bf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.978167 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4bff595a-67a2-4b39-8d77-92ea8ce7dfd5 req-bec821ef-0f3d-47e2-91db-165de7d191bf service nova] Creating event network-vif-plugged:43aaef2d-3096-46ec-8f0f-6cdc431d1a78 for instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 on n-h2-854882-3 Aug 29 15:37:46.986765 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4bff595a-67a2-4b39-8d77-92ea8ce7dfd5 req-bec821ef-0f3d-47e2-91db-165de7d191bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093697 Aug 29 15:37:46.987417 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1294/2725] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:47.004099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:47.004953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:47.018665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:47.019167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:47.020161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:47.020920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:47.024906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:47.025228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:47.371134 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da4b577f-2e2a-49bb-9b1f-b5dbec04a4de tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 4.213207 Aug 29 15:37:47.372446 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1432/2726] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:43 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 4215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:47.385179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-542752066", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:47.449120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] validate_networks() for [('f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:47.577580 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7395f668-7ab2-48fb-9aa0-d56173e5db7c tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1617 microversion: 2.1 time: 0.588859 Aug 29 15:37:47.592986 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1295/2727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:46 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1617 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:48.170078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e041ca61-9bdd-49b3-a632-49af97e2da87 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Action: 'create', calling method: .version_select at 0x7fb0e30e3a60>, body: {"keypair": {"name": "tempest-keypair-65170630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQXB36F6l1+EG95nLPmgMtbCXIbjOvEGz8q/Cs23vFgCJyX5E/GA7Ev4E2ctVpUp2+5CSFofN1LuEmIJ+PJCJHsQncJtAtQ/+tMAVselQ4lGc4QQkR0mBsFNsZZcDFYEA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:48.242030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e041ca61-9bdd-49b3-a632-49af97e2da87 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Getting quotas for project a252756856a8491fb600a3b03f24c598. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:48.271587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e041ca61-9bdd-49b3-a632-49af97e2da87 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Getting quotas for user 26cfb36460a54faca6f9a512c9329d25 and project a252756856a8491fb600a3b03f24c598. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:48.346205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e041ca61-9bdd-49b3-a632-49af97e2da87 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.766474 Aug 29 15:37:48.346831 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1296/2728] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:37:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:48.369925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-148542438", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["4254c3c6-f8b5-44e4-b752-f8ee1828a748"]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:48.557276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:49.365497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:49.366931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:49.367562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:49.368429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:49.369414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:49.385520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=29 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.394625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.397731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.398366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.399616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.401729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.402347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.462459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:49.478839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:49.523317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:49.526165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:49.762195 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b262b52d-a0be-4713-969d-f53e1208e56e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409580 Aug 29 15:37:49.764832 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1297/2729] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:49.792544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.796646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:49.806857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.807675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.808567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.809531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.810139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.810717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:50.071641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:50.084543 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cd1608c2-560b-4688-8e7d-ac6222a32714 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1362 microversion: 2.1 time: 0.317764 Aug 29 15:37:50.097452 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1298/2730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:50.107001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-16c015da-50ec-4927-a949-328d16ff316d req-99c5a043-3a63-4217-9169-fa3fc50e44a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201caf06-9ac5-4656-af53-fe83b1b5baf8", "tag": "5eccb0b2-01d6-49bb-ad04-7f30f153719c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:50.117642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-16c015da-50ec-4927-a949-328d16ff316d req-99c5a043-3a63-4217-9169-fa3fc50e44a2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:50.137349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-16c015da-50ec-4927-a949-328d16ff316d req-99c5a043-3a63-4217-9169-fa3fc50e44a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:50.141003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-16c015da-50ec-4927-a949-328d16ff316d req-99c5a043-3a63-4217-9169-fa3fc50e44a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:50.176271 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-16c015da-50ec-4927-a949-328d16ff316d req-99c5a043-3a63-4217-9169-fa3fc50e44a2 service nova] Creating event network-changed:5eccb0b2-01d6-49bb-ad04-7f30f153719c for instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 on n-h2-854882-3 Aug 29 15:37:50.188782 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-16c015da-50ec-4927-a949-328d16ff316d req-99c5a043-3a63-4217-9169-fa3fc50e44a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085799 Aug 29 15:37:50.192143 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1299/2731] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:50.209044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e9a106a-708a-472f-8ab3-b4d35cc259b2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e29b0040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:50.358057 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e9a106a-708a-472f-8ab3-b4d35cc259b2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.158523 Aug 29 15:37:50.361050 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1300/2732] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:50 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:50.386138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be7149e2-e3b4-4fe5-8ada-8a836423eae7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:50.391340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be7149e2-e3b4-4fe5-8ada-8a836423eae7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:50.612534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be7149e2-e3b4-4fe5-8ada-8a836423eae7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:50.624501 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be7149e2-e3b4-4fe5-8ada-8a836423eae7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1216 microversion: 2.1 time: 0.259645 Aug 29 15:37:50.639500 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1301/2733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:50 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1216 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:51.109410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:51.110378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:51.134311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.135052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.140210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.144141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.145367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.146623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.867267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:51.921342 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9eec872-d71e-4b1f-95ed-27287af826bd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1362 microversion: 2.1 time: 0.814231 Aug 29 15:37:51.925681 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1302/2734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:51 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:51.944023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66f62b16-4e0f-414c-a27b-453da17aab06 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e3050f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:51.999924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:52.001015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:52.001720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:52.002380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:52.004314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:52.045344 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-66f62b16-4e0f-414c-a27b-453da17aab06 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.115674 Aug 29 15:37:52.046101 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1303/2735] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:51 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:52.062836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.066653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.067332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.069254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.071313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.072126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:52.072751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.074691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:52.116124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.118004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.119024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.123476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.127594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.129882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.203859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:52.229738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for user 065c5a92f9c04400be8a515e8233fb0d and project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:52.270919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:52.275787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:52.391276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7e0598a-4206-4707-8029-00ff7e07e772 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.016420 Aug 29 15:37:52.393834 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1433/2736] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 5020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:52.409761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e60841bc-341d-4dc1-a161-5673034544e1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:52.417033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e60841bc-341d-4dc1-a161-5673034544e1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:52.501938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:52.512180 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fbf41056-f158-48ae-b4ac-c619645cd731 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1286 microversion: 2.1 time: 0.454038 Aug 29 15:37:52.512912 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1304/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:52 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1286 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:52.589712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e60841bc-341d-4dc1-a161-5673034544e1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:52.602039 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e60841bc-341d-4dc1-a161-5673034544e1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1214 microversion: 2.1 time: 0.192729 Aug 29 15:37:52.613933 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1434/2738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:52 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:52.951486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:52.953029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:52.964872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.965358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.965844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.966553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.967003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.967420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.070183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4222d0d1-4fdf-4af4-a3f9-7fff40d567c0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2994d30>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:53.156229 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4222d0d1-4fdf-4af4-a3f9-7fff40d567c0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.098586 Aug 29 15:37:53.157587 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1435/2739] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:53 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:53.546046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:53.546908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:53.559136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.559945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.561860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.568318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.569066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.569723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.783653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:53.797195 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36f78cf2-fc0b-45f4-b106-273eb40156bc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1362 microversion: 2.1 time: 0.850262 Aug 29 15:37:53.813426 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1305/2740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:52 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1362 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:53.821047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:53.822147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:53.828938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.829950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.830572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.831650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.832817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.833496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.933968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:53.946586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2a31edc-5a3e-4610-b97e-c2d28da8cf22 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1274 microversion: 2.1 time: 0.406388 Aug 29 15:37:53.964629 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1436/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:53 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1274 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:53.977225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-380901961", "imageRef": "112aa22b-1add-4861-980c-40543f16bddc", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "af5a5c1a-52ee-49a2-9d51-af4ecb6a2d0a"}], "security_groups": [{"name": "tempest-securitygroup--1311046005"}], "key_name": "tempest-keypair-65170630", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:54.016163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:54.028684 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8c80e5c3-a846-4f6c-b2c0-3bf68d6358e3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1266 microversion: 2.1 time: 0.213801 Aug 29 15:37:54.038882 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1306/2742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:53 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:54.172890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e05c4e65-66d8-4b6b-8041-19f4436c521d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e32ff550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:54.251186 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e05c4e65-66d8-4b6b-8041-19f4436c521d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.082870 Aug 29 15:37:54.251782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1307/2743] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:54 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:54.383473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] validate_networks() for [('af5a5c1a-52ee-49a2-9d51-af4ecb6a2d0a', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:54.828215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:54.830310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:54.863799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:54.864678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:54.865404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:54.884320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:54.885439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:54.889183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.344030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:56.357899 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c6fcfa8-91d5-4bea-890b-01ae7ec6bec5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1362 microversion: 2.1 time: 1.541708 Aug 29 15:37:56.379127 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1308/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:54 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1362 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:56.384423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:56.385353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:56.401066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.402241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.403386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.404383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.405080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.405772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.870276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:56.884218 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be4a9009-97db-42bf-a5b3-b21e7cfe9ea1 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 0.503516 Aug 29 15:37:56.886470 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1309/2745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:56 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:56.916106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:56.920146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:56.937527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.938032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.938474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.940226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.940694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.943158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.102377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:57.107335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:57.108505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:57.113823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:57.116889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:57.220203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.225733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.226314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.230461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.231202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.234087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.282639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Getting quotas for project a252756856a8491fb600a3b03f24c598. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:57.295300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Getting quotas for user 26cfb36460a54faca6f9a512c9329d25 and project a252756856a8491fb600a3b03f24c598. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:57.323153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:57.333603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:57.340080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='112aa22b-1add-4861-980c-40543f16bddc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:57.361471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f714740-ca91-4ce6-b482-c460918c3b22 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1272 microversion: 2.1 time: 0.472207 Aug 29 15:37:57.362754 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1310/2746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:56 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1272 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:57.368949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c0d273f-8f8d-4851-97c3-0d0cc25ef4af tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2916ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.451775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2c0d273f-8f8d-4851-97c3-0d0cc25ef4af tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.087269 Aug 29 15:37:57.454477 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1311/2747] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:57.470559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bc748f2d-dcd0-4b63-9b43-90eeae446bd5 req-e632cf06-55ce-42d5-b94a-ea061ab1f9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201caf06-9ac5-4656-af53-fe83b1b5baf8", "name": "network-vif-plugged", "status": "completed", "tag": "5eccb0b2-01d6-49bb-ad04-7f30f153719c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:57.493134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:57.498448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bc748f2d-dcd0-4b63-9b43-90eeae446bd5 req-e632cf06-55ce-42d5-b94a-ea061ab1f9c3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.502204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bc748f2d-dcd0-4b63-9b43-90eeae446bd5 req-e632cf06-55ce-42d5-b94a-ea061ab1f9c3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.502891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bc748f2d-dcd0-4b63-9b43-90eeae446bd5 req-e632cf06-55ce-42d5-b94a-ea061ab1f9c3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.536151 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bc748f2d-dcd0-4b63-9b43-90eeae446bd5 req-e632cf06-55ce-42d5-b94a-ea061ab1f9c3 service nova] Creating event network-vif-plugged:5eccb0b2-01d6-49bb-ad04-7f30f153719c for instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 on n-h2-854882-3 Aug 29 15:37:57.552968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bc748f2d-dcd0-4b63-9b43-90eeae446bd5 req-e632cf06-55ce-42d5-b94a-ea061ab1f9c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094125 Aug 29 15:37:57.561068 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1312/2748] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:57.566875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.570080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:57.583738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.590467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.591339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.592239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.592854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.593461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.630897 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81ec4235-3abe-49d2-966b-49cc94f8cb3b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.656752 Aug 29 15:37:57.640075 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1437/2749] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 3674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:57.680041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13176ec7-f04e-475e-bceb-138787a0c796 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.691289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13176ec7-f04e-475e-bceb-138787a0c796 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:58.205010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13176ec7-f04e-475e-bceb-138787a0c796 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:58.233433 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13176ec7-f04e-475e-bceb-138787a0c796 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1243 microversion: 2.1 time: 0.577467 Aug 29 15:37:58.235286 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1438/2750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1243 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:58.257505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.270271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:58.304213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:58.305587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:58.307877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:58.312502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:58.315445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:58.316616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:58.749919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:58.764944 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c4fe29aa-5d37-40e7-8a1b-794b1492a2a9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1362 microversion: 2.1 time: 1.202239 Aug 29 15:37:58.765710 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1313/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1362 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:58.781464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.782534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:58.816888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:58.818111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:58.819115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:58.821312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:58.822186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:58.822840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:59.368641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:59.386874 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be8b2650-8b8e-4c0f-8041-3e0bca3588c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1314 microversion: 2.1 time: 0.617682 Aug 29 15:37:59.393970 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1314/2752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:59.406735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-893ee5c2-4193-4554-bde3-52d967e5a884 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e29b0160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:59.462376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:59.576567 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-893ee5c2-4193-4554-bde3-52d967e5a884 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1414 microversion: 2.1 time: 0.176589 Aug 29 15:37:59.582758 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1315/2753] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:59 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1414 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:59.610034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:59.610709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:59.626454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:59.636902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:59.638889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:59.639711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:59.640240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:59.640898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:59.788691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:59.805509 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c2397dfb-526d-42e6-b4d5-d0fa89f693c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 1.566563 Aug 29 15:37:59.806515 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1439/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:59.954644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1196136537", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:00.020762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:00.047437 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75a382af-c860-488b-840b-8e2e8a5017a3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1295 microversion: 2.1 time: 0.463433 Aug 29 15:38:00.048052 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1316/2755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:59 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1295 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:00.065717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.066782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:00.085178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.094110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.095094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.096203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.096860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.098030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.099052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] validate_networks() for [('8415dbd5-2216-4578-8fcf-1228fea111ac', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:00.132660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:00.562977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:00.572630 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-37cfb3cd-78b7-4a50-af39-ed55ff2126aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1548 microversion: 2.1 time: 0.523528 Aug 29 15:38:00.577128 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1317/2756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1548 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:00.592896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.594024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:00.607732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.608467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.609003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.610563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.611268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.611797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.622141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:01.532555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:01.548971 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2fb55c10-ce7c-4c79-9067-73f559e3e4e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1314 microversion: 2.1 time: 0.970469 Aug 29 15:38:01.561685 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1318/2757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:01.602471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.603601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:01.629586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.635399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.636718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.638922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.639407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.639839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.994911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:01.996314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:01.997097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:01.997707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:01.998383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:02.041325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:02.044486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:02.047322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:02.052204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:02.055393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:02.056227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:02.122718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Getting quotas for project fbe0e5fcbfed48aaaac38493038900d5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:02.139334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Getting quotas for user d900c75dc1dd4f5d9cac369d156e2745 and project fbe0e5fcbfed48aaaac38493038900d5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:02.184586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:02.188563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:02.318722 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-056c8d9c-3b30-4797-83b2-0974c76d57fc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.509872 Aug 29 15:38:02.328807 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1440/2758] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:02.340813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83007bf7-70f0-4efa-a9a7-9b8a2d0b1ccb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0eb6b8f70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.370500 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5857c416-ddd4-43a0-b9dc-94377e8fcd7a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.805979 Aug 29 15:38:02.382818 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1319/2759] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-interface => generated 284 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:02.390227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.391286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:02.419271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:02.419939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:02.420877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:02.424555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:02.429517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:02.430097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:03.453235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:03.468413 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5282e6a9-e080-4a85-9241-26663a562c7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 1.084367 Aug 29 15:38:03.473315 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1320/2760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:03.676690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f4d05ac-526a-44a9-bd11-2e7f488ff7a3 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Action: 'create', calling method: .version_select at 0x7fb0e2976790>, body: {"pool": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:08.701958 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83007bf7-70f0-4efa-a9a7-9b8a2d0b1ccb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1423 microversion: 2.1 time: 6.371216 Aug 29 15:38:08.703492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1441/2761] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1423 bytes in 6374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:08.708985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:08.709860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:08.712442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:08.722516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.723243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.723849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.724766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.725434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.726221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.738882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:09.242236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:09.263297 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2aaa37ea-862f-4065-a910-14e44280df54 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.558427 Aug 29 15:38:09.263922 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1442/2762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:08 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:09.281790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-26d39a9a-16c6-42d6-939f-32fd1628fc0c req-63f75eed-4641-492a-a491-8efa8d55e8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f257df-f378-4dbc-a0ab-97037668efbc", "tag": "6e02a8e3-2a57-4748-9423-8aa3383d0ca7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:09.306932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-26d39a9a-16c6-42d6-939f-32fd1628fc0c req-63f75eed-4641-492a-a491-8efa8d55e8b2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.309207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-26d39a9a-16c6-42d6-939f-32fd1628fc0c req-63f75eed-4641-492a-a491-8efa8d55e8b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.310011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-26d39a9a-16c6-42d6-939f-32fd1628fc0c req-63f75eed-4641-492a-a491-8efa8d55e8b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.339455 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-26d39a9a-16c6-42d6-939f-32fd1628fc0c req-63f75eed-4641-492a-a491-8efa8d55e8b2 service nova] Creating event network-changed:6e02a8e3-2a57-4748-9423-8aa3383d0ca7 for instance 77f257df-f378-4dbc-a0ab-97037668efbc on n-h1-854882-3 Aug 29 15:38:09.351783 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-26d39a9a-16c6-42d6-939f-32fd1628fc0c req-63f75eed-4641-492a-a491-8efa8d55e8b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086608 Aug 29 15:38:09.352714 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1443/2763] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:09.358323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4d6b35b7-65b5-492d-a573-a31994288845 req-2f6416c1-fb8a-4590-a187-65ac82e42ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "656ec23a-a07a-4868-a7d6-1e57735ae6e3", "tag": "d39d4f65-362d-4a42-85d7-dbbd1b7dd094"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:09.374380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d6b35b7-65b5-492d-a573-a31994288845 req-2f6416c1-fb8a-4590-a187-65ac82e42ea5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.375186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d6b35b7-65b5-492d-a573-a31994288845 req-2f6416c1-fb8a-4590-a187-65ac82e42ea5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.377064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d6b35b7-65b5-492d-a573-a31994288845 req-2f6416c1-fb8a-4590-a187-65ac82e42ea5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.395902 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4d6b35b7-65b5-492d-a573-a31994288845 req-2f6416c1-fb8a-4590-a187-65ac82e42ea5 service nova] Creating event network-changed:d39d4f65-362d-4a42-85d7-dbbd1b7dd094 for instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 on n-h1-854882-3 Aug 29 15:38:09.401683 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4d6b35b7-65b5-492d-a573-a31994288845 req-2f6416c1-fb8a-4590-a187-65ac82e42ea5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047159 Aug 29 15:38:09.402942 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1444/2764] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:09.412501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.417243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:09.427710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.428578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.429311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.430715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.431616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.432415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.002476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:10.015567 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-646741da-16bb-4b80-a6a9-35aa18802e44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1317 microversion: 2.1 time: 0.611022 Aug 29 15:38:10.016278 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1445/2765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:09 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:10.021346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:10.042870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:10.060986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.064744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.068113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.069076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.069795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.072869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.644339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:10.652246 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a84a86e-7eba-46fc-8321-a97d73488b93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1314 microversion: 2.1 time: 0.635036 Aug 29 15:38:10.671158 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1446/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:10 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:10.678568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:10.681418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:10.697185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.698018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.698740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.699540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.700069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.700717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.850178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:11.864319 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08f007fb-4289-4404-a31f-89864745739b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 1.190619 Aug 29 15:38:11.882704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1447/2767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:10 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:11.892295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-462801f9-6e9f-4483-925b-eb3f4c2e4cf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2921ee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:11.989339 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f4d05ac-526a-44a9-bd11-2e7f488ff7a3 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.514237 Aug 29 15:38:11.990301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1321/2768] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:38:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:11.996604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-91ae0795-d813-4710-8065-6769845b4e97 req-798986e7-2345-44aa-ad6f-1b67a549a65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f257df-f378-4dbc-a0ab-97037668efbc", "name": "network-vif-plugged", "status": "completed", "tag": "6e02a8e3-2a57-4748-9423-8aa3383d0ca7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.002257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-462801f9-6e9f-4483-925b-eb3f4c2e4cf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 200 len: 1423 microversion: 2.1 time: 0.112194 Aug 29 15:38:12.007955 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1448/2769] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:11 2022] GET /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 1423 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:12.021024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.022912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:12.030082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91ae0795-d813-4710-8065-6769845b4e97 req-798986e7-2345-44aa-ad6f-1b67a549a65d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.032869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91ae0795-d813-4710-8065-6769845b4e97 req-798986e7-2345-44aa-ad6f-1b67a549a65d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.034139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91ae0795-d813-4710-8065-6769845b4e97 req-798986e7-2345-44aa-ad6f-1b67a549a65d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.045572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.047415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.049137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.050951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.053810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.055928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.065727 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-91ae0795-d813-4710-8065-6769845b4e97 req-798986e7-2345-44aa-ad6f-1b67a549a65d service nova] Creating event network-vif-plugged:6e02a8e3-2a57-4748-9423-8aa3383d0ca7 for instance 77f257df-f378-4dbc-a0ab-97037668efbc on n-h1-854882-3 Aug 29 15:38:12.074093 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-91ae0795-d813-4710-8065-6769845b4e97 req-798986e7-2345-44aa-ad6f-1b67a549a65d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081716 Aug 29 15:38:12.075596 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1322/2770] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:12.111626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.115575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:12.120382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:12.156521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=22 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:12.159861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.161897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.167030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.171755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.173380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.175146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.559959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:12.571856 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d780921-a3cf-4e3a-9b31-51283f2546e3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1317 microversion: 2.1 time: 0.494690 Aug 29 15:38:12.581780 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1323/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:12.587465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-226b697f-790e-4303-b198-c9a859e63fd9 req-0bd0b62c-1e78-447f-b271-b58c20437f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e", "tag": "17ca6f8e-6a58-4644-9b2e-b31ad6b2d742"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.613957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-226b697f-790e-4303-b198-c9a859e63fd9 req-0bd0b62c-1e78-447f-b271-b58c20437f33 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.614685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-226b697f-790e-4303-b198-c9a859e63fd9 req-0bd0b62c-1e78-447f-b271-b58c20437f33 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.615279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-226b697f-790e-4303-b198-c9a859e63fd9 req-0bd0b62c-1e78-447f-b271-b58c20437f33 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.641838 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-226b697f-790e-4303-b198-c9a859e63fd9 req-0bd0b62c-1e78-447f-b271-b58c20437f33 service nova] Creating event network-changed:17ca6f8e-6a58-4644-9b2e-b31ad6b2d742 for instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e on n-h2-854882-3 Aug 29 15:38:12.648992 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-226b697f-790e-4303-b198-c9a859e63fd9 req-0bd0b62c-1e78-447f-b271-b58c20437f33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065374 Aug 29 15:38:12.651237 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1324/2772] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:12.657710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e85ddc0c-5555-4ddb-9ee0-f40cb500ebc2 req-1e500c32-b793-42e6-a495-ad9e0a130275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201caf06-9ac5-4656-af53-fe83b1b5baf8", "tag": "5eccb0b2-01d6-49bb-ad04-7f30f153719c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.695924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e85ddc0c-5555-4ddb-9ee0-f40cb500ebc2 req-1e500c32-b793-42e6-a495-ad9e0a130275 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.697352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e85ddc0c-5555-4ddb-9ee0-f40cb500ebc2 req-1e500c32-b793-42e6-a495-ad9e0a130275 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.698698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e85ddc0c-5555-4ddb-9ee0-f40cb500ebc2 req-1e500c32-b793-42e6-a495-ad9e0a130275 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.728830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:12.731619 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e85ddc0c-5555-4ddb-9ee0-f40cb500ebc2 req-1e500c32-b793-42e6-a495-ad9e0a130275 service nova] Creating event network-changed:5eccb0b2-01d6-49bb-ad04-7f30f153719c for instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 on n-h2-854882-3 Aug 29 15:38:12.738972 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e85ddc0c-5555-4ddb-9ee0-f40cb500ebc2 req-1e500c32-b793-42e6-a495-ad9e0a130275 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085196 Aug 29 15:38:12.740969 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1325/2773] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:12.746102 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4b7c416-dad5-4af7-84ab-0697301f4d5b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.735285 Aug 29 15:38:12.747907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.748901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:12.753696 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1449/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:12.765103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.769433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8c96f57-8cad-4f4b-8d7c-980c7415f3dd tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Calling method '.version_select at 0x7fb0e2813f70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.770415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.771498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.774370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.774914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.775527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.156567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:13.177431 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2c23616-5329-48e2-ac82-f5b8f3006608 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1314 microversion: 2.1 time: 0.434573 Aug 29 15:38:13.178949 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1326/2775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:13.195762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c521ead-b03e-4757-b02d-5b63f59121e4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e29b0e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.244529 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8c96f57-8cad-4f4b-8d7c-980c7415f3dd tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/565bec97-a948-4f9c-9192-9b5f6100caab" status: 200 len: 142 microversion: 2.1 time: 0.486074 Aug 29 15:38:13.246882 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1450/2776] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/os-floating-ips/565bec97-a948-4f9c-9192-9b5f6100caab => generated 142 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:13.252787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.253712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:13.264632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.265604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.266630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.267879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.269482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.271543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.623643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:13.636428 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3873a9ad-7da3-4b01-ba1f-d1d32270c290 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 0.388011 Aug 29 15:38:13.651422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1451/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:13.660612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18869f01-b305-4910-a025-4bcf4f80d5a7 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Calling method '.version_select at 0x7fb0e28790d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.966845 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18869f01-b305-4910-a025-4bcf4f80d5a7 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.314243 Aug 29 15:38:13.967883 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1452/2778] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:13.979227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.979864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:13.996622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.997326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.001020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.002796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.003316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.005809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.232824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.242987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce92441c-ee5e-4085-b9da-219f1fbbd889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1317 microversion: 2.1 time: 0.273985 Aug 29 15:38:14.244178 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1453/2779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:14.249100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.250447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:14.259335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.260316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.261093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.262871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.264031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.266427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.288411 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2c521ead-b03e-4757-b02d-5b63f59121e4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 204 len: 0 microversion: 2.1 time: 1.107634 Aug 29 15:38:14.289771 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1327/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:13 2022] DELETE /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:14.294673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1eb81921-0d8e-409c-a53b-5e54c2f4fafb tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Calling method '.version_select at 0x7fb0e28feaf0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.479680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.490562 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e92df02e-6dff-461e-b672-b9d5a139d88c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.244345 Aug 29 15:38:14.490562 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1454/2781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:14 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:14.518557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.519774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:14.532245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.533162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.539664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.539664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.539664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.539664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.756332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.787752 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-57c95447-55df-437d-a6b2-c72a2efc548c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1502 microversion: 2.1 time: 0.272997 Aug 29 15:38:14.797661 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1455/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:14 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:14.815237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.818227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:14.834294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.835597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.835597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.835931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.836345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.836900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.906802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:15.034549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8baaaff-93d9-43b4-bef5-5e18be1dcaa1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 204 len: 0 microversion: 2.1 time: 0.231884 Aug 29 15:38:15.036976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1456/2783] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:14 2022] DELETE /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:15.049741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-11dbb062-1e82-4ac4-a2c0-7722764fe737 req-55385c37-c649-4164-a2ff-a9880705d106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cafb04-bcb7-4394-9ef5-207dee46d2e8", "name": "network-vif-unplugged", "status": "completed", "tag": "43aaef2d-3096-46ec-8f0f-6cdc431d1a78"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:15.060869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-11dbb062-1e82-4ac4-a2c0-7722764fe737 req-55385c37-c649-4164-a2ff-a9880705d106 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.061422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-11dbb062-1e82-4ac4-a2c0-7722764fe737 req-55385c37-c649-4164-a2ff-a9880705d106 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.062089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-11dbb062-1e82-4ac4-a2c0-7722764fe737 req-55385c37-c649-4164-a2ff-a9880705d106 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.090062 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-11dbb062-1e82-4ac4-a2c0-7722764fe737 req-55385c37-c649-4164-a2ff-a9880705d106 service nova] Creating event network-vif-unplugged:43aaef2d-3096-46ec-8f0f-6cdc431d1a78 for instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 on n-h2-854882-3 Aug 29 15:38:15.101885 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-11dbb062-1e82-4ac4-a2c0-7722764fe737 req-55385c37-c649-4164-a2ff-a9880705d106 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060702 Aug 29 15:38:15.106240 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1457/2784] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:15.113115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:15.114396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:15.124222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.125439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.126344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.132075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.132851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.133313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.306245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:15.314934 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51f84cd8-9e45-491f-9402-806b97636df5 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 0.207360 Aug 29 15:38:15.315518 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1458/2785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:15 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:15.334114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c184c33e-a23c-4c69-8f1a-a0407ac6d392 req-3129c57c-5243-433d-95ae-1fd1dbede1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fdb7873-a953-4b26-8ffb-139cb096faf1", "tag": "7a7b8149-cb7f-4f33-8595-700998dd84d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:15.345226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c184c33e-a23c-4c69-8f1a-a0407ac6d392 req-3129c57c-5243-433d-95ae-1fd1dbede1e3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.346504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c184c33e-a23c-4c69-8f1a-a0407ac6d392 req-3129c57c-5243-433d-95ae-1fd1dbede1e3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.347231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c184c33e-a23c-4c69-8f1a-a0407ac6d392 req-3129c57c-5243-433d-95ae-1fd1dbede1e3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.367046 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c184c33e-a23c-4c69-8f1a-a0407ac6d392 req-3129c57c-5243-433d-95ae-1fd1dbede1e3 service nova] Creating event network-changed:7a7b8149-cb7f-4f33-8595-700998dd84d9 for instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 on n-h1-854882-3 Aug 29 15:38:15.372147 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c184c33e-a23c-4c69-8f1a-a0407ac6d392 req-3129c57c-5243-433d-95ae-1fd1dbede1e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044829 Aug 29 15:38:15.373346 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1459/2786] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:15.379709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:15.380335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:15.403487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.404042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.404605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.405333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.406015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.406708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.434755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lazy-loading 'flavor' on Instance uuid 77f257df-f378-4dbc-a0ab-97037668efbc {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:15.476602 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1eb81921-0d8e-409c-a53b-5e54c2f4fafb tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/565bec97-a948-4f9c-9192-9b5f6100caab" status: 202 len: 0 microversion: 2.1 time: 1.185505 Aug 29 15:38:15.477593 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1328/2787] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:38:14 2022] DELETE /compute/v2.1/os-floating-ips/565bec97-a948-4f9c-9192-9b5f6100caab => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:15.482763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-902163314", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5c089729-15d8-41d3-a996-e24ac0861c49"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:15.543740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:15.606847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] validate_networks() for [('5c089729-15d8-41d3-a996-e24ac0861c49', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:15.753120 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-50e26848-9c0b-41c6-898e-ee8520f4adde tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc/action" status: 202 len: 0 microversion: 2.1 time: 0.378217 Aug 29 15:38:15.757534 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1460/2788] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:15.760585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:15.761318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:15.773284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.773864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.774510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.775277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.775579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.777948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.935357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:15.944669 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f0f822c-a135-4b41-b64a-1bc4c4eda5c4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1317 microversion: 2.1 time: 0.188239 Aug 29 15:38:15.945120 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1461/2789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:15 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:15.949827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b6404752-e43c-4beb-9612-65a6afcf0b92 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Action: 'create', calling method: .version_select at 0x7fb0e2e17310>, body: {"pool": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:16.634884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:16.635384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:16.635851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:16.636477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:16.637118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:16.646692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.647201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.647633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.648353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.648800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.649220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.668046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:16.673785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for user c631f558d99f40feb637f376bac1cffa and project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:16.686794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:16.689099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:16.735024 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ba814aad-8bf1-491d-a014-adda2d174ab8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.256307 Aug 29 15:38:16.741417 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1329/2790] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:16.741417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:16.741417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:16.747272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.747753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.748184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.748888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.749337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.749787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.905060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:16.913298 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14b866e0-1c89-409d-8b42-191c6f114959 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.176308 Aug 29 15:38:16.917793 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1330/2791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:16 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:16.930671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:16.933847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:16.941856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.942659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.943140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.943901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.944646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.945071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.094338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.104004 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9fb1fd3-d7b9-424c-83e9-31e0ee2ca636 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.184882 Aug 29 15:38:17.105225 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1331/2792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:16 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.111248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.112136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.120258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.121095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.121767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.122690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.123508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.124137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.197075 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b6404752-e43c-4beb-9612-65a6afcf0b92 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.250407 Aug 29 15:38:17.205722 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1462/2793] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:17.211693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.212340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.219430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.219923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.220582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.221290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.221785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.222742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.289114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.297104 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-016ea0f6-0f63-4f51-a833-0cd2774a958c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1211 microversion: 2.1 time: 0.090023 Aug 29 15:38:17.297782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1463/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.302979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.303709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.304628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.309931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.310424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.310867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.311581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.312039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.312465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.313271 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80b3ac61-6479-43b6-845a-b0ed1c98d35d tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 0.206591 Aug 29 15:38:17.313885 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1332/2795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.318490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-94f37eb6-0c7d-4603-84f7-5f885de094c6 req-37062206-5b05-42dc-ba30-cd417078b2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656ec23a-a07a-4868-a7d6-1e57735ae6e3", "name": "network-vif-plugged", "status": "completed", "tag": "d39d4f65-362d-4a42-85d7-dbbd1b7dd094"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:17.327842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-94f37eb6-0c7d-4603-84f7-5f885de094c6 req-37062206-5b05-42dc-ba30-cd417078b2b0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.328311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-94f37eb6-0c7d-4603-84f7-5f885de094c6 req-37062206-5b05-42dc-ba30-cd417078b2b0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.328731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-94f37eb6-0c7d-4603-84f7-5f885de094c6 req-37062206-5b05-42dc-ba30-cd417078b2b0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.339895 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-94f37eb6-0c7d-4603-84f7-5f885de094c6 req-37062206-5b05-42dc-ba30-cd417078b2b0 service nova] Creating event network-vif-plugged:d39d4f65-362d-4a42-85d7-dbbd1b7dd094 for instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 on n-h1-854882-3 Aug 29 15:38:17.344664 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-94f37eb6-0c7d-4603-84f7-5f885de094c6 req-37062206-5b05-42dc-ba30-cd417078b2b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029622 Aug 29 15:38:17.345640 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1333/2796] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:17.351312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6ff1191-c661-430a-ba55-bdf52896eb14 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Calling method '.version_select at 0x7fb0e2885ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.452415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.460394 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb64f0d3-c30e-4dd3-9892-f78a30e3b41a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1317 microversion: 2.1 time: 0.161621 Aug 29 15:38:17.460981 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1464/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.934343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.935140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.942202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.942761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.943266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.944078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.944515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.944967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.140446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.149126 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b81d07b1-4aa4-4325-86dd-2390123cb1d7 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.218541 Aug 29 15:38:18.149757 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1465/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:18.154735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.155362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.161918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.162615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.163491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.164406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.165024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.165641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.202679 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6ff1191-c661-430a-ba55-bdf52896eb14 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7" status: 202 len: 0 microversion: 2.1 time: 0.855789 Aug 29 15:38:18.203756 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1334/2799] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:38:17 2022] DELETE /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7 => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:18.213510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-122efad9-b4ad-4c66-878e-239210dca686 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Calling method '.version_select at 0x7fb0e2885670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.262671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-122efad9-b4ad-4c66-878e-239210dca686 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 715f7989-e737-4008-b6cc-da0e28aaa2b7 could not be found", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:38:18.263373 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-122efad9-b4ad-4c66-878e-239210dca686 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] HTTP exception thrown: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-122efad9-b4ad-4c66-878e-239210dca686 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Request method failure captured: Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7 HTTP/1.1 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1YFvS-YYouEpyPJGW9Ms_agz9lbavsPn7o1HI7rrz5WtnXD5eMpro_Uy9cej3sUEUHrcIVuV-TdhznpRRsqraVJUvc1-s4unwVKMkMg8h3WtyKTu30J5pHMeGDp_5zLJS0Bdh5IdyAK3baVTsysAGqCjmM6VC9flL13Q85BSJXVtg Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2cc7a1d46df542979c99fe07a65961cb Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FloatingIPsTestJSON-2094939926 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cc7a1d46df542979c99fe07a65961cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cc7a1d46df542979c99fe07a65961cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cc7a1d46df542979c99fe07a65961cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cc7a1d46df542979c99fe07a65961cb"}]}] Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FloatingIPsTestJSON-2094939926 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2cc7a1d46df542979c99fe07a65961cb Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2094939926 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FloatingIPsTestJSON-2094939926-project Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3481331d8f7745abbd1de6916f7f4c36 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FloatingIPsTestJSON-2094939926-project Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: exception: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '715f7989-e737-4008-b6cc-da0e28aaa2b7'} Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 715f7989-e737-4008-b6cc-da0e28aaa2b7 could not be found Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c2afee2-e800-484b-9300-697b614dc26e'] Aug 29 15:38:18.265344 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7. Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-122efad9-b4ad-4c66-878e-239210dca686 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Returning 404 to user: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-122efad9-b4ad-4c66-878e-239210dca686 tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7" status: 404 len: 111 microversion: 2.1 time: 0.058284 Aug 29 15:38:18.270509 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1335/2800] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:18.277812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24a6c45f-05a5-4664-ae31-30c59ba59b6e tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Calling method '.version_select at 0x7fb0e3268820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.314277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.323257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91838f72-3665-4a26-98a9-e06cfdf9f338 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.172225 Aug 29 15:38:18.324220 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1466/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:18.326165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-24a6c45f-05a5-4664-ae31-30c59ba59b6e tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 715f7989-e737-4008-b6cc-da0e28aaa2b7 could not be found", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:38:18.326913 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-24a6c45f-05a5-4664-ae31-30c59ba59b6e tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] HTTP exception thrown: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24a6c45f-05a5-4664-ae31-30c59ba59b6e tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Request method failure captured: Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7 HTTP/1.1 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1YFvS-YYouEpyPJGW9Ms_agz9lbavsPn7o1HI7rrz5WtnXD5eMpro_Uy9cej3sUEUHrcIVuV-TdhznpRRsqraVJUvc1-s4unwVKMkMg8h3WtyKTu30J5pHMeGDp_5zLJS0Bdh5IdyAK3baVTsysAGqCjmM6VC9flL13Q85BSJXVtg Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2cc7a1d46df542979c99fe07a65961cb Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FloatingIPsTestJSON-2094939926 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cc7a1d46df542979c99fe07a65961cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cc7a1d46df542979c99fe07a65961cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cc7a1d46df542979c99fe07a65961cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cc7a1d46df542979c99fe07a65961cb"}]}] Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FloatingIPsTestJSON-2094939926 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2cc7a1d46df542979c99fe07a65961cb Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2094939926 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FloatingIPsTestJSON-2094939926-project Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3481331d8f7745abbd1de6916f7f4c36 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FloatingIPsTestJSON-2094939926-project Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: exception: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '715f7989-e737-4008-b6cc-da0e28aaa2b7'} Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 715f7989-e737-4008-b6cc-da0e28aaa2b7 could not be found Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45c51dc8-054c-4e87-8747-7c29f55c61be'] Aug 29 15:38:18.329235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7. Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24a6c45f-05a5-4664-ae31-30c59ba59b6e tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] Returning 404 to user: Floating IP not found for ID 715f7989-e737-4008-b6cc-da0e28aaa2b7 {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24a6c45f-05a5-4664-ae31-30c59ba59b6e tempest-FloatingIPsTestJSON-2094939926 tempest-FloatingIPsTestJSON-2094939926-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7" status: 404 len: 111 microversion: 2.1 time: 0.058364 Aug 29 15:38:18.333912 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1336/2802] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:38:18 2022] DELETE /compute/v2.1/os-floating-ips/715f7989-e737-4008-b6cc-da0e28aaa2b7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:38:18.341785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.342989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.343499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.343872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.351267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.352225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.352367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.353019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.353258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.353754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.354520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.355537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.355802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.356342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.356469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.356976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.426676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.434556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef6b0020-fedd-4734-8d0b-607dda1db522 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1203 microversion: 2.1 time: 0.107593 Aug 29 15:38:18.435145 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1467/2803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1203 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:18.481378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.482028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.489527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.490023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.490467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.491180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.491641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.492073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.613696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.622908 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19aa2f21-37fd-4f38-b1ba-1c8cb534d2a4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1316 microversion: 2.1 time: 0.283807 Aug 29 15:38:18.623831 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1337/2804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:18.637745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.646829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6ddf2b61-c81a-4636-b638-77d338aca5ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1317 microversion: 2.1 time: 0.169109 Aug 29 15:38:18.647560 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1468/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:19.170393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.171006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.177328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.177928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.178333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.178961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.179406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.179822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.344272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.344911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.353950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.354887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.356665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.357442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.358251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.358690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.515257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.524095 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9a994ff-a8d6-402f-8866-2029c264c157 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.183574 Aug 29 15:38:19.524681 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1469/2806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:19.530664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.531519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.539755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.540622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.541097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.541949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.542409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.542840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.609187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.616942 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-caee3b0f-d959-46d6-9a72-cb3c733ca405 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1259 microversion: 2.1 time: 0.091072 Aug 29 15:38:19.620069 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1470/2807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1259 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:19.646711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.647721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.654046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.654540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.655072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.655668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.656128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.656590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.796649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.808173 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8a173e4-6142-453b-a3d0-838497e6faa8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1466 microversion: 2.1 time: 0.166697 Aug 29 15:38:19.809617 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1471/2808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1466 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:19.827588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.830715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.830715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.839339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.839969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.840604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.840927 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79fa3bc7-fe98-4829-ad59-a54cafcc22dc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.673201 Aug 29 15:38:19.841606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.852478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.852478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.852776 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1338/2809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:19.858455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.860368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.869569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.870407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.871793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.872932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.873635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.875230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.239755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.255314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71ebc875-ea43-4c2f-a083-c2aabc697fd5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1317 microversion: 2.1 time: 0.428977 Aug 29 15:38:20.255950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1472/2810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:20.304065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1776a6af-bd8a-4d95-b015-fdaeaa192ebd req-57a84f86-42af-4c5a-8e16-b7c25147059a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdb7873-a953-4b26-8ffb-139cb096faf1", "name": "network-vif-plugged", "status": "completed", "tag": "7a7b8149-cb7f-4f33-8595-700998dd84d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:20.314469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1776a6af-bd8a-4d95-b015-fdaeaa192ebd req-57a84f86-42af-4c5a-8e16-b7c25147059a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.315281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1776a6af-bd8a-4d95-b015-fdaeaa192ebd req-57a84f86-42af-4c5a-8e16-b7c25147059a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.315571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1776a6af-bd8a-4d95-b015-fdaeaa192ebd req-57a84f86-42af-4c5a-8e16-b7c25147059a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.329833 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1776a6af-bd8a-4d95-b015-fdaeaa192ebd req-57a84f86-42af-4c5a-8e16-b7c25147059a service nova] Creating event network-vif-plugged:7a7b8149-cb7f-4f33-8595-700998dd84d9 for instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 on n-h1-854882-3 Aug 29 15:38:20.335108 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1776a6af-bd8a-4d95-b015-fdaeaa192ebd req-57a84f86-42af-4c5a-8e16-b7c25147059a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Aug 29 15:38:20.336248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1473/2811] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:20.430597 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b8d1056-bcfc-4afd-ac5f-0059c609b341 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1617 microversion: 2.1 time: 0.578189 Aug 29 15:38:20.431349 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1339/2812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1617 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:20.501024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-37178490", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4254c3c6-f8b5-44e4-b752-f8ee1828a748"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:20.546080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.546960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.556373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.557123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.557770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.559256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.559719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.560148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.578197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:20.906893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.925670 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4193b341-9ee5-4c8d-85fe-d026141e450c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.384755 Aug 29 15:38:20.926427 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1340/2813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:20.944284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.945127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.951931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.952549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.953235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.954609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.955164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.955819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.965915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:20.966351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:20.978143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:20.978585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:20.979015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:21.025107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.025107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.025643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.027781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.029709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.030696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.111719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:21.118126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Getting quotas for user 0b9bbdf34e904843ab7cd7b40bf3720d and project 5bc4a6b62df34515a6df68cfc28f2526. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:21.133583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:21.137753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:21.224902 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55a795f3-836a-46bf-82c4-6a6aa1d82330 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731188 Aug 29 15:38:21.232916 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1474/2814] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:21.238728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.239373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:21.247414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.248084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.248550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.249274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.249778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.250411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.604821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:21.627319 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8bc573b-fea3-462a-90d4-62c37c6da628 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.699106 Aug 29 15:38:21.632205 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1341/2815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:21.651200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-98416f76-37bd-49bf-ae48-7297c42fd412 req-43e0ddd7-b437-4d25-93c9-060073150645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cafb04-bcb7-4394-9ef5-207dee46d2e8", "name": "network-vif-deleted", "tag": "43aaef2d-3096-46ec-8f0f-6cdc431d1a78"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:21.676162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-98416f76-37bd-49bf-ae48-7297c42fd412 req-43e0ddd7-b437-4d25-93c9-060073150645 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.676642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-98416f76-37bd-49bf-ae48-7297c42fd412 req-43e0ddd7-b437-4d25-93c9-060073150645 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.677252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-98416f76-37bd-49bf-ae48-7297c42fd412 req-43e0ddd7-b437-4d25-93c9-060073150645 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.712590 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-98416f76-37bd-49bf-ae48-7297c42fd412 req-43e0ddd7-b437-4d25-93c9-060073150645 service nova] Creating event network-vif-deleted:43aaef2d-3096-46ec-8f0f-6cdc431d1a78 for instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 on n-h2-854882-3 Aug 29 15:38:21.723186 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-98416f76-37bd-49bf-ae48-7297c42fd412 req-43e0ddd7-b437-4d25-93c9-060073150645 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087017 Aug 29 15:38:21.724307 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1342/2816] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:21.731319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0e90989-128c-4dd7-a00c-b0df0c8f8dab tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.732216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f0e90989-128c-4dd7-a00c-b0df0c8f8dab tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.169268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f0e90989-128c-4dd7-a00c-b0df0c8f8dab tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.194583 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f0e90989-128c-4dd7-a00c-b0df0c8f8dab tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1215 microversion: 2.1 time: 0.452698 Aug 29 15:38:22.196049 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1343/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:21 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.203896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.205338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.247638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.254668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.256397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.258188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.261367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.264129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.406087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.418464 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2ecb2fb-cf9d-4051-a0ed-4ede2e27b534 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 1.184238 Aug 29 15:38:22.419222 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1475/2818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:21 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.426879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.427972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.438683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.439531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.440309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.441529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.442477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.443275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.578245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.586966 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0e4b80df-4058-46ae-9192-c2184594b2b8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.389449 Aug 29 15:38:22.587916 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1344/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.655236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.655862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.662651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.663591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.664030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.664903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.665544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.666170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.685884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:22.694991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.707506 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bac37292-c0cd-4067-b0b7-e7dee42591d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.287045 Aug 29 15:38:22.709349 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1476/2820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.731024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1990104507", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:22.812832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] validate_networks() for [('8415dbd5-2216-4578-8fcf-1228fea111ac', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:22.970837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.982576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d5eeb3db-bdc7-4ac1-a664-83028547e716 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.331632 Aug 29 15:38:22.983972 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1345/2821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:23.200184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-432477ae-14eb-4a67-aa68-c6703c38d10d req-4af9017b-b9ec-4802-abb0-e409edd86ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b0012d-740e-40db-b4d0-fac933f03ea1", "tag": "16687ef7-18a5-46c1-a861-d806bae5f0ba"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:23.217254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-432477ae-14eb-4a67-aa68-c6703c38d10d req-4af9017b-b9ec-4802-abb0-e409edd86ab3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.225052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-432477ae-14eb-4a67-aa68-c6703c38d10d req-4af9017b-b9ec-4802-abb0-e409edd86ab3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.225784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-432477ae-14eb-4a67-aa68-c6703c38d10d req-4af9017b-b9ec-4802-abb0-e409edd86ab3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.254778 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-432477ae-14eb-4a67-aa68-c6703c38d10d req-4af9017b-b9ec-4802-abb0-e409edd86ab3 service nova] Creating event network-changed:16687ef7-18a5-46c1-a861-d806bae5f0ba for instance 21b0012d-740e-40db-b4d0-fac933f03ea1 on n-h2-854882-3 Aug 29 15:38:23.266936 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-432477ae-14eb-4a67-aa68-c6703c38d10d req-4af9017b-b9ec-4802-abb0-e409edd86ab3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071087 Aug 29 15:38:23.269645 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1346/2822] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:23.284042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c297490a-9c49-48e0-a3f7-fb88a890cd5f req-ba23e19c-2d33-4b2a-b2b4-7bd4ade1ee56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e", "name": "network-vif-plugged", "status": "completed", "tag": "17ca6f8e-6a58-4644-9b2e-b31ad6b2d742"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:23.326698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c297490a-9c49-48e0-a3f7-fb88a890cd5f req-ba23e19c-2d33-4b2a-b2b4-7bd4ade1ee56 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.327653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c297490a-9c49-48e0-a3f7-fb88a890cd5f req-ba23e19c-2d33-4b2a-b2b4-7bd4ade1ee56 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.328575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c297490a-9c49-48e0-a3f7-fb88a890cd5f req-ba23e19c-2d33-4b2a-b2b4-7bd4ade1ee56 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.350792 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c297490a-9c49-48e0-a3f7-fb88a890cd5f req-ba23e19c-2d33-4b2a-b2b4-7bd4ade1ee56 service nova] Creating event network-vif-plugged:17ca6f8e-6a58-4644-9b2e-b31ad6b2d742 for instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e on n-h2-854882-3 Aug 29 15:38:23.356484 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c297490a-9c49-48e0-a3f7-fb88a890cd5f req-ba23e19c-2d33-4b2a-b2b4-7bd4ade1ee56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085274 Aug 29 15:38:23.361951 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1347/2823] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:23.368506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:23.369767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:23.378360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.379088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.379886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.380965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.381883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.382529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.612273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:23.620634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-87c82159-23b3-4930-89d3-f5aa15bdfd6e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1275 microversion: 2.1 time: 0.256264 Aug 29 15:38:23.621568 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1348/2824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:23 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:23.641993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:23.641993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:23.649328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.649956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.650489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.651251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.651769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.652256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.687032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:23.688150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:23.689605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:23.690305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:23.690981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:23.701686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.702289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.702804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.703832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.704531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.705038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.724640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Getting quotas for project fbe0e5fcbfed48aaaac38493038900d5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:23.730243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Getting quotas for user d900c75dc1dd4f5d9cac369d156e2745 and project fbe0e5fcbfed48aaaac38493038900d5. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:23.744724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:23.747106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:23.798541 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d84f6544-c872-4a31-9d19-856b310d6b57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087133 Aug 29 15:38:23.799635 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1477/2825] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:23.805294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:23.806034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:23.814428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.814626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.815159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.816037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.816572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.817069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.999392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.013839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8470bc5-770a-4e24-88ba-cc8f48ad69b8 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.377811 Aug 29 15:38:24.014896 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1349/2826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:23 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.021366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e37884fe-d5ba-4010-aca2-3e38c064ebd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.022191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e37884fe-d5ba-4010-aca2-3e38c064ebd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.046376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.056543 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e617c814-872d-4140-bcc5-c16b465e9373 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.254037 Aug 29 15:38:24.057152 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1478/2827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:23 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.067036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.068297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.085489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:24.097580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.098692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.099370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.100322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.100990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.102275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.163654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e37884fe-d5ba-4010-aca2-3e38c064ebd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.177870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e37884fe-d5ba-4010-aca2-3e38c064ebd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1217 microversion: 2.1 time: 0.160003 Aug 29 15:38:24.178803 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1350/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.373327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.383441 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-31a94e32-3955-4771-af82-ff267b3847db tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.322662 Aug 29 15:38:24.388135 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1479/2829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.643196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.644461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.653720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.654635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.655293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.657358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.658255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.658895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.755489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.765790 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f88e2b39-f801-4ed5-8ef6-6e59edcb9e9b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1273 microversion: 2.1 time: 0.126796 Aug 29 15:38:24.766714 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1351/2830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:25.038048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.039417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.055332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.056246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.057012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.058993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.060164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.061140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.082497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.086474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.103593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.104277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.105863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.107000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.107769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.108715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.120041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:25.310002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.319128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3dbf2efb-98ff-4b60-8341-08e6ee9a27e6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.241954 Aug 29 15:38:25.320029 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1352/2831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:25.325430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.326618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.334612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.335397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.336230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.337202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.337751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.338261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.346674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.359778 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4289e19-898e-48eb-a7ab-81e67604e31c tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1369 microversion: 2.1 time: 0.326263 Aug 29 15:38:25.368440 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1480/2832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1369 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:25.411730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.412587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.419348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.420008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.420476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.421146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.422297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.423509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.424198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.431680 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd824831-981c-4be0-915c-c02c473fc63b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1269 microversion: 2.1 time: 0.107571 Aug 29 15:38:25.432344 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1353/2833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:25.787818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.789172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.806433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.809036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.810371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.811430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.814381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.815265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.871487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.883233 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-939b2d7f-719f-43bc-bbfe-98caf4607dd4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.475912 Aug 29 15:38:25.885898 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1481/2834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:26.208142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:26.222825 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5bc0e73f-3620-4935-8bab-b92603cd1186 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.439609 Aug 29 15:38:26.236896 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1354/2835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:26.341056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.341750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.349880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.350733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.351260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.352498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.353035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.353582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.382905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.383629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.395786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.396380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.396891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.397802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.398354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.399026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.590105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:26.599831 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1fc1067a-defa-4519-ab41-6e9d25c51489 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.263487 Aug 29 15:38:26.600439 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1482/2836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:26.605345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.606249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.613648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.614409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.615036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.615954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.616580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.617175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.658667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:26.698414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:26.708389 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1477ce74-a3b3-437c-9726-0ce0e8e86054 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1275 microversion: 2.1 time: 0.106689 Aug 29 15:38:26.709158 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1483/2837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1275 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:26.908785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.910701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.917961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.918730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.919582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.920598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.921276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.921795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.936153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:26.951172 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-10ff250a-d0c8-4090-8caf-f9ccc2256e5a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1555 microversion: 2.1 time: 0.572590 Aug 29 15:38:26.967833 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1355/2838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1555 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:26.973828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.974551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.981615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.982111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.982534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.983222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.983801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.984088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.113143 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d1236630-2017-4731-bf61-389fa1733036 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143913 Aug 29 15:38:27.121992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1356/2839] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:27.233037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.245615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.246396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:27.250677 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d97ab7c3-aa76-459f-92f7-cf029336ead4 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.347257 Aug 29 15:38:27.255896 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1484/2840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:27.260227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.260719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.261158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.261897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.262351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.262779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.319847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-79986bca-4e6a-44a4-863f-97f4ba89d118 req-8db500bc-913f-4adf-8eb1-a0564409c05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f97218-0324-4431-8f13-a2d2b6e4f169", "tag": "fe6e7876-20d7-4a71-b56c-cf94bdb66895"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:27.333327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-79986bca-4e6a-44a4-863f-97f4ba89d118 req-8db500bc-913f-4adf-8eb1-a0564409c05f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.334528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-79986bca-4e6a-44a4-863f-97f4ba89d118 req-8db500bc-913f-4adf-8eb1-a0564409c05f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.335074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-79986bca-4e6a-44a4-863f-97f4ba89d118 req-8db500bc-913f-4adf-8eb1-a0564409c05f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.353236 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-79986bca-4e6a-44a4-863f-97f4ba89d118 req-8db500bc-913f-4adf-8eb1-a0564409c05f service nova] Creating event network-changed:fe6e7876-20d7-4a71-b56c-cf94bdb66895 for instance a7f97218-0324-4431-8f13-a2d2b6e4f169 on n-h2-854882-3 Aug 29 15:38:27.360685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-79986bca-4e6a-44a4-863f-97f4ba89d118 req-8db500bc-913f-4adf-8eb1-a0564409c05f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046830 Aug 29 15:38:27.362031 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1485/2841] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:27.625562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.626412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:27.643309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.643936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.644467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.645335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.645887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.646325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.906414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.926526 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f7400a00-9c81-40e8-8aea-5d5f9a595c8c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.686075 Aug 29 15:38:27.927425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1357/2842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:27.945289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.945984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:27.955043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:27.968847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.969573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.970009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.971396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.973126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.973858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.218199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.232019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-070b5a5d-2c6b-4fa3-afdb-7abd3371aa7b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.612503 Aug 29 15:38:28.236524 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1486/2843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:28.276646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.277283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:28.283691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.284502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.285178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.286119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.286800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.287425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.607880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.618608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-331baede-efb1-4798-bfa9-fef2b91bca8b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.689695 Aug 29 15:38:28.619824 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1358/2844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:28.790885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.801722 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08394c54-cb9f-434a-9249-a6e1916f0527 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.529380 Aug 29 15:38:28.802579 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1487/2845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:28 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:28.947595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.948228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:28.957179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.957697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.958148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.958844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.966196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.966686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.254209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.254845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.261660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.262265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.262787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.263591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.264312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.265627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.423729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.442163 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d125bbe0-1738-450a-ac9d-4b6d6c248c39 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.498710 Aug 29 15:38:29.442820 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1359/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:28 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:29.571426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c8476a7a-7c33-459d-abc3-dc0460f622ad req-937bb258-289a-423b-b714-ff9820119611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b0012d-740e-40db-b4d0-fac933f03ea1", "name": "network-vif-plugged", "status": "completed", "tag": "16687ef7-18a5-46c1-a861-d806bae5f0ba"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:29.590121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c8476a7a-7c33-459d-abc3-dc0460f622ad req-937bb258-289a-423b-b714-ff9820119611 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.590905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c8476a7a-7c33-459d-abc3-dc0460f622ad req-937bb258-289a-423b-b714-ff9820119611 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.591497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c8476a7a-7c33-459d-abc3-dc0460f622ad req-937bb258-289a-423b-b714-ff9820119611 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.613553 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c8476a7a-7c33-459d-abc3-dc0460f622ad req-937bb258-289a-423b-b714-ff9820119611 service nova] Creating event network-vif-plugged:16687ef7-18a5-46c1-a861-d806bae5f0ba for instance 21b0012d-740e-40db-b4d0-fac933f03ea1 on n-h2-854882-3 Aug 29 15:38:29.621016 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c8476a7a-7c33-459d-abc3-dc0460f622ad req-937bb258-289a-423b-b714-ff9820119611 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060626 Aug 29 15:38:29.623203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1360/2847] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:29.644571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.650107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.662302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.662828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.664058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.664782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.665409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.666003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.675737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.688522 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da0c7d90-8009-4e12-8413-a5fd1c2bbc12 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.438388 Aug 29 15:38:29.689134 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1488/2848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:29.823720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.824338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.832752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.833256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.833725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.834564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.835210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.835972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.006568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:30.023467 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7163c45b-be4a-4e52-b085-af4e2d5bdeac tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.383740 Aug 29 15:38:30.029231 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1361/2849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:30.103745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:30.135932 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b6ccb10e-b422-4806-aae8-cd70a10724b3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.315124 Aug 29 15:38:30.137923 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1489/2850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:30.357175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e7aaad2b-3ac6-44d4-ab27-5862a57296f0 req-3041459e-3d7d-4cf4-98b1-b221a87abc5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e", "tag": "17ca6f8e-6a58-4644-9b2e-b31ad6b2d742"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:30.418649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e7aaad2b-3ac6-44d4-ab27-5862a57296f0 req-3041459e-3d7d-4cf4-98b1-b221a87abc5e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.422163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e7aaad2b-3ac6-44d4-ab27-5862a57296f0 req-3041459e-3d7d-4cf4-98b1-b221a87abc5e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.422872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e7aaad2b-3ac6-44d4-ab27-5862a57296f0 req-3041459e-3d7d-4cf4-98b1-b221a87abc5e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.453774 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e7aaad2b-3ac6-44d4-ab27-5862a57296f0 req-3041459e-3d7d-4cf4-98b1-b221a87abc5e service nova] Creating event network-changed:17ca6f8e-6a58-4644-9b2e-b31ad6b2d742 for instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e on n-h2-854882-3 Aug 29 15:38:30.463900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.465286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:30.470826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e7aaad2b-3ac6-44d4-ab27-5862a57296f0 req-3041459e-3d7d-4cf4-98b1-b221a87abc5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117805 Aug 29 15:38:30.473455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1362/2851] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:30.477750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.478393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.487938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.488879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.489499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.490046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.711756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.712919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:30.724681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.726251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.726914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.728253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.728908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.729604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.909825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:30.926842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a716ead8-146d-467f-b452-966716d603c8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.467035 Aug 29 15:38:30.940061 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1490/2852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:31.049022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.050043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:31.062780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.063498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.064057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.065072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.065673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.066212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.279076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.290622 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c88de429-69a2-4893-b778-933adf5eaf3e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.584149 Aug 29 15:38:31.291216 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1363/2853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:31.313938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.315852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:31.330780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.332815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.333490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.334368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.334987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.335577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.435971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.453321 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c139e9f3-cde8-4c3b-ab91-e31ad5beb47e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.408911 Aug 29 15:38:31.458392 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1491/2854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:31.622002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.631352 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2f904393-d659-4eac-8dcc-f6b7d99aabf5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1307 microversion: 2.1 time: 0.336220 Aug 29 15:38:31.635273 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1364/2855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:31.950257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.951034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:31.964899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.970612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.971283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.972108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.972584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.973018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.312475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.317254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.331398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.331621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.331897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.332369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.333053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.349822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.350451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.351549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52283e41-5540-4679-9544-4daf3ef50f84 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.406204 Aug 29 15:38:32.353824 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1492/2856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:32.480946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.482013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.510013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.512247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.514334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.515343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.515820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.516374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.598911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.606999 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dd72f972-9515-4459-854f-8e7f14a9431f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.298999 Aug 29 15:38:32.607580 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1365/2857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:32.623744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-aa797cd6-caa5-45b7-a503-0732c8c266da req-d3d38b84-3b76-4019-841e-5938652fe520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8077b5b3-4ef9-4217-bf33-87769843fb88", "tag": "ee7bc403-f74f-4f15-82aa-b5c206917022"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:32.634525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa797cd6-caa5-45b7-a503-0732c8c266da req-d3d38b84-3b76-4019-841e-5938652fe520 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.635028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa797cd6-caa5-45b7-a503-0732c8c266da req-d3d38b84-3b76-4019-841e-5938652fe520 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.635458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa797cd6-caa5-45b7-a503-0732c8c266da req-d3d38b84-3b76-4019-841e-5938652fe520 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.639594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:32.648532 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-aa797cd6-caa5-45b7-a503-0732c8c266da req-d3d38b84-3b76-4019-841e-5938652fe520 service nova] Creating event network-changed:ee7bc403-f74f-4f15-82aa-b5c206917022 for instance 8077b5b3-4ef9-4217-bf33-87769843fb88 on n-h1-854882-3 Aug 29 15:38:32.653801 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-aa797cd6-caa5-45b7-a503-0732c8c266da req-d3d38b84-3b76-4019-841e-5938652fe520 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044888 Aug 29 15:38:32.654416 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1366/2858] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:32.659422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.660118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.666909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.667392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.668017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.668889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.669352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.670225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.827482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.836523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7538e482-0f7b-41cd-a998-27d497c54b16 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.362902 Aug 29 15:38:32.837113 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1493/2859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:32.879467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.895237 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b0c0c9af-23e3-4a72-bc41-bf465f522a5b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1487 microversion: 2.1 time: 0.238790 Aug 29 15:38:32.896162 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1367/2860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1487 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:32.921560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b6bf005-d5b1-448b-a864-c7447054957a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:32.933941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b6bf005-d5b1-448b-a864-c7447054957a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.936069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b6bf005-d5b1-448b-a864-c7447054957a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.936825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b6bf005-d5b1-448b-a864-c7447054957a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.084774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b6bf005-d5b1-448b-a864-c7447054957a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Going to try to stop instance {{(pid=130002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:38:33.195542 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b6bf005-d5b1-448b-a864-c7447054957a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.276540 Aug 29 15:38:33.200751 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1494/2861] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:38:32 2022] POST /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:33.206872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.210581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:33.228312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.229002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.229756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.230638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.231513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.232920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.381515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.383460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:33.399165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.400419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.403439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.405277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.405784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.406218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.527268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:33.540607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a449ae8-9572-4e61-b5c2-908804489223 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.337552 Aug 29 15:38:33.541792 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1368/2862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:33.628330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.629332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:33.638682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.639172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.639646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.640354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.640804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.641224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.681625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:33.692610 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f5267fa6-6404-4b93-91ef-57a08b99e4b4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.323591 Aug 29 15:38:33.693684 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1495/2863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:33.789056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:33.790778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:33.883382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:33.891145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e475657-2985-43a5-aeee-87a59a0715a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.266732 Aug 29 15:38:33.891883 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1369/2864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:33.897130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.897766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:33.903675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.904166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.904599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.905285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.905774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.906186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.928377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-391851460", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "218599c0-ac1c-4325-bb42-974a4122306b"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:33.984424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] validate_networks() for [('218599c0-ac1c-4325-bb42-974a4122306b', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:34.048504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.056180 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c64be4bf-6892-436f-aba8-dca26facdb57 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.162521 Aug 29 15:38:34.056762 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1370/2865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:34.369742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:34.370225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:34.370643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:34.371071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:34.371496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:34.381768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.382378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.383142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.383894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.384434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.385075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.403594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Getting quotas for project ca2f5edb98e54c699a28f840ab356895. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:34.409154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Getting quotas for user 57db38bcade34d99a4ab7e3975a536a4 and project ca2f5edb98e54c699a28f840ab356895. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:34.423720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:34.426207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:34.473035 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfefeb85-7ea7-4bf7-afb4-7741d52366a0 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690001 Aug 29 15:38:34.474064 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1496/2866] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:38:34.484659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-12226c21-987d-46d4-b0d4-576a19262431 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.485470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-12226c21-987d-46d4-b0d4-576a19262431 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.487633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:34.558380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-12226c21-987d-46d4-b0d4-576a19262431 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.562807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.563435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.568051 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-12226c21-987d-46d4-b0d4-576a19262431 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1215 microversion: 2.1 time: 0.087211 Aug 29 15:38:34.569021 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1371/2867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:34.571609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.572103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.572715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.573722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.574341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.574908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.596001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:34.715517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.716390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.727701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.728374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.728999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.729986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.730761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.731793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.759488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.768307 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5d7edf24-4ae8-450e-b5a5-bf8473a3156c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.210361 Aug 29 15:38:34.784877 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1497/2868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:34.913618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.914165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.920642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.921757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.923340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.924450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.925355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.925834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.927606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.929382 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8a23dbf-5af1-4e97-ab06-7c821a2b3cf7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.217638 Aug 29 15:38:34.930034 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1372/2869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:35.076629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.077640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.086685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.089190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.091813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.094896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.095627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.096241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.130323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.140435 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b7b1843-a7c6-4efe-b7e3-3b1ef174f760 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.232188 Aug 29 15:38:35.141624 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1498/2870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:35.290357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.301303 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4446a41f-b50b-4276-bf2e-7bd9181949b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.228571 Aug 29 15:38:35.302639 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1373/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:35.605741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.609973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.639219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.641124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.642265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.643845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.644946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.646026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.793437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.794057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.804361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.805088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.805796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.806917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.808542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.809704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.810323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.813589 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a927c08f-a6ab-4477-a33d-25fe46730628 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1267 microversion: 2.1 time: 0.221551 Aug 29 15:38:35.816641 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1499/2872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:35.862232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5909d17c-e791-4359-a5e5-202b261c782d req-abf57bfa-0b3a-4514-b368-462efeeda769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f97218-0324-4431-8f13-a2d2b6e4f169", "name": "network-vif-plugged", "status": "completed", "tag": "fe6e7876-20d7-4a71-b56c-cf94bdb66895"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:35.879158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5909d17c-e791-4359-a5e5-202b261c782d req-abf57bfa-0b3a-4514-b368-462efeeda769 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.879981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5909d17c-e791-4359-a5e5-202b261c782d req-abf57bfa-0b3a-4514-b368-462efeeda769 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.881094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5909d17c-e791-4359-a5e5-202b261c782d req-abf57bfa-0b3a-4514-b368-462efeeda769 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.895762 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5909d17c-e791-4359-a5e5-202b261c782d req-abf57bfa-0b3a-4514-b368-462efeeda769 service nova] Creating event network-vif-plugged:fe6e7876-20d7-4a71-b56c-cf94bdb66895 for instance a7f97218-0324-4431-8f13-a2d2b6e4f169 on n-h2-854882-3 Aug 29 15:38:35.905272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5909d17c-e791-4359-a5e5-202b261c782d req-abf57bfa-0b3a-4514-b368-462efeeda769 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049667 Aug 29 15:38:35.906434 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1500/2873] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:35.951656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.952607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.960438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.961620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.962350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.963541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.964218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.976502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.059505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.072269 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3862d856-0f32-4485-8435-727773e00d67 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.283669 Aug 29 15:38:36.073507 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1374/2874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:36.164938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.165775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.172897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.173565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.174281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.175699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.176315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.177185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.320440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.332562 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1db8eda-0e44-4be2-b5db-2cfe40c072ee tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.385761 Aug 29 15:38:36.333185 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1501/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:36.342799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.343432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.361414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.363489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.365509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.366508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.369107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.369586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.409955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.418775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-129776fe-11f2-4449-8dbc-f4438ff2e288 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.259912 Aug 29 15:38:36.419595 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1375/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:36.523386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.531678 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff1d8814-79e1-4fab-984b-683a1f057062 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.194021 Aug 29 15:38:36.532263 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1502/2877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:36.836461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.837727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.845446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.846275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.847600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.848900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.849635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.850277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.931548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.939768 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6269e15-070d-4b9e-a09b-96dbdc3f96c5 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1273 microversion: 2.1 time: 0.107471 Aug 29 15:38:36.940356 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1376/2878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:37.096226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:37.097718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:37.105290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.105883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.106522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.107248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.107908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.108359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.354130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:37.354874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:37.358976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:37.368835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.369769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.370520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.371644 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-def918da-0284-4703-bcda-06596378221d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.281297 Aug 29 15:38:37.372630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.372791 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1503/2879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:37 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:37.373411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.374932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.441524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:37.442357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:37.453833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.454330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.454777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.455507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.455973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.457036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.599184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:37.608088 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab00f630-456b-46ab-8f44-26c1fef56808 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1315 microversion: 2.1 time: 0.258245 Aug 29 15:38:37.621925 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1377/2880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:37 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:37.630912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:37.631878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:37.641140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.641975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.642573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.644512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.645139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.646284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.870526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:37.880826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5f4790d-a9b8-4dfd-b4d2-fda692e5e5f2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.257385 Aug 29 15:38:37.881733 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1378/2881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:37 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:37.923429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7ac7542a-4321-4b83-a8ba-90d1f0eedc72 req-c8d4d732-460d-4bdc-85ef-d1407989b1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8077b5b3-4ef9-4217-bf33-87769843fb88", "name": "network-vif-plugged", "status": "completed", "tag": "ee7bc403-f74f-4f15-82aa-b5c206917022"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:37.934435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7ac7542a-4321-4b83-a8ba-90d1f0eedc72 req-c8d4d732-460d-4bdc-85ef-d1407989b1b8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.934913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7ac7542a-4321-4b83-a8ba-90d1f0eedc72 req-c8d4d732-460d-4bdc-85ef-d1407989b1b8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.935355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7ac7542a-4321-4b83-a8ba-90d1f0eedc72 req-c8d4d732-460d-4bdc-85ef-d1407989b1b8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.948319 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7ac7542a-4321-4b83-a8ba-90d1f0eedc72 req-c8d4d732-460d-4bdc-85ef-d1407989b1b8 service nova] Creating event network-vif-plugged:ee7bc403-f74f-4f15-82aa-b5c206917022 for instance 8077b5b3-4ef9-4217-bf33-87769843fb88 on n-h1-854882-3 Aug 29 15:38:37.955636 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7ac7542a-4321-4b83-a8ba-90d1f0eedc72 req-c8d4d732-460d-4bdc-85ef-d1407989b1b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036534 Aug 29 15:38:37.955636 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1379/2882] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:37.962915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:37.963623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:37.971339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.972046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.972565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.973669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.974102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.974627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.181806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:38.191224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:38.192338 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f1d47b5-df57-4de4-acfd-834cb13d3216 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.755671 Aug 29 15:38:38.193051 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1504/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:37 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:38.201058 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ca29c97-33be-4d5b-917b-9efdb6428adc tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.242378 Aug 29 15:38:38.201683 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1380/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:37 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:38.392706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:38.393542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:38.400499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.401965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.401965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.402532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.403211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.403719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.564805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-78f88a3b-3f01-4c0e-9288-6a3154538ce4 req-321cdb8c-91c7-42b6-b164-eefd170a5a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734ef0af-b6c9-44a8-b207-a02308589ebf", "tag": "6aa36628-a586-44f5-981d-cca1c99f682d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:38.574338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-78f88a3b-3f01-4c0e-9288-6a3154538ce4 req-321cdb8c-91c7-42b6-b164-eefd170a5a82 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.575076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-78f88a3b-3f01-4c0e-9288-6a3154538ce4 req-321cdb8c-91c7-42b6-b164-eefd170a5a82 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.575503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-78f88a3b-3f01-4c0e-9288-6a3154538ce4 req-321cdb8c-91c7-42b6-b164-eefd170a5a82 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.587090 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-78f88a3b-3f01-4c0e-9288-6a3154538ce4 req-321cdb8c-91c7-42b6-b164-eefd170a5a82 service nova] Creating event network-changed:6aa36628-a586-44f5-981d-cca1c99f682d for instance 734ef0af-b6c9-44a8-b207-a02308589ebf on n-h2-854882-3 Aug 29 15:38:38.591900 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-78f88a3b-3f01-4c0e-9288-6a3154538ce4 req-321cdb8c-91c7-42b6-b164-eefd170a5a82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030774 Aug 29 15:38:38.592571 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1381/2885] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:38.630224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:38.631063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:38.638294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.638785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.639224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.639951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.640386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.640809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.654857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:38.664817 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ddb53cb3-fe94-4e4c-9a03-dd153967dd75 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.275946 Aug 29 15:38:38.666182 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1505/2886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:38 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:38.782234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:38.791056 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cbb8c13-e3bc-4baf-9e55-b5b724137a8e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1465 microversion: 2.1 time: 0.165666 Aug 29 15:38:38.791639 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1382/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:38 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1465 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:38.810931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:38.811569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:38.818172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.818674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.819118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.819848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.820308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.820739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.901101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:38.901760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:38.909126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.910309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.910831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.911621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.912160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.912800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.070818 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-420f67d2-e9f7-482a-a25d-67b125bf14d3 tempest-ServersOnMultiNodesTest-1603686594 tempest-ServersOnMultiNodesTest-1603686594-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1616 microversion: 2.1 time: 0.263760 Aug 29 15:38:39.071904 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1506/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:38 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1616 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:39.073555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:39.086160 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-553a8fee-7b53-4e77-94bc-8d187970df35 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1317 microversion: 2.1 time: 0.188762 Aug 29 15:38:39.096063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:39.096492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:39.102228 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1383/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:38 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:39.104664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.105338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.105808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.106527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.106986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.107438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.140523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:39.213567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:39.214429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:39.216797 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f17bfee9-f1c3-4a9a-b66f-3db971d1d978 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 204 len: 0 microversion: 2.1 time: 0.124522 Aug 29 15:38:39.218252 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1507/2890] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:39 2022] DELETE /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:39.222514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.222997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.223635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.224039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:39.224351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.224765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:39.224875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.225423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.230943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.231431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.231879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.232579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.233034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.233502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.364135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:39.365415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:39.372218 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d64e7542-1a49-4b60-8f67-3ba8ebde12c6 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.152693 Aug 29 15:38:39.372734 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1508/2891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:39 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:39.375472 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e1a1bda9-2ddd-4175-9f30-6b6092fdf453 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.165779 Aug 29 15:38:39.381297 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1384/2892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:39 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:39.381523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:39.381523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:39.385170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.385711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.386144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.387108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.387722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.388149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.536850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:39.545813 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0679215-04c8-4aee-985a-58a1b7e9f11b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1471 microversion: 2.1 time: 0.172007 Aug 29 15:38:39.552731 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1509/2893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:39 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:39.686385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:39.686920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:39.693556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.694039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.694498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.695185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.695641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.696062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.823921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:39.826227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:39.833513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e730fad1-aa10-4fef-b8ff-6e8c22b20e8b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.151123 Aug 29 15:38:39.834097 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1385/2894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:39 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.109540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.110170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.117781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.118283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.118728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.119456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.119896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.120327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.261677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.269725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6bd60c65-769b-4d84-88a4-a0efb2c164e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1506 microversion: 2.1 time: 0.165341 Aug 29 15:38:40.270331 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1510/2895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.289679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.290257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.296959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.297559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.298061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.298827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.299351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.300302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.329096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:40.393898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.394505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.400895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.401429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.401875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.402583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.403042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.403473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.413072 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c605ecc7-4b73-4e34-98e4-828422112fd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 204 len: 0 microversion: 2.1 time: 0.125988 Aug 29 15:38:40.414336 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1386/2896] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:40 2022] DELETE /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:40.424609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.426146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.433787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.434272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.434710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.435498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.435966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.436444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.582630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.592050 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1e78abf-a6d7-44c2-963a-8e7ecb610c22 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.202091 Aug 29 15:38:40.592683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1511/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:40.594615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.601746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.602735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.603354 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30ecc70b-5680-4335-ac92-f929b92dc4d9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.184210 Aug 29 15:38:40.604226 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1387/2898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.609311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.609872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.610315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.611089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.611288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.611753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.611859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.612983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.619080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.619546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.619983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.620673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.621123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.621590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.751255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.761049 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4836c8ff-2c39-4114-9b9c-696fbc9498ee tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1512 microversion: 2.1 time: 0.167066 Aug 29 15:38:40.761380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.761694 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1512/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.769990 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df504c66-5e38-4269-a0af-be1adb6e2620 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1471 microversion: 2.1 time: 0.163020 Aug 29 15:38:40.770498 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1388/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.855024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.855669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.861832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.862307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.862738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.863422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.863871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.864318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.866994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:41.002808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.011304 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9ff4c1c-15be-4c44-aae1-490609d421ae tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.160462 Aug 29 15:38:41.011909 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1513/2901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:41.612892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.613533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.620601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.621079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.621548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.622238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.622690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.623112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.624215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.624896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.631864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.632352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.632791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.633522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.633982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.634408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.757585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.766123 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bca03372-51e5-46aa-acd8-c4de16001936 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.156996 Aug 29 15:38:41.767052 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1389/2902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:41.769429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.779648 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-661336ca-481e-44ff-abe2-3096630916d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.159453 Aug 29 15:38:41.780330 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1514/2903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:41.785999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.786623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.793459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.793891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.794309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.794427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.795007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.795149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.795461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.795884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.801236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.801762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.802205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.802906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.803366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.803824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.937798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.946816 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e273092e-bab9-4132-b088-8e461d67eb53 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1512 microversion: 2.1 time: 0.165390 Aug 29 15:38:41.947622 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1390/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:41.969834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.977649 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a839fcdf-8e51-4aaa-b915-8a8b752223db tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1471 microversion: 2.1 time: 0.187514 Aug 29 15:38:41.978228 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1515/2905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:42.033745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.034455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.043841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.044352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.044855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.045677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.046189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.046683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.298136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:42.307181 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-053ea6b5-e63b-4c7a-b967-c59343a28e85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.277516 Aug 29 15:38:42.308085 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1391/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:42.787451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.793941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.802059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.803369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.813298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.816640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.817362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.817723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.818534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.818905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.819338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.822762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.823209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.823944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.824398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.825054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.071972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.082027 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a66cc36-8bdb-40ca-b10e-c38fc2249b33 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.298453 Aug 29 15:38:43.098589 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1516/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:43.109614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2f0263db-6028-4b45-a16d-1a463e7b3bfa req-02adbdf9-042c-4e73-b4bb-8da2c99e6f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8077b5b3-4ef9-4217-bf33-87769843fb88", "name": "network-vif-deleted", "tag": "ee7bc403-f74f-4f15-82aa-b5c206917022"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:43.131653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f0263db-6028-4b45-a16d-1a463e7b3bfa req-02adbdf9-042c-4e73-b4bb-8da2c99e6f2d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.138135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f0263db-6028-4b45-a16d-1a463e7b3bfa req-02adbdf9-042c-4e73-b4bb-8da2c99e6f2d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.139248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f0263db-6028-4b45-a16d-1a463e7b3bfa req-02adbdf9-042c-4e73-b4bb-8da2c99e6f2d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.171468 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2f0263db-6028-4b45-a16d-1a463e7b3bfa req-02adbdf9-042c-4e73-b4bb-8da2c99e6f2d service nova] Creating event network-vif-deleted:ee7bc403-f74f-4f15-82aa-b5c206917022 for instance 8077b5b3-4ef9-4217-bf33-87769843fb88 on n-h1-854882-3 Aug 29 15:38:43.186600 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2f0263db-6028-4b45-a16d-1a463e7b3bfa req-02adbdf9-042c-4e73-b4bb-8da2c99e6f2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082822 Aug 29 15:38:43.187506 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1517/2908] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:43.195625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.199941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.223943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.224705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.225310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.226279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.226938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.227567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.266452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:43.269330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.270152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.271089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.271796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lazy-loading 'fault' on Instance uuid 8077b5b3-4ef9-4217-bf33-87769843fb88 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:43.332986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.341422 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-473f4d4f-7a97-4d6e-b219-ffa247d17bb6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 200 len: 1307 microversion: 2.1 time: 0.151971 Aug 29 15:38:43.342703 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1518/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:43.348392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.350040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.361691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.365234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.366178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.371514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.372949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.373854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.480374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.496364 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-365d80ca-3711-4a9b-baf7-df1a02a2537f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.698050 Aug 29 15:38:43.498790 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1392/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:43.508456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.520130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.527605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.542413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-577db8b4-01f8-46ec-b1b4-a4ab23ebcb14 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 200 len: 1429 microversion: 2.1 time: 0.198153 Aug 29 15:38:43.543421 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1519/2911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 1429 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:43.554349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.555448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.558075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.558828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.561050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.561801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.829180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.843432 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-15982181-b2ac-4c1f-b90a-b33e501372bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.343351 Aug 29 15:38:43.846359 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1393/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:44.017856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.018519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.026248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.026827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.027304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.028018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.028482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.028917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.055287 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7566f846-6e7a-43e6-90a7-f8e8e9b6b928 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/ips" status: 200 len: 145 microversion: 2.1 time: 0.041947 Aug 29 15:38:44.056069 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1520/2913] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:44.136121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.136642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.142540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.143024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.143481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.144168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.144621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.145035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.380398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.381323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.387821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.389647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.390216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.390941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.391398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.391827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.396252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:44.399000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.409546 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-69673614-10e4-4707-b8ea-d475b37731b8 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.276192 Aug 29 15:38:44.413434 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1394/2914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:44.417908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:44.420309 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 HTTP/1.1 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '8077b5b3-4ef9-4217-bf33-87769843fb88'} Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.422929 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.427717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.427717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.427717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.427717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:44.427717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:44.427717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:38:44.427717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.429600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:44.430714 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a4e4bcd5-45d6-4fd6-8650-60d913e1898b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 404 len: 111 microversion: 2.1 time: 0.054545 Aug 29 15:38:44.432134 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1521/2915] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:38:44.441822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.442643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.449625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.450226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.450737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.451691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.452462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.453199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.517653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.518315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.525844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.526336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.526773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.527474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.527933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.528360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.564969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:44.626588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.635534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5a18ee22-008a-4502-90d9-db099cb5a4da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.197620 Aug 29 15:38:44.636693 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1395/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:44.641558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.642349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: a7f97218-0324-4431-8f13-a2d2b6e4f169] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.650276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.650987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.651719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.652576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.653176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.653770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.671561 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance a7f97218-0324-4431-8f13-a2d2b6e4f169 could not be found. Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 HTTP/1.1 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance a7f97218-0324-4431-8f13-a2d2b6e4f169 could not be found. Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a7f97218-0324-4431-8f13-a2d2b6e4f169'} Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f97218-0324-4431-8f13-a2d2b6e4f169 could not be found. Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f97218-0324-4431-8f13-a2d2b6e4f169 could not be found. Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.674054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f97218-0324-4431-8f13-a2d2b6e4f169 could not be found. Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance a7f97218-0324-4431-8f13-a2d2b6e4f169 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b16f9957-71c9-4354-8c73-699676bf7e4b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169" status: 404 len: 111 microversion: 2.1 time: 0.037617 Aug 29 15:38:44.679360 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1396/2917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/a7f97218-0324-4431-8f13-a2d2b6e4f169 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:44.685782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.686361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.694657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.695146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.695571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.696263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.696367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.696736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.697153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.708156 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfd82283-6829-46f1-845e-d82be8ebfee9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.194454 Aug 29 15:38:44.708937 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1522/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:44.729429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:44.770662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8949bd5b-bd6d-43e8-b98a-cbfd41872b76 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8949bd5b-bd6d-43e8-b98a-cbfd41872b76 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 163 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": 12345, "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 12345 Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:44.775731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8949bd5b-bd6d-43e8-b98a-cbfd41872b76 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8949bd5b-bd6d-43e8-b98a-cbfd41872b76 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.013120 Aug 29 15:38:44.779783 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1523/2919] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:44 2022] POST /compute/v2.1/servers => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:38:44.787239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.787855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.796186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.796677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.797112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.798524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.799338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.799808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.808208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e541cc52-1bbd-444c-8dd4-c805ced0ab30 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 204 len: 0 microversion: 2.1 time: 0.126223 Aug 29 15:38:44.812030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1397/2920] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:44 2022] DELETE /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:44.817122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.817858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.824491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.824983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.825449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.826162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.826611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.827028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.950196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.960243 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8c32030-ede6-4a35-b59e-5cf6215f1d1d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.178384 Aug 29 15:38:44.961747 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1524/2921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:44.967053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.967943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.981518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.982014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.982450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.983159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.983622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.984235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.989215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.997965 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a967285-be6e-4b9c-9bfa-71682959f689 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1472 microversion: 2.1 time: 0.184879 Aug 29 15:38:45.008713 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1398/2922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:45.016218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.017891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.026787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.027592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.028214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.029253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.029802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.030407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.131829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.140596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-860a3b85-b14f-415f-94a8-a87fded0ef63 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.177514 Aug 29 15:38:45.141176 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1525/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:45.176421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.178793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:45.186191 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bcc2c716-1e7b-4ff1-9bd7-9cc2804304c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.176112 Aug 29 15:38:45.186807 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1399/2924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:45.215939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-92e75484-08a1-47c1-b03c-cc734e214a78 req-dd97e3e1-c0cf-41e8-abb2-982bc091c17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f97218-0324-4431-8f13-a2d2b6e4f169", "name": "network-vif-deleted", "tag": "fe6e7876-20d7-4a71-b56c-cf94bdb66895"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:45.225491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92e75484-08a1-47c1-b03c-cc734e214a78 req-dd97e3e1-c0cf-41e8-abb2-982bc091c17a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.225978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92e75484-08a1-47c1-b03c-cc734e214a78 req-dd97e3e1-c0cf-41e8-abb2-982bc091c17a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.226414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92e75484-08a1-47c1-b03c-cc734e214a78 req-dd97e3e1-c0cf-41e8-abb2-982bc091c17a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.237751 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-92e75484-08a1-47c1-b03c-cc734e214a78 req-dd97e3e1-c0cf-41e8-abb2-982bc091c17a service nova] Creating event network-vif-deleted:fe6e7876-20d7-4a71-b56c-cf94bdb66895 for instance a7f97218-0324-4431-8f13-a2d2b6e4f169 on n-h2-854882-3 Aug 29 15:38:45.243335 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-92e75484-08a1-47c1-b03c-cc734e214a78 req-dd97e3e1-c0cf-41e8-abb2-982bc091c17a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 Aug 29 15:38:45.244256 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1526/2925] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:45.444542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.444542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.444542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.444919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.445025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.445774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.446219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.446807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.603822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.611831 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f133f5b7-dc8b-4b57-9d16-238b64627b29 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.181632 Aug 29 15:38:45.614117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1400/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:45.729541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.730201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.736578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.737070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.738119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.738817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.739275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.739703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.877889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.886034 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3798ee4e-5746-4fff-9cb6-7e5198b2bd18 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1508 microversion: 2.1 time: 0.160903 Aug 29 15:38:45.886616 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1527/2927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:46.020637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.021259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.023992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:46.029705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.030195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.031118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.031366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.031821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.032251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.163212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.164093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.171546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.172043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.172487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.173237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.173923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.174530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.183712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.192238 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a535a7e-d384-48c7-8946-b25dec8d377e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1472 microversion: 2.1 time: 0.175922 Aug 29 15:38:46.192832 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1401/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:46.357958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.367891 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-53080772-ce0f-4323-a0fd-0f6ea4bc5d4e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.209302 Aug 29 15:38:46.368481 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1528/2929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:46.579673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8bbb5537-f918-47a2-b478-4fb7c82b01ff req-409c7da7-39c0-4a16-bc96-9072d6acebc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734ef0af-b6c9-44a8-b207-a02308589ebf", "name": "network-vif-plugged", "status": "completed", "tag": "6aa36628-a586-44f5-981d-cca1c99f682d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:46.601091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bbb5537-f918-47a2-b478-4fb7c82b01ff req-409c7da7-39c0-4a16-bc96-9072d6acebc7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.603404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bbb5537-f918-47a2-b478-4fb7c82b01ff req-409c7da7-39c0-4a16-bc96-9072d6acebc7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.604919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8bbb5537-f918-47a2-b478-4fb7c82b01ff req-409c7da7-39c0-4a16-bc96-9072d6acebc7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.641492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.642086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.657382 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8bbb5537-f918-47a2-b478-4fb7c82b01ff req-409c7da7-39c0-4a16-bc96-9072d6acebc7 service nova] Creating event network-vif-plugged:6aa36628-a586-44f5-981d-cca1c99f682d for instance 734ef0af-b6c9-44a8-b207-a02308589ebf on n-h2-854882-3 Aug 29 15:38:46.664063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.664776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.665603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.666638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.667251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.668169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.668464 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8bbb5537-f918-47a2-b478-4fb7c82b01ff req-409c7da7-39c0-4a16-bc96-9072d6acebc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097068 Aug 29 15:38:46.672390 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1402/2930] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:46.912907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.913906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.932877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.934748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.935385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.938463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.939546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.942094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.966049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.976295 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b6adecf0-e694-4248-a3f2-d305f5f74e4a tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.346906 Aug 29 15:38:46.977335 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1529/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:47.212750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:47.214168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:47.227355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.229431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.230564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.231535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.232270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.232876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.404423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.415646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9502a0e2-5c9f-4b19-ae59-5bd943eee9c4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1472 microversion: 2.1 time: 0.207112 Aug 29 15:38:47.416601 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1530/2932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:47 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:47.422154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:47.422996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:47.435650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.436494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.437120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.438081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.438701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.439922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.467702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.479604 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ebab757c-ed27-4ec6-a8af-9b64db15b887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1529 microversion: 2.1 time: 0.575938 Aug 29 15:38:47.480408 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1403/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1529 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:47.614605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.623155 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-061c735e-202f-433c-9f6a-be8deee240a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.204675 Aug 29 15:38:47.623872 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1531/2934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:47 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:47.757234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-98957db7-4bc9-48be-a217-3d4393ade9e8 req-66b4df5a-8755-4eb3-ab66-484e615e3a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656ec23a-a07a-4868-a7d6-1e57735ae6e3", "name": "network-vif-deleted", "tag": "d39d4f65-362d-4a42-85d7-dbbd1b7dd094"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:47.770001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-98957db7-4bc9-48be-a217-3d4393ade9e8 req-66b4df5a-8755-4eb3-ab66-484e615e3a62 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.773748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-98957db7-4bc9-48be-a217-3d4393ade9e8 req-66b4df5a-8755-4eb3-ab66-484e615e3a62 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.780422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-98957db7-4bc9-48be-a217-3d4393ade9e8 req-66b4df5a-8755-4eb3-ab66-484e615e3a62 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.831720 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-98957db7-4bc9-48be-a217-3d4393ade9e8 req-66b4df5a-8755-4eb3-ab66-484e615e3a62 service nova] Creating event network-vif-deleted:d39d4f65-362d-4a42-85d7-dbbd1b7dd094 for instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 on n-h1-854882-3 Aug 29 15:38:47.842397 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-98957db7-4bc9-48be-a217-3d4393ade9e8 req-66b4df5a-8755-4eb3-ab66-484e615e3a62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095215 Aug 29 15:38:47.843717 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1404/2935] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:47.959186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-689e6117-2228-4376-81e0-7cde22318e61 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1951883594", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "72927585-aacc-4d4f-aa6a-735a5e61852d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:48.002230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.003324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.024517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.025007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.025986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.030151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.030632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.031072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.094339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-689e6117-2228-4376-81e0-7cde22318e61 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Block Device 72927585-aacc-4d4f-aa6a-735a5e61852d is not bootable. Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-689e6117-2228-4376-81e0-7cde22318e61 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 358 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1951883594", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "72927585-aacc-4d4f-aa6a-735a5e61852d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: exception: Block Device 72927585-aacc-4d4f-aa6a-735a5e61852d is not bootable. Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1951883594', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '72927585-aacc-4d4f-aa6a-735a5e61852d'}], 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 72927585-aacc-4d4f-aa6a-735a5e61852d is not bootable. Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:48.102205 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 72927585-aacc-4d4f-aa6a-735a5e61852d is not bootable. Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 72927585-aacc-4d4f-aa6a-735a5e61852d is not bootable. Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:48.106757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-689e6117-2228-4376-81e0-7cde22318e61 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Block Device 72927585-aacc-4d4f-aa6a-735a5e61852d is not bootable. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:48.108204 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-689e6117-2228-4376-81e0-7cde22318e61 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.152070 Aug 29 15:38:48.109031 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1532/2936] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:48.121438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.122099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.130146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.130742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.131383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.132385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.132904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.133432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.231406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.240751 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-48f9f034-74d7-4e26-9022-e07c3d1d40a3 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1315 microversion: 2.1 time: 0.242720 Aug 29 15:38:48.241380 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1405/2937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:47 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:48.296575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.299387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:48.310465 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec371062-7e24-4a1f-90df-d32e75fb7ae1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.195083 Aug 29 15:38:48.311166 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1533/2938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:48.332062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.334633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.341181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.341696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.342409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.343078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.343529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.343949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.436335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.437082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.443985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.444835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.446040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.446871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.447427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.447954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.485889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.486786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.487446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.488180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lazy-loading 'fault' on Instance uuid 656ec23a-a07a-4868-a7d6-1e57735ae6e3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:48.494080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.502725 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d5a52db0-ba7c-4185-9cbe-8f389ae23554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.174893 Aug 29 15:38:48.503531 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1406/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:48.508627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.509488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.516182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.516873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.517694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.519181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.520102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.520753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.561544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.571144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7fe5795a-3f88-4b1a-aa9c-e1778ad865c2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 200 len: 1306 microversion: 2.1 time: 0.138811 Aug 29 15:38:48.572061 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1534/2940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:48.644655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.645276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.654994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.655867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.657150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.658267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.660246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.660983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.710625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.722307 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59b21f51-09bf-41e4-a55e-c28ba7bd26d8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1529 microversion: 2.1 time: 0.217093 Aug 29 15:38:48.723458 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1407/2941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1529 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:48.935905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.947467 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8efba866-941f-4915-aacc-71d7a0a06a5a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.306869 Aug 29 15:38:48.948345 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1535/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:49.044239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7857a5ea-c2d8-4a49-bb56-40d1b5daacb8"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:49.047167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.056260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.057046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.057731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.058596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.059230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.060616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.261724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.262428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.271118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.271947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.272383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.273109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.273572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.273998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.480459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:49.492145 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8b1790f-40e7-44ec-a02a-948d32a00508 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1503 microversion: 2.1 time: 0.234418 Aug 29 15:38:49.512151 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1536/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:49.523233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.524680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.534726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.535228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.536644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.537414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.537903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.538335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.598519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:49.602533 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36ea62b1-4d93-4649-ba25-416feef22a7e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563699 Aug 29 15:38:49.604407 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1408/2944] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:38:49 2022] POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:49.609810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.610783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 656ec23a-a07a-4868-a7d6-1e57735ae6e3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.619078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.619795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.620469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.621448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.622219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.622854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.668920 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 could not be found. Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 HTTP/1.1 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 could not be found. Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '656ec23a-a07a-4868-a7d6-1e57735ae6e3'} Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 could not be found. Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 could not be found. Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:49.671176 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 could not be found. Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance 656ec23a-a07a-4868-a7d6-1e57735ae6e3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:49.676480 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eefdafec-aec7-4127-8ff4-048355a93b54 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3" status: 404 len: 111 microversion: 2.1 time: 0.068158 Aug 29 15:38:49.679050 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1409/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/656ec23a-a07a-4868-a7d6-1e57735ae6e3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:49.685899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.686391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.697895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.699291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.699943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.701227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.701906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.702617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.786594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:49.801008 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfbd0624-c18c-4869-95b5-8958dd7b8ebb tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 204 len: 0 microversion: 2.1 time: 0.286524 Aug 29 15:38:49.801966 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1537/2946] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:49 2022] DELETE /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:49.809133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.810689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.819292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.820900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.822029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.823434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.825345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.826844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.969870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-391865fc-c30f-4e94-9e88-7e3ed92b0dbb tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 204 len: 0 microversion: 2.1 time: 0.287750 Aug 29 15:38:49.971105 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1410/2947] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:49 2022] DELETE /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:49.982091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.984708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.991387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.991879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.992318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.993021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.995004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.995004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.124063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.133829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba4c1b64-8e50-4eae-9843-30e1f58b177b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.330173 Aug 29 15:38:50.134975 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1538/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.140417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.141361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.153850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.155156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.155609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.156549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.157174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.157808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.239741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.258092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16aed785-4db0-4697-a203-32c84e35cf36 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1509 microversion: 2.1 time: 0.285655 Aug 29 15:38:50.258677 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1411/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.263463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.270381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.282513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.283275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.283699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.285078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.288919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.289619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.418693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.434451 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d362971-9dc6-4ac9-bc83-83b47fac0879 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.298208 Aug 29 15:38:50.437748 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1539/2950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.446921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-857529bf-1803-4bde-bd5a-d5744f71a4d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-835398319", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "69b80579-025a-47db-8397-1d03ce8a20ab", "destination_type": "local"}, {"source_type": "volume", "uuid": "981f07b8-1bc1-44c4-9e5b-65beb11603be", "destination_type": "invalid"}], "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-857529bf-1803-4bde-bd5a-d5744f71a4d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 494 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-835398319", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "69b80579-025a-47db-8397-1d03ce8a20ab", "destination_type": "local"}, {"source_type": "volume", "uuid": "981f07b8-1bc1-44c4-9e5b-65beb11603be", "destination_type": "invalid"}], "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-835398319', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '69b80579-025a-47db-8397-1d03ce8a20ab', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '981f07b8-1bc1-44c4-9e5b-65beb11603be', 'destination_type': 'invalid'}], 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:50.459883 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-857529bf-1803-4bde-bd5a-d5744f71a4d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:50.463634 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-857529bf-1803-4bde-bd5a-d5744f71a4d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.023569 Aug 29 15:38:50.464957 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1540/2951] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/servers => generated 155 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:50.472476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f20980cc-cec5-4aef-92dc-c510b74d72d0 req-508373a3-7930-407c-9a44-33e80b927b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f257df-f378-4dbc-a0ab-97037668efbc", "name": "network-vif-plugged", "status": "completed", "tag": "6e02a8e3-2a57-4748-9423-8aa3383d0ca7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.491478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f20980cc-cec5-4aef-92dc-c510b74d72d0 req-508373a3-7930-407c-9a44-33e80b927b92 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.493569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f20980cc-cec5-4aef-92dc-c510b74d72d0 req-508373a3-7930-407c-9a44-33e80b927b92 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.494261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f20980cc-cec5-4aef-92dc-c510b74d72d0 req-508373a3-7930-407c-9a44-33e80b927b92 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.513568 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f20980cc-cec5-4aef-92dc-c510b74d72d0 req-508373a3-7930-407c-9a44-33e80b927b92 service nova] Creating event network-vif-plugged:6e02a8e3-2a57-4748-9423-8aa3383d0ca7 for instance 77f257df-f378-4dbc-a0ab-97037668efbc on n-h1-854882-3 Aug 29 15:38:50.515979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.523155 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f20980cc-cec5-4aef-92dc-c510b74d72d0 req-508373a3-7930-407c-9a44-33e80b927b92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057533 Aug 29 15:38:50.525489 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1541/2952] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:50.528471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-913f6c1b-0119-4a5e-979a-9ce4ac496cfe tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1472 microversion: 2.1 time: 0.266687 Aug 29 15:38:50.532101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.533173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.542206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.543239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.543925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.544898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.545775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.546441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.551819 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1412/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.720065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.731371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4db065df-35b0-40c5-a37a-0cd4949a7afe tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.204283 Aug 29 15:38:50.732211 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1542/2954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.756089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.756804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.762988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.763454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.764043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.764951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.765585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.765998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.931048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.939942 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08fd5a44-792c-4245-a4db-1eed17a340ed tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.188533 Aug 29 15:38:50.945842 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1413/2955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:51.011294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-649f5e6f-b083-4162-980b-20447da715d0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1798812080", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-649f5e6f-b083-4162-980b-20447da715d0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 492 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1798812080", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1798812080', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.020150 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:38:51.024080 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.029126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-649f5e6f-b083-4162-980b-20447da715d0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:51.030665 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-649f5e6f-b083-4162-980b-20447da715d0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.024340 Aug 29 15:38:51.032392 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1543/2956] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:51 2022] POST /compute/v2.1/servers => generated 624 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:51.042708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.043962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.053774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.054794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.057435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.059441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.059978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.061345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.155893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.156773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.169604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.170379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.171135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.172158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.172921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.173556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.275400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.289970 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5cc03fa6-ac81-4e31-ae0b-f9a7f0b8ee23 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.252331 Aug 29 15:38:51.293632 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1414/2957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:51.300849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.303141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.319406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.320615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.321228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.322518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.323125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.323699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.354029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.439903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.460182 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d01aee86-dc30-43b4-b18a-00e86e0cb9c9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.308420 Aug 29 15:38:51.461073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1544/2958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:51.465855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.466668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.478905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.480496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.481149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.482075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.482697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.483284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.751735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.763118 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08d495d4-abfb-432a-97d1-713bd30cb926 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.300814 Aug 29 15:38:51.764294 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1545/2959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:51.769183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.770000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.778231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.778969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.779569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.781614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.782964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.784467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.977314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.988769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a3b9051-2463-4b43-8dc8-1bbd4020b756 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1509 microversion: 2.1 time: 0.693280 Aug 29 15:38:52.006534 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1415/2960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1509 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.011699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.012501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.024071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.024560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.024991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.025710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.033578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.040821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.044015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.050718 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d093c641-6d2e-4d25-8e81-633c7252e2e8 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.281240 Aug 29 15:38:52.051604 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1546/2961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.056811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2a873be-f64d-4763-9bf3-60e4f7ac0f62 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2a873be-f64d-4763-9bf3-60e4f7ac0f62 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 416 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.061731 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:52.064973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.070368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2a873be-f64d-4763-9bf3-60e4f7ac0f62 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:52.071508 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2a873be-f64d-4763-9bf3-60e4f7ac0f62 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018637 Aug 29 15:38:52.072618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1547/2962] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:52 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:52.080781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.081458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.088964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.089507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.089956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.090709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.091175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.091608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.332410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.357291 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94e55fe3-7042-43a1-a88c-591e102132f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.280424 Aug 29 15:38:52.379484 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1548/2963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.397376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.400131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.408637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.411512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.411983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.412714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.413184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.417078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.662851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.676910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-465ec541-245d-4394-9ed4-c946422f376b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1472 microversion: 2.1 time: 0.668902 Aug 29 15:38:52.678658 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1416/2964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1472 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.689956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.691049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.714145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.714934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.716933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.718200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.722032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.722779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.969009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.983363 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-90d8bd19-f228-4fbd-8028-cae3358e221b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.600735 Aug 29 15:38:52.997987 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1549/2965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:53.011644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3207a746-4c09-43ab-bb06-d699f15311da req-dbbec632-06c5-4f63-8e8d-e06f70590225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734ef0af-b6c9-44a8-b207-a02308589ebf", "name": "network-vif-deleted", "tag": "6aa36628-a586-44f5-981d-cca1c99f682d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:53.035963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3207a746-4c09-43ab-bb06-d699f15311da req-dbbec632-06c5-4f63-8e8d-e06f70590225 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.036513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3207a746-4c09-43ab-bb06-d699f15311da req-dbbec632-06c5-4f63-8e8d-e06f70590225 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.036994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3207a746-4c09-43ab-bb06-d699f15311da req-dbbec632-06c5-4f63-8e8d-e06f70590225 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.085418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3207a746-4c09-43ab-bb06-d699f15311da req-dbbec632-06c5-4f63-8e8d-e06f70590225 service nova] Creating event network-vif-deleted:6aa36628-a586-44f5-981d-cca1c99f682d for instance 734ef0af-b6c9-44a8-b207-a02308589ebf on n-h2-854882-3 Aug 29 15:38:53.091087 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3207a746-4c09-43ab-bb06-d699f15311da req-dbbec632-06c5-4f63-8e8d-e06f70590225 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091677 Aug 29 15:38:53.092794 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1550/2966] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:53.109463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.113177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:53.128647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.133124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.133875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.138435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.139352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.140037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.230718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.242263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.242883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.243400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lazy-loading 'fault' on Instance uuid 734ef0af-b6c9-44a8-b207-a02308589ebf {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:53.371429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57db38bcade34d99a4ab7e3975a536a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f5edb98e54c699a28f840ab356895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.382650 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3fceaac6-1d72-46cf-b4c6-d2c353ad6e1e tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 200 len: 1305 microversion: 2.1 time: 0.283506 Aug 29 15:38:53.388842 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1551/2967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 1305 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:53.409577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.410138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.410419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:53.419606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.420106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.420543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.421252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.421735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.422160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.425466 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e660dad-19fe-45c9-a9c1-342a81db65c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.743267 Aug 29 15:38:53.427161 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1417/2968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:53.432609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e92fd8b2-97a9-45d3-9074-34bb666837f4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-619545409", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": -1, "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:53.452989 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e92fd8b2-97a9-45d3-9074-34bb666837f4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Flavor -1 could not be found. Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e92fd8b2-97a9-45d3-9074-34bb666837f4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 205 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-619545409", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": -1, "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: exception: Flavor -1 could not be found. Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-619545409', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': -1, 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:53.456310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 29 15:38:53.460294 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.465773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e92fd8b2-97a9-45d3-9074-34bb666837f4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:53.467018 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e92fd8b2-97a9-45d3-9074-34bb666837f4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.038563 Aug 29 15:38:53.468296 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1418/2969] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:53 2022] POST /compute/v2.1/servers => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:53.473292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:53.483224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.484232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:53.508953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.513707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.514496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.515521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.516508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.519044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.959281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.975831 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-327119a7-d7c9-4ea4-86ef-a2b6d12350da tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.498258 Aug 29 15:38:54.004329 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1419/2970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.028508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.034430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.045074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.048321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.050545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.052268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.053952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.055362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.137947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.149019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8808549b-3790-45d1-8f0d-6f241d84c137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.745080 Aug 29 15:38:54.151661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.152398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.154688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.155228 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1552/2971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.155407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lazy-loading 'fault' on Instance uuid 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:54.170331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.179044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.203605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.204360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.207571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.208496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.209122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.209749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.239122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.249441 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29a13055-1d7e-42f7-9882-78892fef9fd7 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 200 len: 1306 microversion: 2.1 time: 0.242682 Aug 29 15:38:54.249441 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1420/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 1306 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.418902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.419544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.434125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.437799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.438273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.439354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.439475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.439878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.523968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] HTTP exception thrown: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Request method failure captured: Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf HTTP/1.1 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN15G1v1hAH6UjEJjoLgX4SVs9CclsxJC9ot14eJs10tIqoyDSw0kFknmri94dfcXDmTtpAarcnUhp139jBNce0SljaaAm6T_vuvDYCJJ3J11vfQLL4d20UMAj_f-V6OwHJnurL6kKPWAaHzBaBu531elDrbJDElQ2e-ZwPh6ybCYxk Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca2f5edb98e54c699a28f840ab356895", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}] Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 57db38bcade34d99a4ab7e3975a536a4 Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '734ef0af-b6c9-44a8-b207-a02308589ebf'} Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.525593 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Returning 404 to user: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.529692 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5bdcb97a-496c-4388-ba7c-b7d59aabbd0d tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 404 len: 111 microversion: 2.1 time: 0.116359 Aug 29 15:38:54.533682 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1421/2973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:38:54.556160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.557714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.566661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.567513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.568132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.568697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.569285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.569961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.570723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.579766 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-28be7801-a9c6-4823-893f-c3790a5b31f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.421084 Aug 29 15:38:54.580839 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1553/2974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.586978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-926694701", "metadata": {"image_type": "test"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:54.590071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.598123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.598627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.599288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.600397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.601058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.613899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.653110 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] HTTP exception thrown: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Request method failure captured: Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf/action HTTP/1.1 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 111 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN15G1v1hAH6UjEJjoLgX4SVs9CclsxJC9ot14eJs10tIqoyDSw0kFknmri94dfcXDmTtpAarcnUhp139jBNce0SljaaAm6T_vuvDYCJJ3J11vfQLL4d20UMAj_f-V6OwHJnurL6kKPWAaHzBaBu531elDrbJDElQ2e-ZwPh6ybCYxk Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca2f5edb98e54c699a28f840ab356895", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}] Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 57db38bcade34d99a4ab7e3975a536a4 Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-926694701", "metadata": {"image_type": "test"}}} Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '734ef0af-b6c9-44a8-b207-a02308589ebf', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-926694701', 'metadata': {'image_type': 'test'}}}} Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:38:54.657040 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.662384 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.666972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Returning 404 to user: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.668657 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5f79631-c495-4682-868a-334e4786e546 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "POST /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf/action" status: 404 len: 111 microversion: 2.1 time: 0.086536 Aug 29 15:38:54.671729 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1554/2975] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Aug 29 15:38:54 2022] POST /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:54.693799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c5d24dc-cedd-4af6-98ea-b1769c545f53 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-868881546", "metadata": {"image_type": "test"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:54.696948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6c5d24dc-cedd-4af6-98ea-b1769c545f53 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Failed to fetch instance by id tempest-invalid-625729100 {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:38:54.698363 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-6c5d24dc-cedd-4af6-98ea-b1769c545f53 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] HTTP exception thrown: Instance tempest-invalid-625729100 could not be found. Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c5d24dc-cedd-4af6-98ea-b1769c545f53 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Request method failure captured: Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/tempest-invalid-625729100/action HTTP/1.1 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 111 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN15G1v1hAH6UjEJjoLgX4SVs9CclsxJC9ot14eJs10tIqoyDSw0kFknmri94dfcXDmTtpAarcnUhp139jBNce0SljaaAm6T_vuvDYCJJ3J11vfQLL4d20UMAj_f-V6OwHJnurL6kKPWAaHzBaBu531elDrbJDElQ2e-ZwPh6ybCYxk Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca2f5edb98e54c699a28f840ab356895", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}] Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 57db38bcade34d99a4ab7e3975a536a4 Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-868881546", "metadata": {"image_type": "test"}}} Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance tempest-invalid-625729100 could not be found. Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'tempest-invalid-625729100', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-868881546', 'metadata': {'image_type': 'test'}}}} Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-625729100 could not be found. Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.700653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-625729100 could not be found. Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-625729100 could not be found. Aug 29 15:38:54.705178 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.708314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c5d24dc-cedd-4af6-98ea-b1769c545f53 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Returning 404 to user: Instance tempest-invalid-625729100 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.709573 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6c5d24dc-cedd-4af6-98ea-b1769c545f53 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-625729100/action" status: 404 len: 100 microversion: 2.1 time: 0.029716 Aug 29 15:38:54.710746 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1555/2976] 10.222.0.16 () {60 vars in 1246 bytes} [Mon Aug 29 15:38:54 2022] POST /compute/v2.1/servers/tempest-invalid-625729100/action => generated 100 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:54.716222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7665febf-39a2-4c55-8e62-039a4325caaa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-493182032", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7665febf-39a2-4c55-8e62-039a4325caaa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 172 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-493182032", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-493182032', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi -1 Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:54.723504 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:38:54.727706 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.731078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7665febf-39a2-4c55-8e62-039a4325caaa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.732674 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7665febf-39a2-4c55-8e62-039a4325caaa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020600 Aug 29 15:38:54.746348 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1556/2977] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:54 2022] POST /compute/v2.1/servers => generated 145 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:54.746348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8dd08d4f-ba68-40a9-b7ff-09947abf0116 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-766921024"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:54.747548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8dd08d4f-ba68-40a9-b7ff-09947abf0116 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:38:54.748138 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-8dd08d4f-ba68-40a9-b7ff-09947abf0116 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8dd08d4f-ba68-40a9-b7ff-09947abf0116 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Request method failure captured: Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 56 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN15G1v1hAH6UjEJjoLgX4SVs9CclsxJC9ot14eJs10tIqoyDSw0kFknmri94dfcXDmTtpAarcnUhp139jBNce0SljaaAm6T_vuvDYCJJ3J11vfQLL4d20UMAj_f-V6OwHJnurL6kKPWAaHzBaBu531elDrbJDElQ2e-ZwPh6ybCYxk Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca2f5edb98e54c699a28f840ab356895", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}] Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 57db38bcade34d99a4ab7e3975a536a4 Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: {"createImage": {"name": "tempest-test-snap-766921024"}} Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-766921024'}}} Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.763728 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8dd08d4f-ba68-40a9-b7ff-09947abf0116 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8dd08d4f-ba68-40a9-b7ff-09947abf0116 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.018151 Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1557/2978] 10.222.0.16 () {60 vars in 1275 bytes} [Mon Aug 29 15:38:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.774643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.776110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.776110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.777173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.777173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.778394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.868558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.877540 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cf66b2f2-4944-4627-b2a1-b5066f8df5cc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.333639 Aug 29 15:38:54.899974 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1422/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.907407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59bbb902-3859-4bd4-a05d-fee49019c089 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-279942956"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:54.910422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59bbb902-3859-4bd4-a05d-fee49019c089 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:38:54.911302 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-59bbb902-3859-4bd4-a05d-fee49019c089 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59bbb902-3859-4bd4-a05d-fee49019c089 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Request method failure captured: Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 56 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN15G1v1hAH6UjEJjoLgX4SVs9CclsxJC9ot14eJs10tIqoyDSw0kFknmri94dfcXDmTtpAarcnUhp139jBNce0SljaaAm6T_vuvDYCJJ3J11vfQLL4d20UMAj_f-V6OwHJnurL6kKPWAaHzBaBu531elDrbJDElQ2e-ZwPh6ybCYxk Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca2f5edb98e54c699a28f840ab356895", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}] Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 57db38bcade34d99a4ab7e3975a536a4 Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: {"createImage": {"name": "tempest-test-snap-279942956"}} Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-279942956'}}} Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.913125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:38:54.918230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.918898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59bbb902-3859-4bd4-a05d-fee49019c089 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.920884 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59bbb902-3859-4bd4-a05d-fee49019c089 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018404 Aug 29 15:38:54.927722 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1423/2980] 10.222.0.16 () {60 vars in 1281 bytes} [Mon Aug 29 15:38:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:54.933513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.934100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.943688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.944514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.945169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.946105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.946754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.947369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.969941 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] HTTP exception thrown: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.971748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Request method failure captured: Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf HTTP/1.1 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN15G1v1hAH6UjEJjoLgX4SVs9CclsxJC9ot14eJs10tIqoyDSw0kFknmri94dfcXDmTtpAarcnUhp139jBNce0SljaaAm6T_vuvDYCJJ3J11vfQLL4d20UMAj_f-V6OwHJnurL6kKPWAaHzBaBu531elDrbJDElQ2e-ZwPh6ybCYxk Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca2f5edb98e54c699a28f840ab356895", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}] Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 57db38bcade34d99a4ab7e3975a536a4 Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '734ef0af-b6c9-44a8-b207-a02308589ebf'} Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.972060 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Returning 404 to user: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.978461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f522e0e1-6b10-47de-87f7-8413831361e2 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 404 len: 111 microversion: 2.1 time: 0.044552 Aug 29 15:38:54.981068 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1424/2981] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:54 2022] DELETE /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:54.982516 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c9a401bc-5327-45e1-9aa7-e5a1abd9ce34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.225326 Aug 29 15:38:54.983297 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1558/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.986503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.987329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] [instance: 734ef0af-b6c9-44a8-b207-a02308589ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.994133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.994811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.995509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.996491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.997101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.998035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.005028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.009591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.023508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.024313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.024958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.025936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.026782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.031075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.037896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] HTTP exception thrown: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Request method failure captured: Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf HTTP/1.1 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN15G1v1hAH6UjEJjoLgX4SVs9CclsxJC9ot14eJs10tIqoyDSw0kFknmri94dfcXDmTtpAarcnUhp139jBNce0SljaaAm6T_vuvDYCJJ3J11vfQLL4d20UMAj_f-V6OwHJnurL6kKPWAaHzBaBu531elDrbJDElQ2e-ZwPh6ybCYxk Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca2f5edb98e54c699a28f840ab356895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca2f5edb98e54c699a28f840ab356895", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca2f5edb98e54c699a28f840ab356895"}]}] Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ca2f5edb98e54c699a28f840ab356895 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-814108466 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 57db38bcade34d99a4ab7e3975a536a4 Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesNegativeTestJSON-814108466-project Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '734ef0af-b6c9-44a8-b207-a02308589ebf'} Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:55.040014 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.044634 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.044634 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:55.044634 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:55.044634 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:55.044634 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:55.044634 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. Aug 29 15:38:55.044634 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.050882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] Returning 404 to user: Instance 734ef0af-b6c9-44a8-b207-a02308589ebf could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:55.054690 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c434fb51-32df-45c9-86c2-bd5b130a2986 tempest-ImagesNegativeTestJSON-814108466 tempest-ImagesNegativeTestJSON-814108466-project] 10.222.0.16 "GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf" status: 404 len: 111 microversion: 2.1 time: 0.071817 Aug 29 15:38:55.057143 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1425/2983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/734ef0af-b6c9-44a8-b207-a02308589ebf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:55.183261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.184096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.199686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.200706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.200706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.213318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.214867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.215635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.302636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.311142 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-998d9d81-54e6-4be1-839e-673538a8c660 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.310531 Aug 29 15:38:55.311739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1559/2984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:55.329448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c6a61a87-fc11-472c-9784-03c536130c54 req-8b0773cb-7de3-4b66-be27-66e2a7accb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a", "name": "network-vif-deleted", "tag": "48839336-0125-4454-ad50-7b3e665d3faf"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:55.378415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c6a61a87-fc11-472c-9784-03c536130c54 req-8b0773cb-7de3-4b66-be27-66e2a7accb7c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.386427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c6a61a87-fc11-472c-9784-03c536130c54 req-8b0773cb-7de3-4b66-be27-66e2a7accb7c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.389570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c6a61a87-fc11-472c-9784-03c536130c54 req-8b0773cb-7de3-4b66-be27-66e2a7accb7c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.435492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.446080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d9c8a347-10ab-4322-9605-67859b859f31 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.266572 Aug 29 15:38:55.448736 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c6a61a87-fc11-472c-9784-03c536130c54 req-8b0773cb-7de3-4b66-be27-66e2a7accb7c service nova] Creating event network-vif-deleted:48839336-0125-4454-ad50-7b3e665d3faf for instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a on n-h1-854882-3 Aug 29 15:38:55.459824 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c6a61a87-fc11-472c-9784-03c536130c54 req-8b0773cb-7de3-4b66-be27-66e2a7accb7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133886 Aug 29 15:38:55.460723 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1426/2985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:55.461245 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1560/2986] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:55.467063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf0bac6f-5123-44f5-85a2-32b0b823b26b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-792768785", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:55.469805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.471982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.474774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-cf0bac6f-5123-44f5-85a2-32b0b823b26b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:38:55.478741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.479470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.480060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.481228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf0bac6f-5123-44f5-85a2-32b0b823b26b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 215 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-792768785", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-792768785', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.481758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf0bac6f-5123-44f5-85a2-32b0b823b26b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf0bac6f-5123-44f5-85a2-32b0b823b26b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.021527 Aug 29 15:38:55.493265 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1561/2987] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:55 2022] POST /compute/v2.1/servers => generated 123 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:55.495150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.495733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.497766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.498529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.517549 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a could not be found. Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a HTTP/1.1 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a could not be found. Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a'} Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a could not be found. Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a could not be found. Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:55.519757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.523935 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:55.523935 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:55.523935 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:55.523935 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:55.523935 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:55.523935 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a could not be found. Aug 29 15:38:55.523935 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:55.524365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.524365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.524365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.524365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.524365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.524365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.527707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance 897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:55.529980 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-127c68ca-f82c-4f8f-bf3b-dba6ad93b0df tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a" status: 404 len: 111 microversion: 2.1 time: 0.065867 Aug 29 15:38:55.531247 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1427/2988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/servers/897d6ff8-7c8d-423d-8b38-cdbf1b91ae0a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:55.543537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.544089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.562138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.564804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.566239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.567532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.568221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.568898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.638183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:55.783411 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97090ca8-8225-4f25-b791-71c12db92245 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 204 len: 0 microversion: 2.1 time: 0.244453 Aug 29 15:38:55.785630 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1428/2989] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:55 2022] DELETE /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:55.797920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.798803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.805858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.806574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.807158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.808219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.808846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.809453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.839501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:55.853662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.865897 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c7ff8232-cb07-49ca-aa64-9303eafbe35f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.372672 Aug 29 15:38:55.869818 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1562/2990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:55.890707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.891348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.902074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.903537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.904089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.905187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.905901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.906539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.009774 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-17895a15-5e43-4cff-b888-004f286d4d7c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 204 len: 0 microversion: 2.1 time: 0.219150 Aug 29 15:38:56.013200 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1429/2991] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:55 2022] DELETE /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:56.036899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.037850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.055270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.055769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.057032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.057032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.060220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.060709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.215369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.225184 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f35bc0ce-78ba-4d60-8cdc-790126327068 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.338994 Aug 29 15:38:56.242249 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1563/2992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:56.277796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.286281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.306320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.308324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.309237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.310254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.312941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.313751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.332950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.344192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2f3286b8-2b5a-4ced-aaaa-c68de298470d tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.325443 Aug 29 15:38:56.345007 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1430/2993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:56.361190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-420e9587-25bb-481f-9bdc-84254815644b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-439175248", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-key-1569046564", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:56.454512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-420e9587-25bb-481f-9bdc-84254815644b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] validate_networks() for [('8415dbd5-2216-4578-8fcf-1228fea111ac', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:56.713500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.725014 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3a7be6ab-2ee5-4c79-a916-0ce49d60aa50 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 200 len: 1474 microversion: 2.1 time: 0.481195 Aug 29 15:38:56.727277 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1564/2994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 1474 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:56.749833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.752677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.776840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.777628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.778230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.779140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.779756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.781924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.873007 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-420e9587-25bb-481f-9bdc-84254815644b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Invalid key_name provided. Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-420e9587-25bb-481f-9bdc-84254815644b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 246 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-439175248", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-key-1569046564", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid key_name provided. Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-439175248', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'key_name': 'tempest-key-1569046564', 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1569046564 not found for user d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:56.881823 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 29 15:38:56.886054 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.887542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-420e9587-25bb-481f-9bdc-84254815644b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid key_name provided. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:56.890536 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-420e9587-25bb-481f-9bdc-84254815644b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.544163 Aug 29 15:38:56.897574 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1431/2995] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:56 2022] POST /compute/v2.1/servers => generated 70 bytes in 552 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:56.904940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.908836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.919478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.920752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.923449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.924392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.926240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.926868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.122337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.138007 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c5e183aa-7e75-4c6e-9321-834ba1efd68b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.395043 Aug 29 15:38:57.138978 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1565/2996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:57.161691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.184339 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2830ce99-d4a4-49c4-a2cd-de0e9aabdad6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.284124 Aug 29 15:38:57.194488 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1432/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:57.209016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.210052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.216682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.217554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.220956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.222029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.222758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.223413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.364884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.366280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.380049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.380552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.380997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.381757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.382218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.382647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.679107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.698586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e29c1059-cae1-46d1-84d2-69e0c423182e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.493950 Aug 29 15:38:57.699198 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1566/2998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:57.755470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.756106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.767594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.768939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.769470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.770380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.770903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.771341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.147464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.160312 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a3c4d01-d081-4a81-907e-1131774f0a0b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.800072 Aug 29 15:38:58.170137 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1433/2999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:58.192608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b617e16b-73fc-44a8-b5ae-e8cc934b04c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1242763588", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:58.393717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-b617e16b-73fc-44a8-b5ae-e8cc934b04c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Neutron security group does_not_exist not found {{(pid=130001) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 29 15:38:58.394407 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b617e16b-73fc-44a8-b5ae-e8cc934b04c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b617e16b-73fc-44a8-b5ae-e8cc934b04c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 258 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1242763588", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1242763588', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 29 15:38:58.403716 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:58.407932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b617e16b-73fc-44a8-b5ae-e8cc934b04c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:58.412064 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b617e16b-73fc-44a8-b5ae-e8cc934b04c2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.230571 Aug 29 15:38:58.412064 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1434/3000] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:58.415855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.416490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.424184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.424723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.425162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.426247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.426764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.427811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.433908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:58.844160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.854186 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4151ce2f-ab5a-482c-9f87-8973b21d79d6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1497 microversion: 2.1 time: 0.445433 Aug 29 15:38:58.855311 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1435/3001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1497 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:58.869082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7cf7b4c3-d742-46c4-a23e-7314a02e276a req-27eb9537-f0d1-413a-971a-29d9dc77be64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd", "name": "network-vif-deleted", "tag": "6b7330d8-a1b7-4828-a8ba-8fe66cf84c25"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:58.888563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7cf7b4c3-d742-46c4-a23e-7314a02e276a req-27eb9537-f0d1-413a-971a-29d9dc77be64 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.893967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7cf7b4c3-d742-46c4-a23e-7314a02e276a req-27eb9537-f0d1-413a-971a-29d9dc77be64 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.894501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7cf7b4c3-d742-46c4-a23e-7314a02e276a req-27eb9537-f0d1-413a-971a-29d9dc77be64 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.917156 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7cf7b4c3-d742-46c4-a23e-7314a02e276a req-27eb9537-f0d1-413a-971a-29d9dc77be64 service nova] Creating event network-vif-deleted:6b7330d8-a1b7-4828-a8ba-8fe66cf84c25 for instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd on n-h1-854882-3 Aug 29 15:38:58.922773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.940671 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f1b6757a-2877-47f3-b2df-a250ac0990a8 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 200 len: 1474 microversion: 2.1 time: 1.190160 Aug 29 15:38:58.943652 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7cf7b4c3-d742-46c4-a23e-7314a02e276a req-27eb9537-f0d1-413a-971a-29d9dc77be64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087030 Aug 29 15:38:58.950385 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1436/3002] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:58.957904 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1567/3003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 1474 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:58.962821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.963538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.981076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.981829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.982260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.985032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.985536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.985962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.193881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.194771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.215061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.219567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.221871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.223992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.228507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.229241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.229899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.241914 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b754573-108f-4323-b822-df6b784b835d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.289799 Aug 29 15:38:59.245585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1437/3004] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:59.271415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.273629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.283986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.287329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.288066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.290799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.291525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.292853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.538672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.554952 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b6e9150-ab41-414a-ba55-fcd8a122ab79 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.288447 Aug 29 15:38:59.570258 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1438/3005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:59.579568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4f8d387-1afe-4e62-aea3-9ee5a6e23e80 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.580317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4f8d387-1afe-4e62-aea3-9ee5a6e23e80 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 313015ea-3979-49d0-a9b5-4fcdfbfef46d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.594145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f4f8d387-1afe-4e62-aea3-9ee5a6e23e80 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 313015ea-3979-49d0-a9b5-4fcdfbfef46d could not be found. Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4f8d387-1afe-4e62-aea3-9ee5a6e23e80 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/313015ea-3979-49d0-a9b5-4fcdfbfef46d HTTP/1.1 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 313015ea-3979-49d0-a9b5-4fcdfbfef46d could not be found. Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '313015ea-3979-49d0-a9b5-4fcdfbfef46d'} Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 313015ea-3979-49d0-a9b5-4fcdfbfef46d could not be found. Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 313015ea-3979-49d0-a9b5-4fcdfbfef46d could not be found. Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.596757 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 313015ea-3979-49d0-a9b5-4fcdfbfef46d could not be found. Aug 29 15:38:59.600994 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.611726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4f8d387-1afe-4e62-aea3-9ee5a6e23e80 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 313015ea-3979-49d0-a9b5-4fcdfbfef46d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:59.613494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4f8d387-1afe-4e62-aea3-9ee5a6e23e80 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/313015ea-3979-49d0-a9b5-4fcdfbfef46d" status: 404 len: 111 microversion: 2.1 time: 0.038069 Aug 29 15:38:59.617687 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1439/3006] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:59 2022] DELETE /compute/v2.1/servers/313015ea-3979-49d0-a9b5-4fcdfbfef46d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:59.622472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.623090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.649692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.650184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.650612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.651635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.652275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.652887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.793321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.810470 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe2d7b94-bc82-4096-906f-9cdf4bce9ad6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.621735 Aug 29 15:38:59.813618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1568/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:59.869362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-91b90a1c-e76b-4019-91ca-f4f6a0dac08e req-66c85635-7bc7-4e5c-9962-9831f9a99539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0d07cd-dda9-476b-9988-bbaa9ef5d43d", "name": "network-vif-deleted", "tag": "9cc7dd2f-c953-486b-baf4-f3bc94eceb3c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:59.918858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-91b90a1c-e76b-4019-91ca-f4f6a0dac08e req-66c85635-7bc7-4e5c-9962-9831f9a99539 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.928075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-91b90a1c-e76b-4019-91ca-f4f6a0dac08e req-66c85635-7bc7-4e5c-9962-9831f9a99539 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.930332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-91b90a1c-e76b-4019-91ca-f4f6a0dac08e req-66c85635-7bc7-4e5c-9962-9831f9a99539 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.942585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.963362 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f86daafb-3f88-4bac-9aff-56f442d036df tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.344567 Aug 29 15:38:59.978827 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1440/3008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:59.987205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.988010 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-91b90a1c-e76b-4019-91ca-f4f6a0dac08e req-66c85635-7bc7-4e5c-9962-9831f9a99539 service nova] Creating event network-vif-deleted:9cc7dd2f-c953-486b-baf4-f3bc94eceb3c for instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d on n-h2-854882-3 Aug 29 15:38:59.988287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.994349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:59.996074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.996723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.997329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.998239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.999260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.999885 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-91b90a1c-e76b-4019-91ca-f4f6a0dac08e req-66c85635-7bc7-4e5c-9962-9831f9a99539 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133956 Aug 29 15:39:00.000069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.000823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1569/3009] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:00.026961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.031605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.055141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.057021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.058265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.061855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.062547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.063207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.100140 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd could not be found. Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd HTTP/1.1 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd could not be found. Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd'} Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd could not be found. Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd could not be found. Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:00.103760 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.107898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:00.107898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:00.107898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:00.107898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:00.107898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:00.107898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd could not be found. Aug 29 15:39:00.107898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.112902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance 1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:00.114108 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a1339ba-6f8b-4a90-ba52-0e25a4dae2ba tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd" status: 404 len: 111 microversion: 2.1 time: 0.107914 Aug 29 15:39:00.119467 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1570/3010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/1f4c2048-466e-4a7e-8d7b-e21f4b9fbadd => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:00.126605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.134315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.148551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:00.151174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.154019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.160431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.161555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.162258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.163237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.275875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.285275 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aeed5cab-ad90-466f-b03e-ccb40241b5fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 200 len: 1474 microversion: 2.1 time: 0.305017 Aug 29 15:39:00.287323 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1441/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 1474 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:00.297866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.300761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.312914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.316777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.317841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.319642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.322761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.324819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.368176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.369672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.370388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.371135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lazy-loading 'fault' on Instance uuid ea0d07cd-dda9-476b-9988-bbaa9ef5d43d {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:00.425113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.434931 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e5e9b879-eab7-47c2-921a-8ebd8a6c09f4 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 200 len: 1309 microversion: 2.1 time: 0.146216 Aug 29 15:39:00.449910 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1442/3012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:00.455523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1562039597"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:00.458322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.465712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.466543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.467230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.468348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.469105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.469957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.567193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.579860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35644884-eca2-4776-b2a6-84267f0f1d77 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.458900 Aug 29 15:39:00.580448 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1571/3013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:00.602734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52901db0-1f51-4964-b926-75f03b7ea2dc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.603493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52901db0-1f51-4964-b926-75f03b7ea2dc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Failed to fetch instance by id 9223372036854775808 {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:39:00.604212 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-52901db0-1f51-4964-b926-75f03b7ea2dc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52901db0-1f51-4964-b926-75f03b7ea2dc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 9223372036854775808 could not be found. Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '9223372036854775808'} Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:00.605945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:00.610572 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:00.610572 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:00.610572 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:00.610572 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 29 15:39:00.610572 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:00.612211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52901db0-1f51-4964-b926-75f03b7ea2dc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:00.613214 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52901db0-1f51-4964-b926-75f03b7ea2dc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015324 Aug 29 15:39:00.617363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1572/3014] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Aug 29 15:39:00 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:00.622295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.623951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.647606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.648307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.648904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.649827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.651495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.652503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.866761 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-486af908-c52c-44ab-83ca-be17642218dc tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.414454 Aug 29 15:39:00.880023 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1443/3015] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:00 2022] POST /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:39:00.888158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.889259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.897786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.898364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.898802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.900147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.900897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.901335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.024759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.037886 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f7799498-4f8c-4870-b507-a7f2f8a76c0f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.419180 Aug 29 15:39:01.040733 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1573/3016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:01.057017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-070cca50-5772-4c96-a3d8-2b425921fe68 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0eb779b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.152315 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-070cca50-5772-4c96-a3d8-2b425921fe68 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.109977 Aug 29 15:39:01.152917 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1574/3017] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:01.164846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.166939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.175466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.176208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.176716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.177163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.177917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.178378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.178811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.185195 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b47bde6b-b3f8-4e24-91ee-009add613e51 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.303000 Aug 29 15:39:01.188254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1444/3018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:01.461910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.465161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: ea0d07cd-dda9-476b-9988-bbaa9ef5d43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.477658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.478150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.478588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.479361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.485201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.486561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.525735 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d could not be found. Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d HTTP/1.1 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d could not be found. Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ea0d07cd-dda9-476b-9988-bbaa9ef5d43d'} Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d could not be found. Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d could not be found. Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:01.527683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.531988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:01.531988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:01.531988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:01.531988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:01.531988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:01.531988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d could not be found. Aug 29 15:39:01.531988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.539368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance ea0d07cd-dda9-476b-9988-bbaa9ef5d43d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:01.542067 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7901f191-5382-4610-9bfc-a59988194139 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d" status: 404 len: 111 microversion: 2.1 time: 0.089876 Aug 29 15:39:01.545995 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1445/3019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/servers/ea0d07cd-dda9-476b-9988-bbaa9ef5d43d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:01.554272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f475a43a-b7fc-4216-ab23-f02465cbc50b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.610301 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f475a43a-b7fc-4216-ab23-f02465cbc50b tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/7645b9b4-d145-4c76-aacf-96def6708411" status: 204 len: 0 microversion: 2.1 time: 0.056656 Aug 29 15:39:01.611016 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1446/3020] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:39:01 2022] DELETE /compute/v2.1/os-server-groups/7645b9b4-d145-4c76-aacf-96def6708411 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:01.630074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.631054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.637500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.647918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.651598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d28ae33f-b7ca-4dd3-918f-7b8046176759 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.497026 Aug 29 15:39:01.652603 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1575/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:01.653737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.654252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.655055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.655733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.656392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.678136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae1c596f-7e58-4674-ac7c-907d4514e5a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.679011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae1c596f-7e58-4674-ac7c-907d4514e5a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Failed to fetch instance by id -1 {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:39:01.679773 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ae1c596f-7e58-4674-ac7c-907d4514e5a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance -1 could not be found. Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae1c596f-7e58-4674-ac7c-907d4514e5a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance -1 could not be found. Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '-1'} Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:01.683258 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:01.687629 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:01.687629 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:01.687629 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 29 15:39:01.687629 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:01.687629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae1c596f-7e58-4674-ac7c-907d4514e5a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance -1 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:01.687629 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae1c596f-7e58-4674-ac7c-907d4514e5a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018644 Aug 29 15:39:01.689081 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1576/3022] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:01 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:01.700635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.700635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.725418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.726359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.726809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.727572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.728037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.728463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.733792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:01.919162 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8478b21f-c6b5-4acd-94b8-2a88e000c6bf tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553" status: 204 len: 0 microversion: 2.1 time: 0.302605 Aug 29 15:39:01.923492 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1447/3023] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:01 2022] DELETE /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:01.936274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.937586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.944843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.946010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.946448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.947135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.947590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.948509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.975194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.982971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:01.988328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-28cca161-8b4a-4feb-826a-62ea92507fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.294546 Aug 29 15:39:02.003670 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1577/3024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.015616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.017505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.032522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.035570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.036087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.040119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.040707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.041686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.169283 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57541ac3-5890-425c-8059-708c9dfe0cc2 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 204 len: 0 microversion: 2.1 time: 0.240068 Aug 29 15:39:02.174168 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1448/3025] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:01 2022] DELETE /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:02.180876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-21d1e52e-a670-4077-8ea4-17e71178ca77 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e283a4c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.281497 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-21d1e52e-a670-4077-8ea4-17e71178ca77 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.107820 Aug 29 15:39:02.282609 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1449/3026] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.292227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.294708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:02.296987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.297814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.303754 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35477fc4-050c-4e52-b85e-5df728402932 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.295887 Aug 29 15:39:02.309327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.309860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.310287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.311063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.311536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.311937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.322856 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1578/3027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.330491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.339029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.355613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.358717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.359493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.360493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.361203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.362690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.622239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.640410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b71a630f-5771-45b4-9def-d39c17f1e661 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.316018 Aug 29 15:39:02.655247 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1579/3028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.679109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-90318a2a-05d0-44a7-886e-03535a891771 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:02.681218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-90318a2a-05d0-44a7-886e-03535a891771 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: b9e2cecc-5fc5-4650-9224-0fcd668eb3d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.691046 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-90318a2a-05d0-44a7-886e-03535a891771 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance b9e2cecc-5fc5-4650-9224-0fcd668eb3d8 could not be found. Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-90318a2a-05d0-44a7-886e-03535a891771 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/b9e2cecc-5fc5-4650-9224-0fcd668eb3d8/action HTTP/1.1 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 19 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: {"forceDelete": {}} Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance b9e2cecc-5fc5-4650-9224-0fcd668eb3d8 could not be found. Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b9e2cecc-5fc5-4650-9224-0fcd668eb3d8', 'body': {'forceDelete': {}}} Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e2cecc-5fc5-4650-9224-0fcd668eb3d8 could not be found. Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e2cecc-5fc5-4650-9224-0fcd668eb3d8 could not be found. Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:02.698146 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:02.702560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:02.702560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:02.702560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e2cecc-5fc5-4650-9224-0fcd668eb3d8 could not be found. Aug 29 15:39:02.702560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:02.703978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-90318a2a-05d0-44a7-886e-03535a891771 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance b9e2cecc-5fc5-4650-9224-0fcd668eb3d8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:02.705367 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-90318a2a-05d0-44a7-886e-03535a891771 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/b9e2cecc-5fc5-4650-9224-0fcd668eb3d8/action" status: 404 len: 111 microversion: 2.1 time: 0.032535 Aug 29 15:39:02.710256 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1580/3029] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:02 2022] POST /compute/v2.1/servers/b9e2cecc-5fc5-4650-9224-0fcd668eb3d8/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:02.719527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.720216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.742866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.743414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.743810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.744533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.744989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.752524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.767165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.782395 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dbb2175c-2d2f-4aed-bab7-40196b87e72e tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553" status: 200 len: 1474 microversion: 2.1 time: 0.496212 Aug 29 15:39:02.803903 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1450/3030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 => generated 1474 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.998509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:03.009897 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4aac1b9-4e41-4591-8234-d5770db8c271 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.297744 Aug 29 15:39:03.011206 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1581/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:03.033530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.034914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.046661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.047437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.048022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.048878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.049624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.050198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.056870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:03.298270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a42d7d1-7b1a-4ecc-bf8e-f2847c49e747 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e34e1ee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.371937 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a42d7d1-7b1a-4ecc-bf8e-f2847c49e747 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.071742 Aug 29 15:39:03.371937 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1582/3032] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:03.666490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.667323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.678189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.678806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.680849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.681692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.682155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.682582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.693187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:03.734627 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-603ab18c-0d3c-4b35-8100-c1806b57f4be tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.704770 Aug 29 15:39:03.740193 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1451/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:03.757556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96f2a90d-1835-421b-83a4-d959b505f181 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:03.761124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96f2a90d-1835-421b-83a4-d959b505f181 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: fa093e0c-5a99-4911-bb69-4c03b700ee62] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.772350 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-96f2a90d-1835-421b-83a4-d959b505f181 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance fa093e0c-5a99-4911-bb69-4c03b700ee62 could not be found. Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96f2a90d-1835-421b-83a4-d959b505f181 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/fa093e0c-5a99-4911-bb69-4c03b700ee62/action HTTP/1.1 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 39 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: {"os-getConsoleOutput": {"length": 10}} Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance fa093e0c-5a99-4911-bb69-4c03b700ee62 could not be found. Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'fa093e0c-5a99-4911-bb69-4c03b700ee62', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa093e0c-5a99-4911-bb69-4c03b700ee62 could not be found. Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa093e0c-5a99-4911-bb69-4c03b700ee62 could not be found. Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.784750 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:03.790117 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:03.790117 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:03.790117 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:03.790117 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:03.790117 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa093e0c-5a99-4911-bb69-4c03b700ee62 could not be found. Aug 29 15:39:03.790117 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.795027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96f2a90d-1835-421b-83a4-d959b505f181 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance fa093e0c-5a99-4911-bb69-4c03b700ee62 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:03.797075 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96f2a90d-1835-421b-83a4-d959b505f181 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/fa093e0c-5a99-4911-bb69-4c03b700ee62/action" status: 404 len: 111 microversion: 2.1 time: 0.044724 Aug 29 15:39:03.801527 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1452/3034] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:03 2022] POST /compute/v2.1/servers/fa093e0c-5a99-4911-bb69-4c03b700ee62/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:03.812199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.813817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.826656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.827464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.828566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.829772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.830439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.831063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.915934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:03.932786 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ad36689-26dd-4784-8895-90b404de20cf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.271328 Aug 29 15:39:03.959322 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1583/3035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:03.973752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.974840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.984726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.985586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.986030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.987100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.987770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.988731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.102688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.115705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-003427d8-14ff-45b2-afa6-a858ffa42ffa tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.312250 Aug 29 15:39:04.117020 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1453/3036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:04.139624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.140335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.155617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.156109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.156545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.157250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.157745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.158171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.386783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.399616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db577424-8e87-4526-971c-60e235f69860 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553" status: 200 len: 1474 microversion: 2.1 time: 0.438739 Aug 29 15:39:04.407755 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1584/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 => generated 1474 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:04.417555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.422180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a0307f8-7231-4c93-a7e1-d87295bfd32f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e371a9d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.430409 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0da50f9b-87d0-42a1-a219-f747521f4c44 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.294712 Aug 29 15:39:04.442032 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1454/3038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:04.459014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-291e8af9-b36b-4085-a981-2737593c21d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.460058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-291e8af9-b36b-4085-a981-2737593c21d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.468346 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-291e8af9-b36b-4085-a981-2737593c21d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 could not be found. Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-291e8af9-b36b-4085-a981-2737593c21d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 HTTP/1.1 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 could not be found. Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5'} Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 could not be found. Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 could not be found. Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:04.486572 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:04.491155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:04.491155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:04.491155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:04.491155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 could not be found. Aug 29 15:39:04.491155 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:04.492129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-291e8af9-b36b-4085-a981-2737593c21d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:04.493207 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-291e8af9-b36b-4085-a981-2737593c21d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5" status: 404 len: 111 microversion: 2.1 time: 0.039518 Aug 29 15:39:04.494237 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1455/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/servers/c1f3f118-3ff4-4063-aa5f-ee5659a2d7d5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:39:04.508620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.509746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.533608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.536119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.538312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.539783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.541502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.543207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.789321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:05.812363 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f783750c-0019-46b7-98f8-858163207b27 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.314065 Aug 29 15:39:05.821459 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1456/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:05.834211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:05.834841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:05.847180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.847677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.848113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.848828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.849278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.849730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.383364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.394020 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f12437b8-eca7-40d9-bf99-20b349deec44 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.579490 Aug 29 15:39:06.395188 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1457/3041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:05 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:06.399892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:06.400503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:06.429161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.429716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.430475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.430897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.431343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.431757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.509706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.510441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.511026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.511629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lazy-loading 'fault' on Instance uuid 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:06.638775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.648772 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e63a411a-e912-4675-8ae9-7d01ae6b4669 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553" status: 200 len: 1309 microversion: 2.1 time: 0.252439 Aug 29 15:39:06.650877 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1458/3042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:06 2022] GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 => generated 1309 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:06.700475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b805ab6b-7234-4c0e-9853-77a8f6aa0e01 req-d4b1b2c8-713d-4082-a7b7-41c0b38cdc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffae3be-a9cf-4935-a2cc-ae3d02c78553", "name": "network-vif-deleted", "tag": "d2c95a43-5446-44fb-98e9-6950b9097c2a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:06.764660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b805ab6b-7234-4c0e-9853-77a8f6aa0e01 req-d4b1b2c8-713d-4082-a7b7-41c0b38cdc5b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.766532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b805ab6b-7234-4c0e-9853-77a8f6aa0e01 req-d4b1b2c8-713d-4082-a7b7-41c0b38cdc5b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.766987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b805ab6b-7234-4c0e-9853-77a8f6aa0e01 req-d4b1b2c8-713d-4082-a7b7-41c0b38cdc5b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.814146 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b805ab6b-7234-4c0e-9853-77a8f6aa0e01 req-d4b1b2c8-713d-4082-a7b7-41c0b38cdc5b service nova] Creating event network-vif-deleted:d2c95a43-5446-44fb-98e9-6950b9097c2a for instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 on n-h1-854882-3 Aug 29 15:39:06.831610 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b805ab6b-7234-4c0e-9853-77a8f6aa0e01 req-d4b1b2c8-713d-4082-a7b7-41c0b38cdc5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159855 Aug 29 15:39:06.843704 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1459/3043] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:06.847624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:06.870446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:06.882890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.883377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.883809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.900055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.900545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.900985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.365787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:07.378883 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c334beae-08a4-4d0c-82e0-5c725d5c3957 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.535609 Aug 29 15:39:07.380125 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1460/3044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:06 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:07.390530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b7ebd3f1-07f0-4b33-94fb-b5a677514b21 req-63f688aa-dc4c-4407-a4f9-73f917d513be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f613e132-44b7-454b-86a5-5b0848aefc09", "name": "network-vif-deleted", "tag": "136763a3-e42d-4f54-97fd-436a86ec757d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:07.423577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b7ebd3f1-07f0-4b33-94fb-b5a677514b21 req-63f688aa-dc4c-4407-a4f9-73f917d513be service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.436065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b7ebd3f1-07f0-4b33-94fb-b5a677514b21 req-63f688aa-dc4c-4407-a4f9-73f917d513be service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.442039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b7ebd3f1-07f0-4b33-94fb-b5a677514b21 req-63f688aa-dc4c-4407-a4f9-73f917d513be service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.481637 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b7ebd3f1-07f0-4b33-94fb-b5a677514b21 req-63f688aa-dc4c-4407-a4f9-73f917d513be service nova] Creating event network-vif-deleted:136763a3-e42d-4f54-97fd-436a86ec757d for instance f613e132-44b7-454b-86a5-5b0848aefc09 on n-h1-854882-3 Aug 29 15:39:07.495870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b7ebd3f1-07f0-4b33-94fb-b5a677514b21 req-63f688aa-dc4c-4407-a4f9-73f917d513be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114258 Aug 29 15:39:07.499904 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1461/3045] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:07.535850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-477f2059-a6ee-4dcb-81f0-8acd479bc008 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:07.573842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-477f2059-a6ee-4dcb-81f0-8acd479bc008 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.574337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-477f2059-a6ee-4dcb-81f0-8acd479bc008 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.574767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-477f2059-a6ee-4dcb-81f0-8acd479bc008 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.746769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-477f2059-a6ee-4dcb-81f0-8acd479bc008 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Going to try to stop instance {{(pid=130001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:39:07.884658 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-477f2059-a6ee-4dcb-81f0-8acd479bc008 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action" status: 202 len: 0 microversion: 2.1 time: 0.383030 Aug 29 15:39:07.897023 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1462/3046] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:07 2022] POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:07.927077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:07.927934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:07.943589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.944086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.944527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.945217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.956973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.957571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.561854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:08.574812 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-15fba5a1-1f65-49e4-8118-b47fdca20394 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1524 microversion: 2.1 time: 0.670204 Aug 29 15:39:08.575377 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1463/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:07 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1524 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:08.597126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:08.597980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 3ffae3be-a9cf-4935-a2cc-ae3d02c78553] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:08.605100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.605845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.606456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.607305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.607907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.608828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.629260 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 could not be found. Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 HTTP/1.1 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 could not be found. Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3ffae3be-a9cf-4935-a2cc-ae3d02c78553'} Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 could not be found. Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 could not be found. Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.632869 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.638772 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.638772 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.638772 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.638772 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:08.638772 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:08.638772 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 could not be found. Aug 29 15:39:08.638772 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.641503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance 3ffae3be-a9cf-4935-a2cc-ae3d02c78553 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:08.642684 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cd35faf3-1062-4a4e-8ac0-ac0ec1e72d40 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553" status: 404 len: 111 microversion: 2.1 time: 0.049716 Aug 29 15:39:08.644340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1464/3048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:08 2022] GET /compute/v2.1/servers/3ffae3be-a9cf-4935-a2cc-ae3d02c78553 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:08.649488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af2a844f-8f92-40f4-be72-d482b411ea9d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-417975899", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af2a844f-8f92-40f4-be72-d482b411ea9d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 237 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-417975899", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-417975899', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.674036 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:39:08.678857 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.682177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af2a844f-8f92-40f4-be72-d482b411ea9d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:08.683320 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-af2a844f-8f92-40f4-be72-d482b411ea9d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037897 Aug 29 15:39:08.687917 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1465/3049] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:08.697179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:08.698121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:08.707417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.708179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.708971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.709906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.710687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.711440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.011861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:09.022433 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 15:39:09.023110 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 15:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 (ip 10.222.0.16) !!! Aug 29 15:39:09.052860 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc0f740f-f38a-4460-b604-bf0ebaf9a9ea tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.357454 Aug 29 15:39:09.054411 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1466/3050] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:08 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:09.073915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.075452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: f613e132-44b7-454b-86a5-5b0848aefc09] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.101680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.103664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.107672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.110873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.111567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.112952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.163801 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance f613e132-44b7-454b-86a5-5b0848aefc09 could not be found. Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 HTTP/1.1 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance f613e132-44b7-454b-86a5-5b0848aefc09 could not be found. Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'f613e132-44b7-454b-86a5-5b0848aefc09'} Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f613e132-44b7-454b-86a5-5b0848aefc09 could not be found. Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f613e132-44b7-454b-86a5-5b0848aefc09 could not be found. Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:09.166018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f613e132-44b7-454b-86a5-5b0848aefc09 could not be found. Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance f613e132-44b7-454b-86a5-5b0848aefc09 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b9d3516-3f48-425d-9cd6-62037e924846 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09" status: 404 len: 111 microversion: 2.1 time: 0.109699 Aug 29 15:39:09.170125 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1467/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/f613e132-44b7-454b-86a5-5b0848aefc09 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:09.172643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.173901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.180623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.181224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.181741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.182432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.182876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.183301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.268512 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a0307f8-7231-4c93-a7e1-d87295bfd32f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 4.859122 Aug 29 15:39:09.270254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1585/3052] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 4861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:09.281333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5f33529f-c31d-4682-8291-c4ae917ebacf req-e4797ff8-d01b-4b6b-b743-1529e63b309f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b0012d-740e-40db-b4d0-fac933f03ea1", "name": "network-vif-plugged", "status": "completed", "tag": "16687ef7-18a5-46c1-a861-d806bae5f0ba"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:09.302567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5f33529f-c31d-4682-8291-c4ae917ebacf req-e4797ff8-d01b-4b6b-b743-1529e63b309f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.303671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5f33529f-c31d-4682-8291-c4ae917ebacf req-e4797ff8-d01b-4b6b-b743-1529e63b309f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.304124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5f33529f-c31d-4682-8291-c4ae917ebacf req-e4797ff8-d01b-4b6b-b743-1529e63b309f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.320536 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5f33529f-c31d-4682-8291-c4ae917ebacf req-e4797ff8-d01b-4b6b-b743-1529e63b309f service nova] Creating event network-vif-plugged:16687ef7-18a5-46c1-a861-d806bae5f0ba for instance 21b0012d-740e-40db-b4d0-fac933f03ea1 on n-h2-854882-3 Aug 29 15:39:09.327682 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5f33529f-c31d-4682-8291-c4ae917ebacf req-e4797ff8-d01b-4b6b-b743-1529e63b309f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055667 Aug 29 15:39:09.329205 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1586/3053] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:09.335134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1be5a98f-944f-4c2c-acbc-fd958244b14f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.402952 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1be5a98f-944f-4c2c-acbc-fd958244b14f tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/1020dc48-0c68-4ad4-8dd0-2c1d2df7a846" status: 204 len: 0 microversion: 2.1 time: 0.072445 Aug 29 15:39:09.404568 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1587/3054] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:39:09 2022] DELETE /compute/v2.1/os-server-groups/1020dc48-0c68-4ad4-8dd0-2c1d2df7a846 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:09.417186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.417983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.427511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.431643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.432390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.433989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.434641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.435284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.482118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:09.671371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:09.681004 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9397e690-d003-4b36-8a4a-aacbd8e7483c tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 204 len: 0 microversion: 2.1 time: 0.271952 Aug 29 15:39:09.683885 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1588/3055] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:09 2022] DELETE /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:09.693365 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f25366c5-7c87-41fa-9242-a9e57129b57e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.524351 Aug 29 15:39:09.697520 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1468/3056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:09.716730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.719909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.723426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.724111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.733246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.739190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.739941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.740793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.742310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.742732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.744291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.744929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.745596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.746219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.746818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.747403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.009998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.021612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-78b41e3b-695d-4bed-898d-9ca3e1d709d2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1506 microversion: 2.1 time: 0.332062 Aug 29 15:39:10.023802 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1589/3057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.042814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.043744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.055998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.063749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.064251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.064690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.065514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.066004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.066402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.068563 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-efa768ce-9ba7-48a0-ac92-73de51602e69 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1472 microversion: 2.1 time: 0.366514 Aug 29 15:39:10.076189 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1469/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.089331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.096143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.111447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.114732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.115316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.125557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.126157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.126673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.454576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.465571 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f9b6500-729b-4015-887b-babb772b97f0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.439928 Aug 29 15:39:10.468727 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1590/3059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.493695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-279a8ba5-3a74-4a29-bf9a-32050abd19c5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e35c49d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.568275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.589596 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-72c83b6f-bf16-4aef-a385-ad5b2ff69e1b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.502126 Aug 29 15:39:10.590434 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1470/3060] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.601616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-279a8ba5-3a74-4a29-bf9a-32050abd19c5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.122861 Aug 29 15:39:10.601752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c24cfd6-a582-4704-b9e2-6f56732984c3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:10.601752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.602604 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1591/3061] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.615934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.618411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.618547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0288bc75-33af-4f55-88f2-3933fc6de8b9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-244742072", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:10.618856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.619572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.620028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.620454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0288bc75-33af-4f55-88f2-3933fc6de8b9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 234 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-244742072", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-244742072', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.629309 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0288bc75-33af-4f55-88f2-3933fc6de8b9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0288bc75-33af-4f55-88f2-3933fc6de8b9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.027123 Aug 29 15:39:10.637492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1592/3062] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:10 2022] POST /compute/v2.1/servers => generated 133 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:10.644430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.645592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.652199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.652692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.653285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.654431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.654893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.655318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.973246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:11.086431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.104159 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26c1436c-ade4-4ccd-a126-c37a21a7dbd9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.463617 Aug 29 15:39:11.106254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1593/3063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.122246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:11.123237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.144039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.144927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.145639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.146582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.147240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.149161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.310601 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76f4f16e-c377-4e01-8536-fbbc27b46350 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "POST /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.718711 Aug 29 15:39:11.311357 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1471/3064] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:39:10 2022] POST /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:11.350371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:11.351215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.381359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.389906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.390486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.391251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.391723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.392154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.403730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.413104 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-06c7f577-2ba6-40c4-bd44-f9ccc49b635e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1506 microversion: 2.1 time: 0.305497 Aug 29 15:39:11.415457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1594/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.431893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:11.432917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.451711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.452507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.453193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.455482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.456621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.457169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.895405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.904682 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73eb4572-0cf2-4b95-b20a-41f1d86183a4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.487763 Aug 29 15:39:11.907866 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1595/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.921573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-30934916-8e04-4952-b4cb-618ad86725cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e3ed7dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.009456 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-30934916-8e04-4952-b4cb-618ad86725cf tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.099566 Aug 29 15:39:12.023492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1596/3067] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:12.028477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.030091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:12.037055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.037590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.038036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.038758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.039473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.039904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.133487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.142422 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5fda56af-c2b6-4122-a9a7-4524d15b93b3 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1472 microversion: 2.1 time: 0.820998 Aug 29 15:39:12.166798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1472/3068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1472 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:12.187952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1ecc6bf-401b-4edd-9dc1-ebfb6e6a5d6c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:12.188752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e1ecc6bf-401b-4edd-9dc1-ebfb6e6a5d6c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 9ff37f03-b4b3-446b-a197-612ddccaf4a1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:12.208452 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e1ecc6bf-401b-4edd-9dc1-ebfb6e6a5d6c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 9ff37f03-b4b3-446b-a197-612ddccaf4a1 could not be found. Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1ecc6bf-401b-4edd-9dc1-ebfb6e6a5d6c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/9ff37f03-b4b3-446b-a197-612ddccaf4a1/action HTTP/1.1 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 13 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: {"pause": {}} Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 9ff37f03-b4b3-446b-a197-612ddccaf4a1 could not be found. Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '9ff37f03-b4b3-446b-a197-612ddccaf4a1', 'body': {'pause': {}}} Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff37f03-b4b3-446b-a197-612ddccaf4a1 could not be found. Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff37f03-b4b3-446b-a197-612ddccaf4a1 could not be found. Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:12.222979 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:12.227988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:12.227988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:12.227988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff37f03-b4b3-446b-a197-612ddccaf4a1 could not be found. Aug 29 15:39:12.227988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:12.243887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1ecc6bf-401b-4edd-9dc1-ebfb6e6a5d6c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 9ff37f03-b4b3-446b-a197-612ddccaf4a1 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:12.245123 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e1ecc6bf-401b-4edd-9dc1-ebfb6e6a5d6c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/9ff37f03-b4b3-446b-a197-612ddccaf4a1/action" status: 404 len: 111 microversion: 2.1 time: 0.076926 Aug 29 15:39:12.247718 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1473/3069] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:12 2022] POST /compute/v2.1/servers/9ff37f03-b4b3-446b-a197-612ddccaf4a1/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:12.259557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.260917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:12.269431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.270134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.270754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.271645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.272353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.272944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.488069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.498735 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0b89e313-46e3-4d79-9ce4-51f356a16c2f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.242304 Aug 29 15:39:12.512783 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1474/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:12.523461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.530837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:12.552364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.552850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.553497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.554362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.555007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.555606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.618834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.631996 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce4fa875-f593-4af4-96ba-9d1a4f89d7dd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.607266 Aug 29 15:39:12.649414 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1597/3071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:12.663220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.663847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:12.673197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.673729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.674196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.674915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.690590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.691147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.053874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:13.074325 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a881837a-225d-49f7-a4d9-13c3b196f4a8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1506 microversion: 2.1 time: 0.571748 Aug 29 15:39:13.076894 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1475/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:13.111574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ab31c7ad-608a-40b5-8455-e4ea6af28ae4 req-b6711983-0f10-493b-8f44-822f87c4b017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f257df-f378-4dbc-a0ab-97037668efbc", "name": "network-vif-unplugged", "status": "completed", "tag": "6e02a8e3-2a57-4748-9423-8aa3383d0ca7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:13.176469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ab31c7ad-608a-40b5-8455-e4ea6af28ae4 req-b6711983-0f10-493b-8f44-822f87c4b017 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.181063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ab31c7ad-608a-40b5-8455-e4ea6af28ae4 req-b6711983-0f10-493b-8f44-822f87c4b017 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.182604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ab31c7ad-608a-40b5-8455-e4ea6af28ae4 req-b6711983-0f10-493b-8f44-822f87c4b017 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.218166 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ab31c7ad-608a-40b5-8455-e4ea6af28ae4 req-b6711983-0f10-493b-8f44-822f87c4b017 service nova] Creating event network-vif-unplugged:6e02a8e3-2a57-4748-9423-8aa3383d0ca7 for instance 77f257df-f378-4dbc-a0ab-97037668efbc on n-h1-854882-3 Aug 29 15:39:13.236426 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ab31c7ad-608a-40b5-8455-e4ea6af28ae4 req-b6711983-0f10-493b-8f44-822f87c4b017 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155368 Aug 29 15:39:13.238695 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1476/3073] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:13.275824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f968384c-77aa-4f82-85d2-86e6239a92ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e28613a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.291587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:13.308023 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd8a13a4-4135-400d-ac22-f0a954f2cc64 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.655873 Aug 29 15:39:13.310108 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1598/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:13.319053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.320003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.330570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.334309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.337300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.340431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.341182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.341877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.411140 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f968384c-77aa-4f82-85d2-86e6239a92ee tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.170317 Aug 29 15:39:13.417188 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1477/3075] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:13.433714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2d270c70-8deb-4172-8098-dade807f4fe6 req-84a6959a-fb73-47a0-aad0-d12b6b3aa5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4254c3c6-f8b5-44e4-b752-f8ee1828a748", "name": "network-vif-deleted", "tag": "15dad3a3-b5ec-4256-b31c-0e0d601a9866"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:13.495729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2d270c70-8deb-4172-8098-dade807f4fe6 req-84a6959a-fb73-47a0-aad0-d12b6b3aa5c9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.496379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2d270c70-8deb-4172-8098-dade807f4fe6 req-84a6959a-fb73-47a0-aad0-d12b6b3aa5c9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.496680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2d270c70-8deb-4172-8098-dade807f4fe6 req-84a6959a-fb73-47a0-aad0-d12b6b3aa5c9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.530982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9bbdf34e904843ab7cd7b40bf3720d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc4a6b62df34515a6df68cfc28f2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:13.545814 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2d270c70-8deb-4172-8098-dade807f4fe6 req-84a6959a-fb73-47a0-aad0-d12b6b3aa5c9 service nova] Creating event network-vif-deleted:15dad3a3-b5ec-4256-b31c-0e0d601a9866 for instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 on n-h2-854882-3 Aug 29 15:39:13.550117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-227d994d-0d65-4f29-bfe0-06e19e353dff tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 200 len: 1301 microversion: 2.1 time: 0.229191 Aug 29 15:39:13.553919 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1599/3076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 1301 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:13.567210 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2d270c70-8deb-4172-8098-dade807f4fe6 req-84a6959a-fb73-47a0-aad0-d12b6b3aa5c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146495 Aug 29 15:39:13.570697 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1478/3077] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:13.589525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:13.611776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.634020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.639529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.642560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.646904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.648218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.650052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.665037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.667862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.690773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.693061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.693916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.695873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.698760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.699553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.791510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:13.827173 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8067137c-8c19-4b92-935a-10c24fea4758 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 202 len: 0 microversion: 2.1 time: 0.271531 Aug 29 15:39:13.842511 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1600/3078] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:13 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:13.865283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.866133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.881462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.881958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.882398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.888916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.889431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.889884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.167256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.179486 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d96506dc-b53f-42d8-879d-7d5019f35cb2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1510 microversion: 2.1 time: 0.335330 Aug 29 15:39:14.193437 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1601/3079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.193437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.193437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:14.208243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.209786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.211139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.212867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.213639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.214316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.409075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.419839 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3656ff2-7d74-449a-9bfe-42c679801bfd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 200 len: 1449 microversion: 2.1 time: 0.236544 Aug 29 15:39:14.420816 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1602/3080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 1449 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.448179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-46adcdb3-5617-4675-8e79-08564b980c17 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0eb532a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.523154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-46adcdb3-5617-4675-8e79-08564b980c17 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.086854 Aug 29 15:39:14.532122 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1603/3081] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.540280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.542896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:14.566596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.569122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.570273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.572524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.575534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.576347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.635719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:14.651791 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Working on deleting snapshot 415b0eca-724f-42e4-9b94-bad601dc0485 from shelved instance... Aug 29 15:39:14.782547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.794411 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d1184bd9-a29b-4e52-b90a-301617de6c6c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 1.135633 Aug 29 15:39:14.798515 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1479/3082] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.816764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.817807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] [instance: 4254c3c6-f8b5-44e4-b752-f8ee1828a748] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:14.827143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.827641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.828081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.828788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.829239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.829700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.871833 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] HTTP exception thrown: Instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 could not be found. Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Request method failure captured: Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 HTTP/1.1 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzc22qTS-4E2wkeCZRFSbDMm4AJLLIOFMhpoT8o4l5vnhzmuSzjN0L8rR87IpHXAwGRl7yCqw9-RT0FyDvE9MEHHUYwltVjpCtxgrSyWqM-4mFjUGUnb_UHIifPWP9_7h7wybJjp4hnUDs3E79SXWcyvJLS8nUQLKQwnvE24q5dAkc Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bc4a6b62df34515a6df68cfc28f2526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bc4a6b62df34515a6df68cfc28f2526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bc4a6b62df34515a6df68cfc28f2526"}]}] Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 5bc4a6b62df34515a6df68cfc28f2526 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-293921000 Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0b9bbdf34e904843ab7cd7b40bf3720d Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersOnMultiNodesTest-293921000-project Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 could not be found. Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '4254c3c6-f8b5-44e4-b752-f8ee1828a748'} Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 could not be found. Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 could not be found. Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:14.873984 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 could not be found. Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] Returning 404 to user: Instance 4254c3c6-f8b5-44e4-b752-f8ee1828a748 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:14.878736 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a878d2d3-d0ec-4ea5-a16a-5cc06c9e22e0 tempest-ServersOnMultiNodesTest-293921000 tempest-ServersOnMultiNodesTest-293921000-project] 10.222.0.16 "GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748" status: 404 len: 111 microversion: 2.1 time: 0.075132 Aug 29 15:39:14.879718 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1480/3083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/servers/4254c3c6-f8b5-44e4-b752-f8ee1828a748 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:15.203390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.204369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:15.220986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.225622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.228508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.230043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.230969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.232420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.735996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:15.747870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9967d4a1-2c46-4200-b270-70d8927db335 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1490 microversion: 2.1 time: 0.548202 Aug 29 15:39:15.751576 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1481/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1490 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:15.768002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be4ddd31-5526-41ef-9312-b09bff5a0afa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2720e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:16.716356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Doing local delete in cell f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=130002) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 15:39:16.717803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.720111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.721886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.722539 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 15:39:16.734896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] deallocate_for_instance() {{(pid=130002) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 29 15:39:16.745705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be4ddd31-5526-41ef-9312-b09bff5a0afa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.981909 Aug 29 15:39:16.746371 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1482/3085] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:16.756280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:16.757157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:16.780902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.788920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.789994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.793430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.798038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.798763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.878856 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Cannot 'pause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state paused Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action HTTP/1.1 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 13 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: {"pause": {}} Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot 'pause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state paused Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'pause': {}}} Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 in vm_state paused. Cannot pause while the instance is in this state. Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state paused Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:16.880977 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:16.885204 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:16.885204 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:16.885204 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:16.885204 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state paused Aug 29 15:39:16.885204 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:16.887154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 409 to user: Cannot 'pause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state paused {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:16.888648 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2465cca5-80f8-48e2-b3b1-d00c90f3f911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 409 len: 143 microversion: 2.1 time: 0.140941 Aug 29 15:39:16.890117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1483/3086] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:16 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 143 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:16.901433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:16.902925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:16.910964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:16.914849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.916743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.919086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.920576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.921636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.922813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.427848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:17.437432 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f3a5cc9c-99a0-450c-af31-5465d419757e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.545914 Aug 29 15:39:17.460796 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1484/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:16 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:17.961998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:17.962678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:17.974742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.977866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.986296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.988960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.990074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.990918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.110303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:18.374952 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-178d19f8-8aa3-4b02-ad75-26eb8d7c373e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 204 len: 0 microversion: 2.42 time: 0.912464 Aug 29 15:39:18.378775 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1485/3088] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:39:17 2022] DELETE /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 0 bytes in 917 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:39:18.395179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:18.399369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:18.416264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Updating instance_info_cache with network_info: [] {{(pid=130002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:39:18.426292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.427068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.427844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.429420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.430265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.431019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.618103 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c534399-db3d-4001-a488-1afe8b92010f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 202 len: 0 microversion: 2.1 time: 0.237516 Aug 29 15:39:18.621749 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1486/3089] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:18 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:18.635024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e5ca35fc-efb3-484d-9ca2-8c75b3f83b85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2795550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:18.744626 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e5ca35fc-efb3-484d-9ca2-8c75b3f83b85 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.119091 Aug 29 15:39:18.745229 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1487/3090] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:18 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:18.750317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:18.751052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:18.776196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.776896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.778573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.780303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.781159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.782049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.214729 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a20ab8f-1518-4ba6-ab64-9d08043f41c7 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 204 len: 0 microversion: 2.1 time: 4.678944 Aug 29 15:39:19.216153 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1604/3091] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:14 2022] DELETE /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 0 bytes in 4683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:19.229211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f9eac33e-f4ab-4c16-a6f3-6d54111b9a28 req-e578d7ea-da13-4586-80e8-55843dba7332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f257df-f378-4dbc-a0ab-97037668efbc", "name": "network-vif-deleted", "tag": "6e02a8e3-2a57-4748-9423-8aa3383d0ca7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:19.242855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9eac33e-f4ab-4c16-a6f3-6d54111b9a28 req-e578d7ea-da13-4586-80e8-55843dba7332 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.243927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9eac33e-f4ab-4c16-a6f3-6d54111b9a28 req-e578d7ea-da13-4586-80e8-55843dba7332 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.244589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9eac33e-f4ab-4c16-a6f3-6d54111b9a28 req-e578d7ea-da13-4586-80e8-55843dba7332 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.259251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.server_external_events [req-f9eac33e-f4ab-4c16-a6f3-6d54111b9a28 req-e578d7ea-da13-4586-80e8-55843dba7332 service nova] Unable to find a host for instance 77f257df-f378-4dbc-a0ab-97037668efbc. Dropping event network-vif-deleted {{(pid=130002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:39:19.260460 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f9eac33e-f4ab-4c16-a6f3-6d54111b9a28 req-e578d7ea-da13-4586-80e8-55843dba7332 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.043076 Aug 29 15:39:19.276218 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1605/3092] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:39:19.282846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.283771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.293225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.294140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.294742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.295639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.296494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.297211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.359569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.374042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.384193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.385938 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e966bffd-9bfb-46ee-93aa-e0959916a8da tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2961 microversion: 2.42 time: 0.639755 Aug 29 15:39:19.411053 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1488/3093] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:18 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2961 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:19.419970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.423593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.438318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.438895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.443719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.444565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.445243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.445685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.551318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.569073 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-31e5883d-f865-4e50-a419-29b8309cbac1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.290369 Aug 29 15:39:19.571053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1606/3094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:19.763922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.779000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a74f2fb4-021e-4d9e-b838-c5eea5f7e6ce tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.366613 Aug 29 15:39:19.780267 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1489/3095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:19.794382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.795252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.806695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.807116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.807621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.808382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.808842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.809268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.851376 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc HTTP/1.1 Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '77f257df-f378-4dbc-a0ab-97037668efbc'} Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:19.853290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-82ce411a-af0b-4055-8319-64247a254807 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 404 len: 111 microversion: 2.1 time: 0.064557 Aug 29 15:39:19.857965 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1490/3096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:19.860650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30f6afc3-fc45-4557-891d-a461f87eba36 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e27445e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.948547 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30f6afc3-fc45-4557-891d-a461f87eba36 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.091592 Aug 29 15:39:19.949487 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1491/3097] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:19.964370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.965818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.976017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.978501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.979128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.980237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.994297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.995108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.341026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-38547898-8e4f-4a26-9a3b-5ab04ad41983 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Calling method '.version_select at 0x7fb0e381d820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:20.380130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.391855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:20.395742 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a78bc97-4cb1-4969-b3c2-81cd7b525193 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.445009 Aug 29 15:39:20.399934 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1492/3098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:20.415512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-991766743", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:20.447832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-38547898-8e4f-4a26-9a3b-5ab04ad41983 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:39:20.448466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-38547898-8e4f-4a26-9a3b-5ab04ad41983 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Neutron security group 7cf5dc82-10c3-411f-a853-3f61af326fad not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:39:20.448977 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-38547898-8e4f-4a26-9a3b-5ab04ad41983 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] HTTP exception thrown: Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist Aug 29 15:39:20.448977 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-0ea3703c-3312-410d-ad18-ac1fbaf11f20'] Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-38547898-8e4f-4a26-9a3b-5ab04ad41983 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Request method failure captured: Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-security-groups/7cf5dc82-10c3-411f-a853-3f61af326fad HTTP/1.1 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN2mnGzUKS33cOVxgl7LMMx93wfLUHCzaUCYrZad4GJMa_wXOREEclquiV1LbVStwSGF2CaI88ho7ad6cRfFoNhylg-zGT6rZtNUSe4DCMYQ9yrja7_L2Is_GhxfjvEibqHTNzLA1sT9_M9JP3-1bTUvwY_1X4D8XpTopvvdEBWU-dQ Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bb6fbf36e924067b4c98bd14a30ff3f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}] Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 1e7f1e9746ee441a9c8d7bf64e22fb35 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-0ea3703c-3312-410d-ad18-ac1fbaf11f20'] Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '7cf5dc82-10c3-411f-a853-3f61af326fad'} Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:39:20.450946 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3703c-3312-410d-ad18-ac1fbaf11f20'] Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3703c-3312-410d-ad18-ac1fbaf11f20'] Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3703c-3312-410d-ad18-ac1fbaf11f20'] Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ea3703c-3312-410d-ad18-ac1fbaf11f20'] Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-38547898-8e4f-4a26-9a3b-5ab04ad41983 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Returning 404 to user: Security group 7cf5dc82-10c3-411f-a853-3f61af326fad does not exist Aug 29 15:39:20.455727 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-0ea3703c-3312-410d-ad18-ac1fbaf11f20'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:20.459551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-38547898-8e4f-4a26-9a3b-5ab04ad41983 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7cf5dc82-10c3-411f-a853-3f61af326fad" status: 404 len: 194 microversion: 2.1 time: 0.880064 Aug 29 15:39:20.462391 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1607/3099] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:39:19 2022] DELETE /compute/v2.1/os-security-groups/7cf5dc82-10c3-411f-a853-3f61af326fad => generated 194 bytes in 890 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:20.470651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:20.474210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:20.488640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.491002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.491746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.492653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.493286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.493895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.522098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] validate_networks() for [('f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:20.891599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.915383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.920238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.924412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4183669-9a28-4bde-a89e-3584b2520858 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2961 microversion: 2.42 time: 0.460798 Aug 29 15:39:20.929143 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1608/3100] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:20 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2961 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:20.942758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:20.950237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:20.965313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.966272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.967583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.968997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.969739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.970407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.987461 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88/action HTTP/1.1 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 28 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: {"reboot": {"type": "SOFT"}} Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '8077b5b3-4ef9-4217-bf33-87769843fb88', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:20.989814 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:20.993829 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:20.998320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:20.999506 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fec62c61-bd98-4e4f-9586-1937d371a210 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88/action" status: 404 len: 111 microversion: 2.1 time: 0.069004 Aug 29 15:39:21.000711 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1609/3101] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:20 2022] POST /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:21.006938 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ad23a3c-28d0-4635-b88a-badb9765b732 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004923 Aug 29 15:39:21.008110 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1610/3102] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Aug 29 15:39:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:39:21.015964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.017896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.025770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.026594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.027274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.028962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.029840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.030499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.401654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:21.402101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:21.402307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:21.403454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:21.406134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:21.423867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.425106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.425796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.427462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.428260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.428871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.456557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:21.473897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for user 065c5a92f9c04400be8a515e8233fb0d and project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:21.503477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:21.513522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:21.620408 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03f79222-305c-47a1-bf59-f40a014578fb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219262 Aug 29 15:39:21.624112 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1493/3103] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:21.633329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5a880719-8118-4436-b2e2-e93a63286cb7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2730af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.743045 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5a880719-8118-4436-b2e2-e93a63286cb7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.117566 Aug 29 15:39:21.753462 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1494/3104] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:21.759173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.761168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.769634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.770371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.771047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.773189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.779474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.779474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.138166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:22.147630 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-508c1e91-58fa-47d3-b7f4-9909ef2b3182 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.399944 Aug 29 15:39:22.167519 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1495/3105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:22.178661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d742fce4-ef6f-40f5-af1c-ed7b575d9982 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Calling method '.version_select at 0x7fb0e27203a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:22.549789 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d742fce4-ef6f-40f5-af1c-ed7b575d9982 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.380500 Aug 29 15:39:22.551341 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1496/3106] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:39:22 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:22.556822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:22.557710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:22.589083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.592055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.592566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.593994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.597850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.598440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.742397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:22.752192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88b93971-ff26-40bf-bf56-05f4e13d3469 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1218 microversion: 2.1 time: 0.199574 Aug 29 15:39:22.752793 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1497/3107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:22 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:22.761454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:22.762083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:22.776556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.779323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.779928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.783140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.785833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.787101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.857544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:22.877850 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8efce598-c8e4-49c1-a954-e3bddd90daa9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 1.863983 Aug 29 15:39:22.878522 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1611/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:22.903945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:22.913145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:22.925250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.926119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.927344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.928322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.929256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.930045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.285853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.304334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.306717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.308507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f257b93b-af7a-4b8b-ba4c-8163125d2529 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2961 microversion: 2.42 time: 0.551702 Aug 29 15:39:23.309083 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1498/3109] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:22 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2961 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:23.328909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df68fbdc-cfea-4088-ba3a-18579ff871dc tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Calling method '.version_select at 0x7fb0e26d73a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.417771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.463188 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f32b6cd-e3cf-45df-a79a-6c31ceaf2579 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.583542 Aug 29 15:39:23.482600 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1612/3110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:22 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.491788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93f22feb-ee4a-485b-8718-e4c5c5fc0556 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0eb6cc4c0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.569789 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93f22feb-ee4a-485b-8718-e4c5c5fc0556 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.080977 Aug 29 15:39:23.579091 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1613/3111] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.593614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7becac2-266d-4586-8682-8202d1c02878 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.596671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7becac2-266d-4586-8682-8202d1c02878 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 105656e6-a646-4bc2-9afe-acda2884c7f1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.607098 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e7becac2-266d-4586-8682-8202d1c02878 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 105656e6-a646-4bc2-9afe-acda2884c7f1 could not be found. Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7becac2-266d-4586-8682-8202d1c02878 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/105656e6-a646-4bc2-9afe-acda2884c7f1/action HTTP/1.1 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 28 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: {"reboot": {"type": "SOFT"}} Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 105656e6-a646-4bc2-9afe-acda2884c7f1 could not be found. Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '105656e6-a646-4bc2-9afe-acda2884c7f1', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105656e6-a646-4bc2-9afe-acda2884c7f1 could not be found. Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105656e6-a646-4bc2-9afe-acda2884c7f1 could not be found. Aug 29 15:39:23.608991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105656e6-a646-4bc2-9afe-acda2884c7f1 could not be found. Aug 29 15:39:23.614332 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.616607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7becac2-266d-4586-8682-8202d1c02878 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 105656e6-a646-4bc2-9afe-acda2884c7f1 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:23.617544 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7becac2-266d-4586-8682-8202d1c02878 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/105656e6-a646-4bc2-9afe-acda2884c7f1/action" status: 404 len: 111 microversion: 2.1 time: 0.035319 Aug 29 15:39:23.627028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1614/3112] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/servers/105656e6-a646-4bc2-9afe-acda2884c7f1/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:23.642385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.643169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.665903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.666721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.667635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.668604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.670191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.670868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.936364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-df68fbdc-cfea-4088-ba3a-18579ff871dc tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:39:23.937626 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-df68fbdc-cfea-4088-ba3a-18579ff871dc tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 29 15:39:23.937626 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-02316669-995a-4b7b-914f-ceb93fcc9f5f'] Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df68fbdc-cfea-4088-ba3a-18579ff871dc tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Request method failure captured: Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-security-groups/afea25a2-a45e-4c45-b70b-830d1719f25d HTTP/1.1 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN2mnGzUKS33cOVxgl7LMMx93wfLUHCzaUCYrZad4GJMa_wXOREEclquiV1LbVStwSGF2CaI88ho7ad6cRfFoNhylg-zGT6rZtNUSe4DCMYQ9yrja7_L2Is_GhxfjvEibqHTNzLA1sT9_M9JP3-1bTUvwY_1X4D8XpTopvvdEBWU-dQ Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bb6fbf36e924067b4c98bd14a30ff3f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}] Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 1e7f1e9746ee441a9c8d7bf64e22fb35 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: exception: Insufficient rights for removing default security group. Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-02316669-995a-4b7b-914f-ceb93fcc9f5f'] Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'afea25a2-a45e-4c45-b70b-830d1719f25d'} Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:39:23.940293 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02316669-995a-4b7b-914f-ceb93fcc9f5f'] Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02316669-995a-4b7b-914f-ceb93fcc9f5f'] Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02316669-995a-4b7b-914f-ceb93fcc9f5f'] Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02316669-995a-4b7b-914f-ceb93fcc9f5f'] Aug 29 15:39:23.944781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.950491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df68fbdc-cfea-4088-ba3a-18579ff871dc tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 29 15:39:23.950491 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-02316669-995a-4b7b-914f-ceb93fcc9f5f'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:23.951850 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df68fbdc-cfea-4088-ba3a-18579ff871dc tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/afea25a2-a45e-4c45-b70b-830d1719f25d" status: 400 len: 182 microversion: 2.1 time: 0.641646 Aug 29 15:39:23.952961 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1499/3113] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:39:23 2022] DELETE /compute/v2.1/os-security-groups/afea25a2-a45e-4c45-b70b-830d1719f25d => generated 182 bytes in 643 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:23.961951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.962829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.979520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.986224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.986971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.987897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.988528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.989162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.140555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.155742 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5aca1fad-d2c3-4c39-bc3b-a6480f83d662 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1272 microversion: 2.1 time: 0.201399 Aug 29 15:39:24.159991 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1500/3114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.167031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.172447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.186556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.190911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.191579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.192800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.193428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.199976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.352100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.362641 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-845fb2d0-2caa-4c88-906c-2ba896e6073a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.732279 Aug 29 15:39:24.365370 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1615/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.375769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23177de7-1dd5-42f1-8170-bbbe8314e1d3 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Calling method '.version_select at 0x7fb0e356c040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.484677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-23177de7-1dd5-42f1-8170-bbbe8314e1d3 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:39:24.488360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-23177de7-1dd5-42f1-8170-bbbe8314e1d3 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Neutron security group be40dfe6-9560-4c95-8934-1cff90cc1aac not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:39:24.489106 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-23177de7-1dd5-42f1-8170-bbbe8314e1d3 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] HTTP exception thrown: Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist Aug 29 15:39:24.489106 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-4123f11a-25d4-4b7b-a82d-513274e972b4'] Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23177de7-1dd5-42f1-8170-bbbe8314e1d3 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Request method failure captured: Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/os-security-groups/be40dfe6-9560-4c95-8934-1cff90cc1aac HTTP/1.1 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN2mnGzUKS33cOVxgl7LMMx93wfLUHCzaUCYrZad4GJMa_wXOREEclquiV1LbVStwSGF2CaI88ho7ad6cRfFoNhylg-zGT6rZtNUSe4DCMYQ9yrja7_L2Is_GhxfjvEibqHTNzLA1sT9_M9JP3-1bTUvwY_1X4D8XpTopvvdEBWU-dQ Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bb6fbf36e924067b4c98bd14a30ff3f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}] Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 1e7f1e9746ee441a9c8d7bf64e22fb35 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-4123f11a-25d4-4b7b-a82d-513274e972b4'] Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'be40dfe6-9560-4c95-8934-1cff90cc1aac'} Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:39:24.491262 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4123f11a-25d4-4b7b-a82d-513274e972b4'] Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4123f11a-25d4-4b7b-a82d-513274e972b4'] Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4123f11a-25d4-4b7b-a82d-513274e972b4'] Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4123f11a-25d4-4b7b-a82d-513274e972b4'] Aug 29 15:39:24.495797 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.498648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23177de7-1dd5-42f1-8170-bbbe8314e1d3 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Returning 404 to user: Security group be40dfe6-9560-4c95-8934-1cff90cc1aac does not exist Aug 29 15:39:24.498648 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-4123f11a-25d4-4b7b-a82d-513274e972b4'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:24.505068 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23177de7-1dd5-42f1-8170-bbbe8314e1d3 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/be40dfe6-9560-4c95-8934-1cff90cc1aac" status: 404 len: 194 microversion: 2.1 time: 0.132981 Aug 29 15:39:24.505068 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1616/3116] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/os-security-groups/be40dfe6-9560-4c95-8934-1cff90cc1aac => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:24.514015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.514947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.515674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.525193 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-587511b1-3ba2-4a2d-a943-7821549300a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.364029 Aug 29 15:39:24.529829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.531436 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1501/3117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.532080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.532708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.534134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.537501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.538254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.549325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.550190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.557703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.558257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.558698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.559597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.560742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.561338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.850287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.860476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ccb5e12-7460-4a0a-a8c4-190cfa75d65a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.327405 Aug 29 15:39:24.862564 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1502/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.868065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbc5667b-e168-4b28-90ee-c7bfd3706a74 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Action: 'update', calling method: .version_select at 0x7fb0e2730c10>, body: {"security_group": {"name": "tempest-sg-1263976629", "description": "tempest-description-222118629"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:25.007045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-cbc5667b-e168-4b28-90ee-c7bfd3706a74 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:39:25.008479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.security_group_api [None req-cbc5667b-e168-4b28-90ee-c7bfd3706a74 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Neutron security group ee6940cb-9555-4b85-b311-6ec47c34e732 not found {{(pid=130001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:39:25.009371 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cbc5667b-e168-4b28-90ee-c7bfd3706a74 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] HTTP exception thrown: Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist Aug 29 15:39:25.009371 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-0487091b-1cf9-40f0-8080-ef6d6136c9a6'] Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbc5667b-e168-4b28-90ee-c7bfd3706a74 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Request method failure captured: Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/os-security-groups/ee6940cb-9555-4b85-b311-6ec47c34e732 HTTP/1.1 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 101 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN2mnGzUKS33cOVxgl7LMMx93wfLUHCzaUCYrZad4GJMa_wXOREEclquiV1LbVStwSGF2CaI88ho7ad6cRfFoNhylg-zGT6rZtNUSe4DCMYQ9yrja7_L2Is_GhxfjvEibqHTNzLA1sT9_M9JP3-1bTUvwY_1X4D8XpTopvvdEBWU-dQ Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bb6fbf36e924067b4c98bd14a30ff3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bb6fbf36e924067b4c98bd14a30ff3f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bb6fbf36e924067b4c98bd14a30ff3f"}]}] Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 3bb6fbf36e924067b4c98bd14a30ff3f Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 1e7f1e9746ee441a9c8d7bf64e22fb35 Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1291444936-project Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: {"security_group": {"name": "tempest-sg-1263976629", "description": "tempest-description-222118629"}} Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: exception: Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-0487091b-1cf9-40f0-8080-ef6d6136c9a6'] Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ee6940cb-9555-4b85-b311-6ec47c34e732', 'body': {'security_group': {'name': 'tempest-sg-1263976629', 'description': 'tempest-description-222118629'}}} Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:39:25.011668 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0487091b-1cf9-40f0-8080-ef6d6136c9a6'] Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0487091b-1cf9-40f0-8080-ef6d6136c9a6'] Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0487091b-1cf9-40f0-8080-ef6d6136c9a6'] Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0487091b-1cf9-40f0-8080-ef6d6136c9a6'] Aug 29 15:39:25.016158 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.020645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbc5667b-e168-4b28-90ee-c7bfd3706a74 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] Returning 404 to user: Security group ee6940cb-9555-4b85-b311-6ec47c34e732 does not exist Aug 29 15:39:25.020645 n-d-854882-3 devstack@n-api.service[130001]: Neutron server returns request_ids: ['req-0487091b-1cf9-40f0-8080-ef6d6136c9a6'] {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:25.021773 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cbc5667b-e168-4b28-90ee-c7bfd3706a74 tempest-SecurityGroupsNegativeTestJSON-1291444936 tempest-SecurityGroupsNegativeTestJSON-1291444936-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/ee6940cb-9555-4b85-b311-6ec47c34e732" status: 404 len: 194 microversion: 2.1 time: 0.158030 Aug 29 15:39:25.029057 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1503/3119] 10.222.0.16 () {60 vars in 1290 bytes} [Mon Aug 29 15:39:24 2022] PUT /compute/v2.1/os-security-groups/ee6940cb-9555-4b85-b311-6ec47c34e732 => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:25.033891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5f3a74d0-6dc1-44af-90cd-1ec5ad585fff tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2720790>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.126027 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5f3a74d0-6dc1-44af-90cd-1ec5ad585fff tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.093332 Aug 29 15:39:25.136660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1504/3120] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.148079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:25.161281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.170252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.174012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.198839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.199814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.200456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.202112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.222168 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88/action HTTP/1.1 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 65 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '8077b5b3-4ef9-4217-bf33-87769843fb88', 'body': {'rebuild': {'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab'}}} Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:39:25.224111 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:39:25.228868 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.230823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:25.232201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8da65c62-6f37-4cac-8f24-e6d231474cea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88/action" status: 404 len: 111 microversion: 2.1 time: 0.094308 Aug 29 15:39:25.242557 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1505/3121] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:25 2022] POST /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:25.258086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.259718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.275916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.282349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.283286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.285843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.289087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.290041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.293929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.311208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.317162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.318604 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5528ee8f-0cbe-4044-911b-3be5b2d27ac0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2940 microversion: 2.42 time: 0.817466 Aug 29 15:39:25.321041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1617/3122] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2940 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:25.331321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.332188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.348913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.350570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.351636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.354761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.355897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.357975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.382494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:25.523509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.546830 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-72032551-8ccd-473b-9dc3-2a00efc8f16f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1272 microversion: 2.1 time: 0.302635 Aug 29 15:39:25.559821 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1506/3123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.559821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.559821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.573274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.573803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.574242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.575741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.576208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.576637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.898786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.916457 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc1fd684-209c-456f-94b6-1844c487177c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.592868 Aug 29 15:39:25.926825 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1618/3124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.943527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.944418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.963413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.964213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.964812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.965728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.966358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.968981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.450605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.480921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.486937 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5dff6302-bb76-48ea-a6fa-f2e4e895a502 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.937625 Aug 29 15:39:26.488182 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1507/3125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.495833 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-46c5a25f-9b66-4c33-b9d5-0da2696f8c3f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.556595 Aug 29 15:39:26.505997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7d8eb871-f52e-4348-8403-b7e968408507 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e28ba670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.522289 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1619/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.548339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.556149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.574141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.578126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.580370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.582634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.588112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.588582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.612599 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7d8eb871-f52e-4348-8403-b7e968408507 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.118643 Aug 29 15:39:26.613267 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1508/3127] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.630187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f318081a-ecd4-4bc4-9dc5-fb7574ff1e5c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:26.643137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f318081a-ecd4-4bc4-9dc5-fb7574ff1e5c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: c8bbef52-c012-450b-a0d9-1b1faec9e232] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.655560 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f318081a-ecd4-4bc4-9dc5-fb7574ff1e5c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance c8bbef52-c012-450b-a0d9-1b1faec9e232 could not be found. Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f318081a-ecd4-4bc4-9dc5-fb7574ff1e5c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/c8bbef52-c012-450b-a0d9-1b1faec9e232/action HTTP/1.1 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 65 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance c8bbef52-c012-450b-a0d9-1b1faec9e232 could not be found. Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'c8bbef52-c012-450b-a0d9-1b1faec9e232', 'body': {'rebuild': {'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab'}}} Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8bbef52-c012-450b-a0d9-1b1faec9e232 could not be found. Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:39:26.665704 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8bbef52-c012-450b-a0d9-1b1faec9e232 could not be found. Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8bbef52-c012-450b-a0d9-1b1faec9e232 could not be found. Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f318081a-ecd4-4bc4-9dc5-fb7574ff1e5c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance c8bbef52-c012-450b-a0d9-1b1faec9e232 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f318081a-ecd4-4bc4-9dc5-fb7574ff1e5c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/c8bbef52-c012-450b-a0d9-1b1faec9e232/action" status: 404 len: 111 microversion: 2.1 time: 0.054482 Aug 29 15:39:26.676019 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1509/3128] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:26 2022] POST /compute/v2.1/servers/c8bbef52-c012-450b-a0d9-1b1faec9e232/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:26.680447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.681076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.703469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.703961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.708454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.709232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.713983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.714418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.881849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.891869 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c4a30ec-ed5a-4ad7-b9cf-b30347f66885 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1272 microversion: 2.1 time: 0.220946 Aug 29 15:39:26.909223 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1510/3129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.921565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.922077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.938495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.938990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.939429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.940533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.941031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.941507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.205367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.214198 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0075b31e-4516-4eb5-9520-31ba1c50ddd2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.302531 Aug 29 15:39:27.215494 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1511/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:27.241091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.245938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:27.271630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.274059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.274720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.278532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.279517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.280204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.426880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.434833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.436383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.438418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2151accd-a036-4bb9-9f89-b4ca3fb543b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2940 microversion: 2.42 time: 0.914575 Aug 29 15:39:27.453425 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1620/3131] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2940 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:27.453425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-83a5f58c-c064-4ea9-bcc8-7592219d0ee1 req-1f4374a7-9f55-409a-a884-29d0dd2e27bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-unplugged", "status": "completed", "tag": "d0f1fece-2d8a-470c-beed-2ff768e1d636"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:27.475624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-83a5f58c-c064-4ea9-bcc8-7592219d0ee1 req-1f4374a7-9f55-409a-a884-29d0dd2e27bc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.476216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-83a5f58c-c064-4ea9-bcc8-7592219d0ee1 req-1f4374a7-9f55-409a-a884-29d0dd2e27bc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.477176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-83a5f58c-c064-4ea9-bcc8-7592219d0ee1 req-1f4374a7-9f55-409a-a884-29d0dd2e27bc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.567196 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-83a5f58c-c064-4ea9-bcc8-7592219d0ee1 req-1f4374a7-9f55-409a-a884-29d0dd2e27bc service nova] Creating event network-vif-unplugged:d0f1fece-2d8a-470c-beed-2ff768e1d636 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:27.581580 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-83a5f58c-c064-4ea9-bcc8-7592219d0ee1 req-1f4374a7-9f55-409a-a884-29d0dd2e27bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138405 Aug 29 15:39:27.582212 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1621/3132] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:27.597294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.598274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:27.616873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.617931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.619721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.621334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.622998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.625007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.783728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.795658 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e5a759d8-77a4-4009-8c0b-ddf383e642e6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.560770 Aug 29 15:39:27.800745 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1512/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:27.823727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ec1eab9-b249-43b3-a53a-aa4500271946 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e26cb670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.926228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ec1eab9-b249-43b3-a53a-aa4500271946 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1414 microversion: 2.1 time: 0.124368 Aug 29 15:39:27.927927 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1513/3134] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:27.946605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aeab2ece-33e0-4e20-b975-2cbb96e1d03b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:27.947200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aeab2ece-33e0-4e20-b975-2cbb96e1d03b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: f8e0af06-7ad6-4581-8de0-265e30727910] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:27.966214 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-aeab2ece-33e0-4e20-b975-2cbb96e1d03b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance f8e0af06-7ad6-4581-8de0-265e30727910 could not be found. Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aeab2ece-33e0-4e20-b975-2cbb96e1d03b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/f8e0af06-7ad6-4581-8de0-265e30727910/action HTTP/1.1 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 15 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: {"restore": {}} Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance f8e0af06-7ad6-4581-8de0-265e30727910 could not be found. Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'f8e0af06-7ad6-4581-8de0-265e30727910', 'body': {'restore': {}}} Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e0af06-7ad6-4581-8de0-265e30727910 could not be found. Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e0af06-7ad6-4581-8de0-265e30727910 could not be found. Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:27.967976 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:27.977134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:27.977134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:27.977134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e0af06-7ad6-4581-8de0-265e30727910 could not be found. Aug 29 15:39:27.977134 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:27.977134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aeab2ece-33e0-4e20-b975-2cbb96e1d03b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance f8e0af06-7ad6-4581-8de0-265e30727910 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:27.977134 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aeab2ece-33e0-4e20-b975-2cbb96e1d03b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/f8e0af06-7ad6-4581-8de0-265e30727910/action" status: 404 len: 111 microversion: 2.1 time: 0.040340 Aug 29 15:39:27.977134 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1514/3135] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:27 2022] POST /compute/v2.1/servers/f8e0af06-7ad6-4581-8de0-265e30727910/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:27.986974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.992666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.010299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.010779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.011385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.012227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.016349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.017008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.713890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:28.734161 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0317abf8-cb5d-428b-920c-99efed9d4332 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 0.753923 Aug 29 15:39:28.735000 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1515/3136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:28.749452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:28.756815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.775046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:28.778106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.778727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.780882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.783535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.788194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.788848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.792476 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8adeab87-d995-425a-8b03-aaf1c45a5bf7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 1.207558 Aug 29 15:39:28.800366 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1622/3137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:28.807142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:28.812550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.825109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.832769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.834073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.835044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.836159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.836759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.541231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.554395 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5bc97b0-ff1f-4037-b2fd-d6de3ffb9397 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.817546 Aug 29 15:39:29.572965 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1516/3138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:28 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:29.581155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc82157a-e8bd-41a3-a487-d564efae6534 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e26cbd30>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:29.639602 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dc82157a-e8bd-41a3-a487-d564efae6534 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1423 microversion: 2.1 time: 0.065135 Aug 29 15:39:29.648955 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1517/3139] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:29 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1423 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:29.650535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:29.651872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:29.675543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.680085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.680550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.681291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.682928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.683370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.829869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.848535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.852306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.865900 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c0e107ab-4dae-4b9a-b4bf-88e35b5f9b9f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2919 microversion: 2.42 time: 1.051879 Aug 29 15:39:29.871926 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1623/3140] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:28 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2919 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:29.880292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-unplugged", "status": "completed", "tag": "09a9e65a-b239-4c6f-9543-78a3c4be399a"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-unplugged", "status": "completed", "tag": "57038e85-109c-491a-b297-19b2ca678e6c"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-unplugged", "status": "completed", "tag": "c803e1ce-a2da-489e-8ede-123c5aefbdb5"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-unplugged", "status": "completed", "tag": "a0716183-eb1a-4c5d-8847-69ba90609326"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:29.896157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:29.898164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.898657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.899096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.924289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Creating event network-vif-unplugged:09a9e65a-b239-4c6f-9543-78a3c4be399a for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:29.925250 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Creating event network-vif-unplugged:57038e85-109c-491a-b297-19b2ca678e6c for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:29.926094 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Creating event network-vif-unplugged:c803e1ce-a2da-489e-8ede-123c5aefbdb5 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:29.926844 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] Creating event network-vif-unplugged:a0716183-eb1a-4c5d-8847-69ba90609326 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:29.938018 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9fb60e00-aa70-4995-8325-95e8feb0b92f req-f12ded36-a667-490d-a7af-5a53230d4663 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.064057 Aug 29 15:39:29.939500 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1624/3141] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:29.962216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48713dac-db6f-415b-98e5-28072e8edd9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0eb5d2ca0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.063968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.067720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-48713dac-db6f-415b-98e5-28072e8edd9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 200 len: 1423 microversion: 2.1 time: 0.125703 Aug 29 15:39:30.069234 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1625/3142] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:29 2022] GET /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 1423 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.076360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.077179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.084414 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d894b8be-40d2-4884-9ac5-0c07f700ba72 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.442779 Aug 29 15:39:30.085771 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1518/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:29 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.086779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.087467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.088092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.089193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.089912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.090495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.093211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.107795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.131760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.132524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.137381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.138806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.139204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.139941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.189129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-17e7103b-6f6c-40ee-ab1f-36a440b9e73a tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101839 Aug 29 15:39:30.195586 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1519/3144] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:30 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:30.198025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.198738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.206726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.207752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.208250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.214174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.216018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.217570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.496403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.499197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:30.512988 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eebdfe1a-0867-4d9c-97f7-375ee723227a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.320354 Aug 29 15:39:30.515711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1520/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:30 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.526388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c32e9b6d-d365-4109-9585-2a6f306e2a80 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e26cb8b0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.881935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.909630 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d8ac1e7-f5d2-4eea-9524-3fc0ac57b02b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 0.835951 Aug 29 15:39:30.914147 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1626/3146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:30 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.930178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:30.930789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.943802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.945980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.946432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.947158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.947616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.948047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.005365 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Cannot 'restore' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action HTTP/1.1 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 15 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: {"restore": {}} Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'restore' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'restore': {}}} Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 in vm_state active. Cannot restore while the instance is in this state. Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.008057 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:31.012845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:31.012845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:31.012845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:31.012845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:31.012845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.014380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 409 to user: Cannot 'restore' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:31.015866 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab7131d0-4d63-4a9f-8d8b-950b2602694b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 409 len: 145 microversion: 2.1 time: 0.100328 Aug 29 15:39:31.018844 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1627/3147] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:30 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 145 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:31.025470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.026752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.046320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.047114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.047615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.048534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.049033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.049488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.275728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lazy-loading 'services' on Instance uuid 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:31.381271 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c32e9b6d-d365-4109-9585-2a6f306e2a80 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 204 len: 0 microversion: 2.1 time: 0.864223 Aug 29 15:39:31.386880 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1521/3148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:30 2022] DELETE /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:31.411107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d1fde9a1-800d-494f-8159-15cd93837532 req-9c68ad7a-6329-433a-87ad-b2edf960caa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-deleted", "tag": "d0f1fece-2d8a-470c-beed-2ff768e1d636"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:31.437948 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9a3f25a-807e-4770-8719-ffd8cb13effa tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments/6c24cfd6-a582-4704-b9e2-6f56732984c3" status: 202 len: 0 microversion: 2.1 time: 0.417507 Aug 29 15:39:31.438833 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1628/3149] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:39:31 2022] DELETE /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments/6c24cfd6-a582-4704-b9e2-6f56732984c3 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:31.465757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.466473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.479527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:31.491057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d1fde9a1-800d-494f-8159-15cd93837532 req-9c68ad7a-6329-433a-87ad-b2edf960caa9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.497013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.499012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.499195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d1fde9a1-800d-494f-8159-15cd93837532 req-9c68ad7a-6329-433a-87ad-b2edf960caa9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.499762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d1fde9a1-800d-494f-8159-15cd93837532 req-9c68ad7a-6329-433a-87ad-b2edf960caa9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.500734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.501672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.503096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.504160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:31.504796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.544481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d1fde9a1-800d-494f-8159-15cd93837532 req-9c68ad7a-6329-433a-87ad-b2edf960caa9 service nova] Creating event network-vif-deleted:d0f1fece-2d8a-470c-beed-2ff768e1d636 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:31.552250 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d1fde9a1-800d-494f-8159-15cd93837532 req-9c68ad7a-6329-433a-87ad-b2edf960caa9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162749 Aug 29 15:39:31.554396 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1522/3150] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:31.594747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.598707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.626348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.627294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.627906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.628816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.629917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.630523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.829225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:31.837576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5cf715fd-0696-4672-90a4-cf3539b481d4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.281593 Aug 29 15:39:31.850337 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1523/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:31 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:31.864287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.865143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.873728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.874598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.875087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.875856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.876303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.876842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.903922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:31.994291 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-11ced5ff-b7bb-4dcd-a1f3-dab4299ff07e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 204 len: 0 microversion: 2.1 time: 0.134465 Aug 29 15:39:31.999870 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1524/3152] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:31 2022] DELETE /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:32.006488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.007518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.014364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.015843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.016532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.017586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.018458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.019098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.084736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.114657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.116240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.121431 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e561b35-ddef-4da0-8047-938fb3643591 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2872 microversion: 2.42 time: 0.677366 Aug 29 15:39:32.126112 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1629/3153] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:31 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2872 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:32.134215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.134717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.140962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.141959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.142407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.143140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.143597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.144026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.206446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.217433 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07fff896-1782-4996-839a-53cae42170d9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.215667 Aug 29 15:39:32.218080 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1525/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:31 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:32.327077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87f024b4-8eb0-4c73-a3a6-539062b1a679 tempest-FloatingIPDetailsNegativeTestJSON-1875179547 tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project] Calling method '.version_select at 0x7fb0e26e9670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.375696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG neutronclient.v2_0.client [None req-87f024b4-8eb0-4c73-a3a6-539062b1a679 tempest-FloatingIPDetailsNegativeTestJSON-1875179547 tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 678a3fcd-fad6-43dc-b360-4bd4da355365 could not be found", "detail": ""}} {{(pid=130001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:39:32.376402 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-87f024b4-8eb0-4c73-a3a6-539062b1a679 tempest-FloatingIPDetailsNegativeTestJSON-1875179547 tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project] HTTP exception thrown: Floating IP not found for ID 678a3fcd-fad6-43dc-b360-4bd4da355365 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87f024b4-8eb0-4c73-a3a6-539062b1a679 tempest-FloatingIPDetailsNegativeTestJSON-1875179547 tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project] Request method failure captured: Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-floating-ips/678a3fcd-fad6-43dc-b360-4bd4da355365 HTTP/1.1 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN2z0vCkVgzPKUJXE-H0XJtvf8Dw3kRZGQjxFWHlN-flzxIpyih39Fvplvf1r-uAtR1mGkWHN3W956MUnyuuVUWORq1d_Fw8gefnNaaC_B1hbW1Sy4iGGRFZC56qaZ8YVPATdvLeFK5B9HZ8wk-91xskAekWRTRKwIaPot9rq5wtah4 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: b334df134f284700bf2e2ce6e639138d Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1875179547 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b334df134f284700bf2e2ce6e639138d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b334df134f284700bf2e2ce6e639138d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b334df134f284700bf2e2ce6e639138d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b334df134f284700bf2e2ce6e639138d"}]}] Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1875179547 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: b334df134f284700bf2e2ce6e639138d Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1875179547 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a7e987f3fba14c4e8b588bae82e5a728 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: exception: Floating IP not found for ID 678a3fcd-fad6-43dc-b360-4bd4da355365 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '678a3fcd-fad6-43dc-b360-4bd4da355365'} Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:39:32.379437 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 678a3fcd-fad6-43dc-b360-4bd4da355365 could not be found Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f757acd8-24cc-4caf-88f2-a124c5bd0dca'] Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 678a3fcd-fad6-43dc-b360-4bd4da355365. Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 678a3fcd-fad6-43dc-b360-4bd4da355365 Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 678a3fcd-fad6-43dc-b360-4bd4da355365 Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87f024b4-8eb0-4c73-a3a6-539062b1a679 tempest-FloatingIPDetailsNegativeTestJSON-1875179547 tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project] Returning 404 to user: Floating IP not found for ID 678a3fcd-fad6-43dc-b360-4bd4da355365 {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-87f024b4-8eb0-4c73-a3a6-539062b1a679 tempest-FloatingIPDetailsNegativeTestJSON-1875179547 tempest-FloatingIPDetailsNegativeTestJSON-1875179547-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/678a3fcd-fad6-43dc-b360-4bd4da355365" status: 404 len: 111 microversion: 2.1 time: 0.161411 Aug 29 15:39:32.384130 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1526/3155] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:39:32 2022] GET /compute/v2.1/os-floating-ips/678a3fcd-fad6-43dc-b360-4bd4da355365 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:32.389853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.390707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.400828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.402208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.402857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.403790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.404457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.405092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.698445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.710556 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f33574c2-2195-497b-9849-8f6eec1d650b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 0.327928 Aug 29 15:39:32.725459 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1527/3156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:32 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:32.730547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1840176960", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5c089729-15d8-41d3-a996-e24ac0861c49"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:32.816744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] validate_networks() for [('5c089729-15d8-41d3-a996-e24ac0861c49', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:32.969558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.978880 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa185bd1-d954-480d-8a1b-8614ecf87673 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.851448 Aug 29 15:39:32.979474 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1630/3157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:32 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:33.004341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-680f32e3-ab77-47de-a672-329939f95e34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:33.004901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-680f32e3-ab77-47de-a672-329939f95e34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6f4ca3fa-336d-43b2-939c-b50467401aaa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.021178 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-680f32e3-ab77-47de-a672-329939f95e34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 6f4ca3fa-336d-43b2-939c-b50467401aaa could not be found. Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-680f32e3-ab77-47de-a672-329939f95e34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/6f4ca3fa-336d-43b2-939c-b50467401aaa/action HTTP/1.1 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 14 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: {"resume": {}} Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 6f4ca3fa-336d-43b2-939c-b50467401aaa could not be found. Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6f4ca3fa-336d-43b2-939c-b50467401aaa', 'body': {'resume': {}}} Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4ca3fa-336d-43b2-939c-b50467401aaa could not be found. Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4ca3fa-336d-43b2-939c-b50467401aaa could not be found. Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:33.026196 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:33.030452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:33.030452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:33.030452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4ca3fa-336d-43b2-939c-b50467401aaa could not be found. Aug 29 15:39:33.030452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:33.032279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-680f32e3-ab77-47de-a672-329939f95e34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 6f4ca3fa-336d-43b2-939c-b50467401aaa could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:33.034052 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-680f32e3-ab77-47de-a672-329939f95e34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6f4ca3fa-336d-43b2-939c-b50467401aaa/action" status: 404 len: 111 microversion: 2.1 time: 0.033544 Aug 29 15:39:33.038402 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1631/3158] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:32 2022] POST /compute/v2.1/servers/6f4ca3fa-336d-43b2-939c-b50467401aaa/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:39:33.043773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.044971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.053677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.054447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.055376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.056476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.057180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.057860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.419704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.428845 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f6e1008-c02a-4664-a38f-fefd3be9fab5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.389067 Aug 29 15:39:33.449453 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1632/3159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:33.449453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.449453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.464771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.465332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.466995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.467863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.470681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.472245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.157068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.173020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.177663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.182271 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e10cba4-c181-4ca7-afe1-afbd5ec741b7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2758 microversion: 2.42 time: 0.744279 Aug 29 15:39:34.184119 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1633/3160] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2758 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:34.195591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.196455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.213705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.214535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.215145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.217056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.220469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.221148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.745667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:34.746627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:34.747266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:34.747861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:34.748432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:34.765791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.774461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.775425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.776398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.777012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.777657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.827222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:34.846602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for user c631f558d99f40feb637f376bac1cffa and project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:34.870001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:34.871726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:34.878532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:34.962502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.973447 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eea26988-f5d4-4701-aab5-84e2d9bb41d7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.786812 Aug 29 15:39:34.994780 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd75967f-5d67-4238-a6d6-8fa8968812a7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.268073 Aug 29 15:39:34.996225 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1528/3161] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:35.002200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.002940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.009569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1634/3162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.019232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.020066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.020846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.021884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.022504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.023088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.028102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-eee45229-5c9e-43d2-a1a4-0c1b668d3c56 req-a2f9f68b-22b0-4df3-a64c-5d06c06c3841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50951512-cad1-427e-a545-a0d3d1a290af", "tag": "a752e861-4c71-449e-98e9-bd3c83f8360b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:35.084999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eee45229-5c9e-43d2-a1a4-0c1b668d3c56 req-a2f9f68b-22b0-4df3-a64c-5d06c06c3841 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.086003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eee45229-5c9e-43d2-a1a4-0c1b668d3c56 req-a2f9f68b-22b0-4df3-a64c-5d06c06c3841 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.086003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eee45229-5c9e-43d2-a1a4-0c1b668d3c56 req-a2f9f68b-22b0-4df3-a64c-5d06c06c3841 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.133576 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-eee45229-5c9e-43d2-a1a4-0c1b668d3c56 req-a2f9f68b-22b0-4df3-a64c-5d06c06c3841 service nova] Creating event network-changed:a752e861-4c71-449e-98e9-bd3c83f8360b for instance 50951512-cad1-427e-a545-a0d3d1a290af on n-h1-854882-3 Aug 29 15:39:35.150351 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-eee45229-5c9e-43d2-a1a4-0c1b668d3c56 req-a2f9f68b-22b0-4df3-a64c-5d06c06c3841 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137940 Aug 29 15:39:35.153838 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1635/3163] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:35.165694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.167802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.197765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.198629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.199096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.201071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.201598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.202042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.535332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.550962 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee82bb1e-ed27-4a1b-b740-070f9d57ca96 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.553353 Aug 29 15:39:35.554601 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1529/3164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.572865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7e52ce80-d5ef-4782-9491-6d90714bd174 req-05418ac9-6d56-4bad-ab10-bb60e47454e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b0012d-740e-40db-b4d0-fac933f03ea1", "name": "network-vif-unplugged", "status": "completed", "tag": "16687ef7-18a5-46c1-a861-d806bae5f0ba"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:35.588679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7e52ce80-d5ef-4782-9491-6d90714bd174 req-05418ac9-6d56-4bad-ab10-bb60e47454e5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.589374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7e52ce80-d5ef-4782-9491-6d90714bd174 req-05418ac9-6d56-4bad-ab10-bb60e47454e5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.590455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7e52ce80-d5ef-4782-9491-6d90714bd174 req-05418ac9-6d56-4bad-ab10-bb60e47454e5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.627073 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7e52ce80-d5ef-4782-9491-6d90714bd174 req-05418ac9-6d56-4bad-ab10-bb60e47454e5 service nova] Creating event network-vif-unplugged:16687ef7-18a5-46c1-a861-d806bae5f0ba for instance 21b0012d-740e-40db-b4d0-fac933f03ea1 on n-h2-854882-3 Aug 29 15:39:35.633896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7e52ce80-d5ef-4782-9491-6d90714bd174 req-05418ac9-6d56-4bad-ab10-bb60e47454e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078004 Aug 29 15:39:35.635382 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1530/3165] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:35.650924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1e93670b-1e5a-4d96-973b-b3b2161c0126 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.652033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1e93670b-1e5a-4d96-973b-b3b2161c0126 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.800924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e93670b-1e5a-4d96-973b-b3b2161c0126 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.815930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1e93670b-1e5a-4d96-973b-b3b2161c0126 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1208 microversion: 2.1 time: 0.178040 Aug 29 15:39:35.834428 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1531/3166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.848040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.851926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.867927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.868718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.870050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.873457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.874164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.876123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.091716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.112986 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b5dd5b0-1e6b-4ce4-92cb-14f74fe2b583 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 0.946681 Aug 29 15:39:36.114088 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1636/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:36.141072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:36.143826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.159776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.161363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.162295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.163284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.164253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.165156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.241264 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Cannot 'resume' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action HTTP/1.1 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 14 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: {"resume": {}} Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'resume' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'resume': {}}} Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 in vm_state active. Cannot resume while the instance is in this state. Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:36.246412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:36.252991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:36.252991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:36.252991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:36.252991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:36.252991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:36.252991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:39:36.252991 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:36.262478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 409 to user: Cannot 'resume' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:36.266736 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0ecc63f-e52e-427a-a259-d4ab8fc43088 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 409 len: 144 microversion: 2.1 time: 0.148381 Aug 29 15:39:36.274706 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1637/3168] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:36 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 144 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:36.284405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-61a64198-5d6b-4cbb-b117-ac2e42b0c8ad req-ac666363-28dd-4699-b511-2df75e8dfe40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b0012d-740e-40db-b4d0-fac933f03ea1", "name": "network-vif-deleted", "tag": "16687ef7-18a5-46c1-a861-d806bae5f0ba"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:36.324322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-61a64198-5d6b-4cbb-b117-ac2e42b0c8ad req-ac666363-28dd-4699-b511-2df75e8dfe40 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.324806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-61a64198-5d6b-4cbb-b117-ac2e42b0c8ad req-ac666363-28dd-4699-b511-2df75e8dfe40 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.325240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-61a64198-5d6b-4cbb-b117-ac2e42b0c8ad req-ac666363-28dd-4699-b511-2df75e8dfe40 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.368471 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-61a64198-5d6b-4cbb-b117-ac2e42b0c8ad req-ac666363-28dd-4699-b511-2df75e8dfe40 service nova] Creating event network-vif-deleted:16687ef7-18a5-46c1-a861-d806bae5f0ba for instance 21b0012d-740e-40db-b4d0-fac933f03ea1 on n-h2-854882-3 Aug 29 15:39:36.386166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-61a64198-5d6b-4cbb-b117-ac2e42b0c8ad req-ac666363-28dd-4699-b511-2df75e8dfe40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109460 Aug 29 15:39:36.387496 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1638/3169] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:36.394510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.395591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.406861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.407711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.408401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.409481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.410244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.410833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.443043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:36.475263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.485933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.491749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.499638 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ea41d42a-a996-486a-a0ef-a2abd7231c12 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2711 microversion: 2.42 time: 0.662954 Aug 29 15:39:36.500889 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1532/3170] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2711 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:36.511599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.519387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.530438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.531231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.534452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.535434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.539923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.543361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.020184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.031499 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d63a3c2e-3c3a-401c-9cce-2709cd475d7f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.529311 Aug 29 15:39:37.035823 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1533/3171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.057134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.060485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.073814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.075927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.076591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.079820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.084652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.085169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.233165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.241482 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6e5350c6-ffec-46aa-a932-c022cd4a8d00 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1260 microversion: 2.1 time: 0.204064 Aug 29 15:39:37.242085 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1534/3172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.249764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.258343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.269123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.270842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.273509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.274136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.276213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.278239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.280797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.286148 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-68fe888f-e55c-4854-89a2-d7b1142882bb tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1722 microversion: 2.1 time: 0.896704 Aug 29 15:39:37.290751 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1639/3173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1722 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.299454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.310986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.318539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.319532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.320807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.321788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.323237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.323705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.063112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.100692 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7d85ce03-86ea-42be-b208-3e5c4114626d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.854519 Aug 29 15:39:38.106061 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1535/3174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.132602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c140d6bf-71d6-4da4-bfc7-0facfdd6f1f9 req-9e8b0247-94ef-45e2-a3b9-12482b81e676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-deleted", "tag": "09a9e65a-b239-4c6f-9543-78a3c4be399a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:38.152103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c140d6bf-71d6-4da4-bfc7-0facfdd6f1f9 req-9e8b0247-94ef-45e2-a3b9-12482b81e676 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.152842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c140d6bf-71d6-4da4-bfc7-0facfdd6f1f9 req-9e8b0247-94ef-45e2-a3b9-12482b81e676 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.153454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c140d6bf-71d6-4da4-bfc7-0facfdd6f1f9 req-9e8b0247-94ef-45e2-a3b9-12482b81e676 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.170538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c140d6bf-71d6-4da4-bfc7-0facfdd6f1f9 req-9e8b0247-94ef-45e2-a3b9-12482b81e676 service nova] Creating event network-vif-deleted:09a9e65a-b239-4c6f-9543-78a3c4be399a for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:38.178137 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c140d6bf-71d6-4da4-bfc7-0facfdd6f1f9 req-9e8b0247-94ef-45e2-a3b9-12482b81e676 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066429 Aug 29 15:39:38.194800 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1536/3175] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:38.215482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.220059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.239823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.241017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.241486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.242216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.242669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.247335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.336657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.369080 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d515d22-fdaa-4c04-ac7c-36d5dd10c887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 1.073388 Aug 29 15:39:38.383008 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1640/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.396215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.397464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.418353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.420103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.421647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.425071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.425736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.426613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.681841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.693931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.698334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.699750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8f59caaa-a441-4a13-9f96-a1917f66c2be tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2420 microversion: 2.42 time: 0.503466 Aug 29 15:39:38.700323 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1537/3177] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2420 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:38.717158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.718072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.731518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.733876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.739334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.741260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.743630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.745505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.051953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:39.062959 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b454e0ba-81db-41e8-9264-aca94913b227 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1266 microversion: 2.1 time: 0.678550 Aug 29 15:39:39.064045 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1641/3178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1266 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:39.150504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bba56f55-a735-4c1b-b45a-3e8ba2fa5911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bba56f55-a735-4c1b-b45a-3e8ba2fa5911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 160 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8415dbd5-2216-4578-8fcf-1228fea111ac"}]}} Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': '', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'networks': [{'uuid': '8415dbd5-2216-4578-8fcf-1228fea111ac'}]}}} Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi '' Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:39:39.162978 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:39:39.167900 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:39.175743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bba56f55-a735-4c1b-b45a-3e8ba2fa5911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:39.179043 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bba56f55-a735-4c1b-b45a-3e8ba2fa5911 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.071420 Aug 29 15:39:39.183310 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1642/3179] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:39 2022] POST /compute/v2.1/servers => generated 108 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:39.193099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:39.194515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:39.204599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.209989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.210768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.211798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.214008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.215052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.359669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:39.371412 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf4171d4-93f4-4f1b-a54f-ecf6d92a609b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1699 microversion: 2.1 time: 0.665775 Aug 29 15:39:39.372004 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1538/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1699 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:39.398472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:39.399761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:39.417217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.419143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.420303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.422271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.426563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.430220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.984228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.002019 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-854b2871-8f69-402a-8717-224ab329dafd tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 0.609563 Aug 29 15:39:40.008489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1539/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:39 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:40.013381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8401a9f-1ea8-41c3-be26-173273b9ba00 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:40.021428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8401a9f-1ea8-41c3-be26-173273b9ba00 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.022521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8401a9f-1ea8-41c3-be26-173273b9ba00 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.023205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8401a9f-1ea8-41c3-be26-173273b9ba00 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.061415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8401a9f-1ea8-41c3-be26-173273b9ba00 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Going to try to start instance {{(pid=130001) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:39:40.096672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:40.129242 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8401a9f-1ea8-41c3-be26-173273b9ba00 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action" status: 202 len: 0 microversion: 2.1 time: 0.119416 Aug 29 15:39:40.131038 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1540/3182] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:40 2022] POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:40.138320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.139531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.151109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.151903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.155034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.156710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.170549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.185457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.197130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.199807 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-02fad5b2-7f90-420f-89ee-e1edbb465af8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.012892 Aug 29 15:39:40.201094 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1643/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:39 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.206175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.207446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.214835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.215662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.216345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.217578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.221046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.221868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.347833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.360415 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f9c7caed-2d51-4247-b7f7-ab06553fe45e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1266 microversion: 2.1 time: 0.157712 Aug 29 15:39:40.362415 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1644/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.367639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.368470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.375797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.376562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.377713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.378988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.379618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.380205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.648425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.658707 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60a3317e-7de8-41cc-9fdd-cdbbec971b66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1708 microversion: 2.1 time: 0.294583 Aug 29 15:39:40.660157 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1645/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1708 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.666955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.667592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.674948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.675759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.676320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.677162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.679221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.679660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.879073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.898538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.901729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.903856 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c666ecfb-09c3-4674-9b7a-9f47f5771608 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 2373 microversion: 2.42 time: 0.770735 Aug 29 15:39:40.905565 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1541/3186] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 2373 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:40.923455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e2ae5d92-3570-4f08-a6da-01de45004138 req-0ebedf73-c224-487c-9339-7081cf2f0196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-deleted", "tag": "57038e85-109c-491a-b297-19b2ca678e6c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:40.940504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.949964 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-172673a8-b2da-42a8-8ea1-35969a1b4665 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.287752 Aug 29 15:39:40.957084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e2ae5d92-3570-4f08-a6da-01de45004138 req-0ebedf73-c224-487c-9339-7081cf2f0196 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.960801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e2ae5d92-3570-4f08-a6da-01de45004138 req-0ebedf73-c224-487c-9339-7081cf2f0196 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.963037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e2ae5d92-3570-4f08-a6da-01de45004138 req-0ebedf73-c224-487c-9339-7081cf2f0196 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.969085 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1646/3187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.981663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-858c3c32-e8a0-4669-bdf9-2c72ff0dd150 req-a67a084d-9a4b-43a5-80e0-d5402eb7e7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50951512-cad1-427e-a545-a0d3d1a290af", "name": "network-vif-plugged", "status": "completed", "tag": "a752e861-4c71-449e-98e9-bd3c83f8360b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:40.999518 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e2ae5d92-3570-4f08-a6da-01de45004138 req-0ebedf73-c224-487c-9339-7081cf2f0196 service nova] Creating event network-vif-deleted:57038e85-109c-491a-b297-19b2ca678e6c for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:41.011862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-858c3c32-e8a0-4669-bdf9-2c72ff0dd150 req-a67a084d-9a4b-43a5-80e0-d5402eb7e7d2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.012365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-858c3c32-e8a0-4669-bdf9-2c72ff0dd150 req-a67a084d-9a4b-43a5-80e0-d5402eb7e7d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.014561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-858c3c32-e8a0-4669-bdf9-2c72ff0dd150 req-a67a084d-9a4b-43a5-80e0-d5402eb7e7d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.017238 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e2ae5d92-3570-4f08-a6da-01de45004138 req-0ebedf73-c224-487c-9339-7081cf2f0196 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110038 Aug 29 15:39:41.038437 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-858c3c32-e8a0-4669-bdf9-2c72ff0dd150 req-a67a084d-9a4b-43a5-80e0-d5402eb7e7d2 service nova] Creating event network-vif-plugged:a752e861-4c71-449e-98e9-bd3c83f8360b for instance 50951512-cad1-427e-a545-a0d3d1a290af on n-h1-854882-3 Aug 29 15:39:41.047202 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1542/3188] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:41.062470 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-858c3c32-e8a0-4669-bdf9-2c72ff0dd150 req-a67a084d-9a4b-43a5-80e0-d5402eb7e7d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091160 Aug 29 15:39:41.064000 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1647/3189] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:41.073643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.078185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de563453-9ce5-4045-9b6e-dfa10475bf5e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:41.078324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.080630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-de563453-9ce5-4045-9b6e-dfa10475bf5e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: c59885ea-1c45-45bf-9f4b-ebb964764eed] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.091689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-de563453-9ce5-4045-9b6e-dfa10475bf5e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance c59885ea-1c45-45bf-9f4b-ebb964764eed could not be found. Aug 29 15:39:41.095992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.096795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.097459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.098549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.099323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de563453-9ce5-4045-9b6e-dfa10475bf5e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/c59885ea-1c45-45bf-9f4b-ebb964764eed/action HTTP/1.1 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 14 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: {"shelve": {}} Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c59885ea-1c45-45bf-9f4b-ebb964764eed could not be found. Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c59885ea-1c45-45bf-9f4b-ebb964764eed', 'body': {'shelve': {}}} Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c59885ea-1c45-45bf-9f4b-ebb964764eed could not be found. Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c59885ea-1c45-45bf-9f4b-ebb964764eed could not be found. Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:41.100407 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:41.104682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:41.104682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:41.104682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c59885ea-1c45-45bf-9f4b-ebb964764eed could not be found. Aug 29 15:39:41.104682 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.104682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de563453-9ce5-4045-9b6e-dfa10475bf5e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance c59885ea-1c45-45bf-9f4b-ebb964764eed could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:41.106446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-de563453-9ce5-4045-9b6e-dfa10475bf5e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/c59885ea-1c45-45bf-9f4b-ebb964764eed/action" status: 404 len: 111 microversion: 2.1 time: 0.040371 Aug 29 15:39:41.106773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.108225 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1648/3190] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:41 2022] POST /compute/v2.1/servers/c59885ea-1c45-45bf-9f4b-ebb964764eed/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:41.124813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.130656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.155955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.156449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.156887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.157635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.158089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.159048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.173073 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f16c4041-5a4c-417e-ae85-43501182735b tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124494 Aug 29 15:39:41.181301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1543/3191] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:41.186766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.187687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.196257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.197027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.198399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.199358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.201122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.201831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.528752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.540151 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cac50601-ea81-4698-a973-a0d5fc096a05 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 0.425012 Aug 29 15:39:41.540820 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1649/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:41.546908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.549633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.556353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.557033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.563396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.563396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.563396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.563396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.599745 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5dbcc557-8da6-4b8f-9e4a-5429ae42ac68 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057543 Aug 29 15:39:41.606221 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1650/3193] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:41.612077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.612849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.620015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.620641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.621222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.622195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.622895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.623571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.798666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.807702 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-67c2e761-8826-47d4-8c97-2dbc09b84b97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.200174 Aug 29 15:39:41.808290 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1651/3194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:41.827493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.828071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.835913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.836399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.836835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.837566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.838197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.838625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.868166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:41.975415 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5f2434a-0592-449f-81ae-80cdf49588c3 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 204 len: 0 microversion: 2.1 time: 0.151640 Aug 29 15:39:41.978315 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1652/3195] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:41 2022] DELETE /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:41.993157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.995108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.003739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.004741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.005379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.006328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.006981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.007634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.224395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.230676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.250480 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b5d0c39-8029-4060-a9a6-9a2a862f1bca tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.067518 Aug 29 15:39:42.251969 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-323dab2f-9f7e-42f8-a707-b6ee323d1c18 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1708 microversion: 2.1 time: 0.266292 Aug 29 15:39:42.252803 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1544/3196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.254753 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1653/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1708 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.273763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.276053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.277600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.278792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.293827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.294560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.295503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.295871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.296451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.297934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.298306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.299291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.299811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.300321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.300880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.303616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.453901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.464364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.466127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.469861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.478114 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13e7985a-2868-42c4-bee7-4b15a0e0ba84 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1680 microversion: 2.1 time: 0.222105 Aug 29 15:39:42.479098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-530b575d-d276-478f-8336-decf0a4d7d07 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.224284 Aug 29 15:39:42.494942 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1654/3198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.494942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.494942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.499358 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1545/3199] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:42.510694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.511388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.511991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.512869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.513513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.514120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.560078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.560686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.567976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.568717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.569336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.570306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.570926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.571561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.722590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.732287 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0bb3f702-2eb1-4739-9e0d-2c1dc197ca08 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.244692 Aug 29 15:39:42.733303 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1655/3200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.753734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:42.754289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.760887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.761450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.761865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.762656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.763124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.763616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.808705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lazy-loading 'flavor' on Instance uuid 6fdb7873-a953-4b26-8ffb-139cb096faf1 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:42.830802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:42.980795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.992179 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1da35986-d35c-4420-aaff-d59792c16209 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1314 microversion: 2.1 time: 0.433660 Aug 29 15:39:42.993179 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1546/3201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:43.006518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.007467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.024162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.024162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.024162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.029434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.030515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.031069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.044003 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8858712-6056-4076-a458-04251c05727b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 202 len: 0 microversion: 2.1 time: 0.293774 Aug 29 15:39:43.045435 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1656/3202] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:42 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:43.072489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.073540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.102346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.103167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.103626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.109381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.110213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.112955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.407034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.421240 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aca49047-ddde-4702-9bfb-29397973548c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.368618 Aug 29 15:39:43.434745 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1657/3203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:43.440174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c4f90fdd-ee67-4326-9da8-07564e468799 req-fb870647-0480-407a-a6c8-d0c160ef6989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-deleted", "tag": "c803e1ce-a2da-489e-8ede-123c5aefbdb5"}, {"server_uuid": "2b8e9ddb-0f1d-42e8-8ee1-b96defe07784", "name": "network-vif-deleted", "tag": "a0716183-eb1a-4c5d-8847-69ba90609326"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:43.452031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4f90fdd-ee67-4326-9da8-07564e468799 req-fb870647-0480-407a-a6c8-d0c160ef6989 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.452529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4f90fdd-ee67-4326-9da8-07564e468799 req-fb870647-0480-407a-a6c8-d0c160ef6989 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.454882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4f90fdd-ee67-4326-9da8-07564e468799 req-fb870647-0480-407a-a6c8-d0c160ef6989 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.474166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c4f90fdd-ee67-4326-9da8-07564e468799 req-fb870647-0480-407a-a6c8-d0c160ef6989 service nova] Creating event network-vif-deleted:c803e1ce-a2da-489e-8ede-123c5aefbdb5 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:43.474805 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c4f90fdd-ee67-4326-9da8-07564e468799 req-fb870647-0480-407a-a6c8-d0c160ef6989 service nova] Creating event network-vif-deleted:a0716183-eb1a-4c5d-8847-69ba90609326 for instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 on n-h2-854882-3 Aug 29 15:39:43.491473 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c4f90fdd-ee67-4326-9da8-07564e468799 req-fb870647-0480-407a-a6c8-d0c160ef6989 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055316 Aug 29 15:39:43.492113 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1658/3204] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:43.521284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.522167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.533129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.533818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.534628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.541417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.541417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.541417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.642402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.651430 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9114106a-34d9-4647-bf15-2767b5badb28 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.654579 Aug 29 15:39:43.652251 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1547/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:43.657052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.659613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.677816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.678416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.678885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.680010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.680768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.681622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.814177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.824162 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc2a78ca-d9fd-4cd0-b8d0-84f238c5af4b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1708 microversion: 2.1 time: 0.319698 Aug 29 15:39:43.824919 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1659/3206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1708 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:43.841428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.842340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.853834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.854697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.855372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.857500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.858359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.859344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.877628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.903082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.904998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.906872 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8f97ae39-9879-4fc7-b5e7-4439a0850c17 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.253448 Aug 29 15:39:43.907806 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1548/3207] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:44.019597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.021173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.031927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.033120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.033988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.035103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.036143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.036911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.211200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:44.220424 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8d87643-c812-4745-8d65-f5866d188a37 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1680 microversion: 2.1 time: 0.394309 Aug 29 15:39:44.230458 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1660/3208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1680 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:44.388761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:44.397910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40b9fef1-00d4-432c-8843-4f4a9d772f49 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1502 microversion: 2.1 time: 0.385640 Aug 29 15:39:44.404660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1549/3209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:44.428995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9d2c3e3-a6d4-49ae-a6cc-8ef1854a2b36 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:44.446895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.447512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.459810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.460328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.460961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.464689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2c3e3-a6d4-49ae-a6cc-8ef1854a2b36 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.465205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2c3e3-a6d4-49ae-a6cc-8ef1854a2b36 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.466268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.466749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.467183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.468520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9d2c3e3-a6d4-49ae-a6cc-8ef1854a2b36 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.564122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9d2c3e3-a6d4-49ae-a6cc-8ef1854a2b36 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Going to try to stop instance {{(pid=130002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:39:44.650445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9d2c3e3-a6d4-49ae-a6cc-8ef1854a2b36 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af/action" status: 202 len: 0 microversion: 2.1 time: 0.228496 Aug 29 15:39:44.651525 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1661/3210] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:44 2022] POST /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:44.660773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.664055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.679777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.680444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.682970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.683842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.685239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.688699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.800165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:44.913906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:44.935746 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-267d5dc9-e952-40a7-baff-578e29c017ec tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.493145 Aug 29 15:39:44.938670 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1550/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:44.949048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.954252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.969623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.970492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.971456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.972183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.972625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.973232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.096534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.106187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21cce1a9-4ab1-4a0d-8b80-bb56ef665147 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.450120 Aug 29 15:39:45.106834 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1662/3212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:45.127443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.128450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.136055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.136781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.137420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.138580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.139347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.140179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.452507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.471584 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf1844f2-bb87-4c42-95ef-b8adf09c14bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.531067 Aug 29 15:39:45.476631 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1551/3213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:45.484496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.485494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.495046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.496641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.503044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.504280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.505081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.505964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.615648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.624072 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5968d793-31a0-4846-a499-97046951c9a5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1712 microversion: 2.1 time: 0.505109 Aug 29 15:39:45.624681 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1663/3214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1712 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:45.650321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5ec8bec3-eb42-4750-8f8d-2c606912795c req-636b66b9-3978-4275-8f1c-6a13478dd873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7d3301-a307-4d91-8767-35314cf5f3fa", "tag": "753d848f-72ee-429f-b2a5-67dd323907d1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:45.654114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.668384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.669761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.670961 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae8803d9-2227-4c88-a36f-dfe76ba5fc32 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.193187 Aug 29 15:39:45.671540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1552/3215] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:45.689044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.690206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.702807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ec8bec3-eb42-4750-8f8d-2c606912795c req-636b66b9-3978-4275-8f1c-6a13478dd873 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.703286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ec8bec3-eb42-4750-8f8d-2c606912795c req-636b66b9-3978-4275-8f1c-6a13478dd873 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.703901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ec8bec3-eb42-4750-8f8d-2c606912795c req-636b66b9-3978-4275-8f1c-6a13478dd873 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.721966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.722463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.722897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.723606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.724051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.724466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.737206 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5ec8bec3-eb42-4750-8f8d-2c606912795c req-636b66b9-3978-4275-8f1c-6a13478dd873 service nova] Creating event network-changed:753d848f-72ee-429f-b2a5-67dd323907d1 for instance eb7d3301-a307-4d91-8767-35314cf5f3fa on n-h2-854882-3 Aug 29 15:39:45.750331 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5ec8bec3-eb42-4750-8f8d-2c606912795c req-636b66b9-3978-4275-8f1c-6a13478dd873 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101273 Aug 29 15:39:45.751744 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1664/3216] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:45.813254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:45.888832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.903654 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c3de9ea-71b0-48ab-bab5-be5f8a9921a0 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1612 microversion: 2.1 time: 0.229543 Aug 29 15:39:45.905816 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1553/3217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1612 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:45.961925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.962650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.977680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.997139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.999553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.004009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.005776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.006770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.132353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.134244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.145156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.145943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.146394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.150280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.150819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.151373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.418653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.430276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-517a20c1-5c87-458b-8f5b-de6fb55b8fa4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.470986 Aug 29 15:39:46.430896 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1665/3218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:46.443686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.453960 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c195e9e0-b5df-460d-92a3-85791df25e93 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.325604 Aug 29 15:39:46.454530 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1554/3219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:46.456248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-895990c9-737a-4bf4-a80f-1cdaf3e06647 req-5eec63a9-eac7-42da-983b-95b34309310d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e", "name": "network-vif-deleted", "tag": "17ca6f8e-6a58-4644-9b2e-b31ad6b2d742"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:46.468522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-895990c9-737a-4bf4-a80f-1cdaf3e06647 req-5eec63a9-eac7-42da-983b-95b34309310d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.469154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-895990c9-737a-4bf4-a80f-1cdaf3e06647 req-5eec63a9-eac7-42da-983b-95b34309310d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.469628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-895990c9-737a-4bf4-a80f-1cdaf3e06647 req-5eec63a9-eac7-42da-983b-95b34309310d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.484399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-895990c9-737a-4bf4-a80f-1cdaf3e06647 req-5eec63a9-eac7-42da-983b-95b34309310d service nova] Creating event network-vif-deleted:17ca6f8e-6a58-4644-9b2e-b31ad6b2d742 for instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e on n-h2-854882-3 Aug 29 15:39:46.490490 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-895990c9-737a-4bf4-a80f-1cdaf3e06647 req-5eec63a9-eac7-42da-983b-95b34309310d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057220 Aug 29 15:39:46.491704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1666/3220] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:46.505864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.506752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.518734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.523484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.525956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.526972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.547010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.547502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.699667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.701213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.709317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.711053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.711872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.713610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.714208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.714811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.830551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.843061 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcc12e12-4d4e-4316-8c4a-1296c79323a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.341739 Aug 29 15:39:46.855763 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1555/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:46.867684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.901605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.905777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.909566 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d901f975-9f3a-4cd9-89d4-6d7508204c41 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.213122 Aug 29 15:39:46.912515 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1667/3222] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:46.942344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.944357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.965860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.966372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.966809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.967519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.967956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.972150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.214493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cfb36460a54faca6f9a512c9329d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252756856a8491fb600a3b03f24c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.227016 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2743c403-8890-4bf0-9549-617fff3ebe01 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 200 len: 1324 microversion: 2.1 time: 0.303730 Aug 29 15:39:47.242765 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1556/3223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:47.454850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.455493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.473490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.473982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.474420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.475125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.475574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.476006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.477401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.478226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.494997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.497349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.498566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.500441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.501407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.502365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.836196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.838967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:47.851804 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07fc92fa-e7c8-48f8-a3ac-57907b5046d6 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.378171 Aug 29 15:39:47.865713 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1557/3224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:47.865713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.865713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.875538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.876066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.876516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.877799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.878258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.878684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.125600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.141861 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eddfe3b7-ef59-4876-a002-d09c10738e66 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.280068 Aug 29 15:39:48.151475 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1558/3225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:48.157145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.157992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.167953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.168474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.169709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.171189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.172295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.174065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.272486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.288716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.292691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.295328 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6013ca11-eb51-4132-9dab-bdb9b3dbdc93 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.142452 Aug 29 15:39:48.296406 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1559/3226] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:48.331139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.342113 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1105617d-d745-489b-855f-c428abef0ae3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.891089 Aug 29 15:39:48.367448 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1668/3227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:48.374736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.381062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.393773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.395481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.397213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.399508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.400164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.401194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.426103 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] HTTP exception thrown: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Request method failure captured: Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e HTTP/1.1 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN0MKasRYYXjCt6Lh56JNkSD4rxn2YFwR7F1NqI_t4dJh5761LH6saBziKOU_quILhUFwNTYByvRhfl2pxjcU-xhNAcSPL-4_QWsYL4z2-xQuOfkm1yEZT1kZQjVU6tQKeddNwG3he4BRjTMeItXgnFN8WFDK7AI7yEKo19IE6dSqjs Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: a252756856a8491fb600a3b03f24c598 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252756856a8491fb600a3b03f24c598"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a252756856a8491fb600a3b03f24c598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a252756856a8491fb600a3b03f24c598", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252756856a8491fb600a3b03f24c598"}]}] Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: a252756856a8491fb600a3b03f24c598 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachSCSIVolumeTestJSON-182427534-project Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26cfb36460a54faca6f9a512c9329d25 Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-182427534-project Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e'} Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:48.433723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Returning 404 to user: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:48.438977 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3238a7f-4724-47ba-ba51-8b66bbc33b49 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 404 len: 111 microversion: 2.1 time: 0.067730 Aug 29 15:39:48.442578 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1669/3228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:48.453150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52177b44-d110-4fa1-911f-e3063caa1a33 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '.version_select at 0x7fb0e2988550>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.486821 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52177b44-d110-4fa1-911f-e3063caa1a33 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-65170630" status: 202 len: 0 microversion: 2.1 time: 0.041326 Aug 29 15:39:48.487474 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1670/3229] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Aug 29 15:39:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-65170630 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:48.541522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83f3280d-e38c-4110-92e7-dd35dc14c3d3 tempest-ListImageFiltersNegativeTestJSON-1541809280 tempest-ListImageFiltersNegativeTestJSON-1541809280-project] Calling method '.version_select at 0x7fb0e26943a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.575398 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-83f3280d-e38c-4110-92e7-dd35dc14c3d3 tempest-ListImageFiltersNegativeTestJSON-1541809280 tempest-ListImageFiltersNegativeTestJSON-1541809280-project] HTTP exception thrown: Image not found. Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83f3280d-e38c-4110-92e7-dd35dc14c3d3 tempest-ListImageFiltersNegativeTestJSON-1541809280 tempest-ListImageFiltersNegativeTestJSON-1541809280-project] Request method failure captured: Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/images/f737db6e-d2b8-4b1e-b5df-d40ea3790baf HTTP/1.1 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN3Ealy3oj2jj0Gf0qmevqdGQD7Np_Qh7qBl-2M-LBGSm8ocwKTfh4Wgy_XyOL-0dhXpCTg8glNmDKBp7oVgYpdkRReg4fRF5RyfnDJVJ_6NGzTuUBICfxB9-4JCFlBQu7n6aKLtEuCtwfiULk25DaxpsNyFyoSXsMaLURwmyKofys0 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 213958ef743d4e4ca1fab9535912590b Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1541809280 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/213958ef743d4e4ca1fab9535912590b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/213958ef743d4e4ca1fab9535912590b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_213958ef743d4e4ca1fab9535912590b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/213958ef743d4e4ca1fab9535912590b"}]}] Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1541809280 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 213958ef743d4e4ca1fab9535912590b Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1541809280 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ListImageFiltersNegativeTestJSON-1541809280-project Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 6462cf2be07848bc9b05d492f49c7866 Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1541809280-project Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'f737db6e-d2b8-4b1e-b5df-d40ea3790baf'} Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f737db6e-d2b8-4b1e-b5df-d40ea3790baf Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:39:48.579055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f737db6e-d2b8-4b1e-b5df-d40ea3790baf could not be found. Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:39:48.583274 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:48.588567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83f3280d-e38c-4110-92e7-dd35dc14c3d3 tempest-ListImageFiltersNegativeTestJSON-1541809280 tempest-ListImageFiltersNegativeTestJSON-1541809280-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:48.589648 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83f3280d-e38c-4110-92e7-dd35dc14c3d3 tempest-ListImageFiltersNegativeTestJSON-1541809280 tempest-ListImageFiltersNegativeTestJSON-1541809280-project] 10.222.0.16 "GET /compute/v2.1/images/f737db6e-d2b8-4b1e-b5df-d40ea3790baf" status: 404 len: 62 microversion: 2.1 time: 0.292135 Aug 29 15:39:48.590719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1560/3230] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/images/f737db6e-d2b8-4b1e-b5df-d40ea3790baf => generated 62 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:48.876731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.878022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.892509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.893550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.897821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.898631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.899124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.899665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.171832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.178934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.189126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.190518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.191118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.192027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.193301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.193947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.456338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.465828 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23ae66b9-290f-4f2d-821f-fc4dc8377050 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.593266 Aug 29 15:39:49.471236 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1671/3231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:49.477346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.487055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.499072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:49.501049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.502336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.508124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.509336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.510012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.510612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.657764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.671932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.674732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.684369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.686539 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef5d1b70-b75e-41c3-afc9-030a6138a65d tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.213594 Aug 29 15:39:49.686852 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30a8f32d-4bb2-4407-9431-a107414c67ba tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.522699 Aug 29 15:39:49.693661 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1561/3232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:49.694823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1672/3233] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:49.723843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.724783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.732459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.733311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.733994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.735788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.738329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.739174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.018907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.027750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a0fe60f7-cd81-4dd0-aa1e-5b67e300a585 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.338124 Aug 29 15:39:50.031316 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1562/3234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:50.500152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.500780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.512118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.512622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.513062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.518264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.518967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.519921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.712869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.713565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.727472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.728358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.729010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.731681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.734334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.735177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.987971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.000955 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03650a76-9df3-410a-82e9-312e905d3c1e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.296225 Aug 29 15:39:51.003396 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1563/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.014527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.015881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.032924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.034447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.035969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.036946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.039074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.041749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.155241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.179950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.182042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.185878 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-34e3a103-ebac-4d2e-bb21-d64b5d7a0c38 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.177658 Aug 29 15:39:51.186818 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1564/3236] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:51.202221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.203253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.234559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.234916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.235588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.236151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.237212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.237581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.238189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.251491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e36f9ac-a454-45ab-b5a5-737f65dc4d20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.752350 Aug 29 15:39:51.274160 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1673/3237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.284447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9ddc0637-78e0-49e0-a8d1-92c670415065 req-fc37aaa8-8058-4370-9da8-74f1678e6a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7d3301-a307-4d91-8767-35314cf5f3fa", "name": "network-vif-plugged", "status": "completed", "tag": "753d848f-72ee-429f-b2a5-67dd323907d1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:51.320502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9ddc0637-78e0-49e0-a8d1-92c670415065 req-fc37aaa8-8058-4370-9da8-74f1678e6a6c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.321053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9ddc0637-78e0-49e0-a8d1-92c670415065 req-fc37aaa8-8058-4370-9da8-74f1678e6a6c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.321555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9ddc0637-78e0-49e0-a8d1-92c670415065 req-fc37aaa8-8058-4370-9da8-74f1678e6a6c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.363371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9ddc0637-78e0-49e0-a8d1-92c670415065 req-fc37aaa8-8058-4370-9da8-74f1678e6a6c service nova] Creating event network-vif-plugged:753d848f-72ee-429f-b2a5-67dd323907d1 for instance eb7d3301-a307-4d91-8767-35314cf5f3fa on n-h2-854882-3 Aug 29 15:39:51.382568 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9ddc0637-78e0-49e0-a8d1-92c670415065 req-fc37aaa8-8058-4370-9da8-74f1678e6a6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103256 Aug 29 15:39:51.399990 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1674/3238] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:51.520317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.528999 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b283b1a5-4755-4ac3-a02d-ff2bcd12d46c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.340806 Aug 29 15:39:51.541415 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1565/3239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.023047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.025001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.038301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.039147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.040111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.042385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.045078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.045764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.073783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7fc10af2-8b38-482f-a8e5-25816a8cbe2f tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Action: 'create', calling method: .version_select at 0x7fb0e2de8d30>, body: {"keypair": {"name": "tempest-keypair-684809394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrqnJ4IkzFXLlenW9gfQ0eo5cgWtJT/GiqR38rlDmsikvT1kxhHZXXPOurvv6alMUTYCWMooXbgN56oBll4KhxxBYhMBbfc2ITCD4ywF8PfWaCDzESPmaeKThdPpTgP7A=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:52.099104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-7fc10af2-8b38-482f-a8e5-25816a8cbe2f tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:52.114966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-7fc10af2-8b38-482f-a8e5-25816a8cbe2f tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for user 3fa47fbc7a23461a89b2a0ed04e8277a and project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:52.154409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7fc10af2-8b38-482f-a8e5-25816a8cbe2f tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.305079 Aug 29 15:39:52.157768 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1675/3240] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:52.173929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a444fed7-9fb6-4fe8-a498-427e5421ce72 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0e2bdedc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.186465 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a444fed7-9fb6-4fe8-a498-427e5421ce72 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-684809394" status: 200 len: 497 microversion: 2.1 time: 0.020575 Aug 29 15:39:52.187742 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1676/3241] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-684809394 => generated 497 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:52.199961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-318d85cc-eff7-4a37-86fb-2ad4b32cff7c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0e28c3ca0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.232611 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-318d85cc-eff7-4a37-86fb-2ad4b32cff7c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-684809394" status: 202 len: 0 microversion: 2.1 time: 0.037985 Aug 29 15:39:52.236846 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1677/3242] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-684809394 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:52.247238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.247984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.260033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.264826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.268428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.269027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.269818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.270292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.274731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.275545 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c44b5c5d-6401-4882-9522-e90770f7434d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1308 microversion: 2.1 time: 0.256608 Aug 29 15:39:52.276455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1566/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.294604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d1f993e-73a8-4aeb-aa4f-578b7e755625 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Action: 'create', calling method: .version_select at 0x7fb0e26acd30>, body: {"keypair": {"name": "tempest-keypair-742625634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW49NnWThjPzkMVgxvayWzvBDxd0EBkWLjVXZGxzhc2TD5GFVAi6FN9PKNUHKfayeqQnS0AN2GxHMvT6kkCt6orhbFfI7HUsFMe71Ql7Ccgwf3/a8nepUc91bpipqjJTA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:52.313325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:52.313754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0d1f993e-73a8-4aeb-aa4f-578b7e755625 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:52.320690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-0d1f993e-73a8-4aeb-aa4f-578b7e755625 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for user 3fa47fbc7a23461a89b2a0ed04e8277a and project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:52.351827 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d1f993e-73a8-4aeb-aa4f-578b7e755625 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074052 Aug 29 15:39:52.352828 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1567/3244] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:52.358677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.359396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.366808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.367395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.367934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.371927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.376057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.379488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.382045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.384041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.395902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.398554 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2edbd644-3980-4696-a58c-5ba3807a55c2 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.160220 Aug 29 15:39:52.400196 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1678/3245] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:52.410732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-043d8dab-66de-497f-91f6-5f78da770f7e tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0e2aa8280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.444713 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-043d8dab-66de-497f-91f6-5f78da770f7e tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742625634" status: 202 len: 0 microversion: 2.1 time: 0.042609 Aug 29 15:39:52.445659 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1679/3246] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742625634 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:52.457369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b2b34d2-d7c7-4779-b651-be4033af624c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Action: 'create', calling method: .version_select at 0x7fb0eb793820>, body: {"keypair": {"name": "tempest-keypair-1319990752", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:52.476481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9b2b34d2-d7c7-4779-b651-be4033af624c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:52.508741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9b2b34d2-d7c7-4779-b651-be4033af624c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for user 3fa47fbc7a23461a89b2a0ed04e8277a and project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:52.559480 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b2b34d2-d7c7-4779-b651-be4033af624c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.108406 Aug 29 15:39:52.560110 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1680/3247] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:52 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:52.575672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.578433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.589481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.599507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.600304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.600471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45a6bda9-68c9-4fde-8921-7c3a7387696c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.246505 Aug 29 15:39:52.602843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.603748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.604217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.604659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.615341 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1568/3248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.622846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ccdfb53b-06fb-4ca8-8571-a3ed8cc4a38d tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0e26be280>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.647505 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ccdfb53b-06fb-4ca8-8571-a3ed8cc4a38d tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319990752" status: 202 len: 0 microversion: 2.1 time: 0.028888 Aug 29 15:39:52.648644 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1569/3249] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319990752 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:52.666262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5002751a-890d-4de3-8c58-de4dc0e62b65 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Action: 'create', calling method: .version_select at 0x7fb0e285b700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-163171051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoZbRGkUJwqH/mEVqHjn5knlim/wGl+ioMFfoYtm/c3ALBsldgKuWHwJMrTzQFMs5qJbslqAj3ELZD7LlIH19+ER3t6tzXV/AmNS+R8f5NX4anl5EKhTpYO+0ENkgd+5g=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:52.674226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:52.696725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5002751a-890d-4de3-8c58-de4dc0e62b65 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:52.702923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5002751a-890d-4de3-8c58-de4dc0e62b65 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for user 3fa47fbc7a23461a89b2a0ed04e8277a and project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:52.733262 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5002751a-890d-4de3-8c58-de4dc0e62b65 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.076573 Aug 29 15:39:52.734715 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1570/3250] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:52.747977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-020578fa-fcc0-4928-9d40-a2517c4b3be9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Action: 'create', calling method: .version_select at 0x7fb0e2642550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-626511939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSKUZqKBcHyFlRB1arvZN7X2OJOsSsFj1DJFmwcCsKgdmMTCwr4Y+8k0owyNU3+DW5DLxC45LL9qTuFbO55Z6oYv6nieowCkYUKSmOTuaaDiNiCE4KgflV3LY6LcqDJQg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:52.772244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-020578fa-fcc0-4928-9d40-a2517c4b3be9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:52.778831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-020578fa-fcc0-4928-9d40-a2517c4b3be9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for user 3fa47fbc7a23461a89b2a0ed04e8277a and project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:52.812474 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-020578fa-fcc0-4928-9d40-a2517c4b3be9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.068721 Aug 29 15:39:52.813602 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1571/3251] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:52.818963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.835309 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86fdcc1a-029d-4b7e-a6b5-4cb4a3ae4df5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.266314 Aug 29 15:39:52.838539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b7882213-3fb3-4267-bba3-15044f11a0c9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Action: 'create', calling method: .version_select at 0x7fb0e26ac040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-341979512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFl8Of9rmE/W6/KS+gCQ4Bb5oWYzoZ69cn9E5fbcDqmlDQheHMrIfq5s2j/c27R2sk5O6X9m8GCp47lYdYyQYLuOJ34Uf4vcDadA5OO7kkp5Lvq6yH+sYST35CoCWWqQA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:52.841051 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1681/3252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.884912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b7882213-3fb3-4267-bba3-15044f11a0c9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:52.890627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b7882213-3fb3-4267-bba3-15044f11a0c9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Getting quotas for user 3fa47fbc7a23461a89b2a0ed04e8277a and project 1a7f041a45b14dd6a3ee43d4b2e55a03. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:52.916729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b7882213-3fb3-4267-bba3-15044f11a0c9 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.092592 Aug 29 15:39:52.917721 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1572/3253] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:52.930637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b63c8c99-c5dc-4b0f-92b0-99209738d380 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0e2aa8d30>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.937169 n-d-854882-3 devstack@n-api.service[130002]: WARNING oslo_db.sqlalchemy.utils [None req-b63c8c99-c5dc-4b0f-92b0-99209738d380 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:39:52.953914 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b63c8c99-c5dc-4b0f-92b0-99209738d380 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.030043 Aug 29 15:39:52.954517 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1682/3254] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.964975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7938ab2a-5494-4cd8-995e-c3d53e82fdd7 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0e26cb670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.301459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.302249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.308519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.309036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.309550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.315655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.316155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.317019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.381580 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7938ab2a-5494-4cd8-995e-c3d53e82fdd7 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-341979512" status: 202 len: 0 microversion: 2.1 time: 0.420301 Aug 29 15:39:53.386906 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1573/3255] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-341979512 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:39:53.393067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0cdac359-28db-48a0-84f2-8fbbff2f88c6 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0e2642550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.417184 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0cdac359-28db-48a0-84f2-8fbbff2f88c6 tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-626511939" status: 202 len: 0 microversion: 2.1 time: 0.028018 Aug 29 15:39:53.418718 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1574/3256] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:39:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-626511939 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:53.432306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.433342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.450322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.450826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.453551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.454305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.459059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.459473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.480008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.499547 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d34952c-6653-4fa4-beb6-52b101f2f22a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1488 microversion: 2.1 time: 0.198180 Aug 29 15:39:53.501537 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1683/3257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1488 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:53.507878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a0cc6185-6ab8-4982-89aa-c2957698487c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] Calling method '.version_select at 0x7fb0eb7931f0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.542547 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a0cc6185-6ab8-4982-89aa-c2957698487c tempest-KeyPairsV2TestJSON-613556554 tempest-KeyPairsV2TestJSON-613556554-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-163171051" status: 202 len: 0 microversion: 2.1 time: 0.039186 Aug 29 15:39:53.552894 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1684/3258] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:39:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-163171051 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:53.559679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:53.560707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.569804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.570519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.571185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.572080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.572702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.573625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.606137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lazy-loading 'flavor' on Instance uuid eb7d3301-a307-4d91-8767-35314cf5f3fa {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:53.612084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.630716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.634373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.636731 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac132eea-04bc-4a1c-85b5-675d99144a72 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.212303 Aug 29 15:39:53.650757 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1575/3259] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:53.664063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.665983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.676575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.677305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.677990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.679736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.680829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.682091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.801769 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-97163186-8cba-4e23-81d9-4ec99c2ec752 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.246337 Aug 29 15:39:53.805208 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1685/3260] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:53 2022] POST /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:53.818924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.819969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.833121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.835308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.835740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.836495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.836919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.837729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.064832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.076231 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df832e0b-1b7b-4d0d-b338-a1c34fdc2f99 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.423264 Aug 29 15:39:54.078476 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1576/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:54.089631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.090264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:54.096925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.102818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.103317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.103761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.104482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.104931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.105356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.107219 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a72e44d2-2364-46c8-b625-3952d4b9c2a6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1496 microversion: 2.1 time: 0.297857 Aug 29 15:39:54.108823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1686/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1496 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:54.524610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.540385 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b9366b59-34ee-4e9d-93dd-74f2dd261ca6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.455622 Aug 29 15:39:54.558164 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1577/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:54.670598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.672899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:54.697702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.698231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.700234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.701203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.701874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.702471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.786637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.809822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.819079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.830745 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ae8b2d9-8833-4173-81d0-58ecec2b7c4f tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.168600 Aug 29 15:39:54.834181 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1687/3264] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:55.099584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.100209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.108207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.108588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.109258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.110406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.111635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.112375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.132519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.135232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.147762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.148887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.149934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.154026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.156779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.165038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.460765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.472547 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8b46d40f-6236-4431-a677-a3409290882c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 200 len: 1479 microversion: 2.1 time: 0.342880 Aug 29 15:39:55.473475 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1688/3265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 1479 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:55.492824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-666444944"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:55.495313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.507049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.510675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.512296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.513272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.515179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.515734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.654590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.672073 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-72a117f4-453c-41eb-8c9b-19d6598d49a2 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.576140 Aug 29 15:39:55.673320 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1578/3266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:55.681634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.685783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.698854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.704638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.705992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.706902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.707536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.708115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.867041 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-263e84f2-a1f2-43c7-b6b1-6d14aa14c88b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.376726 Aug 29 15:39:55.869164 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1689/3267] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:55 2022] POST /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 15:39:55.889337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.890744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.910691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.911206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.911664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.912412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.912874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.913303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.078364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.089224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.112886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.114187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-426c56bd-0dc3-4104-a2bc-21804a341bdb tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.242320 Aug 29 15:39:56.117775 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1690/3268] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:56.135299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-49856df8-7e33-4a5b-9154-b5e596859d2f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2be4dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.202723 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-49856df8-7e33-4a5b-9154-b5e596859d2f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 200 len: 1439 microversion: 2.1 time: 0.077057 Aug 29 15:39:56.203556 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1691/3269] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 1439 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:56.226522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.236537 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79a2c660-0bef-45f8-bfb4-8d9de9c6c937 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.561360 Aug 29 15:39:56.241751 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1579/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:56.699234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.700170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:56.709129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.710017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.710556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.712164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.712762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.713296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.143840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.145126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.159368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.174314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.177958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.178869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.179673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.180224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.182992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.192748 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-984d717e-b150-4a22-a50f-c516742e9811 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.502224 Aug 29 15:39:57.201673 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1692/3271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:57.218024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8dc7cc76-e10b-4c45-b4a2-6f2d2c5924fb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2d229d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.300036 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8dc7cc76-e10b-4c45-b4a2-6f2d2c5924fb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 200 len: 1439 microversion: 2.1 time: 0.086735 Aug 29 15:39:57.305305 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1693/3272] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:57.316184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.316733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.346352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.352313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.353071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.354069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.358771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.359523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.419645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.437277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.443014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.444651 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-89d584d8-f796-4910-afc9-e7200187c350 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.306205 Aug 29 15:39:57.455269 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1580/3273] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:57.712495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.723691 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51be6ca6-1baa-4023-b0e6-5ef1fbd5840d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.417084 Aug 29 15:39:57.727156 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1694/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:58.225431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.225996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.245960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.246465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.246909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.247626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.250805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.254803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.317191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c7c9f41a-1a82-4c00-9dcc-43a01a3a1e78 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0eb793160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.410396 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c7c9f41a-1a82-4c00-9dcc-43a01a3a1e78 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 200 len: 1439 microversion: 2.1 time: 0.098796 Aug 29 15:39:58.412524 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1695/3275] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:58.472234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.473232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.493156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.493893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.494657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.497176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.499591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.503077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.666543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.688682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.695704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.696870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a6b15567-37f5-4c46-a67c-d64098beb1e7 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.231481 Aug 29 15:39:58.698254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1696/3276] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:39:58.749231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.749912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.761264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.761855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.762305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.763029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.763489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.763930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.113001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.124586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fc248f29-84e8-438e-bf7d-7f3a369bbd9a tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.903800 Aug 29 15:39:59.139696 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1581/3277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:59.429764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53acecfd-6ca3-4317-b149-8dcbba489c97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2680e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.513547 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53acecfd-6ca3-4317-b149-8dcbba489c97 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 200 len: 1439 microversion: 2.1 time: 0.088721 Aug 29 15:39:59.514244 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1582/3278] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:59.678810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.679310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.688301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.688790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.689801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.715894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.716415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.716856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.775513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] HTTP exception thrown: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Request method failure captured: Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e HTTP/1.1 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0MKasRYYXjCt6Lh56JNkSD4rxn2YFwR7F1NqI_t4dJh5761LH6saBziKOU_quILhUFwNTYByvRhfl2pxjcU-xhNAcSPL-4_QWsYL4z2-xQuOfkm1yEZT1kZQjVU6tQKeddNwG3he4BRjTMeItXgnFN8WFDK7AI7yEKo19IE6dSqjs Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a252756856a8491fb600a3b03f24c598 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252756856a8491fb600a3b03f24c598"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a252756856a8491fb600a3b03f24c598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a252756856a8491fb600a3b03f24c598", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252756856a8491fb600a3b03f24c598"}]}] Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a252756856a8491fb600a3b03f24c598 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachSCSIVolumeTestJSON-182427534-project Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26cfb36460a54faca6f9a512c9329d25 Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-182427534-project Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e'} Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:59.784601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Returning 404 to user: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:59.788701 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-deea0c07-e731-45f9-b5f2-58827f45c132 tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 404 len: 111 microversion: 2.1 time: 0.112733 Aug 29 15:39:59.790391 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1583/3279] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:59 2022] DELETE /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:59.809045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.813818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.845982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.846529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.846979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.854590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.855095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.855844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.859369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:00.036133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.053169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.060065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.061337 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6fde0567-0686-4f4d-a9df-6e771c0bcc8e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.269983 Aug 29 15:40:00.061927 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1584/3280] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:00.084795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.093350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] [instance: 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.120702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.122551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.128252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.130210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.134794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.135450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.188743 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] HTTP exception thrown: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Request method failure captured: Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e HTTP/1.1 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0MKasRYYXjCt6Lh56JNkSD4rxn2YFwR7F1NqI_t4dJh5761LH6saBziKOU_quILhUFwNTYByvRhfl2pxjcU-xhNAcSPL-4_QWsYL4z2-xQuOfkm1yEZT1kZQjVU6tQKeddNwG3he4BRjTMeItXgnFN8WFDK7AI7yEKo19IE6dSqjs Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a252756856a8491fb600a3b03f24c598 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252756856a8491fb600a3b03f24c598"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a252756856a8491fb600a3b03f24c598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a252756856a8491fb600a3b03f24c598", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252756856a8491fb600a3b03f24c598"}]}] Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a252756856a8491fb600a3b03f24c598 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-182427534 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachSCSIVolumeTestJSON-182427534-project Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26cfb36460a54faca6f9a512c9329d25 Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-182427534-project Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e'} Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:00.202318 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:00.206419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:00.206419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:00.206419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:00.206419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:00.206419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:00.206419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. Aug 29 15:40:00.206419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:00.212337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] Returning 404 to user: Instance 2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:00.213476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb807bfb-6995-4b05-bf32-3d4fa6a06fbc tempest-AttachSCSIVolumeTestJSON-182427534 tempest-AttachSCSIVolumeTestJSON-182427534-project] 10.222.0.16 "GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e" status: 404 len: 111 microversion: 2.1 time: 0.146726 Aug 29 15:40:00.224500 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1585/3281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers/2b22a7dd-ff2b-4406-a2ed-d8de47d1b05e => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:00.251621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-69137063", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "2694c839-3720-458b-9422-5941da8b479c"}, {"uuid": "80ee5fd9-4590-4d70-872f-e8e3fddada3a"}, {"uuid": "2694c839-3720-458b-9422-5941da8b479c"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:00.396638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] validate_networks() for [('2694c839-3720-458b-9422-5941da8b479c', None, None, None, None, None), ('80ee5fd9-4590-4d70-872f-e8e3fddada3a', None, None, None, None, None), ('2694c839-3720-458b-9422-5941da8b479c', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:00.525800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.539387 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-932114f9-7e14-4c87-bc76-8c509ce32313 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1532 microversion: 2.1 time: 1.795131 Aug 29 15:40:00.549874 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1697/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1532 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:00.561738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.562356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.574562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.575056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.575493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.576190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.576638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.577064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.117073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.122327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:01.155621 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e5975602-be22-48ea-aea2-6778e272edd4 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.603444 Aug 29 15:40:01.156311 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1698/3283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:01.180421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c402d40-4bcc-4bd6-95e8-fa5e2dad9f52 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2bdec10>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.651792 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c402d40-4bcc-4bd6-95e8-fa5e2dad9f52 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 200 len: 1439 microversion: 2.1 time: 0.480149 Aug 29 15:40:01.654494 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1699/3284] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 1439 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:01.666569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.670759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.690072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.691971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.692947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.694368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.697922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.698588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.983631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.014856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.023828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.031787 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b37a529e-5769-4443-b1b8-fab92853033a tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.374364 Aug 29 15:40:02.034670 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1700/3285] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:02.048062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:02.049074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:02.069942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.072133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.073482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.075431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.076611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.078666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.518975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:02.898464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:02.956150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.965649 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b68b256-7087-496f-a1cb-8b20ac4d3e6d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 0.927411 Aug 29 15:40:02.967940 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1701/3286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:02 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:02.981751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:02.982755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.004165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.005301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.006413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.007900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.008982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.009899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.058565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:03.059230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:03.060511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:03.061142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:03.061829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:03.092411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.096938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.097671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.098678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.099374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.101954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.144945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Getting quotas for project fe151c445bb64766b4a8f2282ed2f1de. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:03.160199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Getting quotas for user f0c165a4dd4648888d45d44df5acbe2b and project fe151c445bb64766b4a8f2282ed2f1de. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:03.191480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:03.194237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:03.307715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e877667c-94cc-49e0-afcd-b11e163eee30 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.081802 Aug 29 15:40:03.321424 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1586/3287] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:40:03.338747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ad7498f8-9f7e-42c8-9339-4f4c46438e70 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e26e9310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.524135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.535751 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d80553c-2fe3-4299-9a35-ca4ef0e353bc tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.566449 Aug 29 15:40:03.555821 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1702/3288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:02 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:03.571700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.574972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.606186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.606186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.606186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.607291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.607853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.608389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.804879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.830164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.833686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.846686 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c188dfbb-e225-4c27-8eda-94ba70ab9675 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.280530 Aug 29 15:40:03.847899 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1703/3289] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:03.862537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f89b912-56ef-4245-a7c2-3857777fbe39 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.865424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f89b912-56ef-4245-a7c2-3857777fbe39 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.069110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f89b912-56ef-4245-a7c2-3857777fbe39 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.079362 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f89b912-56ef-4245-a7c2-3857777fbe39 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1211 microversion: 2.1 time: 0.227928 Aug 29 15:40:04.079362 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1704/3290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1211 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:04.116181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.123143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.145358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.146101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.146794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.149811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.150574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.158157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.899438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.918977 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75742351-5a50-4a32-843a-0e5348685734 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 0.833655 Aug 29 15:40:04.919592 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1705/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:04.958759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.963150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.976230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.976950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.980203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.981408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.982108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.997760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.603721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.618347 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b819b34e-a90b-42e7-a48c-a3bc2963a650 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 0.686840 Aug 29 15:40:05.618992 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1706/3292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:05.637723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.643291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.670282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.672596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.673052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.674361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.674839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.684272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.948333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.973029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.980635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33daa615bc42447b9056611bc563e131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfce36a97ee446a5a79d91b67b855558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.986180 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0ff08d80-0bc0-440d-ba79-3b74ca39e085 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 200 len: 1604 microversion: 2.42 time: 0.361895 Aug 29 15:40:06.011884 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1707/3293] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 1604 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:06.028694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:06.029329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:06.057252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.057866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.058341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.065751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.069688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.075089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.167092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.181611 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac9cdc8a-8d75-48bb-ae7e-e0bfd312e0e0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1281 microversion: 2.1 time: 1.166162 Aug 29 15:40:07.182249 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1708/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:06 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1281 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:07.205491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:07.206589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:07.232993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.238632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.239361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.241220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.251420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.252183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.776966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.809669 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-204974bf-e0a8-4933-be93-f51a29c1381d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 1.608114 Aug 29 15:40:08.812772 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1709/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:07 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:08.890992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:08.894419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:08.944852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.945790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.951763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.952601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.953098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.953578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.743170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:10.754055 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8031f0c-676d-402d-b359-ca42f315cdd0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1512 microversion: 2.1 time: 1.939604 Aug 29 15:40:10.754659 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1710/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:08 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1512 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:10.770450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.771165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.783773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.784279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.784730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.785481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.785947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.786382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.822757 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] HTTP exception thrown: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Request method failure captured: Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 HTTP/1.1 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNxO6fmLfMnTSgo8tWfOJSATvUTMHav-1L0q_a-P5mTc90ZY6k5wF265mJv_ODtEnKpong4Y-fOGdPFjAgvlgnrqbx1segz4-35G1RDXYNuXN6hGW3LAUQ_30ZMbxJ8wpIzkl_36ZSUsUXiL3SG_tEkjmFjJXucdrHuVEmLCGAq6nuc Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: dfce36a97ee446a5a79d91b67b855558 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfce36a97ee446a5a79d91b67b855558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dfce36a97ee446a5a79d91b67b855558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dfce36a97ee446a5a79d91b67b855558", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfce36a97ee446a5a79d91b67b855558"}]}] Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: dfce36a97ee446a5a79d91b67b855558 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TaggedBootDevicesTest_v242-1078358515-project Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 33daa615bc42447b9056611bc563e131 Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1078358515-project Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '2b8e9ddb-0f1d-42e8-8ee1-b96defe07784'} Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:10.826020 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Returning 404 to user: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:10.831599 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-caa9b443-6ceb-4199-9f23-6b398dbc3041 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 404 len: 111 microversion: 2.42 time: 0.072018 Aug 29 15:40:10.832594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1711/3297] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:40:10.854750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.855038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.861483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:10.863235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.863683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.864695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.865723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.866348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.866942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.982560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:10.994522 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-38099398-ee4f-4dee-9e70-6c64951043be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1269 microversion: 2.1 time: 0.161170 Aug 29 15:40:11.002404 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1712/3298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:11.014256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-686e66cc-efab-4a79-ba35-c1d966c979fa req-02d9c01f-80f0-445c-8eec-37ac46a50886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7d3301-a307-4d91-8767-35314cf5f3fa", "name": "network-vif-plugged", "status": "completed", "tag": "753d848f-72ee-429f-b2a5-67dd323907d1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:11.039361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-686e66cc-efab-4a79-ba35-c1d966c979fa req-02d9c01f-80f0-445c-8eec-37ac46a50886 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.041182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-686e66cc-efab-4a79-ba35-c1d966c979fa req-02d9c01f-80f0-445c-8eec-37ac46a50886 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.042224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-686e66cc-efab-4a79-ba35-c1d966c979fa req-02d9c01f-80f0-445c-8eec-37ac46a50886 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.076218 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-686e66cc-efab-4a79-ba35-c1d966c979fa req-02d9c01f-80f0-445c-8eec-37ac46a50886 service nova] Creating event network-vif-plugged:753d848f-72ee-429f-b2a5-67dd323907d1 for instance eb7d3301-a307-4d91-8767-35314cf5f3fa on n-h2-854882-3 Aug 29 15:40:11.096631 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-686e66cc-efab-4a79-ba35-c1d966c979fa req-02d9c01f-80f0-445c-8eec-37ac46a50886 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086798 Aug 29 15:40:11.100220 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1713/3299] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:11.121325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:11.124469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:11.147874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.156512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.157174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.158702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.162097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.169192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.912117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:11.928202 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-406e668a-27fa-485c-add1-5536b9d86c10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 0.825711 Aug 29 15:40:11.945932 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1714/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:11 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:11.959705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-78e3459c-1b22-4de1-bbd9-0d5485449621 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '.version_select at 0x7fb0e2bde280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.019031 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-78e3459c-1b22-4de1-bbd9-0d5485449621 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547540489" status: 204 len: 0 microversion: 2.42 time: 0.070470 Aug 29 15:40:12.020351 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1715/3301] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Aug 29 15:40:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547540489 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:40:12.034078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.039183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.060622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.061627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.062303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.066564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.067392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.068069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.695735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.705929 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1f95484d-c8cf-4db9-bbc8-5cdcf58c3313 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1489 microversion: 2.1 time: 0.681796 Aug 29 15:40:12.717773 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1716/3302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1489 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:12.723237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.723864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.829838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.830835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.831274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.831992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.832449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.832876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.125788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:13.127863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=9 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:13.182127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:13.254121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:14.078390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:14.087143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:14.097244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83671b5f-39fc-4c8e-a428-24e859ba5629 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1311 microversion: 2.1 time: 1.378268 Aug 29 15:40:14.106858 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1717/3303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1311 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:14.117000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.132793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.153770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.156212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.156882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.160625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.161958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.163870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.258795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:14.365791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:14.498065 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8289346-f2ab-4cec-8bd8-d9962d1fea8e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 204 len: 0 microversion: 2.1 time: 0.387657 Aug 29 15:40:14.509802 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1718/3304] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:14 2022] DELETE /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:14.516125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.519521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.550329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.551038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.551653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.552629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.553248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.554000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.129949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:15.144221 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0098142-5631-44ae-b047-53ae26459f4a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 0.632748 Aug 29 15:40:15.152124 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1719/3305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:15.168697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2d92973f-3674-48e0-93fa-26b051a224f2 req-863de38c-34c9-42eb-8031-f50eced5178b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdb7873-a953-4b26-8ffb-139cb096faf1", "name": "network-vif-plugged", "status": "completed", "tag": "7a7b8149-cb7f-4f33-8595-700998dd84d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:15.225220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2d92973f-3674-48e0-93fa-26b051a224f2 req-863de38c-34c9-42eb-8031-f50eced5178b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.239516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2d92973f-3674-48e0-93fa-26b051a224f2 req-863de38c-34c9-42eb-8031-f50eced5178b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.240655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2d92973f-3674-48e0-93fa-26b051a224f2 req-863de38c-34c9-42eb-8031-f50eced5178b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.280044 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2d92973f-3674-48e0-93fa-26b051a224f2 req-863de38c-34c9-42eb-8031-f50eced5178b service nova] Creating event network-vif-plugged:7a7b8149-cb7f-4f33-8595-700998dd84d9 for instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 on n-h1-854882-3 Aug 29 15:40:15.291544 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2d92973f-3674-48e0-93fa-26b051a224f2 req-863de38c-34c9-42eb-8031-f50eced5178b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137095 Aug 29 15:40:15.295217 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1720/3306] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:15.309979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:15.311474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:15.345349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.346476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.347901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.350196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.355955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.356721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.071097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.084987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7aa23de5-dea1-46ce-86b1-626c0a9af72f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1495 microversion: 2.1 time: 0.788149 Aug 29 15:40:16.093740 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1721/3307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:15 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1495 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.112250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.112882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.127824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.129038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.130088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.134936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.136024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.136878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.781823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.820285 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81befec0-0190-4fb7-ba70-be29176f300a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1311 microversion: 2.1 time: 0.708045 Aug 29 15:40:16.821332 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1722/3308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1311 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.860276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.861416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.902344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.907432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.908802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.910752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.914083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.915279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.990450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.007351 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e0a6e6e-69ae-4ae3-9ecd-630d6ada08c7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 1.180883 Aug 29 15:40:18.010397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1723/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:18.024816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.031818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.068843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.072697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.080338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.082009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.085805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.086632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.295582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.307036 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1cb7b26f-2933-4f5b-b40d-2771813ebb7f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 200 len: 1453 microversion: 2.1 time: 0.293481 Aug 29 15:40:18.313762 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1724/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:18.724373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-299286fe-b4bc-4102-ba6b-d17cd934403d tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0eb793160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-787119412", "description": "tempest-description-256421922"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:20.643557 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-299286fe-b4bc-4102-ba6b-d17cd934403d tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.326067 Aug 29 15:40:20.652878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1725/3311] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:40:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:20.658752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:20.667396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:20.694007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.697796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.698591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.699607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.700408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.705921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.037451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.082462 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0dc08ec3-c9c7-44df-9baa-c3da7944b1d5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1332 microversion: 2.1 time: 1.393550 Aug 29 15:40:22.083163 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1726/3312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:20 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1332 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:22.123654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:22.124212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.170188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.190633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.197071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.206773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.208823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.212215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.547888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lazy-loading 'services' on Instance uuid 201caf06-9ac5-4656-af53-fe83b1b5baf8 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:22.805183 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b21a3f0b-44ea-4533-a337-af8d7ea4e09d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-volume_attachments/7857a5ea-c2d8-4a49-bb56-40d1b5daacb8" status: 202 len: 0 microversion: 2.1 time: 0.720673 Aug 29 15:40:22.815709 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1727/3313] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:40:22 2022] DELETE /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-volume_attachments/7857a5ea-c2d8-4a49-bb56-40d1b5daacb8 => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:22.839131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4da51d11-b7a7-43ad-9606-3572180839fd req-b82953f7-d9db-4439-aa4d-b76d76a036b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50951512-cad1-427e-a545-a0d3d1a290af", "name": "network-vif-deleted", "tag": "a752e861-4c71-449e-98e9-bd3c83f8360b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:22.887297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4da51d11-b7a7-43ad-9606-3572180839fd req-b82953f7-d9db-4439-aa4d-b76d76a036b4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.888088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4da51d11-b7a7-43ad-9606-3572180839fd req-b82953f7-d9db-4439-aa4d-b76d76a036b4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.890291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4da51d11-b7a7-43ad-9606-3572180839fd req-b82953f7-d9db-4439-aa4d-b76d76a036b4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.949057 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4da51d11-b7a7-43ad-9606-3572180839fd req-b82953f7-d9db-4439-aa4d-b76d76a036b4 service nova] Creating event network-vif-deleted:a752e861-4c71-449e-98e9-bd3c83f8360b for instance 50951512-cad1-427e-a545-a0d3d1a290af on n-h1-854882-3 Aug 29 15:40:22.977555 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4da51d11-b7a7-43ad-9606-3572180839fd req-b82953f7-d9db-4439-aa4d-b76d76a036b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147349 Aug 29 15:40:22.983046 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1728/3314] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:23.006207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.006996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.030825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.031339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.034194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.035048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.035537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.035977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.628963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.659173 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-227532d6-4616-4806-a2d0-8b676374dc33 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 0.668870 Aug 29 15:40:23.660751 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1729/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:22 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:23.675626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.679045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.709678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.712587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.716097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.716866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.725934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.726719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.794973 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af HTTP/1.1 Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '50951512-cad1-427e-a545-a0d3d1a290af'} Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:23.809038 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:23.814585 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:23.814585 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:23.814585 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:23.814585 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:23.814585 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:23.814585 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:40:23.814585 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:23.818635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:23.819744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dbc80209-0df1-4a1c-8718-2f03b5c0e920 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 404 len: 111 microversion: 2.1 time: 0.158005 Aug 29 15:40:23.828142 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1730/3316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:23 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:23.843394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af9a8c11-f383-48df-b05a-63078da0d06d tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e28215e0>, body: {"security_group_rule": {"parent_group_id": "331f3ed9-1703-4e49-82d0-abae25887cea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:25.095878 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af9a8c11-f383-48df-b05a-63078da0d06d tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.266446 Aug 29 15:40:25.097094 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1731/3317] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:40:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:25.105353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.106169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:25.133508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.135341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.136907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.138119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.139888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.142565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.167591 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ad7498f8-9f7e-42c8-9339-4f4c46438e70 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 200 len: 1448 microversion: 2.1 time: 21.844044 Aug 29 15:40:25.177090 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1587/3318] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 1448 bytes in 21855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:25.226211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-758035709", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:25.338214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] validate_networks() for [('f8e45aa1-4cd2-42f6-a2e0-4fe7f0a24b53', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:26.241549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:26.265085 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18407630-8179-41f1-8e52-e7804ed7f382 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 1.166799 Aug 29 15:40:26.266743 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1732/3319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:26.278172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:26.279159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:26.300907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.301746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.308529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.309608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.310253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.310842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.631035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:26.643370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e0a4ad78-e02c-4fe9-934a-4eff9cdc312a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 0.374193 Aug 29 15:40:26.644911 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1733/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:26.651934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-be45b90f-cb12-430d-964e-0de04105c434 req-191cf848-62dd-4642-8664-fb8cb9cd5801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "tag": "ace44df1-db24-4c32-ad6c-65ab6ad7bc58"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:26.669756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-be45b90f-cb12-430d-964e-0de04105c434 req-191cf848-62dd-4642-8664-fb8cb9cd5801 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.670677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-be45b90f-cb12-430d-964e-0de04105c434 req-191cf848-62dd-4642-8664-fb8cb9cd5801 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.672262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-be45b90f-cb12-430d-964e-0de04105c434 req-191cf848-62dd-4642-8664-fb8cb9cd5801 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.695912 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-be45b90f-cb12-430d-964e-0de04105c434 req-191cf848-62dd-4642-8664-fb8cb9cd5801 service nova] Creating event network-changed:ace44df1-db24-4c32-ad6c-65ab6ad7bc58 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:26.702688 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-be45b90f-cb12-430d-964e-0de04105c434 req-191cf848-62dd-4642-8664-fb8cb9cd5801 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055587 Aug 29 15:40:26.704200 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1734/3321] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:26.731287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d7c3efd-89a9-492e-a3e2-6440bcd9b748 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e297e0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1330990499", "description": "tempest-description-454414232"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:26.738262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:26.738837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:26.739125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:26.739716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:26.740308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:26.755977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.756725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.757317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.760185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.760818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.761423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.799918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:26.806899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Getting quotas for user 065c5a92f9c04400be8a515e8233fb0d and project 8f71ab69d5754077b34ee79ccb42d7cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:26.822122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:26.824491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:26.886146 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c56c2753-d3ae-4e20-ae3a-85e9583413b3 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686050 Aug 29 15:40:26.887103 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1588/3322] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:40:26.893535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2875dd88-0a94-4dd2-8e10-8b1eed3bbf1f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2730310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:26.988189 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2875dd88-0a94-4dd2-8e10-8b1eed3bbf1f tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 200 len: 1448 microversion: 2.1 time: 0.096759 Aug 29 15:40:26.988798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1589/3323] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 1448 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:27.022373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac4e7785-d21a-4bee-aa0d-00bf532335b9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.024769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac4e7785-d21a-4bee-aa0d-00bf532335b9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.356602 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d7c3efd-89a9-492e-a3e2-6440bcd9b748 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.650784 Aug 29 15:40:27.366675 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1735/3324] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:40:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:27.371949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c6d3b63-c04f-490d-b61b-ff87f83b6da7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e3d96790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.431799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac4e7785-d21a-4bee-aa0d-00bf532335b9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:27.449414 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac4e7785-d21a-4bee-aa0d-00bf532335b9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1214 microversion: 2.1 time: 0.445797 Aug 29 15:40:27.450889 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1590/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1214 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:27.560735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.565095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.583303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.589690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.601651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.611663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.612506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.613262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.197120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.211904 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7743da76-1804-453e-9e38-81dd918113cf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.674911 Aug 29 15:40:28.220521 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1591/3326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:28.228221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6446d00b-2a12-404c-a939-0eab3bf6c8fb tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e26e9280>, body: {"security_group_rule": {"parent_group_id": "731f77a7-9c26-46da-9a04-49c85211b08b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:28.644670 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6446d00b-2a12-404c-a939-0eab3bf6c8fb tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.429272 Aug 29 15:40:28.646425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1592/3327] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:40:28 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:28.654432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:28.655390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:28.666141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.666777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.667288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.668060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.668580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.669069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.703057 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] HTTP exception thrown: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Request method failure captured: Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 HTTP/1.1 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNxO6fmLfMnTSgo8tWfOJSATvUTMHav-1L0q_a-P5mTc90ZY6k5wF265mJv_ODtEnKpong4Y-fOGdPFjAgvlgnrqbx1segz4-35G1RDXYNuXN6hGW3LAUQ_30ZMbxJ8wpIzkl_36ZSUsUXiL3SG_tEkjmFjJXucdrHuVEmLCGAq6nuc Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: dfce36a97ee446a5a79d91b67b855558 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfce36a97ee446a5a79d91b67b855558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dfce36a97ee446a5a79d91b67b855558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dfce36a97ee446a5a79d91b67b855558", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfce36a97ee446a5a79d91b67b855558"}]}] Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: dfce36a97ee446a5a79d91b67b855558 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TaggedBootDevicesTest_v242-1078358515-project Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 33daa615bc42447b9056611bc563e131 Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1078358515-project Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2b8e9ddb-0f1d-42e8-8ee1-b96defe07784'} Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:28.705360 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:28.709677 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:28.713831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Returning 404 to user: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:28.716308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3d146ea9-8ce8-439c-b10c-a709bb5e37b0 tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 404 len: 111 microversion: 2.42 time: 0.068611 Aug 29 15:40:28.717511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1593/3328] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:40:28 2022] DELETE /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:40:28.725134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:28.726830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:28.734816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.736269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.736944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.738116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.738827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.739480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.744807 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0c6d3b63-c04f-490d-b61b-ff87f83b6da7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 204 len: 0 microversion: 2.1 time: 1.376921 Aug 29 15:40:28.748864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1736/3329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:27 2022] DELETE /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 0 bytes in 1378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:28.755097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:28.756110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:28.764307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.765105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.765740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.766603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.767777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.768361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.860675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.869463 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a0dac392-d29a-4e29-a173-444e6562efbb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1266 microversion: 2.1 time: 0.119276 Aug 29 15:40:28.870078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1737/3330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:28 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:28.874973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdfc870d-f4c9-42ef-a705-db2808c73700 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e36353a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-225176787", "description": "tempest-description-702624132"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:29.031804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:29.041639 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe79ea44-8737-4cc7-9076-60d2224d88b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1527 microversion: 2.1 time: 0.322387 Aug 29 15:40:29.056458 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1594/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:28 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1527 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.063182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.064151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] [instance: 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.072175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.073037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.073751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.074820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.075480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.076112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.093662 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] HTTP exception thrown: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Request method failure captured: Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 HTTP/1.1 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNxO6fmLfMnTSgo8tWfOJSATvUTMHav-1L0q_a-P5mTc90ZY6k5wF265mJv_ODtEnKpong4Y-fOGdPFjAgvlgnrqbx1segz4-35G1RDXYNuXN6hGW3LAUQ_30ZMbxJ8wpIzkl_36ZSUsUXiL3SG_tEkjmFjJXucdrHuVEmLCGAq6nuc Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: dfce36a97ee446a5a79d91b67b855558 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfce36a97ee446a5a79d91b67b855558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dfce36a97ee446a5a79d91b67b855558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dfce36a97ee446a5a79d91b67b855558", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfce36a97ee446a5a79d91b67b855558"}]}] Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: dfce36a97ee446a5a79d91b67b855558 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1078358515 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TaggedBootDevicesTest_v242-1078358515-project Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 33daa615bc42447b9056611bc563e131 Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1078358515-project Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2b8e9ddb-0f1d-42e8-8ee1-b96defe07784'} Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:29.096179 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. Aug 29 15:40:29.100793 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:40:29.103294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] Returning 404 to user: Instance 2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:29.104373 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8f6713e2-3eee-423e-80b7-46435bfe2f1e tempest-TaggedBootDevicesTest_v242-1078358515 tempest-TaggedBootDevicesTest_v242-1078358515-project] 10.222.0.16 "GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784" status: 404 len: 111 microversion: 2.42 time: 0.046231 Aug 29 15:40:29.121758 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1595/3332] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/servers/2b8e9ddb-0f1d-42e8-8ee1-b96defe07784 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:40:29.128012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-6852e2f2-7e47-4c45-ac38-793bd2a235e6 req-0c559219-a152-41fa-81eb-a6955d694fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "tag": "e84f8c8c-ddb4-41c6-b895-09864fd4f756"}, {"name": "network-changed", "server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "tag": "67303c1a-9438-492b-8533-38c336022779"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:29.162388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6852e2f2-7e47-4c45-ac38-793bd2a235e6 req-0c559219-a152-41fa-81eb-a6955d694fc6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.163301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6852e2f2-7e47-4c45-ac38-793bd2a235e6 req-0c559219-a152-41fa-81eb-a6955d694fc6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.164071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6852e2f2-7e47-4c45-ac38-793bd2a235e6 req-0c559219-a152-41fa-81eb-a6955d694fc6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.186612 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6852e2f2-7e47-4c45-ac38-793bd2a235e6 req-0c559219-a152-41fa-81eb-a6955d694fc6 service nova] Creating event network-changed:e84f8c8c-ddb4-41c6-b895-09864fd4f756 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:29.187236 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6852e2f2-7e47-4c45-ac38-793bd2a235e6 req-0c559219-a152-41fa-81eb-a6955d694fc6 service nova] Creating event network-changed:67303c1a-9438-492b-8533-38c336022779 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:29.216777 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-6852e2f2-7e47-4c45-ac38-793bd2a235e6 req-0c559219-a152-41fa-81eb-a6955d694fc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093220 Aug 29 15:40:29.220006 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1596/3333] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:29.235465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.237369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.260082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.262722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.263804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.267771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.275855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.276730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.331417 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fdfc870d-f4c9-42ef-a705-db2808c73700 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.460107 Aug 29 15:40:29.332490 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1738/3334] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:40:28 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:29.339496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:29.344831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.346553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.357930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.362330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.368362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.370576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.371282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.371970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.441795 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63f3ba95-3817-4c27-8c84-8adafb7b86c2 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 204 len: 0 microversion: 2.1 time: 0.220167 Aug 29 15:40:29.446436 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1597/3335] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:29 2022] DELETE /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:29.453998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-876e71f5-b155-4875-8425-3f17bab53bdc tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e2744d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1485607890", "description": "tempest-description-1009714756"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:29.727894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:29.740235 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dee865a2-d200-4179-98d5-252f94cd191d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.399242 Aug 29 15:40:29.741171 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1739/3336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.749602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1443435045", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5c089729-15d8-41d3-a996-e24ac0861c49"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:29.852433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] validate_networks() for [('5c089729-15d8-41d3-a996-e24ac0861c49', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:30.309294 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-876e71f5-b155-4875-8425-3f17bab53bdc tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.860892 Aug 29 15:40:30.310316 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1598/3337] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:40:29 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:30.315510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.316241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.334089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.334828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.335455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.336335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.337117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.337747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.445825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.459170 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa21801b-ed92-4bb5-ae0d-c477ccabb08b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1272 microversion: 2.1 time: 0.146021 Aug 29 15:40:30.459796 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1599/3338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:30.470552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.471297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.493500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.494067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.494524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.495510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.496014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.496452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.502426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:30.502837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:30.503323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:30.503738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:30.504155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:30.519840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.520614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.521425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.522900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.523527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.524408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.562690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:30.569930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Getting quotas for user c631f558d99f40feb637f376bac1cffa and project c4289f452ed34003a85d00e8f6959d78. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:30.584986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:30.587479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:30.647676 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-27071f86-12dd-4fdb-bcbb-fc235b69c35e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905356 Aug 29 15:40:30.655014 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1740/3339] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:40:30.661127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93434601-f931-48c9-b496-7a2cdf95ff68 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e2d3b9d0>, body: {"security_group_rule": {"parent_group_id": "ce6fde3c-53c1-419c-9681-a4f0b8bbc848", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "91111c74-412f-412b-8389-ac972cb00077"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:31.135939 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93434601-f931-48c9-b496-7a2cdf95ff68 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.479668 Aug 29 15:40:31.146323 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1741/3340] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:40:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:31.152039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b25e09d-1655-4856-b9c2-e22433fe0601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.152908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5b25e09d-1655-4856-b9c2-e22433fe0601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.257904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:31.266547 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e90dfdd-8c92-4209-bb76-2455f3f5a7c1 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1509 microversion: 2.1 time: 0.805671 Aug 29 15:40:31.270123 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1600/3341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1509 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:31.276709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.280373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.301698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.303914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.306043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.307995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.311256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.311823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.320417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b25e09d-1655-4856-b9c2-e22433fe0601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:31.330239 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b25e09d-1655-4856-b9c2-e22433fe0601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1208 microversion: 2.1 time: 0.180790 Aug 29 15:40:31.332240 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1742/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:31.339878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4b5d0ae9-c4ff-43f8-b1ea-e1ec7e1aae15 req-ec6da95e-bf16-421b-84b4-dcbae589f7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7d3301-a307-4d91-8767-35314cf5f3fa", "name": "network-vif-unplugged", "status": "completed", "tag": "753d848f-72ee-429f-b2a5-67dd323907d1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:31.371629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4b5d0ae9-c4ff-43f8-b1ea-e1ec7e1aae15 req-ec6da95e-bf16-421b-84b4-dcbae589f7a8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.372168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4b5d0ae9-c4ff-43f8-b1ea-e1ec7e1aae15 req-ec6da95e-bf16-421b-84b4-dcbae589f7a8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.375016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4b5d0ae9-c4ff-43f8-b1ea-e1ec7e1aae15 req-ec6da95e-bf16-421b-84b4-dcbae589f7a8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.406152 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4b5d0ae9-c4ff-43f8-b1ea-e1ec7e1aae15 req-ec6da95e-bf16-421b-84b4-dcbae589f7a8 service nova] Creating event network-vif-unplugged:753d848f-72ee-429f-b2a5-67dd323907d1 for instance eb7d3301-a307-4d91-8767-35314cf5f3fa on n-h2-854882-3 Aug 29 15:40:31.419217 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4b5d0ae9-c4ff-43f8-b1ea-e1ec7e1aae15 req-ec6da95e-bf16-421b-84b4-dcbae589f7a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085725 Aug 29 15:40:31.424254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1743/3343] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:31.441776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff666da6-4276-4415-9d19-91dea658bcf1 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e28c30d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-738661353", "description": "tempest-description-1112985903"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:31.845124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:31.861213 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f0e29af5-5d71-40c6-8ac9-b39b3d9b8e62 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.581831 Aug 29 15:40:31.861996 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1601/3344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:31.884022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.885759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.912709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.916528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.917161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.917922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.924546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.925021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.260453 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff666da6-4276-4415-9d19-91dea658bcf1 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.832068 Aug 29 15:40:32.261091 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1744/3345] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:40:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:32.273893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99fb19eb-1807-48a2-beaa-4a834d3f4f03 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e2bde310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1542352957", "description": "tempest-description-1986144510"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:32.727403 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99fb19eb-1807-48a2-beaa-4a834d3f4f03 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.457638 Aug 29 15:40:32.728497 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1745/3346] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:40:32 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:32.734170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:32.735253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:32.772775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.775892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.778195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.781407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.786028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.787341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.168995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.178957 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c93ef1f4-318f-4b45-a74c-d824849b4213 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 1.310600 Aug 29 15:40:33.184619 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1602/3347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.205429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.214510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.228307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.228943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.231539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.232746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.233502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.234786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.264266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.276240 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-79913aae-5854-442e-ab97-ddc62ac1c889 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1452 microversion: 2.1 time: 0.546450 Aug 29 15:40:33.282351 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1746/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:32 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1452 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.292851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-556283e6-e373-4bd4-807d-808f4c32735f req-1d51bf69-142b-4d30-ad6a-2bf3e880eeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7d3301-a307-4d91-8767-35314cf5f3fa", "name": "network-vif-deleted", "tag": "753d848f-72ee-429f-b2a5-67dd323907d1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:33.321477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-556283e6-e373-4bd4-807d-808f4c32735f req-1d51bf69-142b-4d30-ad6a-2bf3e880eeb1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.322230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-556283e6-e373-4bd4-807d-808f4c32735f req-1d51bf69-142b-4d30-ad6a-2bf3e880eeb1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.323014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-556283e6-e373-4bd4-807d-808f4c32735f req-1d51bf69-142b-4d30-ad6a-2bf3e880eeb1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.327480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:33.336289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-556283e6-e373-4bd4-807d-808f4c32735f req-1d51bf69-142b-4d30-ad6a-2bf3e880eeb1 service nova] Creating event network-vif-deleted:753d848f-72ee-429f-b2a5-67dd323907d1 for instance eb7d3301-a307-4d91-8767-35314cf5f3fa on n-h2-854882-3 Aug 29 15:40:33.354258 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-556283e6-e373-4bd4-807d-808f4c32735f req-1d51bf69-142b-4d30-ad6a-2bf3e880eeb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070117 Aug 29 15:40:33.358149 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1747/3349] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:33.369947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6fd4fe94-4ed7-47b6-b6e0-08ebdf67030d tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e28c3ca0>, body: {"security_group_rule": {"parent_group_id": "64d644a3-e842-484f-afb4-c05c88aa813b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8def47ca-89a9-42f6-99bf-5a021eb6065c"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:33.549318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.565534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7af922dd-48f8-49ee-ac40-99d48de79148 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1266 microversion: 2.1 time: 0.378726 Aug 29 15:40:33.579892 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1603/3350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1266 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.592856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.593633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.605061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.605848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.606924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.607938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.608609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.610331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.965601 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6fd4fe94-4ed7-47b6-b6e0-08ebdf67030d tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.605729 Aug 29 15:40:33.969582 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1748/3351] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:40:33 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:33.985403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09958c4c-e777-498a-ad95-1af24fd28f9c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:34.025008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09958c4c-e777-498a-ad95-1af24fd28f9c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.034851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09958c4c-e777-498a-ad95-1af24fd28f9c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.041374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09958c4c-e777-498a-ad95-1af24fd28f9c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.088552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-09958c4c-e777-498a-ad95-1af24fd28f9c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Going to try to stop instance {{(pid=130002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:40:34.101892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:34.134584 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae7fb683-e409-4ec8-a9a2-413d20264aab tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.547583 Aug 29 15:40:34.135920 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1604/3352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:34.153262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.154835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.164196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.165182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.166501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.167690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.168414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.169731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.184751 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-09958c4c-e777-498a-ad95-1af24fd28f9c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action" status: 202 len: 0 microversion: 2.1 time: 0.210693 Aug 29 15:40:34.186073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1749/3353] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:33 2022] POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:34.216727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e6c71932-c4fe-4df3-8020-37261ffeb84e req-2630e168-a70d-48ec-a5ac-77ba305b8d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdb7873-a953-4b26-8ffb-139cb096faf1", "name": "network-vif-unplugged", "status": "completed", "tag": "7a7b8149-cb7f-4f33-8595-700998dd84d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:34.231344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e6c71932-c4fe-4df3-8020-37261ffeb84e req-2630e168-a70d-48ec-a5ac-77ba305b8d00 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.233005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e6c71932-c4fe-4df3-8020-37261ffeb84e req-2630e168-a70d-48ec-a5ac-77ba305b8d00 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.233751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e6c71932-c4fe-4df3-8020-37261ffeb84e req-2630e168-a70d-48ec-a5ac-77ba305b8d00 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.249128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.server_external_events [req-e6c71932-c4fe-4df3-8020-37261ffeb84e req-2630e168-a70d-48ec-a5ac-77ba305b8d00 service nova] Unable to find a host for instance 6fdb7873-a953-4b26-8ffb-139cb096faf1. Dropping event network-vif-unplugged {{(pid=130002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:40:34.250409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e6c71932-c4fe-4df3-8020-37261ffeb84e req-2630e168-a70d-48ec-a5ac-77ba305b8d00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062971 Aug 29 15:40:34.251271 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1750/3354] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:40:34.256770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d0e72a9-74c6-443b-992a-27406161617e tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e29f51f0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.698569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:34.712877 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76f6992f-9472-4318-95c4-fb5b0ba38753 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1452 microversion: 2.1 time: 0.575613 Aug 29 15:40:34.715881 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1605/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1452 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:34.726164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.730937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.761653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.770268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.771107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.773593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.792218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.799379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.102228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.112415 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ecd7f504-1932-4207-9523-8ffcca2d865e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1676 microversion: 2.1 time: 0.393248 Aug 29 15:40:35.117938 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1606/3356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1676 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:35.124452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.127143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.133987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.134722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.135326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.136199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.136819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.137436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.340384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.363356 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2613b8e-5a38-4b12-883b-730d9185c380 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.243737 Aug 29 15:40:35.364293 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1607/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:35.369596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.370564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.383079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.383721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.384256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.385064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.385819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.386346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.545721 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d0e72a9-74c6-443b-992a-27406161617e tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8def47ca-89a9-42f6-99bf-5a021eb6065c" status: 202 len: 0 microversion: 2.1 time: 1.293125 Aug 29 15:40:35.546312 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1751/3358] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:34 2022] DELETE /compute/v2.1/os-security-groups/8def47ca-89a9-42f6-99bf-5a021eb6065c => generated 0 bytes in 1294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:35.552577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:35.553234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.562512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.565520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.566383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.567598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.568303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.568895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.609257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lazy-loading 'flavor' on Instance uuid 6fdb7873-a953-4b26-8ffb-139cb096faf1 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:35.623151 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Cannot 'shelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state shelved_offloaded Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action HTTP/1.1 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 14 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: {"shelve": {}} Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'shelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state shelved_offloaded Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'shelve': {}}} Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:40:35.625764 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state shelved_offloaded Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state shelved_offloaded Aug 29 15:40:35.630548 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:35.632160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 409 to user: Cannot 'shelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state shelved_offloaded {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:35.633186 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-072471f8-b739-4ac2-a588-87257c5ba449 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 409 len: 155 microversion: 2.1 time: 0.084654 Aug 29 15:40:35.634513 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1752/3359] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:35 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 155 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:40:35.644140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-cc811c0a-8a0f-4425-b28d-51d1f1001db5 req-9af1d98f-b76d-47ab-b966-33b4d833f3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325edc13-1844-41b6-a92a-2f123021d1bc", "tag": "b90e2fa0-8a13-42a9-996e-998a9f9b5194"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:35.660750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cc811c0a-8a0f-4425-b28d-51d1f1001db5 req-9af1d98f-b76d-47ab-b966-33b4d833f3fc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.661928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cc811c0a-8a0f-4425-b28d-51d1f1001db5 req-9af1d98f-b76d-47ab-b966-33b4d833f3fc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.662537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cc811c0a-8a0f-4425-b28d-51d1f1001db5 req-9af1d98f-b76d-47ab-b966-33b4d833f3fc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.676788 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-cc811c0a-8a0f-4425-b28d-51d1f1001db5 req-9af1d98f-b76d-47ab-b966-33b4d833f3fc service nova] Creating event network-changed:b90e2fa0-8a13-42a9-996e-998a9f9b5194 for instance 325edc13-1844-41b6-a92a-2f123021d1bc on n-h1-854882-3 Aug 29 15:40:35.683670 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-cc811c0a-8a0f-4425-b28d-51d1f1001db5 req-9af1d98f-b76d-47ab-b966-33b4d833f3fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046917 Aug 29 15:40:35.684790 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1753/3360] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:35.690659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.691579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.699312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.700163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.700841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.701761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.702378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.702970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.823945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.838366 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a65b888-abd1-4b5b-97cd-621fbaf1b167 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.472718 Aug 29 15:40:35.840649 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1608/3361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:35.846876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ab12456-a691-41dd-9276-7dc9f785eac7 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e2744c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.005852 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ab12456-a691-41dd-9276-7dc9f785eac7 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/64d644a3-e842-484f-afb4-c05c88aa813b" status: 200 len: 247 microversion: 2.1 time: 0.163579 Aug 29 15:40:36.006772 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1609/3362] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/os-security-groups/64d644a3-e842-484f-afb4-c05c88aa813b => generated 247 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:36.011839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:36.012664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.031527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.032034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.032526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.033245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.033754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.034187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.076323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:36.110737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.134517 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2d932b6b-fef7-4dd0-91d9-d6ba09420e96 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.447529 Aug 29 15:40:36.134517 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1754/3363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:36.150594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b8623ec-f402-4678-b945-0cc670af2863 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e2821b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1073798907", "description": "tempest-description-1241801076"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:36.160949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130001) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 15:40:36.307828 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e1d5993-6447-4f74-9a20-b29e49eb8f83 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 202 len: 0 microversion: 2.1 time: 0.299759 Aug 29 15:40:36.318912 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1610/3364] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:36 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:36.331883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.335012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.351024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.351840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.352570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.354011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.354739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.355514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.792801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:36.965284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b8623ec-f402-4678-b945-0cc670af2863 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.826411 Aug 29 15:40:36.966737 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1755/3365] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:40:36 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:36.977600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.978466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.987147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.990532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.991287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.993851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.994525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.006199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.436572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:37.631231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.640595 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03655662-97e6-4fad-9596-b61eae9016b1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1676 microversion: 2.1 time: 1.320069 Aug 29 15:40:37.647587 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1611/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1676 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:37.657463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.658325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:37.674488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.675096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.675642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.676468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.677032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.677795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.041974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.051022 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0dc0e847-938a-44ea-bc54-258943bb99ce tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.402172 Aug 29 15:40:38.051637 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1612/3367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.064896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3e6805c7-e395-467d-b2ed-d9af8a6eb607 req-78b3fe19-3ef2-41d7-9a67-7a44d6d857f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1697418-0461-46cd-a0f2-82f75af54233", "tag": "30c2003e-c982-4a88-9a3b-20c2f9e5072c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:38.081412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3e6805c7-e395-467d-b2ed-d9af8a6eb607 req-78b3fe19-3ef2-41d7-9a67-7a44d6d857f1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.088228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3e6805c7-e395-467d-b2ed-d9af8a6eb607 req-78b3fe19-3ef2-41d7-9a67-7a44d6d857f1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.088698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3e6805c7-e395-467d-b2ed-d9af8a6eb607 req-78b3fe19-3ef2-41d7-9a67-7a44d6d857f1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.109368 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3e6805c7-e395-467d-b2ed-d9af8a6eb607 req-78b3fe19-3ef2-41d7-9a67-7a44d6d857f1 service nova] Creating event network-changed:30c2003e-c982-4a88-9a3b-20c2f9e5072c for instance e1697418-0461-46cd-a0f2-82f75af54233 on n-h2-854882-3 Aug 29 15:40:38.129078 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3e6805c7-e395-467d-b2ed-d9af8a6eb607 req-78b3fe19-3ef2-41d7-9a67-7a44d6d857f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076048 Aug 29 15:40:38.130259 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1613/3368] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:38.137306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.138408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.157821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.161955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.162630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.163545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.164587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.165182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.239522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.258960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e4f41364-bc75-4055-a761-9d92f2ca0568 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1460 microversion: 2.1 time: 1.290877 Aug 29 15:40:38.263864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1756/3369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1460 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.278500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-741d16cd-2871-46e4-b033-7788e910ee1f tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e28c3dc0>, body: {"security_group_rule": {"parent_group_id": "7df1f6a7-31fe-4d92-bbd7-43cd57e1fecc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:38.430081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.446049 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f3d3940a-0afb-4269-8932-8e1e79efe5bd tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.313877 Aug 29 15:40:38.459211 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1614/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.464063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.464678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.480987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.481795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.482412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.483305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.483760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.484182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.771372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.783507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c57a047b-41c8-4e2a-817c-4911e9622b37 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.323078 Aug 29 15:40:38.784294 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1615/3371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.790666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.791975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.800536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.801273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.801922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.802958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.803579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.804356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.048553 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-741d16cd-2871-46e4-b033-7788e910ee1f tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.780427 Aug 29 15:40:39.049600 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1757/3372] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:40:38 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:39.060668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c18a76fc-918c-4b03-93d6-df88da1bea5f tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Action: 'create', calling method: .version_select at 0x7fb0e2d3be50>, body: {"security_group_rule": {"parent_group_id": "7df1f6a7-31fe-4d92-bbd7-43cd57e1fecc", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:39.488040 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c18a76fc-918c-4b03-93d6-df88da1bea5f tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.431204 Aug 29 15:40:39.489046 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1758/3373] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Aug 29 15:40:39 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:39.494454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.495447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.509028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.512671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.513327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.514255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.515907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.518660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.581299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:39.597019 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-99ae7c87-7798-424d-8431-b78af32578de tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1676 microversion: 2.1 time: 0.808807 Aug 29 15:40:39.610638 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1616/3374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1676 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:39.610638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.610638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.611492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.611994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.612640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.627542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.628083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.628540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.769163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:39.780221 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-718c6084-991f-4877-ba69-fe670c2fcd20 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.289989 Aug 29 15:40:39.781228 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1759/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:39.788303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.788932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.796901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.797325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.797981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.798723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.800818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.801265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.084316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.097294 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-50fd58b6-debf-4997-8951-4a318d165055 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1462 microversion: 2.1 time: 0.498131 Aug 29 15:40:40.110547 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1617/3376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1462 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.116976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ec8d44e-b42a-4dcb-86f0-482c13b12776 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e2795040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.137987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.147978 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec075fff-2c47-4c85-9525-76e424269660 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.364983 Aug 29 15:40:40.161968 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1760/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.176666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.187080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:40.214814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.218738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.221328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.222840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.224556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.225176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.328110 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ec8d44e-b42a-4dcb-86f0-482c13b12776 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/7df1f6a7-31fe-4d92-bbd7-43cd57e1fecc" status: 200 len: 665 microversion: 2.1 time: 0.215844 Aug 29 15:40:40.337701 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1618/3378] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/os-security-groups/7df1f6a7-31fe-4d92-bbd7-43cd57e1fecc => generated 665 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:40.343199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-49061e8c-3abd-470d-889b-6827ebc5e06a tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e273fe50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.505485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.518965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c36acf99-a118-4f20-ba28-b132ac43bfd7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.350800 Aug 29 15:40:40.519805 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1761/3379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.618346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.618967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:40.621543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:40.631417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.632457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.638914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.639662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.640281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.640710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.917416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.927731 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2dde345-1f8f-4d79-bad4-c3cb4d6cb6e8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1676 microversion: 2.1 time: 0.313238 Aug 29 15:40:40.931549 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1762/3380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1676 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.944711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.947150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:40.962100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:40.963888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.967198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.967830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.970757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.971611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.973909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.200987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.225966 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-49061e8c-3abd-470d-889b-6827ebc5e06a tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/e3b85b69-5302-45e8-aca7-10acb93232d1" status: 202 len: 0 microversion: 2.1 time: 0.886398 Aug 29 15:40:41.232788 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1619/3381] 10.222.0.16 () {58 vars in 1287 bytes} [Mon Aug 29 15:40:40 2022] DELETE /compute/v2.1/os-security-group-rules/e3b85b69-5302-45e8-aca7-10acb93232d1 => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:40:41.239966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.240858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.249257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e65b42b4-6abb-41e8-8f22-3d50782d4011 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.310701 Aug 29 15:40:41.250477 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1763/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:41.266010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.266927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.272027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.273369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.273679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.274937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.275532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.276189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.305795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.306626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.308035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.309203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.311040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.312276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.328321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:41.613261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.624882 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eb38b599-ddec-4035-9f7c-ac3cf3fb19fa tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.372253 Aug 29 15:40:41.625502 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1764/3383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:41.631580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c0b12ec2-18dd-47ce-899f-0a0fd9198e17 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e2d6ab80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.814640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.825819 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1273d74-e7b6-43d2-a1b7-e1298e0b543d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.591377 Aug 29 15:40:41.827117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1620/3384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:41.834340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.835256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.845892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.846671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.847490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.848389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.849470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.850681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.920221 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c0b12ec2-18dd-47ce-899f-0a0fd9198e17 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7df1f6a7-31fe-4d92-bbd7-43cd57e1fecc" status: 202 len: 0 microversion: 2.1 time: 0.293187 Aug 29 15:40:41.921447 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1765/3385] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:41 2022] DELETE /compute/v2.1/os-security-groups/7df1f6a7-31fe-4d92-bbd7-43cd57e1fecc => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:41.926882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0f1a89e5-206c-48c9-92ce-f4b814f7b263 req-0af361b9-5765-4e1d-b162-a8594eddc212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-plugged", "status": "completed", "tag": "e84f8c8c-ddb4-41c6-b895-09864fd4f756"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:41.951829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0f1a89e5-206c-48c9-92ce-f4b814f7b263 req-0af361b9-5765-4e1d-b162-a8594eddc212 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.952328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0f1a89e5-206c-48c9-92ce-f4b814f7b263 req-0af361b9-5765-4e1d-b162-a8594eddc212 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.952777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0f1a89e5-206c-48c9-92ce-f4b814f7b263 req-0af361b9-5765-4e1d-b162-a8594eddc212 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.979969 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0f1a89e5-206c-48c9-92ce-f4b814f7b263 req-0af361b9-5765-4e1d-b162-a8594eddc212 service nova] Creating event network-vif-plugged:e84f8c8c-ddb4-41c6-b895-09864fd4f756 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:42.001613 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0f1a89e5-206c-48c9-92ce-f4b814f7b263 req-0af361b9-5765-4e1d-b162-a8594eddc212 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078054 Aug 29 15:40:42.002793 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1766/3386] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:42.008550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8c1e31c-e258-4e11-93e0-3735e2d5c0fa tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e2de88b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.055478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG neutronclient.v2_0.client [None req-e8c1e31c-e258-4e11-93e0-3735e2d5c0fa tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist", "detail": ""}} {{(pid=130002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:40:42.056864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.security_group_api [None req-e8c1e31c-e258-4e11-93e0-3735e2d5c0fa tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Neutron security group 8def47ca-89a9-42f6-99bf-5a021eb6065c not found {{(pid=130002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:40:42.057434 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e8c1e31c-e258-4e11-93e0-3735e2d5c0fa tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] HTTP exception thrown: Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist Aug 29 15:40:42.057434 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-3dcf6d11-3099-4943-9389-866b4c8f9612'] Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8c1e31c-e258-4e11-93e0-3735e2d5c0fa tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Request method failure captured: Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-security-groups/8def47ca-89a9-42f6-99bf-5a021eb6065c HTTP/1.1 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN3gsR33VgCUqAgJPSCBzDA8u-AMS0EGpSWvIphBQu7jGb8q_K4PDkZRdgYNoyd6CIh2HFKUi-0pUTXpFEbzWeIbaQ741KBunnzBPqEZaBQs9EtUh2KN3pEmsENT05L5MiwXCc4jp0ZNd91DR-l3CXPA1I0BN2tfWAjoqNv0nVjhsTI Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0e1f9ed29dd545da93c61d1a8cf9f37f Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-17063389 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e1f9ed29dd545da93c61d1a8cf9f37f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e1f9ed29dd545da93c61d1a8cf9f37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e1f9ed29dd545da93c61d1a8cf9f37f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e1f9ed29dd545da93c61d1a8cf9f37f"}]}] Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-SecurityGroupRulesTestJSON-17063389 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0e1f9ed29dd545da93c61d1a8cf9f37f Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-17063389 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-SecurityGroupRulesTestJSON-17063389-project Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3b0b3cb059bc44e5b3eb892827315411 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-SecurityGroupRulesTestJSON-17063389-project Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: exception: Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-3dcf6d11-3099-4943-9389-866b4c8f9612'] Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '8def47ca-89a9-42f6-99bf-5a021eb6065c'} Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:40:42.059648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dcf6d11-3099-4943-9389-866b4c8f9612'] Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dcf6d11-3099-4943-9389-866b4c8f9612'] Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dcf6d11-3099-4943-9389-866b4c8f9612'] Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dcf6d11-3099-4943-9389-866b4c8f9612'] Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8c1e31c-e258-4e11-93e0-3735e2d5c0fa tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Returning 404 to user: Security group 8def47ca-89a9-42f6-99bf-5a021eb6065c does not exist Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: Neutron server returns request_ids: ['req-3dcf6d11-3099-4943-9389-866b4c8f9612'] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8c1e31c-e258-4e11-93e0-3735e2d5c0fa tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8def47ca-89a9-42f6-99bf-5a021eb6065c" status: 404 len: 194 microversion: 2.1 time: 0.056949 Aug 29 15:40:42.066339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1767/3387] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:42 2022] DELETE /compute/v2.1/os-security-groups/8def47ca-89a9-42f6-99bf-5a021eb6065c => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:42.074326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.075085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:42.099756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.100382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.100781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.101542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.102007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.102438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.381901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:42.393119 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e72a8b4b-3ed2-4187-a17e-d13c3e177bac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1676 microversion: 2.1 time: 0.327029 Aug 29 15:40:42.393758 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1768/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1676 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:42.405575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9ecf228-2845-48da-8008-0a35c0453a55 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e28c3550>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.704119 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9ecf228-2845-48da-8008-0a35c0453a55 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/64d644a3-e842-484f-afb4-c05c88aa813b" status: 202 len: 0 microversion: 2.1 time: 0.309199 Aug 29 15:40:42.705886 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1769/3389] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:42 2022] DELETE /compute/v2.1/os-security-groups/64d644a3-e842-484f-afb4-c05c88aa813b => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:42.711573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.713236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:42.732723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.733331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.733858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.734639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.735165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.735702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.021197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.030995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c6af2bb5-cf49-42d7-8e19-75515a868bb9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.323646 Aug 29 15:40:43.048617 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1770/3390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.050042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.050754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.058550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.059160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.059779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.060738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.061457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.062097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.140283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.154201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a00bdfb7-8f3c-4508-96e5-b8d2578d49f3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 1.325820 Aug 29 15:40:43.154802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1621/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.159642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7e9546c-d05d-40b2-9760-d090d4df4870 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e27441f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.303320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.317577 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a57dc6d-be80-4f86-9349-85cba3fa5e0d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.268162 Aug 29 15:40:43.319133 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1771/3392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.324061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.330014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.347504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.352135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.352619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.353372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.355307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.355979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.588431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.604183 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3abedb8e-49cc-4cda-9ecb-45e538bcc795 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.282984 Aug 29 15:40:43.605182 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1772/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.614481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.615460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.622654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.623531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.624254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.625183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.625987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.626649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.653805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:43.835474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.856730 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6181aec1-b5b7-4d75-af8a-3675ebfacfb1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1676 microversion: 2.1 time: 0.250180 Aug 29 15:40:43.871591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1773/3394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1676 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.895206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9853bff2-fad1-4c86-aeba-d3fda69f25e1 req-d35c9d50-96c9-450f-991a-579657c0a08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fdb7873-a953-4b26-8ffb-139cb096faf1", "tag": "7a7b8149-cb7f-4f33-8595-700998dd84d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:43.907915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9853bff2-fad1-4c86-aeba-d3fda69f25e1 req-d35c9d50-96c9-450f-991a-579657c0a08e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.908755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9853bff2-fad1-4c86-aeba-d3fda69f25e1 req-d35c9d50-96c9-450f-991a-579657c0a08e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.909438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9853bff2-fad1-4c86-aeba-d3fda69f25e1 req-d35c9d50-96c9-450f-991a-579657c0a08e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.926798 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9853bff2-fad1-4c86-aeba-d3fda69f25e1 req-d35c9d50-96c9-450f-991a-579657c0a08e service nova] Creating event network-changed:7a7b8149-cb7f-4f33-8595-700998dd84d9 for instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 on n-h2-854882-3 Aug 29 15:40:43.935215 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9853bff2-fad1-4c86-aeba-d3fda69f25e1 req-d35c9d50-96c9-450f-991a-579657c0a08e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Aug 29 15:40:43.939234 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1774/3395] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:44.057137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.057900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.060212 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7e9546c-d05d-40b2-9760-d090d4df4870 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/91111c74-412f-412b-8389-ac972cb00077" status: 202 len: 0 microversion: 2.1 time: 0.904109 Aug 29 15:40:44.065009 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1622/3396] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:43 2022] DELETE /compute/v2.1/os-security-groups/91111c74-412f-412b-8389-ac972cb00077 => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:44.070868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e33cf132-0269-4a60-b706-280d68b224a4 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e26e9e50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.073161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.073724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.084869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.085659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.086320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.086941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.336472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:44.345870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5912ed1f-0457-43bb-bdb5-e1b941dce23e tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.292068 Aug 29 15:40:44.346808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1775/3397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:44.352134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-30a2458d-5fc2-4c1b-b535-c5ad3d3f8b17 req-c1af735e-03b4-4fea-b140-d51c0f935b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-plugged", "status": "completed", "tag": "67303c1a-9438-492b-8533-38c336022779"}, {"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-plugged", "status": "completed", "tag": "ace44df1-db24-4c32-ad6c-65ab6ad7bc58"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:44.362433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30a2458d-5fc2-4c1b-b535-c5ad3d3f8b17 req-c1af735e-03b4-4fea-b140-d51c0f935b96 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.363055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30a2458d-5fc2-4c1b-b535-c5ad3d3f8b17 req-c1af735e-03b4-4fea-b140-d51c0f935b96 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.363494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30a2458d-5fc2-4c1b-b535-c5ad3d3f8b17 req-c1af735e-03b4-4fea-b140-d51c0f935b96 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.379714 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-30a2458d-5fc2-4c1b-b535-c5ad3d3f8b17 req-c1af735e-03b4-4fea-b140-d51c0f935b96 service nova] Creating event network-vif-plugged:67303c1a-9438-492b-8533-38c336022779 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:44.381296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-30a2458d-5fc2-4c1b-b535-c5ad3d3f8b17 req-c1af735e-03b4-4fea-b140-d51c0f935b96 service nova] Creating event network-vif-plugged:ace44df1-db24-4c32-ad6c-65ab6ad7bc58 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:44.386063 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-30a2458d-5fc2-4c1b-b535-c5ad3d3f8b17 req-c1af735e-03b4-4fea-b140-d51c0f935b96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037424 Aug 29 15:40:44.387331 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1776/3398] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:44.393326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.394141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.407493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.407978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.408410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.409531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.409656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.410135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.666051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:44.678251 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e6ada0f-4e65-42bd-8a91-5ea5629af7a6 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.289652 Aug 29 15:40:44.693521 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1777/3399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:44.699199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.700201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.708410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.709072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.709656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.711926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.712504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.713028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.880900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:44.890965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfabebe0-57ac-4274-9af1-3236a131da73 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.196036 Aug 29 15:40:44.891814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1778/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:44.897673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.898854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.905430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.906225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.906753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.908072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.908753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.909299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.003907 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e33cf132-0269-4a60-b706-280d68b224a4 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ce6fde3c-53c1-419c-9681-a4f0b8bbc848" status: 202 len: 0 microversion: 2.1 time: 0.937362 Aug 29 15:40:45.004946 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1623/3401] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:44 2022] DELETE /compute/v2.1/os-security-groups/ce6fde3c-53c1-419c-9681-a4f0b8bbc848 => generated 0 bytes in 939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:45.017793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.018478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:45.049454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.049974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.050427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.056909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.057299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.060724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.070456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.081822 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3ff9149-74a2-499b-bb4d-fb510bf88353 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.187771 Aug 29 15:40:45.093414 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1779/3402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:45.093414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ed149bc-d62d-4b5a-b8ae-166967c4e874 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e2d6ad30>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.402360 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7ed149bc-d62d-4b5a-b8ae-166967c4e874 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/731f77a7-9c26-46da-9a04-49c85211b08b" status: 202 len: 0 microversion: 2.1 time: 0.317165 Aug 29 15:40:45.403751 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1780/3403] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:45 2022] DELETE /compute/v2.1/os-security-groups/731f77a7-9c26-46da-9a04-49c85211b08b => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:45.411811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.412854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:45.419027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.430659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae42bf8c-85a0-4d13-9819-9e5394f2152d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1653 microversion: 2.1 time: 0.424546 Aug 29 15:40:45.453542 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1624/3404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:45 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1653 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:45.460187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.461007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.461676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.471333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.472256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c3807e6-2675-4f2a-b813-e18290a69436 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] Calling method '.version_select at 0x7fb0e26e9940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.473013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.474229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.636939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.648470 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96270148-e0dc-4ce6-9c4d-7f3632182e17 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.243562 Aug 29 15:40:45.652351 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1781/3405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:45 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:45.657932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8f73f3bc-1849-4414-a3d7-1239b812f87a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:45.664423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f73f3bc-1849-4414-a3d7-1239b812f87a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.664923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f73f3bc-1849-4414-a3d7-1239b812f87a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.665367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f73f3bc-1849-4414-a3d7-1239b812f87a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.697091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8f73f3bc-1849-4414-a3d7-1239b812f87a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Going to try to start instance {{(pid=130002) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:40:45.759647 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8f73f3bc-1849-4414-a3d7-1239b812f87a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action" status: 202 len: 0 microversion: 2.1 time: 0.105155 Aug 29 15:40:45.760849 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1782/3406] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:45 2022] POST /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:45.785285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.786059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:45.797229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.798510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.798956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.799709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.800174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.800772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.180236 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c3807e6-2675-4f2a-b813-e18290a69436 tempest-SecurityGroupRulesTestJSON-17063389 tempest-SecurityGroupRulesTestJSON-17063389-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/331f3ed9-1703-4e49-82d0-abae25887cea" status: 202 len: 0 microversion: 2.1 time: 0.724580 Aug 29 15:40:46.180860 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1625/3407] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:40:45 2022] DELETE /compute/v2.1/os-security-groups/331f3ed9-1703-4e49-82d0-abae25887cea => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:46.186027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.186937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:46.229695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.231201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.236068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.236832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.237304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.237761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.332107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:46.348014 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb30b0ba-8759-4d5d-95f2-dcddb32c8cb1 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1353 microversion: 2.1 time: 0.585580 Aug 29 15:40:46.362918 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1783/3408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:45 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1353 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:46.382849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.383788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:46.392007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.393032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.393832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.395407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.396387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.397097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.797105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:46.806586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9de4d55e-e6e8-4a20-bda0-b80f334bd5bb tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.442090 Aug 29 15:40:46.812889 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1784/3409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:46.826538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.835008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:46.854742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.866361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.866816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.867604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.868013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.868453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.298597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.310284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-76407849-d6b1-4ac3-a66e-b3d1e817b10d tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.487410 Aug 29 15:40:47.330508 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1785/3410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:47.338016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-056dfddc-8a62-4d95-a977-06ce3e420efb req-1bf286bd-74b6-4fb1-b450-6351bdaf44d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325edc13-1844-41b6-a92a-2f123021d1bc", "name": "network-vif-plugged", "status": "completed", "tag": "b90e2fa0-8a13-42a9-996e-998a9f9b5194"}, {"server_uuid": "e1697418-0461-46cd-a0f2-82f75af54233", "name": "network-vif-plugged", "status": "completed", "tag": "30c2003e-c982-4a88-9a3b-20c2f9e5072c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:47.351389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-056dfddc-8a62-4d95-a977-06ce3e420efb req-1bf286bd-74b6-4fb1-b450-6351bdaf44d4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.353620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-056dfddc-8a62-4d95-a977-06ce3e420efb req-1bf286bd-74b6-4fb1-b450-6351bdaf44d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.354563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-056dfddc-8a62-4d95-a977-06ce3e420efb req-1bf286bd-74b6-4fb1-b450-6351bdaf44d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.396752 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-056dfddc-8a62-4d95-a977-06ce3e420efb req-1bf286bd-74b6-4fb1-b450-6351bdaf44d4 service nova] Creating event network-vif-plugged:b90e2fa0-8a13-42a9-996e-998a9f9b5194 for instance 325edc13-1844-41b6-a92a-2f123021d1bc on n-h1-854882-3 Aug 29 15:40:47.399414 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-056dfddc-8a62-4d95-a977-06ce3e420efb req-1bf286bd-74b6-4fb1-b450-6351bdaf44d4 service nova] Creating event network-vif-plugged:30c2003e-c982-4a88-9a3b-20c2f9e5072c for instance e1697418-0461-46cd-a0f2-82f75af54233 on n-h2-854882-3 Aug 29 15:40:47.432993 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-056dfddc-8a62-4d95-a977-06ce3e420efb req-1bf286bd-74b6-4fb1-b450-6351bdaf44d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081243 Aug 29 15:40:47.434261 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1786/3411] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:47.451565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:47.468678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.498415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.500309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.503474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.504277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.504818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.505290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.785801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.802627 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86991bb3-3cb9-41e4-b4e3-b19e74ced13c tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 0.366263 Aug 29 15:40:47.815890 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1787/3412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:47 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:47.821147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:47.822035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.828609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.830001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.830667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.831621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.832287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.832913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.846490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.859676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c02d72b6-d2b8-4a40-9610-0471f7644fc9 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1662 microversion: 2.1 time: 1.677315 Aug 29 15:40:47.860328 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1626/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1662 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:47.886306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:47.893804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.900497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.901339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.901987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.902991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.903916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.904547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.078006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.091631 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cb155af3-2117-41e9-977e-a55d3b3cce5a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1803 microversion: 2.1 time: 0.274117 Aug 29 15:40:48.105447 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1788/3414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:47 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1803 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:48.118818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.120045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.128207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.129240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.129854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.131486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.132059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.132940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.195988 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b977626c-a8eb-41d5-a9cf-966680375a66 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1/ips" status: 200 len: 218 microversion: 2.1 time: 0.086079 Aug 29 15:40:48.203014 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1789/3415] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1/ips => generated 218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:48.211522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.212506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.239435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.240230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.240856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.241760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.242385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.248989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.282928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:48.318333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.330794 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-519ddbeb-dbcd-487f-8365-522c86efa27e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1308 microversion: 2.1 time: 0.451105 Aug 29 15:40:48.332030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1627/3416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:47 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:48.345940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.346869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.362384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.363169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.363760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.364720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.365524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.366191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.414128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:48.477892 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f37eae6-6609-4aa3-92ec-a353d8cf2b8d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 204 len: 0 microversion: 2.1 time: 0.272292 Aug 29 15:40:48.482505 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1790/3417] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:48 2022] DELETE /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:48.598726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9e7add2-e26e-4152-bf12-06feb070ea65 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Action: 'create', calling method: .version_select at 0x7fb0e3635670>, body: {"pool": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:48.728012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.740256 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-990b7e27-0a43-4326-9ef0-cd51168f60e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.406320 Aug 29 15:40:48.743279 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1628/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:48.757361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.758030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.793834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.798906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.799708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.801713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.805015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.808714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.501434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:49.520033 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1035d43f-2539-446e-bfb1-b40f226f477c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1809 microversion: 2.1 time: 0.763196 Aug 29 15:40:49.521180 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1629/3419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1809 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:49.539727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.544214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:49.566491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.580785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.582265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.586251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.587407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.591534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.764407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.777169 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63dc30ac-9cf2-4731-9c1f-727651a614e9 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1314 microversion: 2.1 time: 1.252756 Aug 29 15:40:50.789470 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1630/3420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1314 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:50.795294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:50.796266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:50.804440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.807256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.818153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.823592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.824420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.825113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.373497 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9e7add2-e26e-4152-bf12-06feb070ea65 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.889512 Aug 29 15:40:51.382139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1791/3421] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:51.389092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:51.390241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:51.397611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.407847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.409062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.410079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.410813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.411482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.690513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:51.714564 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a53567af-85c3-4629-acee-6e32a15b0c9a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1489 microversion: 2.1 time: 0.330056 Aug 29 15:40:51.716823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1792/3422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:51 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1489 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:51.725062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:51.726328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:51.748724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.751941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.753669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.758442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.759248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.759711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:52.054233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:52.080336 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8870d44d-b739-4e0a-a916-631e5660ab10 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.356252 Aug 29 15:40:52.081020 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1793/3423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:51 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:52.091863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:52.092491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:52.120243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:52.121941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:52.122417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:52.123154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:52.123621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:52.124058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:52.132792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:52.151895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:52.180262 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2c3a5d1-fa91-4db2-ae3f-923d1f2dc9e4 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1666 microversion: 2.1 time: 1.389195 Aug 29 15:40:52.180879 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1631/3424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:50 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1666 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:52.201368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ff2b45ef-c059-41b1-93c6-1d34db7d207b tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Action: 'create', calling method: .version_select at 0x7fb0e2730b80>, body: {"pool": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:52.548752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:52.566525 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-80f4e339-ef59-4414-893f-05b553253c76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1809 microversion: 2.1 time: 0.480270 Aug 29 15:40:52.567389 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1794/3425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:52 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1809 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:52.586752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-586457650"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:52.589337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:52.629748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:52.631673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:52.632550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:52.633963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:52.634620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:52.635257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.027641 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-790443aa-2ee3-4c02-add5-2a207da6cc61 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "POST /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233/action" status: 202 len: 0 microversion: 2.1 time: 0.444801 Aug 29 15:40:53.029010 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1795/3426] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:52 2022] POST /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:40:53.037164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.042973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.059638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.060838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.062236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.064045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.065288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.066456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.412663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.438019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae5aabb6-8ba8-4c27-ba4f-02ca13de10eb tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1501 microversion: 2.1 time: 0.405274 Aug 29 15:40:53.441179 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1796/3427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1501 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.460349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-545cfc96-9fe5-4f55-be26-0b115d34fab6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e28c3b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.593022 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-545cfc96-9fe5-4f55-be26-0b115d34fab6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632" status: 200 len: 1413 microversion: 2.1 time: 0.149989 Aug 29 15:40:53.601999 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1797/3428] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632 => generated 1413 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.612692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.613613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.622001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.622514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.623134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.624329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.624329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.624803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.851622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.862644 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3458c58e-03c7-467d-bcf8-576732f6f42a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.258284 Aug 29 15:40:53.875152 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1798/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.885970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:53.886812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.898083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.898873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.899540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.900429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.901045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.901672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.932562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lazy-loading 'flavor' on Instance uuid 325edc13-1844-41b6-a92a-2f123021d1bc {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:54.100370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cbeef9c5-498f-40fe-ae4e-7830c65f0746 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "POST /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc/action" status: 202 len: 0 microversion: 2.1 time: 0.219091 Aug 29 15:40:54.109092 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1799/3430] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:53 2022] POST /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:54.120624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-df3f8033-1ca2-4b7d-a04e-5e92944d82cc req-ad20dfe1-1709-46fb-8950-8991c4c1d01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-unplugged", "status": "completed", "tag": "e84f8c8c-ddb4-41c6-b895-09864fd4f756"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:54.136101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df3f8033-1ca2-4b7d-a04e-5e92944d82cc req-ad20dfe1-1709-46fb-8950-8991c4c1d01e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.136868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df3f8033-1ca2-4b7d-a04e-5e92944d82cc req-ad20dfe1-1709-46fb-8950-8991c4c1d01e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.137521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df3f8033-1ca2-4b7d-a04e-5e92944d82cc req-ad20dfe1-1709-46fb-8950-8991c4c1d01e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.178663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-df3f8033-1ca2-4b7d-a04e-5e92944d82cc req-ad20dfe1-1709-46fb-8950-8991c4c1d01e service nova] Creating event network-vif-unplugged:e84f8c8c-ddb4-41c6-b895-09864fd4f756 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:54.191365 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-df3f8033-1ca2-4b7d-a04e-5e92944d82cc req-ad20dfe1-1709-46fb-8950-8991c4c1d01e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080355 Aug 29 15:40:54.192266 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1800/3431] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:54.210844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.217055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.227293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.227919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.229105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.231131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.231715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.243667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.530837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:54.545747 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66586880-0d0d-48b3-9596-72bc870d94bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1788 microversion: 2.1 time: 0.350476 Aug 29 15:40:54.547142 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1801/3432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1788 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:54.553261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-052f62f5-8a7a-45ce-85fd-ff6d88c6337d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2966af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.666723 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-052f62f5-8a7a-45ce-85fd-ff6d88c6337d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632" status: 200 len: 1413 microversion: 2.1 time: 0.118395 Aug 29 15:40:54.680986 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1802/3433] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:54.701426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.703172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.736166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.745329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.747413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.748445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.749968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.759918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.229289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:55.238986 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b9f07d4-bbe1-4f0b-b4c7-c0dcdd309ba8 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1492 microversion: 2.1 time: 0.556189 Aug 29 15:40:55.261740 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1803/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1492 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:55.267334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-253aad68-5aec-41e5-815d-0d2070108220 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e29f5790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:55.519201 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-253aad68-5aec-41e5-815d-0d2070108220 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632" status: 204 len: 0 microversion: 2.1 time: 0.256153 Aug 29 15:40:55.519796 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1804/3435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:55 2022] DELETE /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:55.524772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-332a1303-cc27-46d5-87bf-86c94b184b42 req-f97541b6-a2cf-4195-b899-ba412bcaa4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-deleted", "tag": "67303c1a-9438-492b-8533-38c336022779"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:55.550863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-332a1303-cc27-46d5-87bf-86c94b184b42 req-f97541b6-a2cf-4195-b899-ba412bcaa4fc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.551876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-332a1303-cc27-46d5-87bf-86c94b184b42 req-f97541b6-a2cf-4195-b899-ba412bcaa4fc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.552484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-332a1303-cc27-46d5-87bf-86c94b184b42 req-f97541b6-a2cf-4195-b899-ba412bcaa4fc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.573862 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-332a1303-cc27-46d5-87bf-86c94b184b42 req-f97541b6-a2cf-4195-b899-ba412bcaa4fc service nova] Creating event network-vif-deleted:67303c1a-9438-492b-8533-38c336022779 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:55.585995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-332a1303-cc27-46d5-87bf-86c94b184b42 req-f97541b6-a2cf-4195-b899-ba412bcaa4fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064098 Aug 29 15:40:55.588355 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1805/3436] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:55.625524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:55.627996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:55.651394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.652905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.654347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.656300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.657851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.658831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.890164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:55.905198 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1d16509f-c20b-4e45-b553-a42b6388ac0a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.312583 Aug 29 15:40:55.918302 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1806/3437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:55 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:55.926826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:55.927626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:55.934773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.935578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.936186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.937195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.937852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.938956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.968243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:56.116164 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03b80e57-0283-48a9-b56a-76c2ab529886 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 204 len: 0 microversion: 2.1 time: 0.196185 Aug 29 15:40:56.116886 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1807/3438] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:55 2022] DELETE /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:56.123389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-acd74c59-f3d3-4d75-a1cf-634c44008b4d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2d6a9d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.165428 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-acd74c59-f3d3-4d75-a1cf-634c44008b4d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Image not found. Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-acd74c59-f3d3-4d75-a1cf-634c44008b4d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632 HTTP/1.1 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'bb0a1f22-4897-42a2-aabb-418806eec632'} Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bb0a1f22-4897-42a2-aabb-418806eec632 Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:40:56.167850 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb0a1f22-4897-42a2-aabb-418806eec632 could not be found. Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-acd74c59-f3d3-4d75-a1cf-634c44008b4d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-acd74c59-f3d3-4d75-a1cf-634c44008b4d tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632" status: 404 len: 62 microversion: 2.1 time: 0.050923 Aug 29 15:40:56.173082 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1808/3439] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:40:56.180549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.181221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.188143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.189213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.189701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.190486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.191019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.191512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.194748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:56.375567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.387225 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a5f9fed-5f6d-47c9-87bc-71069e41cbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1673 microversion: 2.1 time: 0.211680 Aug 29 15:40:56.402446 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1809/3440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.407747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.408383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.414964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.415462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.416282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.416987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.417588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.418237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.642904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.658091 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85fd81f1-69a2-481c-bade-675ef297ecaf tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1498 microversion: 2.1 time: 0.267023 Aug 29 15:40:56.659458 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1810/3441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.671796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.673916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.681194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.681740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.682178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.683256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.683854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.684286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.901694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.912131 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-390a74b5-9c9a-4dbe-8346-2406978f9601 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1507 microversion: 2.1 time: 0.247295 Aug 29 15:40:56.913057 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1811/3442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.917926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c418de11-3fbd-49e1-aaf7-24fa8e9458fe req-5e005a2a-e1ae-469b-9641-e562d23de46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-unplugged", "status": "completed", "tag": "67303c1a-9438-492b-8533-38c336022779"}, {"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-unplugged", "status": "completed", "tag": "ace44df1-db24-4c32-ad6c-65ab6ad7bc58"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:56.930863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c418de11-3fbd-49e1-aaf7-24fa8e9458fe req-5e005a2a-e1ae-469b-9641-e562d23de46f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.931345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c418de11-3fbd-49e1-aaf7-24fa8e9458fe req-5e005a2a-e1ae-469b-9641-e562d23de46f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.931771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c418de11-3fbd-49e1-aaf7-24fa8e9458fe req-5e005a2a-e1ae-469b-9641-e562d23de46f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.944725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c418de11-3fbd-49e1-aaf7-24fa8e9458fe req-5e005a2a-e1ae-469b-9641-e562d23de46f service nova] Creating event network-vif-unplugged:67303c1a-9438-492b-8533-38c336022779 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:56.945321 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c418de11-3fbd-49e1-aaf7-24fa8e9458fe req-5e005a2a-e1ae-469b-9641-e562d23de46f service nova] Creating event network-vif-unplugged:ace44df1-db24-4c32-ad6c-65ab6ad7bc58 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:56.950960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c418de11-3fbd-49e1-aaf7-24fa8e9458fe req-5e005a2a-e1ae-469b-9641-e562d23de46f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.036639 Aug 29 15:40:56.951824 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1812/3443] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:56.957925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.958722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.965478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.965941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.966409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.967207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.967723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.968210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.146692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:57.170326 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea0f0875-768e-4138-b7fe-1d3d2fd1efe2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.216840 Aug 29 15:40:57.170954 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1813/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:57.411017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:57.411645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.423282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.423862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.424384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.425186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.425781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.426287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.590846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:57.600515 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9f0d9895-30ed-4c84-b7b0-8485660c58b5 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1652 microversion: 2.1 time: 0.194078 Aug 29 15:40:57.613422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1814/3445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:57 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1652 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:57.680158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:57.682035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.693092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.694124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.694804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.695745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.696400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.697285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.975958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.002755 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-84260e93-33f9-41fb-a5fb-2e57e98f6e4b tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1498 microversion: 2.1 time: 0.325733 Aug 29 15:40:58.003606 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1815/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:57 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1498 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.018920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.019691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.027194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:58.029314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.030895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.031612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.034123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.034885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.035928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.273619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.284204 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e37c559-d346-4603-91b1-78d4fca80926 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1507 microversion: 2.1 time: 0.276468 Aug 29 15:40:58.284988 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1816/3447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.290021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2f9e3d56-71f6-4acb-809c-bb8513dafe13 req-17a4a5a3-25d1-4959-be87-c8b11dd5300f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-deleted", "tag": "ace44df1-db24-4c32-ad6c-65ab6ad7bc58"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:58.309734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f9e3d56-71f6-4acb-809c-bb8513dafe13 req-17a4a5a3-25d1-4959-be87-c8b11dd5300f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.311507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f9e3d56-71f6-4acb-809c-bb8513dafe13 req-17a4a5a3-25d1-4959-be87-c8b11dd5300f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.312115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2f9e3d56-71f6-4acb-809c-bb8513dafe13 req-17a4a5a3-25d1-4959-be87-c8b11dd5300f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.339005 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2f9e3d56-71f6-4acb-809c-bb8513dafe13 req-17a4a5a3-25d1-4959-be87-c8b11dd5300f service nova] Creating event network-vif-deleted:ace44df1-db24-4c32-ad6c-65ab6ad7bc58 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:40:58.349732 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2f9e3d56-71f6-4acb-809c-bb8513dafe13 req-17a4a5a3-25d1-4959-be87-c8b11dd5300f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063304 Aug 29 15:40:58.350700 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1817/3448] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:58.356037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.357019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.364395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.365177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.365893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.366868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.368069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.368995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.598250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.610880 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a15a87b4-2b76-47bc-8028-5495bd433b0e tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.258796 Aug 29 15:40:58.617517 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1818/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.624416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.625033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.640600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.642690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.643091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.643986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.644554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.645153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.960601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.971022 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d99768f-0f7c-4111-ae04-51445fee715d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1494 microversion: 2.1 time: 0.350379 Aug 29 15:40:58.971681 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1819/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:59.031732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.033740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.041084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.041884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.042500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.043389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.049237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.049997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.229039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065c5a92f9c04400be8a515e8233fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f71ab69d5754077b34ee79ccb42d7cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:59.238651 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23460cad-8bbb-4333-9902-4ba7c1ebe369 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 200 len: 1456 microversion: 2.1 time: 0.216032 Aug 29 15:40:59.241436 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1820/3451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 1456 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:59.305882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e4f8ff96-d04d-4609-b05c-c5c95c0c1d84 req-c6dd5627-1250-4211-b368-962327372e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1697418-0461-46cd-a0f2-82f75af54233", "name": "network-vif-plugged", "status": "completed", "tag": "30c2003e-c982-4a88-9a3b-20c2f9e5072c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:59.316439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e4f8ff96-d04d-4609-b05c-c5c95c0c1d84 req-c6dd5627-1250-4211-b368-962327372e25 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.317335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e4f8ff96-d04d-4609-b05c-c5c95c0c1d84 req-c6dd5627-1250-4211-b368-962327372e25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.318187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e4f8ff96-d04d-4609-b05c-c5c95c0c1d84 req-c6dd5627-1250-4211-b368-962327372e25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.332299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e4f8ff96-d04d-4609-b05c-c5c95c0c1d84 req-c6dd5627-1250-4211-b368-962327372e25 service nova] Creating event network-vif-plugged:30c2003e-c982-4a88-9a3b-20c2f9e5072c for instance e1697418-0461-46cd-a0f2-82f75af54233 on n-h2-854882-3 Aug 29 15:40:59.339905 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e4f8ff96-d04d-4609-b05c-c5c95c0c1d84 req-c6dd5627-1250-4211-b368-962327372e25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037851 Aug 29 15:40:59.343377 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1821/3452] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:59.349536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.350489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.363770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.365163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.365819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.367959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.370134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.370632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.844267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:59.867314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b21c78e-9fea-415c-bc31-6e6f3e267561 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1489 microversion: 2.1 time: 0.522522 Aug 29 15:40:59.869487 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1822/3453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1489 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:59.874421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.875058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.882662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.883418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.884006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.884975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.885620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.886234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.938916 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ff2b45ef-c059-41b1-93c6-1d34db7d207b tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.756005 Aug 29 15:40:59.940069 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1632/3454] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:59.945867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.946764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.961325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:59.967721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.968782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.969340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.974463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.975133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.975590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.059723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:00.268321 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c01a3bea-c9bd-4380-b412-5478618c5e3a tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 204 len: 0 microversion: 2.1 time: 0.326857 Aug 29 15:41:00.274474 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1633/3455] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:59 2022] DELETE /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:00.281312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3924d4bd-822d-48d3-9bf5-551f8ce15eef tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Action: 'create', calling method: .version_select at 0x7fb0e26e9d30>, body: {"pool": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:00.308616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:00.318319 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6932d8ff-ba63-4bb3-9dea-8de92a0c76e4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.448653 Aug 29 15:41:00.326294 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1823/3456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:00.338243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.338921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.362700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.363441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.363877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.364614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.365667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.366477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.409876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.410432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.410962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.411682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lazy-loading 'fault' on Instance uuid ee636a6e-b71b-4304-98b5-a6a3ce6893e1 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:00.563695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:00.589439 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5131f0cd-41e7-4cfb-9b97-5851e7532288 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 200 len: 1301 microversion: 2.1 time: 0.261205 Aug 29 15:41:00.604157 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1824/3457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 1301 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:00.613044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.614075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.621819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.622443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.622964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.623910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.624802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.625422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.645719 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc HTTP/1.1 Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '325edc13-1844-41b6-a92a-2f123021d1bc'} Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:00.647655 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.653039 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.653039 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:00.653039 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:00.653039 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:00.653039 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:00.653039 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.653039 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.655206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:00.656630 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-06e60d53-5b36-47a4-b430-69c10b9a7be0 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 404 len: 111 microversion: 2.1 time: 0.048485 Aug 29 15:41:00.661577 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1825/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:00.667387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-006baa25-4e60-484f-9dac-e8739c233137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e26ecaf0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.700854 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-006baa25-4e60-484f-9dac-e8739c233137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Image not found. Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-006baa25-4e60-484f-9dac-e8739c233137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632 HTTP/1.1 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'bb0a1f22-4897-42a2-aabb-418806eec632'} Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bb0a1f22-4897-42a2-aabb-418806eec632 to delete Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb0a1f22-4897-42a2-aabb-418806eec632 could not be found. Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.703132 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-006baa25-4e60-484f-9dac-e8739c233137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-006baa25-4e60-484f-9dac-e8739c233137 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632" status: 404 len: 62 microversion: 2.1 time: 0.042000 Aug 29 15:41:00.709717 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1826/3459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] DELETE /compute/v2.1/images/bb0a1f22-4897-42a2-aabb-418806eec632 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:00.732716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-265c4ee0-d7a6-4da7-81eb-dd18282a8b5c req-42acaae8-0f49-4432-bc08-6c372fb3125d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325edc13-1844-41b6-a92a-2f123021d1bc", "name": "network-vif-deleted", "tag": "b90e2fa0-8a13-42a9-996e-998a9f9b5194"}, {"server_uuid": "ee636a6e-b71b-4304-98b5-a6a3ce6893e1", "name": "network-vif-deleted", "tag": "e84f8c8c-ddb4-41c6-b895-09864fd4f756"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:00.758807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-265c4ee0-d7a6-4da7-81eb-dd18282a8b5c req-42acaae8-0f49-4432-bc08-6c372fb3125d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.759307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-265c4ee0-d7a6-4da7-81eb-dd18282a8b5c req-42acaae8-0f49-4432-bc08-6c372fb3125d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.761463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-265c4ee0-d7a6-4da7-81eb-dd18282a8b5c req-42acaae8-0f49-4432-bc08-6c372fb3125d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.798690 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-265c4ee0-d7a6-4da7-81eb-dd18282a8b5c req-42acaae8-0f49-4432-bc08-6c372fb3125d service nova] Creating event network-vif-deleted:b90e2fa0-8a13-42a9-996e-998a9f9b5194 for instance 325edc13-1844-41b6-a92a-2f123021d1bc on n-h1-854882-3 Aug 29 15:41:00.799280 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-265c4ee0-d7a6-4da7-81eb-dd18282a8b5c req-42acaae8-0f49-4432-bc08-6c372fb3125d service nova] Creating event network-vif-deleted:e84f8c8c-ddb4-41c6-b895-09864fd4f756 for instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 on n-h1-854882-3 Aug 29 15:41:00.815685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-265c4ee0-d7a6-4da7-81eb-dd18282a8b5c req-42acaae8-0f49-4432-bc08-6c372fb3125d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105192 Aug 29 15:41:00.817847 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1827/3460] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:00.824768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.825621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.834635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.835311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.835740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.836786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.837503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.838270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.856115 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc HTTP/1.1 Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '325edc13-1844-41b6-a92a-2f123021d1bc'} Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:00.858343 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:00.862592 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:00.864296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:00.865149 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5256edbe-3111-455d-b55e-c39f28787f39 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 404 len: 111 microversion: 2.1 time: 0.044503 Aug 29 15:41:00.865906 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1828/3461] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:00 2022] DELETE /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:00.871262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.871931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.879628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.880108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.880539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.881224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.881709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.882134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.910924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:00.937843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:00.966491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Instance is already in deleting state, ignoring this request Aug 29 15:41:00.967320 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-824d23c3-a3c5-44b8-baad-e89e92e02632 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 204 len: 0 microversion: 2.1 time: 0.100257 Aug 29 15:41:00.968087 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1829/3462] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:00 2022] DELETE /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:00.974336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.974969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 325edc13-1844-41b6-a92a-2f123021d1bc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.980948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.981470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.981913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.982615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.983121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.983554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.999450 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc HTTP/1.1 Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '325edc13-1844-41b6-a92a-2f123021d1bc'} Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.002356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 325edc13-1844-41b6-a92a-2f123021d1bc could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d7c77bea-ef39-4a53-8452-449644ac23c1 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc" status: 404 len: 111 microversion: 2.1 time: 0.033811 Aug 29 15:41:01.006842 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1830/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/325edc13-1844-41b6-a92a-2f123021d1bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.010787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.011510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.018217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.018704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.019140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.019849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.020293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.020718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.186932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.215211 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af7fa7d9-caf6-4f56-9201-dbfc3986b726 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1495 microversion: 2.1 time: 0.209367 Aug 29 15:41:01.217865 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1831/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1495 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.224411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.225238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.249028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.249890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.250606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.252428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.253091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.253770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.270870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af HTTP/1.1 Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '50951512-cad1-427e-a545-a0d3d1a290af'} Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.272964 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.283647 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.286423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.287262 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d50d4bde-9fc0-42fc-8e19-5fb48bedbb02 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 404 len: 111 microversion: 2.1 time: 0.068244 Aug 29 15:41:01.287860 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1832/3465] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:01 2022] DELETE /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.299968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.300884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 50951512-cad1-427e-a545-a0d3d1a290af] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.310583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.311234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.311500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.312383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.312997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.314209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.329219 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af HTTP/1.1 Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '50951512-cad1-427e-a545-a0d3d1a290af'} Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.331329 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.336717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 50951512-cad1-427e-a545-a0d3d1a290af could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.340935 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-65522b3d-3e6c-4ba6-a5b8-88aad6684913 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af" status: 404 len: 111 microversion: 2.1 time: 0.043412 Aug 29 15:41:01.340935 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1833/3466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/50951512-cad1-427e-a545-a0d3d1a290af => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.346818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.347701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.355309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.355894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.356408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.357194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.357692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.358116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.586449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.600370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77f86728-da9c-4da1-ae4e-0605ea47a4e5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.258125 Aug 29 15:41:01.606282 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1834/3467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.608807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.608807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.624210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.624753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.625363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.626238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.626958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.627376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.656276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc HTTP/1.1 Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '77f257df-f378-4dbc-a0ab-97037668efbc'} Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.658713 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3a9caae-a7a8-4df9-80e8-967ab5b88b86 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 404 len: 111 microversion: 2.1 time: 0.058102 Aug 29 15:41:01.662644 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1835/3468] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:01 2022] DELETE /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.668075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.668735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.676626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.677227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.678246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.679099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.679913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.680782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.699194 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] HTTP exception thrown: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Request method failure captured: Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 HTTP/1.1 Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN3MUCAUrpd8BXSU3Y_8Xt455pW9s8_CIrs5sSkcsiIhQ-74xg-xK5-Urv78TIItdd3jjO7k90vFz7zXVKDqYkQja5kcGwrr-anarRMv9wDVLGNHA7NwT_91IhS4LDKRUxgMO7l0Ab5VUSQohQFtl1OArd7C8wrLG0w0rn5WNBzZ8yA Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe151c445bb64766b4a8f2282ed2f1de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}] Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestMultiNic-1735601978 Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f0c165a4dd4648888d45d44df5acbe2b Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ee636a6e-b71b-4304-98b5-a6a3ce6893e1'} Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.702489 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Returning 404 to user: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ff3aad4-735b-4f40-b73d-3cef3ef5e910 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 404 len: 111 microversion: 2.1 time: 0.041260 Aug 29 15:41:01.708538 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1836/3469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.714630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.715394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 77f257df-f378-4dbc-a0ab-97037668efbc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.723452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.724185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.724678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.725457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.726138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.726322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.743351 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc HTTP/1.1 Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '77f257df-f378-4dbc-a0ab-97037668efbc'} Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.745082 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 77f257df-f378-4dbc-a0ab-97037668efbc could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e3a20185-8e41-4dc9-a1cb-e29700b72c29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc" status: 404 len: 111 microversion: 2.1 time: 0.041278 Aug 29 15:41:01.751475 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1837/3470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/77f257df-f378-4dbc-a0ab-97037668efbc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.756866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.757782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.764624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.765333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.765723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.767043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.767824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.768120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.788292 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d HTTP/1.1 Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '759c3df5-e807-49a4-b5e9-fb983aa5345d'} Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.790341 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.794532 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.797070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.798370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f927f21e-086d-4c0d-adee-77614953fd29 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 404 len: 111 microversion: 2.1 time: 0.045253 Aug 29 15:41:01.799682 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1838/3471] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:01 2022] DELETE /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.814708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.815738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 759c3df5-e807-49a4-b5e9-fb983aa5345d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.825114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.826964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.828275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.830061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.830898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.831632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.850532 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d HTTP/1.1 Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '759c3df5-e807-49a4-b5e9-fb983aa5345d'} Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.852637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.856674 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.856674 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.856674 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.856674 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.856674 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.856674 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. Aug 29 15:41:01.856674 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.858902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 759c3df5-e807-49a4-b5e9-fb983aa5345d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.860767 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf590257-1302-48ef-9a39-2c9c8f13f525 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d" status: 404 len: 111 microversion: 2.1 time: 0.051283 Aug 29 15:41:01.861990 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1839/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/759c3df5-e807-49a4-b5e9-fb983aa5345d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.873170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.873705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.886356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.887661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.888414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.889240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.889748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.890313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.909058 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba HTTP/1.1 Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c17a8278-64cc-420a-8852-58214e841bba'} Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.911171 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.915137 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.917847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.918960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a1bba04-942e-422a-bb78-e3a5d6dad318 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 404 len: 111 microversion: 2.1 time: 0.051059 Aug 29 15:41:01.920151 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1840/3473] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:01 2022] DELETE /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:01.929602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.931506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: c17a8278-64cc-420a-8852-58214e841bba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.939260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.940149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.940835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.942398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.943096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.943743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.962069 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba HTTP/1.1 Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c17a8278-64cc-420a-8852-58214e841bba'} Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.964065 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.970170 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.970170 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.970170 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.970170 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.970170 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.970170 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. Aug 29 15:41:01.970170 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.971123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance c17a8278-64cc-420a-8852-58214e841bba could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.971721 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb9f42ef-551f-4355-b362-f4eaeee34b07 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba" status: 404 len: 111 microversion: 2.1 time: 0.046952 Aug 29 15:41:01.972618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1841/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/c17a8278-64cc-420a-8852-58214e841bba => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:02.239038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.239612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:02.257102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.257641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.258081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.258790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.259243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.259665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.526638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:02.565448 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-98d48f88-9edf-4cbb-ae3d-e2878961efa7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1495 microversion: 2.1 time: 0.330868 Aug 29 15:41:02.566257 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1842/3475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1495 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.622591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.623567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:02.632164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.632683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.633121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.634133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.634596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.635024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.863330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:02.874765 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c2ec278-eac1-433b-89c6-601262e376e0 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.256153 Aug 29 15:41:02.891951 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1843/3476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:03.529745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-96f02e1e-ba54-4891-ad83-8732e839cb56 req-0beadb73-b2b3-48e0-8e58-d3c3d8dd0e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdb7873-a953-4b26-8ffb-139cb096faf1", "name": "network-vif-plugged", "status": "completed", "tag": "7a7b8149-cb7f-4f33-8595-700998dd84d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:03.554734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-96f02e1e-ba54-4891-ad83-8732e839cb56 req-0beadb73-b2b3-48e0-8e58-d3c3d8dd0e0b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.555449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-96f02e1e-ba54-4891-ad83-8732e839cb56 req-0beadb73-b2b3-48e0-8e58-d3c3d8dd0e0b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.556101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-96f02e1e-ba54-4891-ad83-8732e839cb56 req-0beadb73-b2b3-48e0-8e58-d3c3d8dd0e0b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.584608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-96f02e1e-ba54-4891-ad83-8732e839cb56 req-0beadb73-b2b3-48e0-8e58-d3c3d8dd0e0b service nova] Creating event network-vif-plugged:7a7b8149-cb7f-4f33-8595-700998dd84d9 for instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 on n-h2-854882-3 Aug 29 15:41:03.597507 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-96f02e1e-ba54-4891-ad83-8732e839cb56 req-0beadb73-b2b3-48e0-8e58-d3c3d8dd0e0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070102 Aug 29 15:41:03.598782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1844/3477] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:03.611475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.621477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.640624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.645557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.647624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.648538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.649259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.652150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.338828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.352354 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb3a1fcc-7729-41a1-b936-4556a43788f6 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1495 microversion: 2.1 time: 0.752029 Aug 29 15:41:04.372878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1845/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1495 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.386684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.393952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.402342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.402840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.411785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.412738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.414263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.416234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.840658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.854298 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f233faa-5dcd-408f-8d0c-2929a6ee4554 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.477253 Aug 29 15:41:04.888565 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1846/3479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.957616 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3924d4bd-822d-48d3-9bf5-551f8ce15eef tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.681368 Aug 29 15:41:04.960997 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1634/3480] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:41:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:04.973959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-65e07e9d-34f2-45fe-9192-8df72c4b446e tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Action: 'create', calling method: .version_select at 0x7fb0e2725040>, body: {"pool": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:05.381832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.382763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.432473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.433044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.433516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.442429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.442919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.443359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.624191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c631f558d99f40feb637f376bac1cffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4289f452ed34003a85d00e8f6959d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:05.633375 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2f0d9b42-d919-4f07-8cbb-694f3d4a51a1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 200 len: 1453 microversion: 2.1 time: 0.256240 Aug 29 15:41:05.638512 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1635/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:05.669755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-cc2cc5e3-d95b-48a7-be50-526e74f6c38d req-325dda78-98b3-43d7-89e0-8b6b01f3298e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1697418-0461-46cd-a0f2-82f75af54233", "name": "network-vif-deleted", "tag": "30c2003e-c982-4a88-9a3b-20c2f9e5072c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:05.691157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cc2cc5e3-d95b-48a7-be50-526e74f6c38d req-325dda78-98b3-43d7-89e0-8b6b01f3298e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.691730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cc2cc5e3-d95b-48a7-be50-526e74f6c38d req-325dda78-98b3-43d7-89e0-8b6b01f3298e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.692516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cc2cc5e3-d95b-48a7-be50-526e74f6c38d req-325dda78-98b3-43d7-89e0-8b6b01f3298e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.737622 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-cc2cc5e3-d95b-48a7-be50-526e74f6c38d req-325dda78-98b3-43d7-89e0-8b6b01f3298e service nova] Creating event network-vif-deleted:30c2003e-c982-4a88-9a3b-20c2f9e5072c for instance e1697418-0461-46cd-a0f2-82f75af54233 on n-h2-854882-3 Aug 29 15:41:05.755549 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-cc2cc5e3-d95b-48a7-be50-526e74f6c38d req-325dda78-98b3-43d7-89e0-8b6b01f3298e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091385 Aug 29 15:41:05.756311 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1636/3482] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:05.880733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.882067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.898470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.900075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.900963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.902050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.903374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.904050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.836333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.845144 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-636fc974-9786-4966-b314-bf9a3f6a132b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1518 microversion: 2.1 time: 0.969877 Aug 29 15:41:06.849289 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1637/3483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1518 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:06.860138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c513175d-a3b4-47ef-8540-d1ad0ebc5991 req-5ca9f585-49b3-41d5-94e9-f6ce044aa7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1697418-0461-46cd-a0f2-82f75af54233", "name": "network-vif-unplugged", "status": "completed", "tag": "30c2003e-c982-4a88-9a3b-20c2f9e5072c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:06.887244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c513175d-a3b4-47ef-8540-d1ad0ebc5991 req-5ca9f585-49b3-41d5-94e9-f6ce044aa7f2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.890001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c513175d-a3b4-47ef-8540-d1ad0ebc5991 req-5ca9f585-49b3-41d5-94e9-f6ce044aa7f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.890742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c513175d-a3b4-47ef-8540-d1ad0ebc5991 req-5ca9f585-49b3-41d5-94e9-f6ce044aa7f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.919334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c513175d-a3b4-47ef-8540-d1ad0ebc5991 req-5ca9f585-49b3-41d5-94e9-f6ce044aa7f2 service nova] Creating event network-vif-unplugged:30c2003e-c982-4a88-9a3b-20c2f9e5072c for instance e1697418-0461-46cd-a0f2-82f75af54233 on n-h2-854882-3 Aug 29 15:41:06.935160 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c513175d-a3b4-47ef-8540-d1ad0ebc5991 req-5ca9f585-49b3-41d5-94e9-f6ce044aa7f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084423 Aug 29 15:41:06.939413 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1638/3484] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:06.957190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.958973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.968076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.968962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.970152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.972773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.973515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.974252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.990310 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 HTTP/1.1 Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5d4e2cb7-3b60-47c9-a99a-c7bc0a907044'} Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:06.992348 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:06.997235 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:06.999076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.000660 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb8bfa12-eebe-4c2a-b763-094e418fd42f tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 404 len: 111 microversion: 2.1 time: 0.056953 Aug 29 15:41:07.001900 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1639/3485] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:06 2022] DELETE /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.007461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.008579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: e1697418-0461-46cd-a0f2-82f75af54233] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.015602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.016992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.017714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.018916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.020552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.021242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.040094 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Instance e1697418-0461-46cd-a0f2-82f75af54233 could not be found. Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 HTTP/1.1 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e1697418-0461-46cd-a0f2-82f75af54233 could not be found. Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e1697418-0461-46cd-a0f2-82f75af54233'} Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1697418-0461-46cd-a0f2-82f75af54233 could not be found. Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1697418-0461-46cd-a0f2-82f75af54233 could not be found. Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.042784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.049128 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.049128 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.049128 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.049128 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.049128 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1697418-0461-46cd-a0f2-82f75af54233 could not be found. Aug 29 15:41:07.049128 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.052490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Instance e1697418-0461-46cd-a0f2-82f75af54233 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.053662 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16d4c537-6584-475a-9e55-452b305b73a0 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233" status: 404 len: 111 microversion: 2.1 time: 0.050583 Aug 29 15:41:07.055348 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1640/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/e1697418-0461-46cd-a0f2-82f75af54233 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.060772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.062101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.071580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.075461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.076450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.077722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.078464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.079623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.099383 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 HTTP/1.1 Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5d4e2cb7-3b60-47c9-a99a-c7bc0a907044'} Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.102222 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.107366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.107366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.107366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.107366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.107366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.107366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. Aug 29 15:41:07.107366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.109543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.110834 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bbfce758-70c1-411e-81d3-7fb9e0d43855 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044" status: 404 len: 111 microversion: 2.1 time: 0.054312 Aug 29 15:41:07.112011 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1641/3487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/5d4e2cb7-3b60-47c9-a99a-c7bc0a907044 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.118097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f44e469-0684-4a3c-b18f-4c83fef6e1e7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e390b1f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.157680 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6f44e469-0684-4a3c-b18f-4c83fef6e1e7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Image not found. Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f44e469-0684-4a3c-b18f-4c83fef6e1e7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 HTTP/1.1 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '42b0930c-c9f9-43be-a45e-7409ed474ba8'} Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 42b0930c-c9f9-43be-a45e-7409ed474ba8 to delete Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42b0930c-c9f9-43be-a45e-7409ed474ba8 could not be found. Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.161495 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:07.166904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.170595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f44e469-0684-4a3c-b18f-4c83fef6e1e7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.172281 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f44e469-0684-4a3c-b18f-4c83fef6e1e7 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8" status: 404 len: 62 microversion: 2.1 time: 0.059066 Aug 29 15:41:07.173536 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1642/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/images/42b0930c-c9f9-43be-a45e-7409ed474ba8 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:07.179348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.180381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.189318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.192123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.192800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.194125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.194731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.195464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.220140 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 HTTP/1.1 Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '707dfc82-2388-462a-aefd-fb2a0a87d926'} Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.221906 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.226631 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53d9953c-befc-4e96-ba58-e9625efdc887 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "DELETE /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 404 len: 111 microversion: 2.1 time: 0.048863 Aug 29 15:41:07.227968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1643/3489] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.239659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.240755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.249266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.249830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.250362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.251167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.251631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.252062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.274625 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa HTTP/1.1 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'eb7d3301-a307-4d91-8767-35314cf5f3fa'} Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.276644 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f88c266e-b244-4701-8525-b360d2bf43fe tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 404 len: 111 microversion: 2.1 time: 0.049360 Aug 29 15:41:07.281702 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1644/3490] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.285537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.286648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] [instance: 707dfc82-2388-462a-aefd-fb2a0a87d926] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.298210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.298724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.299243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.300242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.301665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.302109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.343314 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] HTTP exception thrown: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Request method failure captured: Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 HTTP/1.1 Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDNzE44yhp4Q23v6l24VviTnctXGK3oERIjGKi-xCumxUNXRr8R2OT9gq62fp7pXl15ysNGjKXkntn4uS5RZ-8kSjrXGeBdNUEq1_N8EmnV4yDxHymmPCMmhVDYZClRwDR-VJNrGuxcUg3u0cbNZbWmun0cmGHPxhf4P7AAQarG5w6aw Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f71ab69d5754077b34ee79ccb42d7cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f71ab69d5754077b34ee79ccb42d7cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f71ab69d5754077b34ee79ccb42d7cc"}]}] Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8f71ab69d5754077b34ee79ccb42d7cc Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1809441325 Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 065c5a92f9c04400be8a515e8233fb0d Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-1809441325-project Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '707dfc82-2388-462a-aefd-fb2a0a87d926'} Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.345527 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] Returning 404 to user: Instance 707dfc82-2388-462a-aefd-fb2a0a87d926 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb4ca73c-548e-40c2-9a36-3e8a1228f616 tempest-DeleteServersTestJSON-1809441325 tempest-DeleteServersTestJSON-1809441325-project] 10.222.0.16 "GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926" status: 404 len: 111 microversion: 2.1 time: 0.066944 Aug 29 15:41:07.351018 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1645/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/707dfc82-2388-462a-aefd-fb2a0a87d926 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.367447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.368100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: eb7d3301-a307-4d91-8767-35314cf5f3fa] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.384385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.385102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.385606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.386347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.386943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.387392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.409916 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa HTTP/1.1 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'eb7d3301-a307-4d91-8767-35314cf5f3fa'} Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.412787 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.418931 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.418931 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.418931 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.418931 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.418931 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. Aug 29 15:41:07.418931 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.420828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Instance eb7d3301-a307-4d91-8767-35314cf5f3fa could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.429835 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d88f77b-22f2-4f44-8cac-e0c4fdfe96a3 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa" status: 404 len: 111 microversion: 2.1 time: 0.065992 Aug 29 15:41:07.430940 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1646/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/eb7d3301-a307-4d91-8767-35314cf5f3fa => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.442375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53156749-97f8-405e-8cb6-7ac58a6eebd1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2801b80>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.496155 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-53156749-97f8-405e-8cb6-7ac58a6eebd1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Image not found. Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53156749-97f8-405e-8cb6-7ac58a6eebd1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 HTTP/1.1 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '409410c2-80ee-443d-af68-628498566ba0'} Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 409410c2-80ee-443d-af68-628498566ba0 to delete Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 409410c2-80ee-443d-af68-628498566ba0 could not be found. Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.498901 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:07.504785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.509694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53156749-97f8-405e-8cb6-7ac58a6eebd1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.509694 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53156749-97f8-405e-8cb6-7ac58a6eebd1 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0" status: 404 len: 62 microversion: 2.1 time: 0.071352 Aug 29 15:41:07.509694 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1647/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/images/409410c2-80ee-443d-af68-628498566ba0 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:41:07.518111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.525640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.544118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.544708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.545217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.553713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.554314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.554820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.585040 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 HTTP/1.1 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '21b0012d-740e-40db-b4d0-fac933f03ea1'} Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.586781 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.591227 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.593844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.596848 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b82b4aca-f7bc-4b67-9149-6bcaf27b704c tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 404 len: 111 microversion: 2.1 time: 0.084971 Aug 29 15:41:07.599017 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1648/3494] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:07.615745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.616809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 21b0012d-740e-40db-b4d0-fac933f03ea1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.627308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.632687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.633338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.634251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.634993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.635894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.668671 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 HTTP/1.1 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '21b0012d-740e-40db-b4d0-fac933f03ea1'} Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.673662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.678630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.678630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.678630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.678630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.678630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. Aug 29 15:41:07.678630 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.683615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Instance 21b0012d-740e-40db-b4d0-fac933f03ea1 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.684741 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03d3a3ba-adf8-456b-8195-5123e0b4f51b tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1" status: 404 len: 111 microversion: 2.1 time: 0.080615 Aug 29 15:41:07.685511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1649/3495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/21b0012d-740e-40db-b4d0-fac933f03ea1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.695139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2e0603af-3c04-4da4-b4fd-bbdc568fc80e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '.version_select at 0x7fb0e2795c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.737443 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2e0603af-3c04-4da4-b4fd-bbdc568fc80e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Image not found. Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2e0603af-3c04-4da4-b4fd-bbdc568fc80e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c HTTP/1.1 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6eaac8e3-ee29-44c0-8007-06c393ec649c'} Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6eaac8e3-ee29-44c0-8007-06c393ec649c to delete Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6eaac8e3-ee29-44c0-8007-06c393ec649c could not be found. Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.739428 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:07.744483 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.747430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2e0603af-3c04-4da4-b4fd-bbdc568fc80e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.748456 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2e0603af-3c04-4da4-b4fd-bbdc568fc80e tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c" status: 404 len: 62 microversion: 2.1 time: 0.057312 Aug 29 15:41:07.749191 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1650/3496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/images/6eaac8e3-ee29-44c0-8007-06c393ec649c => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:41:07.758424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.759181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.779141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.779914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.780513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.781380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.782045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.782629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.807815 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 HTTP/1.1 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '44cafb04-bcb7-4394-9ef5-207dee46d2e8'} Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.819446 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f624d2a-b28f-416e-948d-1e0ff4cbf4a5 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 404 len: 111 microversion: 2.1 time: 0.066599 Aug 29 15:41:07.824673 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1651/3497] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:07.830839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.831473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] [instance: 44cafb04-bcb7-4394-9ef5-207dee46d2e8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.859644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.862442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.863895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.870791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.872743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.874056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.917575 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] HTTP exception thrown: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Request method failure captured: Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 HTTP/1.1 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN0klJ3n9fNmJ-1l0UVHzCacBOcB7HhizCyEb1ikzCO0_gBNr0qK1O1PIPjqlpdTcvaS7o2LR0H5Rz_xKFVO8fVb40-daQFSykrGo0od89fije0X0jLMoxssQWTv4RmLLDT4tVTToplk2JHM_4HpXeu3HqhqYVMqnZ8x6V8q7YwIQBA Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4289f452ed34003a85d00e8f6959d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4289f452ed34003a85d00e8f6959d78", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4289f452ed34003a85d00e8f6959d78"}]}] Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c4289f452ed34003a85d00e8f6959d78 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesTestJSON-1619620042 Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c631f558d99f40feb637f376bac1cffa Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesTestJSON-1619620042-project Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '44cafb04-bcb7-4394-9ef5-207dee46d2e8'} Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.922990 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.927107 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.927107 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.927107 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.927107 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.927107 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. Aug 29 15:41:07.927107 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.927107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] Returning 404 to user: Instance 44cafb04-bcb7-4394-9ef5-207dee46d2e8 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.927574 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08e8e5fe-c7f4-4ff4-9068-3f5a2b8c2640 tempest-ImagesTestJSON-1619620042 tempest-ImagesTestJSON-1619620042-project] 10.222.0.16 "GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8" status: 404 len: 111 microversion: 2.1 time: 0.098062 Aug 29 15:41:07.929550 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1652/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/44cafb04-bcb7-4394-9ef5-207dee46d2e8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.940041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.942052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.953025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.953566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.954069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.954774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.955708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.956377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.661331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.676343 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dbf465f3-c98a-4999-a601-8f7dbd5564e7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.742989 Aug 29 15:41:08.698168 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1653/3499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:08.745749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.749978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.764991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.767942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.769250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.773983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.775126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.776731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.176975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-65e07e9d-34f2-45fe-9192-8df72c4b446e tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.206769 Aug 29 15:41:09.177927 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1847/3500] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:41:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:09.214506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01db15c0-e923-491b-8d0e-afd2b0fe4714 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Calling method '.version_select at 0x7fb0e26fbe50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:09.473806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.486305 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c59d00bf-ecf4-4a1c-b560-044e9cac0093 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.771791 Aug 29 15:41:09.522187 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1654/3501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:09.532584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:09.539678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:09.557650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.558548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.558995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.559719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.561692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.562131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.579994 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-01db15c0-e923-491b-8d0e-afd2b0fe4714 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/02e52cc5-0ca8-4fa3-b940-ddb74ee20662" status: 200 len: 142 microversion: 2.1 time: 0.390711 Aug 29 15:41:09.580680 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1848/3502] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:09 2022] GET /compute/v2.1/os-floating-ips/02e52cc5-0ca8-4fa3-b940-ddb74ee20662 => generated 142 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:09.592708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c597a31b-7dea-461b-94f3-da9c10dbe631 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Calling method '.version_select at 0x7fb0e27253a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.032081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:10.046475 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c5ae11a-a552-4164-b483-f4d1c1eeadcc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.523008 Aug 29 15:41:10.065133 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1655/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:09 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:10.076332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb7d638d-3d44-4ff3-903d-e77ebbaba4a9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:10.089162 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cb7d638d-3d44-4ff3-903d-e77ebbaba4a9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 1f83950e-17ec-47de-ae89-1b862e70fd89 has no mapping to a cell. Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb7d638d-3d44-4ff3-903d-e77ebbaba4a9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/1f83950e-17ec-47de-ae89-1b862e70fd89/action HTTP/1.1 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 15 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: {"os-stop": {}} Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 1f83950e-17ec-47de-ae89-1b862e70fd89 has no mapping to a cell. Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1f83950e-17ec-47de-ae89-1b862e70fd89', 'body': {'os-stop': {}}} Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 1f83950e-17ec-47de-ae89-1b862e70fd89 has no mapping to a cell. Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:10.096783 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f83950e-17ec-47de-ae89-1b862e70fd89 has no mapping to a cell. Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f83950e-17ec-47de-ae89-1b862e70fd89 has no mapping to a cell. Aug 29 15:41:10.101942 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:10.103766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb7d638d-3d44-4ff3-903d-e77ebbaba4a9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 1f83950e-17ec-47de-ae89-1b862e70fd89 has no mapping to a cell. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:10.105166 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb7d638d-3d44-4ff3-903d-e77ebbaba4a9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/1f83950e-17ec-47de-ae89-1b862e70fd89/action" status: 404 len: 117 microversion: 2.1 time: 0.038713 Aug 29 15:41:10.113551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1656/3504] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:10 2022] POST /compute/v2.1/servers/1f83950e-17ec-47de-ae89-1b862e70fd89/action => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:10.120356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.121679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:10.129818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.130547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.131173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.132225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.132840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.133449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.021968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.044633 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8141d076-d06f-4d47-876b-7cc3c376ae59 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.929294 Aug 29 15:41:11.044909 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1657/3505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:10 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:11.066604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.067228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.077963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.079173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.079622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.080354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.080943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.082372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.470524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.480156 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dc81354b-f2c1-4678-abc6-7285c97de14b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.418405 Aug 29 15:41:11.486667 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1658/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:11.512297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37ecb5a4-61ba-47eb-be36-72929e8f5d0c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:11.512838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-37ecb5a4-61ba-47eb-be36-72929e8f5d0c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 7dbbe37e-6fcf-4708-976e-3bf1d03bee40] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.520864 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-37ecb5a4-61ba-47eb-be36-72929e8f5d0c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 7dbbe37e-6fcf-4708-976e-3bf1d03bee40 could not be found. Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37ecb5a4-61ba-47eb-be36-72929e8f5d0c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/7dbbe37e-6fcf-4708-976e-3bf1d03bee40/action HTTP/1.1 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 15 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: {"suspend": {}} Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 7dbbe37e-6fcf-4708-976e-3bf1d03bee40 could not be found. Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '7dbbe37e-6fcf-4708-976e-3bf1d03bee40', 'body': {'suspend': {}}} Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dbbe37e-6fcf-4708-976e-3bf1d03bee40 could not be found. Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dbbe37e-6fcf-4708-976e-3bf1d03bee40 could not be found. Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:11.523250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:11.528193 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:11.528193 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:11.528193 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dbbe37e-6fcf-4708-976e-3bf1d03bee40 could not be found. Aug 29 15:41:11.528193 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:11.529587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37ecb5a4-61ba-47eb-be36-72929e8f5d0c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 7dbbe37e-6fcf-4708-976e-3bf1d03bee40 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:11.530705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-37ecb5a4-61ba-47eb-be36-72929e8f5d0c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/7dbbe37e-6fcf-4708-976e-3bf1d03bee40/action" status: 404 len: 111 microversion: 2.1 time: 0.024026 Aug 29 15:41:11.541157 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1659/3507] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:11 2022] POST /compute/v2.1/servers/7dbbe37e-6fcf-4708-976e-3bf1d03bee40/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:11.557944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.558759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.566963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.567559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.568161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.568988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.569580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.570274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.355661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.384221 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9b02e403-b8ca-40df-9bac-80c314bd406c tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.836686 Aug 29 15:41:12.393159 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1660/3508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:12.407776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.408335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:12.417039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.417991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.418957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.420233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.420890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.421581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.595755 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c597a31b-7dea-461b-94f3-da9c10dbe631 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/02e52cc5-0ca8-4fa3-b940-ddb74ee20662" status: 202 len: 0 microversion: 2.1 time: 3.006003 Aug 29 15:41:12.597532 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1849/3509] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:09 2022] DELETE /compute/v2.1/os-floating-ips/02e52cc5-0ca8-4fa3-b940-ddb74ee20662 => generated 0 bytes in 3009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:41:12.612243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1531a938-aaa7-4a2d-9612-cc6f630eea93 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Calling method '.version_select at 0x7fb0e26f60d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.988891 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1531a938-aaa7-4a2d-9612-cc6f630eea93 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.384418 Aug 29 15:41:12.992058 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1850/3510] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:13.014967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8edf07f6-eeae-4796-aa58-25b906709fd0 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Calling method '.version_select at 0x7fb0e26ec5e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.043069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.057212 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-91b20e20-dd4d-47b2-a593-8a200474e5eb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.653485 Aug 29 15:41:13.081840 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1661/3511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:13.089571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:13.091099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:13.132976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.134492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.135339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.137688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.139255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.139918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.195511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:13.206653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lazy-loading 'flavor' on Instance uuid 6fdb7873-a953-4b26-8ffb-139cb096faf1 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:13.328137 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0dde4eea-2c92-4813-945a-a80e22706b9b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 202 len: 0 microversion: 2.1 time: 0.242670 Aug 29 15:41:13.330418 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1662/3512] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:13 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:13.360956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.363811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:13.376836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.377958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.379151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.381425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.382524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.383444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.752663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8edf07f6-eeae-4796-aa58-25b906709fd0 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.744447 Aug 29 15:41:13.754162 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1851/3513] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:41:13 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:13.770523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5db3742-28a7-4bc7-b0a1-d24b160e8f35 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Calling method '.version_select at 0x7fb0e26fbee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.773181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.784424 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2d79980-2248-4125-b572-81337633e2f8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1513 microversion: 2.1 time: 0.434786 Aug 29 15:41:13.785578 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1663/3514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:13 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:14.147664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1121951130", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "e5661c11-6b5c-4b51-9a18-d3c87eadfcd9"}, {"uuid": "9f1c39da-fa9a-4fad-9aa3-70656779422b"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:14.276253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] validate_networks() for [('e5661c11-6b5c-4b51-9a18-d3c87eadfcd9', None, None, None, None, None), ('9f1c39da-fa9a-4fad-9aa3-70656779422b', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:14.398959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=61 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:14.852825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:16.058818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:16.060545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:16.061299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:16.064671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:16.065495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:16.081094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.083453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.085299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.086832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.087526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.088418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.146058 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5db3742-28a7-4bc7-b0a1-d24b160e8f35 tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/2d2d03d0-f7d6-4b0d-a7f8-75e5256c5968" status: 202 len: 0 microversion: 2.1 time: 2.379829 Aug 29 15:41:16.149968 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1852/3515] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:13 2022] DELETE /compute/v2.1/os-floating-ips/2d2d03d0-f7d6-4b0d-a7f8-75e5256c5968 => generated 0 bytes in 2384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:16.151216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Getting quotas for project fe151c445bb64766b4a8f2282ed2f1de. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:16.156712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:16.157695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:16.163181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Getting quotas for user f0c165a4dd4648888d45d44df5acbe2b and project fe151c445bb64766b4a8f2282ed2f1de. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:16.174662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.175649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.176349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.178926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.179879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.182001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.207889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:16.214558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:16.339981 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19d63eff-bb7f-41f0-a708-389292e8ad93 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.198438 Aug 29 15:41:16.340719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1664/3516] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:41:16.368897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-60516698-dce9-4e04-8b47-e7d76b278b7d tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Calling method '.version_select at 0x7fb0e2730280>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:17.166937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.215007 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-72cce7f5-63cd-4f7d-a15e-8cfa5010c231 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1496 microversion: 2.1 time: 1.062963 Aug 29 15:41:17.217081 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1853/3517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:16 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1496 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:17.232194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:17.233516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.246676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.253756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.256294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.259157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.259979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.260744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.762448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.771546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81901399-eb99-455b-913f-6a132fd5d1a3 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1217 microversion: 2.1 time: 0.552994 Aug 29 15:41:17.779969 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1854/3518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:17 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1217 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:17.788227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:17.788894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.799641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.800521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.801197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.802184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.803197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.803907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.850320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lazy-loading 'flavor' on Instance uuid 6fdb7873-a953-4b26-8ffb-139cb096faf1 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:17.878629 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Cannot 'suspend' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state suspended Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action HTTP/1.1 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 15 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: {"suspend": {}} Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: exception: Cannot 'suspend' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state suspended Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'suspend': {}}} Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 29 15:41:17.881759 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state suspended Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state suspended Aug 29 15:41:17.887656 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:17.890309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 409 to user: Cannot 'suspend' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state suspended {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:17.895748 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c11673a-6c9a-45c1-a386-508a70fe17ea tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 409 len: 148 microversion: 2.1 time: 0.113980 Aug 29 15:41:17.896801 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1855/3519] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:17 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 148 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:17.909316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:17.912072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.922762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.926872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.932415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.933597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.936046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.936922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.182783 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfbafd46-4fe1-4801-9eb0-e87a88ce20f6 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 202 len: 0 microversion: 2.1 time: 0.281285 Aug 29 15:41:18.186187 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1856/3520] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:17 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:41:18.202374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:18.204214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:18.227459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.233449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.234471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.236424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.241637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.242395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.865894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:18.901173 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c2a34bc-ba32-400a-956b-bed98ee18a24 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1502 microversion: 2.1 time: 0.709973 Aug 29 15:41:18.901952 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1857/3521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:18 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1502 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:18.919684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:18.921259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:18.942847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.943759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.944368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.945308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.945958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.946553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.085903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:19.095286 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df6329eb-1f7b-4c12-b412-8c974ac7dd59 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1271 microversion: 2.1 time: 0.190588 Aug 29 15:41:19.098858 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1858/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:18 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:19.928810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.929601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:19.936247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.937063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.937766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.938757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.939661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.940319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.297444 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-60516698-dce9-4e04-8b47-e7d76b278b7d tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/28d3f5ce-3ef2-4a46-8146-ac892a8e4c4c" status: 202 len: 0 microversion: 2.1 time: 3.943175 Aug 29 15:41:20.298066 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1665/3523] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:16 2022] DELETE /compute/v2.1/os-floating-ips/28d3f5ce-3ef2-4a46-8146-ac892a8e4c4c => generated 0 bytes in 3957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:20.306392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:20.307021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:20.327496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.328003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.328474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.329758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.330216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.330643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.655658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.668220 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8894ef8f-e40f-4b6e-8a86-85964a715747 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1271 microversion: 2.1 time: 0.368809 Aug 29 15:41:20.683968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1666/3524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:20 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1271 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:20.691094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e6770be3-b26f-4b1b-9367-909b2b405b2c tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] Calling method '.version_select at 0x7fb0e2744a60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:21.225905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:21.246024 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0cbb6c5a-f73a-4f62-af75-ab3683ae01b3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1502 microversion: 2.1 time: 1.318828 Aug 29 15:41:21.247081 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1859/3525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:19 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1502 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:21.692186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:21.693180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:21.700392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.701211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.701887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.702831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.703584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.704725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.034744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:22.051139 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b0280ef-250c-4556-a545-1bbc5ee4af36 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1313 microversion: 2.1 time: 0.362735 Aug 29 15:41:22.064894 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1860/3526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:21 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:22.285998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:22.287862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:22.301897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.314425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.317087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.318950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.320999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.324372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.737495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:22.755554 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6e18355-f84e-4a10-8fb7-e56827d41c73 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.489162 Aug 29 15:41:22.757289 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1861/3527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:22 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:22.783610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:22.784561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:22.793283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.794953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.795650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.797336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.798688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.799457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.086644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:23.102565 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff153b62-059a-40d5-b1e9-52dc2ad2324a tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.323285 Aug 29 15:41:23.105092 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1862/3528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:22 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:23.110879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:23.112145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:23.132101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.135174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.136427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.138059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.139438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.142453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.445593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:23.461827 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0143f178-e49a-4701-91ab-3a382b79cb58 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1313 microversion: 2.1 time: 0.354137 Aug 29 15:41:23.479205 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1863/3529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:23 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:23.488944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84710a8b-5287-4b29-b0ee-42a8fe6d0a47 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:23.490925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-84710a8b-5287-4b29-b0ee-42a8fe6d0a47 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8c10d543-1d4a-4eff-ad6c-e92b5ca2a197] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:23.501078 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-84710a8b-5287-4b29-b0ee-42a8fe6d0a47 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 8c10d543-1d4a-4eff-ad6c-e92b5ca2a197 could not be found. Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84710a8b-5287-4b29-b0ee-42a8fe6d0a47 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/8c10d543-1d4a-4eff-ad6c-e92b5ca2a197/action HTTP/1.1 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 15 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: {"unpause": {}} Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 8c10d543-1d4a-4eff-ad6c-e92b5ca2a197 could not be found. Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '8c10d543-1d4a-4eff-ad6c-e92b5ca2a197', 'body': {'unpause': {}}} Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c10d543-1d4a-4eff-ad6c-e92b5ca2a197 could not be found. Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c10d543-1d4a-4eff-ad6c-e92b5ca2a197 could not be found. Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:23.503265 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:23.507450 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:23.507450 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:23.507450 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c10d543-1d4a-4eff-ad6c-e92b5ca2a197 could not be found. Aug 29 15:41:23.507450 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:23.509618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84710a8b-5287-4b29-b0ee-42a8fe6d0a47 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 8c10d543-1d4a-4eff-ad6c-e92b5ca2a197 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:23.511469 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-84710a8b-5287-4b29-b0ee-42a8fe6d0a47 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/8c10d543-1d4a-4eff-ad6c-e92b5ca2a197/action" status: 404 len: 111 microversion: 2.1 time: 0.029896 Aug 29 15:41:23.517092 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1864/3530] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:23 2022] POST /compute/v2.1/servers/8c10d543-1d4a-4eff-ad6c-e92b5ca2a197/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:23.522835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:23.523899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:23.532627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.533469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.534070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.534955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.535566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.536139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.825428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:23.841097 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-067e4fa1-2bf1-452e-a845-f686a298563b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.322474 Aug 29 15:41:23.849567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1865/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:23 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:23.881790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:23.883155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:23.899323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.899833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.900279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.901012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.901504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.901938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.310327 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e6770be3-b26f-4b1b-9367-909b2b405b2c tempest-FloatingIPDetailsTestJSON-1541554938 tempest-FloatingIPDetailsTestJSON-1541554938-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/7610908b-4568-4307-b3e4-48c650fc1ada" status: 202 len: 0 microversion: 2.1 time: 3.625201 Aug 29 15:41:24.311105 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1667/3532] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:20 2022] DELETE /compute/v2.1/os-floating-ips/7610908b-4568-4307-b3e4-48c650fc1ada => generated 0 bytes in 3627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:24.320126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:24.337991 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-19ba0b54-8934-4ac3-8e44-6ad81ff494b7 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.460961 Aug 29 15:41:24.339653 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1866/3533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:23 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:24.360994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:24.363952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.379116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.379868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.380471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.381944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.382933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.383929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.423141 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Cannot 'unpause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action HTTP/1.1 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 15 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: {"unpause": {}} Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot 'unpause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'unpause': {}}} Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 in vm_state active. Cannot unpause while the instance is in this state. Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:24.427210 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:24.431419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:24.431419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:24.431419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:24.431419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:24.431419 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:24.433319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 409 to user: Cannot 'unpause' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:24.434930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-77c8fcf0-23f3-44e2-82d9-8c6d15e71fab tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 409 len: 145 microversion: 2.1 time: 0.078332 Aug 29 15:41:24.445366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.446500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.452829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1668/3534] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:24 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 145 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:24.456338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.457210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.458605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.461260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.463459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.464152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.492879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.493929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.509329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.510996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.512518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.513905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.515556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.517641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.145498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.157462 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-36ad1c1c-da0c-49fc-b962-8007fb3efb94 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.717095 Aug 29 15:41:25.158121 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1867/3535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:25.368847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.382435 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eaf739d8-5d80-4741-95b2-33e70c1f3c50 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.900136 Aug 29 15:41:25.386651 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1669/3536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:25.386949 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c7a07b05-17e1-4462-a5a5-b1b8ee374f58 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.227492 Aug 29 15:41:25.387502 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1868/3537] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:41:25 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:41:25.397299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.397522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.398400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:25.407593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:25.423034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.425124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.425818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.426291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.427038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.427204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.427507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.427936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.428428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.430378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.433035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.435008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.504638 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c3fe31f-8581-4d1b-926d-46c114c1d668 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105778 Aug 29 15:41:25.505622 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1670/3538] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:41:25 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:25.519702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23a5195a-3450-41d5-aeba-5538d9da7611 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Calling method '.version_select at 0x7fb0e3850a60>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.561007 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-23a5195a-3450-41d5-aeba-5538d9da7611 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] HTTP exception thrown: Image not found. Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23a5195a-3450-41d5-aeba-5538d9da7611 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Request method failure captured: Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4k--OjcAtey_YNh5XHXZK0Yrux7JoHKAJ6rytboYXSiPbAiJ-VevWtWpcRWk5RyPwJMCkCnYMzsaAfikWqZKKTLlurjsHV9qGH3hP-uCnsUKTzEkNFpkzbzC9h7IHi3_bHT7aAopln9oOkiBXnyyQ4xdCIe7CLuZmrq8Ve_zWanec Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d729e16452c423a8814423076f29283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d729e16452c423a8814423076f29283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}] Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0821d6e67ebc40bcac1e1c176511f512 Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '-1'} Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.565104 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:25.570007 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.573281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23a5195a-3450-41d5-aeba-5538d9da7611 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:25.575503 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-23a5195a-3450-41d5-aeba-5538d9da7611 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.062678 Aug 29 15:41:25.576262 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1671/3539] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Aug 29 15:41:25 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:25.586855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-751c5609-0349-4e9d-8257-8b8744d42a72 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Calling method '.version_select at 0x7fb0e28859d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.641332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-751c5609-0349-4e9d-8257-8b8744d42a72 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] HTTP exception thrown: Image not found. Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-751c5609-0349-4e9d-8257-8b8744d42a72 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Request method failure captured: Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/images/3c95ee72-6d6b-43bd-b7b7-6f83907e22dj HTTP/1.1 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4k--OjcAtey_YNh5XHXZK0Yrux7JoHKAJ6rytboYXSiPbAiJ-VevWtWpcRWk5RyPwJMCkCnYMzsaAfikWqZKKTLlurjsHV9qGH3hP-uCnsUKTzEkNFpkzbzC9h7IHi3_bHT7aAopln9oOkiBXnyyQ4xdCIe7CLuZmrq8Ve_zWanec Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d729e16452c423a8814423076f29283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d729e16452c423a8814423076f29283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}] Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0821d6e67ebc40bcac1e1c176511f512 Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3c95ee72-6d6b-43bd-b7b7-6f83907e22dj'} Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3c95ee72-6d6b-43bd-b7b7-6f83907e22dj to delete Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c95ee72-6d6b-43bd-b7b7-6f83907e22dj could not be found. Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.645299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-751c5609-0349-4e9d-8257-8b8744d42a72 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:25.649971 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-751c5609-0349-4e9d-8257-8b8744d42a72 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] 10.222.0.16 "DELETE /compute/v2.1/images/3c95ee72-6d6b-43bd-b7b7-6f83907e22dj" status: 404 len: 62 microversion: 2.1 time: 0.065857 Aug 29 15:41:25.653356 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1672/3540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:25 2022] DELETE /compute/v2.1/images/3c95ee72-6d6b-43bd-b7b7-6f83907e22dj => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:25.678374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.679657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:25.718153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.718694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.720363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.721593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.722296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.723028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.760033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:25.918610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.937453 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-067795a7-3d0e-4dc6-bc37-116ab3fa2131 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 204 len: 0 microversion: 2.1 time: 0.281708 Aug 29 15:41:25.940617 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1673/3541] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:25 2022] DELETE /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:25.943408 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ad8d2181-7ac7-472c-a737-9b3f62769b34 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.554024 Aug 29 15:41:25.944371 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1869/3542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:25 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:25.951538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ec8e7dd-6a27-438a-8c9a-77572f84ad80 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Calling method '.version_select at 0x7fb0e28baaf0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.956002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.957594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:25.975410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.976026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.976563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.980032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.980529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.981075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.984891 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-9ec8e7dd-6a27-438a-8c9a-77572f84ad80 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] HTTP exception thrown: Image not found. Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ec8e7dd-6a27-438a-8c9a-77572f84ad80 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Request method failure captured: Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/images/fb7b0c41-a4e2-4f88-bba3-94476101e11a1 HTTP/1.1 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4k--OjcAtey_YNh5XHXZK0Yrux7JoHKAJ6rytboYXSiPbAiJ-VevWtWpcRWk5RyPwJMCkCnYMzsaAfikWqZKKTLlurjsHV9qGH3hP-uCnsUKTzEkNFpkzbzC9h7IHi3_bHT7aAopln9oOkiBXnyyQ4xdCIe7CLuZmrq8Ve_zWanec Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d729e16452c423a8814423076f29283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d729e16452c423a8814423076f29283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}] Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0821d6e67ebc40bcac1e1c176511f512 Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'fb7b0c41-a4e2-4f88-bba3-94476101e11a1'} Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fb7b0c41-a4e2-4f88-bba3-94476101e11a1 to delete Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb7b0c41-a4e2-4f88-bba3-94476101e11a1 could not be found. Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.990767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:25.995137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ec8e7dd-6a27-438a-8c9a-77572f84ad80 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:25.998332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ec8e7dd-6a27-438a-8c9a-77572f84ad80 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] 10.222.0.16 "DELETE /compute/v2.1/images/fb7b0c41-a4e2-4f88-bba3-94476101e11a1" status: 404 len: 62 microversion: 2.1 time: 0.052000 Aug 29 15:41:25.998332 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1674/3543] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:25 2022] DELETE /compute/v2.1/images/fb7b0c41-a4e2-4f88-bba3-94476101e11a1 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:26.011832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99f0b979-d128-4817-919f-eddba63fbfb5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:26.015566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-99f0b979-d128-4817-919f-eddba63fbfb5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: d81e8821-ec3c-46ae-8978-f17e0b6bf49d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.029287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:26.034071 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-99f0b979-d128-4817-919f-eddba63fbfb5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance d81e8821-ec3c-46ae-8978-f17e0b6bf49d could not be found. Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99f0b979-d128-4817-919f-eddba63fbfb5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/d81e8821-ec3c-46ae-8978-f17e0b6bf49d/action HTTP/1.1 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 18 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: {"unshelve": null} Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d81e8821-ec3c-46ae-8978-f17e0b6bf49d could not be found. Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd81e8821-ec3c-46ae-8978-f17e0b6bf49d', 'body': {'unshelve': None}} Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81e8821-ec3c-46ae-8978-f17e0b6bf49d could not be found. Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81e8821-ec3c-46ae-8978-f17e0b6bf49d could not be found. Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.037679 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81e8821-ec3c-46ae-8978-f17e0b6bf49d could not be found. Aug 29 15:41:26.044114 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.047337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99f0b979-d128-4817-919f-eddba63fbfb5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance d81e8821-ec3c-46ae-8978-f17e0b6bf49d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:26.049226 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-99f0b979-d128-4817-919f-eddba63fbfb5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/d81e8821-ec3c-46ae-8978-f17e0b6bf49d/action" status: 404 len: 111 microversion: 2.1 time: 0.050851 Aug 29 15:41:26.051829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1675/3544] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:25 2022] POST /compute/v2.1/servers/d81e8821-ec3c-46ae-8978-f17e0b6bf49d/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:26.069529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26a8ae27-2d74-4fd3-b3e5-27b3cbd2d507 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Calling method '.version_select at 0x7fb0e27ea5e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.101620 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-26a8ae27-2d74-4fd3-b3e5-27b3cbd2d507 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] HTTP exception thrown: Image not found. Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26a8ae27-2d74-4fd3-b3e5-27b3cbd2d507 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Request method failure captured: Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/images/tempest-invalid-123296953 HTTP/1.1 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4k--OjcAtey_YNh5XHXZK0Yrux7JoHKAJ6rytboYXSiPbAiJ-VevWtWpcRWk5RyPwJMCkCnYMzsaAfikWqZKKTLlurjsHV9qGH3hP-uCnsUKTzEkNFpkzbzC9h7IHi3_bHT7aAopln9oOkiBXnyyQ4xdCIe7CLuZmrq8Ve_zWanec Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d729e16452c423a8814423076f29283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d729e16452c423a8814423076f29283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}] Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0821d6e67ebc40bcac1e1c176511f512 Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'tempest-invalid-123296953'} Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-123296953 to delete Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-123296953 could not be found. Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.103396 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26a8ae27-2d74-4fd3-b3e5-27b3cbd2d507 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:26.107946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-26a8ae27-2d74-4fd3-b3e5-27b3cbd2d507 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-123296953" status: 404 len: 62 microversion: 2.1 time: 0.050339 Aug 29 15:41:26.112420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1676/3545] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:41:26 2022] DELETE /compute/v2.1/images/tempest-invalid-123296953 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:26.117956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.119494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.134613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:26.145092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.146987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.147483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.148240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.148714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.149139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.209272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:26.304836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.314341 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ba2f0c2-b45b-4f8c-a21f-32ab537fff66 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1672 microversion: 2.1 time: 0.368683 Aug 29 15:41:26.316046 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1870/3546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:25 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1672 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:26.324005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fab02b9d-8768-4ed6-970f-283e0fd39b40 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Calling method '.version_select at 0x7fb0e356c040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.359345 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-fab02b9d-8768-4ed6-970f-283e0fd39b40 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] HTTP exception thrown: Image not found. Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fab02b9d-8768-4ed6-970f-283e0fd39b40 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Request method failure captured: Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/images/4b6da2e5-4b82-47d7-ad4a-4045a51c4f8a HTTP/1.1 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN4k--OjcAtey_YNh5XHXZK0Yrux7JoHKAJ6rytboYXSiPbAiJ-VevWtWpcRWk5RyPwJMCkCnYMzsaAfikWqZKKTLlurjsHV9qGH3hP-uCnsUKTzEkNFpkzbzC9h7IHi3_bHT7aAopln9oOkiBXnyyQ4xdCIe7CLuZmrq8Ve_zWanec Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d729e16452c423a8814423076f29283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d729e16452c423a8814423076f29283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d729e16452c423a8814423076f29283"}]}] Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0d729e16452c423a8814423076f29283 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0821d6e67ebc40bcac1e1c176511f512 Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1178905195-project Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '4b6da2e5-4b82-47d7-ad4a-4045a51c4f8a'} Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b6da2e5-4b82-47d7-ad4a-4045a51c4f8a to delete Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b6da2e5-4b82-47d7-ad4a-4045a51c4f8a could not be found. Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.361556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fab02b9d-8768-4ed6-970f-283e0fd39b40 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fab02b9d-8768-4ed6-970f-283e0fd39b40 tempest-ImagesDeleteNegativeTestJSON-1178905195 tempest-ImagesDeleteNegativeTestJSON-1178905195-project] 10.222.0.16 "DELETE /compute/v2.1/images/4b6da2e5-4b82-47d7-ad4a-4045a51c4f8a" status: 404 len: 62 microversion: 2.1 time: 0.046420 Aug 29 15:41:26.366441 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1871/3547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] DELETE /compute/v2.1/images/4b6da2e5-4b82-47d7-ad4a-4045a51c4f8a => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:26.420760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.421424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.455030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.455544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.455990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.465489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.466570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.467499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.732035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.743504 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-628a40ff-a98f-43db-8f0e-0429df7a9113 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.326791 Aug 29 15:41:26.744412 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1872/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:26.930450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.943950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f3280391-b4e3-4949-823b-d1fa48b3daa3 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.830352 Aug 29 15:41:26.958939 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1677/3549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:26.969980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.971877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.982140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.983134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.984122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.985631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.986335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.986992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.224271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:27.243438 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-064fe9a4-3025-497a-b459-0f571fcd5814 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.276208 Aug 29 15:41:27.258067 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1873/3550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:27.266489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:27.267512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.275333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.276194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.276843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.277906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.278564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.279198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.321842 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Cannot 'unshelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action HTTP/1.1 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 18 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: {"unshelve": null} Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: exception: Cannot 'unshelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'unshelve': None}} Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 in vm_state active. Cannot unshelve while the instance is in this state. Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:41:27.323575 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active Aug 29 15:41:27.329326 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.332321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 409 to user: Cannot 'unshelve' instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 while it is in vm_state active {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:27.334992 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f227236-9fe5-41be-9d47-5f61bf26aee4 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action" status: 409 len: 146 microversion: 2.1 time: 0.073655 Aug 29 15:41:27.336576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.337206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.338106 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1678/3551] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:27 2022] POST /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1/action => generated 146 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:27.346954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.348238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.351575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.352082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.355547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.356419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.356878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.357318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.358873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.359827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.360736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.361759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.362593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.363243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.767918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:27.782379 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c6cc689b-e0b9-401e-9340-7245b194b3aa tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1672 microversion: 2.1 time: 0.446556 Aug 29 15:41:27.785579 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1874/3552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:27 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1672 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:27.814863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.815495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.835390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.835831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.836255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.836981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.837457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.837890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.273859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.299134 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4721c007-346f-4768-87e3-321c71f0de76 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.498891 Aug 29 15:41:28.302170 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1875/3553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:27 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:28.814714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.815379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:28.830111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.830607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.831084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.831823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.832308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.832768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.868990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.884488 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a84855fa-23cd-4ca7-9be4-062128c41ee5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.540628 Aug 29 15:41:28.886135 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1679/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:27 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:28.909995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.910909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:28.913297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:28.929527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.930330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.931469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.932360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.933310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.935068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.246600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.257561 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6744d17d-7799-4567-b86b-9ab5edb7cabc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1672 microversion: 2.1 time: 0.448954 Aug 29 15:41:29.258100 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1876/3555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1672 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:29.322138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.323663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:29.334235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.334740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.335188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.335905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.336367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.336802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.706225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.718254 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9ec9d2c-5435-40c0-bd25-f2bc9cff0934 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.397103 Aug 29 15:41:29.719127 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1877/3556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:30.088731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:30.107950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c161423-226a-45c8-bb45-b0bdf07a6c02 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.204166 Aug 29 15:41:30.119915 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1680/3557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:30.130375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b24e8e26-5a5a-4215-892c-c9ca8e00fa9f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-349107884_updated"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:30.132924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b24e8e26-5a5a-4215-892c-c9ca8e00fa9f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 05fef2d9-438a-4629-94d4-abd8529c84f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:30.148094 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b24e8e26-5a5a-4215-892c-c9ca8e00fa9f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 05fef2d9-438a-4629-94d4-abd8529c84f3 could not be found. Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b24e8e26-5a5a-4215-892c-c9ca8e00fa9f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/servers/05fef2d9-438a-4629-94d4-abd8529c84f3 HTTP/1.1 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 80 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-349107884_updated"}} Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 05fef2d9-438a-4629-94d4-abd8529c84f3 could not be found. Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '05fef2d9-438a-4629-94d4-abd8529c84f3', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-349107884_updated'}}} Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05fef2d9-438a-4629-94d4-abd8529c84f3 could not be found. Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 15:41:30.149769 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05fef2d9-438a-4629-94d4-abd8529c84f3 could not be found. Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05fef2d9-438a-4629-94d4-abd8529c84f3 could not be found. Aug 29 15:41:30.154625 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:30.156407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b24e8e26-5a5a-4215-892c-c9ca8e00fa9f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 05fef2d9-438a-4629-94d4-abd8529c84f3 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:30.157810 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b24e8e26-5a5a-4215-892c-c9ca8e00fa9f tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "PUT /compute/v2.1/servers/05fef2d9-438a-4629-94d4-abd8529c84f3" status: 404 len: 111 microversion: 2.1 time: 0.031712 Aug 29 15:41:30.161631 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1878/3558] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:41:30 2022] PUT /compute/v2.1/servers/05fef2d9-438a-4629-94d4-abd8529c84f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:30.167569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:30.168909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:30.185976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.186868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.189132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.190606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.192713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.193421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.281006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:30.283591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:30.297993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.308494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.318995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.320072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.320570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.321087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.967243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:30.976888 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a786e7b-8717-4c80-b51e-91adf493c45c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1672 microversion: 2.1 time: 0.701801 Aug 29 15:41:30.990553 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1879/3559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:30 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1672 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:30.998916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.000835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:31.008927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.009785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.010404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.011294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.011911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.012499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.290829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:31.313675 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8942eb7c-eb26-4ec0-9dc6-d133ed5ad6d0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.317827 Aug 29 15:41:31.315787 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1880/3560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:30 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:31.329035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-45db6f64-1467-4579-ba36-5d6ac88441a2 req-506389c3-579a-4be7-a954-4e565add10ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5994e18c-700e-431a-a391-195d20e48a46", "tag": "20f39766-d891-4b25-842c-bb662c25b9d3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:31.359433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-45db6f64-1467-4579-ba36-5d6ac88441a2 req-506389c3-579a-4be7-a954-4e565add10ea service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.360275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-45db6f64-1467-4579-ba36-5d6ac88441a2 req-506389c3-579a-4be7-a954-4e565add10ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.361104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-45db6f64-1467-4579-ba36-5d6ac88441a2 req-506389c3-579a-4be7-a954-4e565add10ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.386214 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-45db6f64-1467-4579-ba36-5d6ac88441a2 req-506389c3-579a-4be7-a954-4e565add10ea service nova] Creating event network-changed:20f39766-d891-4b25-842c-bb662c25b9d3 for instance 5994e18c-700e-431a-a391-195d20e48a46 on n-h1-854882-3 Aug 29 15:41:31.404362 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-45db6f64-1467-4579-ba36-5d6ac88441a2 req-506389c3-579a-4be7-a954-4e565add10ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081138 Aug 29 15:41:31.404987 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1881/3561] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:32.005341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.006811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:32.013701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.014484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.015121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.016055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.016679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.017276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.269675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.283489 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-614f53db-2334-446b-8e52-10f21db18657 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 2.118284 Aug 29 15:41:32.284187 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1681/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:30 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:32.313413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.314851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:32.323408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.324154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.324828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.325801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.326488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.327134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.377587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.390728 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e52dc0e4-e794-45e7-9f71-c704934bb4f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1672 microversion: 2.1 time: 0.389122 Aug 29 15:41:32.394541 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1882/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1672 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:32.409011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.411431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:32.424606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.425460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.425883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.426923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.427550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.428288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.720702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.729156 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c3e800de-4c4a-4ce7-87ac-ae9b9ab041bf tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.333389 Aug 29 15:41:32.729790 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1883/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:33.412831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.413364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:33.429800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.432209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.446264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.447493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.452151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.452882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.866217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:33.874836 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e9a2d03-df62-4bc1-bf64-b3b15c9ae86c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1672 microversion: 2.1 time: 0.466365 Aug 29 15:41:33.877262 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1884/3565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1672 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:33.894983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.899305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:33.920686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.928482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.930330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.934205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.937278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.938579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.270606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.271143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.294586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ab4b632-f620-4224-9c5e-873cbc42aa95 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.985538 Aug 29 15:41:34.296962 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d9f1b99-507a-491d-a2a7-77375e0b8aa2 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.415310 Aug 29 15:41:34.311928 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1885/3567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:34.312202 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1682/3567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:34.324555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-438574c0-f2ea-472d-aeae-2ac3388ea042 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-438574c0-f2ea-472d-aeae-2ac3388ea042 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 HTTP/1.1 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 280 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.330295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:41:34.334394 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.338218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-438574c0-f2ea-472d-aeae-2ac3388ea042 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:34.340933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-438574c0-f2ea-472d-aeae-2ac3388ea042 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "PUT /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 400 len: 619 microversion: 2.1 time: 0.024027 Aug 29 15:41:34.342324 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1683/3568] 10.222.0.16 () {60 vars in 1257 bytes} [Mon Aug 29 15:41:34 2022] PUT /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:34.356785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:34.358601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:34.366159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.366923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.367673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.370021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.370774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.371425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.559305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-655713ec-3a04-4343-8710-c66b2caff2fa tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Action: 'create', calling method: .version_select at 0x7fb0e26f63a0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-516496756", "policies": ["affinity"]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:34.613615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-655713ec-3a04-4343-8710-c66b2caff2fa tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:34.633610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-655713ec-3a04-4343-8710-c66b2caff2fa tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:34.762684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-655713ec-3a04-4343-8710-c66b2caff2fa tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:34.785876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-655713ec-3a04-4343-8710-c66b2caff2fa tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:34.804883 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-655713ec-3a04-4343-8710-c66b2caff2fa tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.490465 Aug 29 15:41:34.806297 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1886/3569] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:41:34 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:34.817197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9ccf3b6-6e14-4343-ab65-891010f9c6cb tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Action: 'create', calling method: .version_select at 0x7fb0e26f6670>, body: {"server_group": {"name": "tempest-server-group-1428753469", "policies": ["affinity"]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:34.853738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e9ccf3b6-6e14-4343-ab65-891010f9c6cb tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:34.879136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e9ccf3b6-6e14-4343-ab65-891010f9c6cb tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:34.902837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:34.974156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e9ccf3b6-6e14-4343-ab65-891010f9c6cb tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:34.982399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e9ccf3b6-6e14-4343-ab65-891010f9c6cb tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:35.002190 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9ccf3b6-6e14-4343-ab65-891010f9c6cb tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.189455 Aug 29 15:41:35.008702 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1887/3570] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Aug 29 15:41:34 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:35.014449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.015090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:35.022466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.022972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.023422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.024161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.024628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.025120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.113206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.124570 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9832dea8-71c9-4362-8f75-3a101e040a31 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1605 microversion: 2.1 time: 0.114141 Aug 29 15:41:35.131900 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1888/3571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1605 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:35.137439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e069359-3bc0-4bc5-a3a9-88ef175e5b8c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Action: 'create', calling method: .version_select at 0x7fb0e2725f70>, body: {"server_group": {"name": "tempest-server-group-1428753469", "policies": ["affinity"]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:35.160769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0e069359-3bc0-4bc5-a3a9-88ef175e5b8c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:35.168618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0e069359-3bc0-4bc5-a3a9-88ef175e5b8c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:35.229119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0e069359-3bc0-4bc5-a3a9-88ef175e5b8c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:35.235896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0e069359-3bc0-4bc5-a3a9-88ef175e5b8c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:35.252677 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e069359-3bc0-4bc5-a3a9-88ef175e5b8c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.119206 Aug 29 15:41:35.259358 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1889/3572] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Aug 29 15:41:35 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:35.265134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6aa78ae4-4657-432a-9811-39af4401f478 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.313467 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6aa78ae4-4657-432a-9811-39af4401f478 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/898070da-bf76-46c5-9e1d-8d328d2b1e27" status: 204 len: 0 microversion: 2.1 time: 0.051532 Aug 29 15:41:35.317735 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1890/3573] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:41:35 2022] DELETE /compute/v2.1/os-server-groups/898070da-bf76-46c5-9e1d-8d328d2b1e27 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:35.323908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.324698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:35.332065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.332740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.333734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.334589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.335166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.335763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.551363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.560935 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-063c04ef-6895-4064-b23b-61acf6771096 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.241993 Aug 29 15:41:35.563376 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1891/3574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:35.568941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55aec684-ac2d-4696-83df-5a9a38f26a3a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.592616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55aec684-ac2d-4696-83df-5a9a38f26a3a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.027206 Aug 29 15:41:35.601746 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1892/3575] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:35.620632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8911ed99-0680-4cb5-8056-815bd2f3bb39 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.661752 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8911ed99-0680-4cb5-8056-815bd2f3bb39 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a9ba85f9-20c5-4e9f-acfc-b55a95e787a4" status: 204 len: 0 microversion: 2.1 time: 0.057696 Aug 29 15:41:35.668226 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1893/3576] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:41:35 2022] DELETE /compute/v2.1/os-server-groups/a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:35.673948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cc0e7990-93e3-49f1-9821-68320dd9b7b7 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.693983 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cc0e7990-93e3-49f1-9821-68320dd9b7b7 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023404 Aug 29 15:41:35.694438 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1894/3577] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:35.707622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10084fed-2a1c-40bd-b90c-4ab14fb50a5e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Action: 'create', calling method: .version_select at 0x7fb0e271de50>, body: {"server_group": {"name": "tempest-server-group-61211990", "policies": ["affinity"]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:35.733464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-10084fed-2a1c-40bd-b90c-4ab14fb50a5e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:35.739699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-10084fed-2a1c-40bd-b90c-4ab14fb50a5e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:35.819651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-10084fed-2a1c-40bd-b90c-4ab14fb50a5e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:35.826388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-10084fed-2a1c-40bd-b90c-4ab14fb50a5e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:35.847393 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-10084fed-2a1c-40bd-b90c-4ab14fb50a5e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.143836 Aug 29 15:41:35.856826 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1895/3578] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Aug 29 15:41:35 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:35.862144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b05f25a-b9b8-4486-9106-5b25ad906f7c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.892176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:35.905594 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b05f25a-b9b8-4486-9106-5b25ad906f7c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/80cced2f-7f39-43a9-81aa-fafc02643d93" status: 204 len: 0 microversion: 2.1 time: 0.047281 Aug 29 15:41:35.909541 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1896/3579] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:41:35 2022] DELETE /compute/v2.1/os-server-groups/80cced2f-7f39-43a9-81aa-fafc02643d93 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:35.921062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a132ea3a-eba1-419e-bf88-7288df41b5b4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.966489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.969832 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a132ea3a-eba1-419e-bf88-7288df41b5b4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.058383 Aug 29 15:41:35.970007 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1897/3580] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:35.981295 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e42909c-4aa3-4022-8d45-c381acbe638b tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.632244 Aug 29 15:41:35.983536 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1684/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:34 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:35.987524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cc0fca4b-b40d-42a4-924f-efabfc61a057 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Action: 'create', calling method: .version_select at 0x7fb0e26e5280>, body: {"server_group": {"name": "tempest-server-group-1051508842", "policies": ["anti-affinity"]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:36.011326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.013142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.020692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.021749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.022478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.023455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.024163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.024813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.029775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:36.032807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-cc0fca4b-b40d-42a4-924f-efabfc61a057 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:36.039280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-cc0fca4b-b40d-42a4-924f-efabfc61a057 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:36.110488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-cc0fca4b-b40d-42a4-924f-efabfc61a057 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:36.118138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-cc0fca4b-b40d-42a4-924f-efabfc61a057 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_groups'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:36.145154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cc0fca4b-b40d-42a4-924f-efabfc61a057 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.164193 Aug 29 15:41:36.148484 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1898/3582] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Aug 29 15:41:35 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:36.154888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.155917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.162988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.163720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.164338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.165050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.165526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.166128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.251662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:36.272238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c63eb2c2-8711-4c14-bcd1-7b5f1b4f8d09 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 200 len: 1605 microversion: 2.1 time: 0.122194 Aug 29 15:41:36.282917 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1899/3583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 1605 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:36.286883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-17517799-621c-42ba-bf12-315b15c884fc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.328168 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-17517799-621c-42ba-bf12-315b15c884fc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/50602290-dd9b-4d51-889a-99b0a4d441e8" status: 204 len: 0 microversion: 2.1 time: 0.043647 Aug 29 15:41:36.332501 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1900/3584] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:41:36 2022] DELETE /compute/v2.1/os-server-groups/50602290-dd9b-4d51-889a-99b0a4d441e8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:36.338536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-745ee782-1563-47ac-887e-da3868628f55 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.379726 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-745ee782-1563-47ac-887e-da3868628f55 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.045820 Aug 29 15:41:36.380326 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1901/3585] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:36.467937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-69052180", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "6d4b6a48-5ee7-47e0-8d88-3bd11dd73b24"}]}, "os:scheduler_hints": {"group": "e2a4d376-db79-41a1-a797-eecaa1147e32"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:36.548172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] validate_networks() for [('6d4b6a48-5ee7-47e0-8d88-3bd11dd73b24', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:37.400623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.410614 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed470a2e-c34d-4ef3-8feb-3535a79d6719 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 1.407091 Aug 29 15:41:37.411217 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1685/3586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:37.429428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:37.431943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:37.449460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.463985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.465994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.467197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.468370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.469842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.871459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:37.879446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:37.880644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:37.881521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:37.882179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:37.927850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.933114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.933902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.935298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.936122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.939081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.971810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:37.990314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:38.013907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:38.019951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:38.182100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:38.196370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:38.383016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:38.403731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Getting quotas for user 3aacfc6a126542f2897c3d3e51e736dc and project 871a37b020bc46d5b1840e19ad0a997e. Resources: {'server_group_members'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:38.458566 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8c24748-34ba-4774-b89a-c4ccbe5f451e tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994579 Aug 29 15:41:38.459969 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1902/3587] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:41:38.472380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.475494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.522595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.523098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.523860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.524259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.524718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.525150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.579215 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] HTTP exception thrown: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Request method failure captured: Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 HTTP/1.1 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN05VAioCZovOuNCysCh8aBQCefmZtc-cps-ZLlcvykr_eZmmakzs20hOfX56ysw6KyS-77LX3Ks2nBB5Mk9Gk5uKdKuVqMYpYsgGcDETgG2tPbMBJBBjf8hc5ZzQTcyVA0e1ciDR6tApdqNUH6xQ7zXS3BGvQSo3MuuVYYnu99uXOU Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/069a60f32d554f05b34f429706187490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_069a60f32d554f05b34f429706187490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}] Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 48a7b8433888412abc328cbc3aea214b Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '201caf06-9ac5-4656-af53-fe83b1b5baf8'} Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:38.585490 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.590677 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:38.590677 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:38.590677 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:38.590677 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:38.590677 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:38.590677 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:41:38.590677 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.592539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Returning 404 to user: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:38.595748 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d75c773-e5cc-4a9b-a7e5-a8569e289df8 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 404 len: 111 microversion: 2.1 time: 0.133097 Aug 29 15:41:38.599912 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1903/3588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:38.607619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4306c83-6d45-43b8-a1fe-c90c499af4f5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4306c83-6d45-43b8-a1fe-c90c499af4f5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 HTTP/1.1 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 24 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": ""}} Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1', 'body': {'server': {'name': ''}}} Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi '' Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:38.615369 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:41:38.620318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:38.636504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4306c83-6d45-43b8-a1fe-c90c499af4f5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:38.638760 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4306c83-6d45-43b8-a1fe-c90c499af4f5 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "PUT /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 400 len: 108 microversion: 2.1 time: 0.036569 Aug 29 15:41:38.644466 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1904/3589] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:41:38 2022] PUT /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:38.652168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3eac0773-5520-4c2d-8325-4d5818921668 req-d69413b8-f8e8-46dc-b326-aec0fd1e8dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201caf06-9ac5-4656-af53-fe83b1b5baf8", "name": "network-vif-deleted", "tag": "5eccb0b2-01d6-49bb-ad04-7f30f153719c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:38.681987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3eac0773-5520-4c2d-8325-4d5818921668 req-d69413b8-f8e8-46dc-b326-aec0fd1e8dbe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.682441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3eac0773-5520-4c2d-8325-4d5818921668 req-d69413b8-f8e8-46dc-b326-aec0fd1e8dbe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.682881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3eac0773-5520-4c2d-8325-4d5818921668 req-d69413b8-f8e8-46dc-b326-aec0fd1e8dbe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.699178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:38.709551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3eac0773-5520-4c2d-8325-4d5818921668 req-d69413b8-f8e8-46dc-b326-aec0fd1e8dbe service nova] Creating event network-vif-deleted:5eccb0b2-01d6-49bb-ad04-7f30f153719c for instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 on n-h2-854882-3 Aug 29 15:41:38.723910 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3eac0773-5520-4c2d-8325-4d5818921668 req-d69413b8-f8e8-46dc-b326-aec0fd1e8dbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077680 Aug 29 15:41:38.726514 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1905/3590] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:38.732987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-30158d11-49ef-49d4-b5a5-919372140716 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.733849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-30158d11-49ef-49d4-b5a5-919372140716 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.873005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-30158d11-49ef-49d4-b5a5-919372140716 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:38.887611 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-30158d11-49ef-49d4-b5a5-919372140716 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1211 microversion: 2.1 time: 0.156726 Aug 29 15:41:38.888276 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1906/3591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1211 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:38.919595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb58e771-d5cc-43cd-9ec7-a4f25f7f191a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '.version_select at 0x7fb0e26e63a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.965176 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb58e771-d5cc-43cd-9ec7-a4f25f7f191a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659300762" status: 202 len: 0 microversion: 2.1 time: 0.052407 Aug 29 15:41:38.966574 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1907/3592] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:41:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659300762 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:38.981932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.982942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.996864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.997733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.998336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.999307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.000879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.001744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:39.558047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:39.566384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:39.589318 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab610bf9-bb31-4112-b7c1-b2792d567f65 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1505 microversion: 2.1 time: 0.621320 Aug 29 15:41:39.589976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1908/3593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:39.603786 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-823ccb75-523c-4871-a598-738881e146be tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 2.179896 Aug 29 15:41:39.604717 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1686/3594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:39.909913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:39.911259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:39.913936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:39.932550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.934244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.935318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:39.936704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.952102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.953048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:40.061413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:40.074383 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0319875-f5e7-45b1-bf7a-b0b0cbba9452 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1207 microversion: 2.1 time: 0.169451 Aug 29 15:41:40.075068 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1909/3595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:39 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1207 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:40.638509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:40.640107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:40.662198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:40.662955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:40.666167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:40.667481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:40.680689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:40.684988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.099158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:41.099785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:41.114882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.115387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.124188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.126238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.126739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.127195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.341774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.356964 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-57e093c7-0fdd-4a77-b612-262299d7c958 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1269 microversion: 2.1 time: 0.256679 Aug 29 15:41:41.370328 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1910/3596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:41 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:41.480025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f589d579-0de7-435d-b57e-e55abf535659 req-64e65b2c-2040-48ca-bf11-9b0219b20760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5994e18c-700e-431a-a391-195d20e48a46", "tag": "f9170cc5-42b5-4589-b4c0-44d8453b3fe6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:41.509218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f589d579-0de7-435d-b57e-e55abf535659 req-64e65b2c-2040-48ca-bf11-9b0219b20760 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.510081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f589d579-0de7-435d-b57e-e55abf535659 req-64e65b2c-2040-48ca-bf11-9b0219b20760 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.510738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f589d579-0de7-435d-b57e-e55abf535659 req-64e65b2c-2040-48ca-bf11-9b0219b20760 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.525626 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f589d579-0de7-435d-b57e-e55abf535659 req-64e65b2c-2040-48ca-bf11-9b0219b20760 service nova] Creating event network-changed:f9170cc5-42b5-4589-b4c0-44d8453b3fe6 for instance 5994e18c-700e-431a-a391-195d20e48a46 on n-h1-854882-3 Aug 29 15:41:41.531208 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f589d579-0de7-435d-b57e-e55abf535659 req-64e65b2c-2040-48ca-bf11-9b0219b20760 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057837 Aug 29 15:41:41.532192 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1911/3597] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.181283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:42.191771 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df91d012-5e09-43b9-8cc9-3db94f7b5fea tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 1.559340 Aug 29 15:41:42.199530 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1687/3598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:40 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.379547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.380165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:42.401494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.402214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.402823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.403703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.404323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.404922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.502697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:42.519064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2314390-befd-4163-bb76-f210c5799c9a tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1269 microversion: 2.1 time: 0.144626 Aug 29 15:41:42.519911 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1912/3599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:43.228880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.230713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:43.246561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:43.247362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:43.247997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:43.249190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:43.250024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:43.252134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:43.540982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.541889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:43.559010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:43.562870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:43.563506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:43.564613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:43.565251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:43.565903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:43.834771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:43.846241 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a4f5bd3-ed97-4ac8-97ed-c09cfa6f0581 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1269 microversion: 2.1 time: 0.308948 Aug 29 15:41:43.852616 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1913/3600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1269 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:45.006959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73091da1-56d8-44f1-9522-2bfcf5076221 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Calling method '.version_select at 0x7fb0e268fe50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.045119 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-73091da1-56d8-44f1-9522-2bfcf5076221 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] HTTP exception thrown: Image not found. Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73091da1-56d8-44f1-9522-2bfcf5076221 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Request method failure captured: Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/images/5fe0bdc7-5fb9-4e02-8d8e-7849064fd5c6/metadata/os_distro HTTP/1.1 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN44frk9xFboOKYXDuPS3JO1A55v37THpRErtJBHTeD91ti1sVVWR1fu2Rm8gd3asvZtGI1jCbp783vC2FKrVMTcpJjVI6dxDAESPglwxggdMO8SR2AScUYJr1esvFJfFabCgOIpTfXl08SKL2ywJ-f-Ok3iEYFnRUpJ8AK8PgFsd_I Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d5fdf46130f848b793d96f5b8710ee63", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}] Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0fe76a8ee1b04b81afaed92ad7c0a664 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'image_id': '5fe0bdc7-5fb9-4e02-8d8e-7849064fd5c6', 'id': 'os_distro'} Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5fe0bdc7-5fb9-4e02-8d8e-7849064fd5c6 Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:41:45.062777 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5fe0bdc7-5fb9-4e02-8d8e-7849064fd5c6 could not be found. Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:45.068085 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.073977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73091da1-56d8-44f1-9522-2bfcf5076221 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:45.075041 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73091da1-56d8-44f1-9522-2bfcf5076221 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] 10.222.0.16 "DELETE /compute/v2.1/images/5fe0bdc7-5fb9-4e02-8d8e-7849064fd5c6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.312416 Aug 29 15:41:45.076120 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1914/3601] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:41:44 2022] DELETE /compute/v2.1/images/5fe0bdc7-5fb9-4e02-8d8e-7849064fd5c6/metadata/os_distro => generated 62 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:41:45.086350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.087251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:45.110309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.113365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.114611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.117033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.118205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.120017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.480709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:45.521834 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92c7281f-e886-4c14-9540-f172beeb686f tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 0.443801 Aug 29 15:41:45.525594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1915/3602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:45 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:45.536376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87077624-cf22-43ad-a617-48764850b71d tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Calling method '.version_select at 0x7fb0e26e6670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.588225 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-87077624-cf22-43ad-a617-48764850b71d tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] HTTP exception thrown: Image not found. Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87077624-cf22-43ad-a617-48764850b71d tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Request method failure captured: Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/images/d765ab89-246e-4614-809d-76553f394b5c/metadata/os_version HTTP/1.1 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN44frk9xFboOKYXDuPS3JO1A55v37THpRErtJBHTeD91ti1sVVWR1fu2Rm8gd3asvZtGI1jCbp783vC2FKrVMTcpJjVI6dxDAESPglwxggdMO8SR2AScUYJr1esvFJfFabCgOIpTfXl08SKL2ywJ-f-Ok3iEYFnRUpJ8AK8PgFsd_I Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d5fdf46130f848b793d96f5b8710ee63", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}] Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0fe76a8ee1b04b81afaed92ad7c0a664 Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'image_id': 'd765ab89-246e-4614-809d-76553f394b5c', 'id': 'os_version'} Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d765ab89-246e-4614-809d-76553f394b5c Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:41:45.592939 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d765ab89-246e-4614-809d-76553f394b5c could not be found. Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87077624-cf22-43ad-a617-48764850b71d tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:45.597499 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-87077624-cf22-43ad-a617-48764850b71d tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] 10.222.0.16 "GET /compute/v2.1/images/d765ab89-246e-4614-809d-76553f394b5c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.065933 Aug 29 15:41:45.606527 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1916/3603] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:41:45 2022] GET /compute/v2.1/images/d765ab89-246e-4614-809d-76553f394b5c/metadata/os_version => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:45.636067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-935dfef6-cea6-4544-a865-beff789cb16c tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Calling method '.version_select at 0x7fb0e26e5a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.712990 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-935dfef6-cea6-4544-a865-beff789cb16c tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] HTTP exception thrown: Image not found. Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-935dfef6-cea6-4544-a865-beff789cb16c tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Request method failure captured: Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/images/aa4d5043-87dd-4ec4-8b0c-e279b0affaad/metadata HTTP/1.1 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN44frk9xFboOKYXDuPS3JO1A55v37THpRErtJBHTeD91ti1sVVWR1fu2Rm8gd3asvZtGI1jCbp783vC2FKrVMTcpJjVI6dxDAESPglwxggdMO8SR2AScUYJr1esvFJfFabCgOIpTfXl08SKL2ywJ-f-Ok3iEYFnRUpJ8AK8PgFsd_I Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d5fdf46130f848b793d96f5b8710ee63", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}] Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0fe76a8ee1b04b81afaed92ad7c0a664 Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'image_id': 'aa4d5043-87dd-4ec4-8b0c-e279b0affaad'} Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aa4d5043-87dd-4ec4-8b0c-e279b0affaad Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:41:45.723135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa4d5043-87dd-4ec4-8b0c-e279b0affaad could not be found. Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.727135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-935dfef6-cea6-4544-a865-beff789cb16c tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:45.730459 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-935dfef6-cea6-4544-a865-beff789cb16c tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] 10.222.0.16 "GET /compute/v2.1/images/aa4d5043-87dd-4ec4-8b0c-e279b0affaad/metadata" status: 404 len: 62 microversion: 2.1 time: 0.119954 Aug 29 15:41:45.730459 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1917/3604] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:45 2022] GET /compute/v2.1/images/aa4d5043-87dd-4ec4-8b0c-e279b0affaad/metadata => generated 62 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:45.751169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9806836-be6a-4399-a19d-2ba506c218d6 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Action: 'update_all', calling method: .version_select at 0x7fb0e268f820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:45.796582 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b9806836-be6a-4399-a19d-2ba506c218d6 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] HTTP exception thrown: Image not found. Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9806836-be6a-4399-a19d-2ba506c218d6 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Request method failure captured: Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: request: PUT /compute/v2.1/images/2e9ef45e-2488-45d6-8c52-624313e43e4a/metadata HTTP/1.1 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 57 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN44frk9xFboOKYXDuPS3JO1A55v37THpRErtJBHTeD91ti1sVVWR1fu2Rm8gd3asvZtGI1jCbp783vC2FKrVMTcpJjVI6dxDAESPglwxggdMO8SR2AScUYJr1esvFJfFabCgOIpTfXl08SKL2ywJ-f-Ok3iEYFnRUpJ8AK8PgFsd_I Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d5fdf46130f848b793d96f5b8710ee63", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}] Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0fe76a8ee1b04b81afaed92ad7c0a664 Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'image_id': '2e9ef45e-2488-45d6-8c52-624313e43e4a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2e9ef45e-2488-45d6-8c52-624313e43e4a Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:41:45.806533 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e9ef45e-2488-45d6-8c52-624313e43e4a could not be found. Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:45.811505 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.818721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:45.828610 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-51979d8f-3186-4ea8-b7cc-f5f51d6c695a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 2.604141 Aug 29 15:41:45.830125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9806836-be6a-4399-a19d-2ba506c218d6 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:45.831174 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9806836-be6a-4399-a19d-2ba506c218d6 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] 10.222.0.16 "PUT /compute/v2.1/images/2e9ef45e-2488-45d6-8c52-624313e43e4a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.096627 Aug 29 15:41:45.832658 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1688/3605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 2609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:45.838412 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1918/3606] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:45 2022] PUT /compute/v2.1/images/2e9ef45e-2488-45d6-8c52-624313e43e4a/metadata => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:41:45.865208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ecbea2a-a98f-4d2e-9090-fb83bbdd3ef1 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Action: 'update', calling method: .version_select at 0x7fb0e273f040>, body: {"meta": {"os_distro": "alt"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:45.922894 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-7ecbea2a-a98f-4d2e-9090-fb83bbdd3ef1 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] HTTP exception thrown: Image not found. Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ecbea2a-a98f-4d2e-9090-fb83bbdd3ef1 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Request method failure captured: Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/images/1bb4ce68-d7f9-47fc-b028-88269625eefe/metadata/os_distro HTTP/1.1 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 30 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN44frk9xFboOKYXDuPS3JO1A55v37THpRErtJBHTeD91ti1sVVWR1fu2Rm8gd3asvZtGI1jCbp783vC2FKrVMTcpJjVI6dxDAESPglwxggdMO8SR2AScUYJr1esvFJfFabCgOIpTfXl08SKL2ywJ-f-Ok3iEYFnRUpJ8AK8PgFsd_I Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d5fdf46130f848b793d96f5b8710ee63", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}] Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0fe76a8ee1b04b81afaed92ad7c0a664 Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: {"meta": {"os_distro": "alt"}} Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: exception: Image not found. Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'image_id': '1bb4ce68-d7f9-47fc-b028-88269625eefe', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1bb4ce68-d7f9-47fc-b028-88269625eefe Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:41:45.925606 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1bb4ce68-d7f9-47fc-b028-88269625eefe could not be found. Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ecbea2a-a98f-4d2e-9090-fb83bbdd3ef1 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Returning 404 to user: Image not found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:45.929839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ecbea2a-a98f-4d2e-9090-fb83bbdd3ef1 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] 10.222.0.16 "PUT /compute/v2.1/images/1bb4ce68-d7f9-47fc-b028-88269625eefe/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.072220 Aug 29 15:41:45.942134 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1689/3607] 10.222.0.16 () {60 vars in 1310 bytes} [Mon Aug 29 15:41:45 2022] PUT /compute/v2.1/images/1bb4ce68-d7f9-47fc-b028-88269625eefe/metadata/os_distro => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:45.954229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a7d0521-3ce8-4e99-bdcc-fa5c60ff2579 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Action: 'create', calling method: .version_select at 0x7fb0e26be9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:45.992389 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-8a7d0521-3ce8-4e99-bdcc-fa5c60ff2579 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] HTTP exception thrown: Image not found. Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a7d0521-3ce8-4e99-bdcc-fa5c60ff2579 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Request method failure captured: Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/images/317963f2-6f82-494a-97ce-87c829fd518f/metadata HTTP/1.1 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 57 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN44frk9xFboOKYXDuPS3JO1A55v37THpRErtJBHTeD91ti1sVVWR1fu2Rm8gd3asvZtGI1jCbp783vC2FKrVMTcpJjVI6dxDAESPglwxggdMO8SR2AScUYJr1esvFJfFabCgOIpTfXl08SKL2ywJ-f-Ok3iEYFnRUpJ8AK8PgFsd_I Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d5fdf46130f848b793d96f5b8710ee63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d5fdf46130f848b793d96f5b8710ee63", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5fdf46130f848b793d96f5b8710ee63"}]}] Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: d5fdf46130f848b793d96f5b8710ee63 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-549698874 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0fe76a8ee1b04b81afaed92ad7c0a664 Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-549698874-project Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: exception: Image not found. Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'image_id': '317963f2-6f82-494a-97ce-87c829fd518f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 317963f2-6f82-494a-97ce-87c829fd518f Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:41:45.994635 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 317963f2-6f82-494a-97ce-87c829fd518f could not be found. Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:45.998860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a7d0521-3ce8-4e99-bdcc-fa5c60ff2579 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] Returning 404 to user: Image not found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:46.005877 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a7d0521-3ce8-4e99-bdcc-fa5c60ff2579 tempest-ImagesMetadataNegativeTestJSON-549698874 tempest-ImagesMetadataNegativeTestJSON-549698874-project] 10.222.0.16 "POST /compute/v2.1/images/317963f2-6f82-494a-97ce-87c829fd518f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055788 Aug 29 15:41:46.006374 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1919/3608] 10.222.0.16 () {60 vars in 1281 bytes} [Mon Aug 29 15:41:45 2022] POST /compute/v2.1/images/317963f2-6f82-494a-97ce-87c829fd518f/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:46.377567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bb73cab7-80ad-4f89-8820-a97838ca789a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'create', calling method: .version_select at 0x7fb0e30e3040>, body: {"keypair": {"name": "tempest-keypair-1958706590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBU2EcxcaIMWcdbhSYq0wDirkxKESkwA2j/CMeROkj/UUTxA9EhZLRIKDHj4SwXKwGaKkezHNZyUvEEnZyJ1hHA0L0NDwut+J/g5/pfPQdXZ9HcUpIHmXqXidZ9X2atPxA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:46.439777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bb73cab7-80ad-4f89-8820-a97838ca789a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for project 069a60f32d554f05b34f429706187490. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:46.455980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bb73cab7-80ad-4f89-8820-a97838ca789a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for user 48a7b8433888412abc328cbc3aea214b and project 069a60f32d554f05b34f429706187490. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:46.519088 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bb73cab7-80ad-4f89-8820-a97838ca789a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156384 Aug 29 15:41:46.520191 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1690/3609] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:46.550394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:46.551722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:46.559868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.560579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.561201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.564235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.568546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.569870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.855321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:46.856768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:46.868280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.870468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.873359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.874451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.875488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.875998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.743621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:47.758496 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95f085d1-c72c-48a0-b0d2-00d6dac61cc3 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 1.217532 Aug 29 15:41:47.759105 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1920/3610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:46 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:47.804847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:47.831533 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f2595573-8ef0-4127-aa7b-fce96e606080 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.978461 Aug 29 15:41:47.832765 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1691/3611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:46 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:47.956674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:48.114987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1866894697", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "5ccfd33f-7b88-46d7-ba74-c5346092412d"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:48.284532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] validate_networks() for [('5ccfd33f-7b88-46d7-ba74-c5346092412d', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:48.782889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:48.783528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:48.805103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.805585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.806035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.806805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.807481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.815213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.879381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=56 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:50.511652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:50.545939 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-147ad234-bf62-4ef9-af7a-5e721fcb5502 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 1.768322 Aug 29 15:41:50.559636 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1692/3612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:48 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:50.579341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:50.581211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:50.597499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.599839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.600519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.602926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.608405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.609865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.019988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:51.028666 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7904ec0e-0cbd-478e-84b1-0436318b6947 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.467647 Aug 29 15:41:51.042455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1693/3613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:50 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:51.047836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:51.048346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:51.074558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.075056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.075498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.076210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.076668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.077097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.130173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 HTTP/1.1 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '8077b5b3-4ef9-4217-bf33-87769843fb88'} Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:51.137920 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.142231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:51.145774 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2c834dac-702e-45e2-8849-b2dc8b78c1f9 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 404 len: 111 microversion: 2.1 time: 0.106369 Aug 29 15:41:51.148418 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1694/3614] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:51 2022] DELETE /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:51.178694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:51.179462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 8077b5b3-4ef9-4217-bf33-87769843fb88] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:51.203463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.204760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.205944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.207915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.208416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.209998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.246118 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 HTTP/1.1 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '8077b5b3-4ef9-4217-bf33-87769843fb88'} Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:51.251865 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.258932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:51.258932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:51.258932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:51.258932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:51.258932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:51.258932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. Aug 29 15:41:51.258932 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:51.261066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 8077b5b3-4ef9-4217-bf33-87769843fb88 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:51.262177 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e7ecb15f-9e1a-4769-999e-f1a3e41e83d8 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88" status: 404 len: 111 microversion: 2.1 time: 0.112557 Aug 29 15:41:51.268548 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1695/3615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:51 2022] GET /compute/v2.1/servers/8077b5b3-4ef9-4217-bf33-87769843fb88 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:51.732844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a93e436d-b6b9-4837-a46d-a20924092001 req-6aaee962-9854-4ce4-a76c-dd0f6552d7df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402f953c-af45-4428-9dd9-f20cf2a32e58", "tag": "0e660a77-46b0-4751-b691-b33fb92b20fe"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:51.765698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a93e436d-b6b9-4837-a46d-a20924092001 req-6aaee962-9854-4ce4-a76c-dd0f6552d7df service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.766200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a93e436d-b6b9-4837-a46d-a20924092001 req-6aaee962-9854-4ce4-a76c-dd0f6552d7df service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.766902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a93e436d-b6b9-4837-a46d-a20924092001 req-6aaee962-9854-4ce4-a76c-dd0f6552d7df service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.819395 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a93e436d-b6b9-4837-a46d-a20924092001 req-6aaee962-9854-4ce4-a76c-dd0f6552d7df service nova] Creating event network-changed:0e660a77-46b0-4751-b691-b33fb92b20fe for instance 402f953c-af45-4428-9dd9-f20cf2a32e58 on n-h2-854882-3 Aug 29 15:41:51.853875 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a93e436d-b6b9-4837-a46d-a20924092001 req-6aaee962-9854-4ce4-a76c-dd0f6552d7df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.583472 Aug 29 15:41:51.854551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1696/3616] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:51.860715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:51.867696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:51.886731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.891001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.894090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.894869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.898454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.898987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.989070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:52.256541 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-222911e0-bad8-4335-a9c8-589e90a9a402 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 204 len: 0 microversion: 2.1 time: 0.398163 Aug 29 15:41:52.259923 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1697/3617] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:51 2022] DELETE /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:52.280099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:52.281274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:52.312280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.314906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.317422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.318390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.322336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.333096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.752025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:52.767426 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb464da1-b851-4de4-805e-c1c6ba1a9922 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 0.504396 Aug 29 15:41:52.769976 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1698/3618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:52 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:52.777042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:52.783510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:52.798188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.798678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.799042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:52.799491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.799618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:52.799790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.800242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.800629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:52.800770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.801335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:52.802020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:52.823374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.824205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.825615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.827486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.828693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.834157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.891915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Getting quotas for project 0340e062377e49ff99fabbc16cc73c9a. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:52.913500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Getting quotas for user bb6c138e67fa4aa9805412ba7283592c and project 0340e062377e49ff99fabbc16cc73c9a. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:52.958317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:52.961734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:53.075843 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9725b09-00ee-4705-9e4e-43ad235db74e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.315609 Aug 29 15:41:53.077222 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1921/3619] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 5317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:41:53.102455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:53.110426 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-debedc2d-883e-48a4-9046-da434ed58940 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.339247 Aug 29 15:41:53.111047 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1699/3620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:52 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:53.129416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:53.130504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:53.136824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.137754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.138352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.140090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.141251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.142059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.278532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9dbcf9f8-bebd-4dad-90b0-d4e115ca11d6 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e26b4820>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3cSzd2V6T4kUu9nOBAMGm2jr8a6pJysh4L8t7ciMNDdjFmS7BFdLYn1e27iYVPXtImV122BZSMmYv773hq8VpRUuXlQNEkAs9YfugRWASm6JJEVkc3LiU/kNrXxEW/HA=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9dbcf9f8-bebd-4dad-90b0-d4e115ca11d6 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 257 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3cSzd2V6T4kUu9nOBAMGm2jr8a6pJysh4L8t7ciMNDdjFmS7BFdLYn1e27iYVPXtImV122BZSMmYv773hq8VpRUuXlQNEkAs9YfugRWASm6JJEVkc3LiU/kNrXxEW/HA=="}} Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3cSzd2V6T4kUu9nOBAMGm2jr8a6pJysh4L8t7ciMNDdjFmS7BFdLYn1e27iYVPXtImV122BZSMmYv773hq8VpRUuXlQNEkAs9YfugRWASm6JJEVkc3LiU/kNrXxEW/HA=='}}} Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 29 15:41:53.284436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:41:53.289753 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.298657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9dbcf9f8-bebd-4dad-90b0-d4e115ca11d6 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:53.299815 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9dbcf9f8-bebd-4dad-90b0-d4e115ca11d6 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.220797 Aug 29 15:41:53.300970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1922/3621] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:53 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:53.315641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-76d823a9-3c88-4f53-9414-abba0919b577 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:53.316807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-76d823a9-3c88-4f53-9414-abba0919b577 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:53.453820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-76d823a9-3c88-4f53-9414-abba0919b577 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:53.462996 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-76d823a9-3c88-4f53-9414-abba0919b577 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1217 microversion: 2.1 time: 0.160281 Aug 29 15:41:53.468013 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1923/3622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:53.476542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b3056c00-84bb-435f-a559-74fe98f41f93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e2725550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1204891046", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:53.572661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-b3056c00-84bb-435f-a559-74fe98f41f93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:53.606154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-b3056c00-84bb-435f-a559-74fe98f41f93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for user b1111a8787d4470b9fd6cec9f2a0a18d and project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:53.729472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b3056c00-84bb-435f-a559-74fe98f41f93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b3056c00-84bb-435f-a559-74fe98f41f93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 2167 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1204891046", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:53.761729 n-d-854882-3 devstack@n-api.service[130002]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1204891046', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:53.764315 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:53.769121 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:53.774189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b3056c00-84bb-435f-a559-74fe98f41f93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:53.776105 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b3056c00-84bb-435f-a559-74fe98f41f93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.305840 Aug 29 15:41:53.820175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1924/3623] 10.222.0.16 () {60 vars in 1160 bytes} [Mon Aug 29 15:41:53 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 350 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:53.827540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:53.842656 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0cb8dcea-848c-4469-8aac-8fe6f741d6cc tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.719921 Aug 29 15:41:53.843249 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1700/3624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:53.849693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5637bd91-a965-443c-a7c3-eef9b1b6564c tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e27448b0>, body: {"keypair": {"name": "tempest-keypair-115589098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFH5VUfYmaSlmo4GexgCtkagEhkXZQf4L/vN6EiRmV4rJqJnBeD0m1kVUsPtVA8OLssmVQ/aKSzKWyyZR5KQ87B77hpjemBcyQLMVnIaBSp+hyP1lIz9q83pNUFiC6LFpQ=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:53.859956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:53.860665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:53.907703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.915657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.916374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.917597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.918400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.918995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.929564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5637bd91-a965-443c-a7c3-eef9b1b6564c tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:53.941425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5637bd91-a965-443c-a7c3-eef9b1b6564c tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for user b1111a8787d4470b9fd6cec9f2a0a18d and project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:54.018959 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5637bd91-a965-443c-a7c3-eef9b1b6564c tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172493 Aug 29 15:41:54.020886 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1701/3625] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:54.041910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc4bf0fb-f2b2-43f5-a178-ae709566e363 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e288dd30>, body: {"keypair": {"name": "tempest-keypair-115589098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+5osZCriC59vxlEwmEGLfxQmw0wH3s2fQO2o/tWeR/23grr7LXDFN+LfuA0/AEnoEWnxWSVnOrP57NWnieBISyD0JrRa3bJRuPWkLDbBbeeh4lZ3AEw2YnYdAiaV5n1A=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:54.085239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-dc4bf0fb-f2b2-43f5-a178-ae709566e363 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:54.096045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-dc4bf0fb-f2b2-43f5-a178-ae709566e363 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for user b1111a8787d4470b9fd6cec9f2a0a18d and project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:54.133559 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-dc4bf0fb-f2b2-43f5-a178-ae709566e363 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] HTTP exception thrown: Key pair 'tempest-keypair-115589098' already exists. Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc4bf0fb-f2b2-43f5-a178-ae709566e363 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 272 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: {"keypair": {"name": "tempest-keypair-115589098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+5osZCriC59vxlEwmEGLfxQmw0wH3s2fQO2o/tWeR/23grr7LXDFN+LfuA0/AEnoEWnxWSVnOrP57NWnieBISyD0JrRa3bJRuPWkLDbBbeeh4lZ3AEw2YnYdAiaV5n1A=="}} Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: exception: Key pair 'tempest-keypair-115589098' already exists. Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-115589098', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+5osZCriC59vxlEwmEGLfxQmw0wH3s2fQO2o/tWeR/23grr7LXDFN+LfuA0/AEnoEWnxWSVnOrP57NWnieBISyD0JrRa3bJRuPWkLDbBbeeh4lZ3AEw2YnYdAiaV5n1A=='}}} Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b1111a8787d4470b9fd6cec9f2a0a18d-tempest-keypair-115589098' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 15:41:54.139055 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:41:54.143505 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b1111a8787d4470b9fd6cec9f2a0a18d-tempest-keypair-115589098' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 41, 54, 120508), 'updated_at': None, 'name': 'tempest-keypair-115589098', 'user_id': 'b1111a8787d4470b9fd6cec9f2a0a18d', 'fingerprint': '08:c6:db:35:f6:74:45:63:7d:4d:25:a0:b5:2d:7e:66', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+5osZCriC59vxlEwmEGLfxQmw0wH3s2fQO2o/tWeR/23grr7LXDFN+LfuA0/AEnoEWnxWSVnOrP57NWnieBISyD0JrRa3bJRuPWkLDbBbeeh4lZ3AEw2YnYdAiaV5n1A==', 'type': 'ssh'}] Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi keypair.create() Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._create() Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-115589098' already exists. Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 29 15:41:54.149812 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-115589098' already exists. Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-115589098' already exists. Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.158185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc4bf0fb-f2b2-43f5-a178-ae709566e363 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 409 to user: Key pair 'tempest-keypair-115589098' already exists. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:54.161691 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dc4bf0fb-f2b2-43f5-a178-ae709566e363 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.126944 Aug 29 15:41:54.162879 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1702/3626] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:54 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:54.168664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.177476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:54.185616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.186457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.187096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.188770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.189513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.190148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.493793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:54.508240 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19dd5242-5bda-47d1-8b84-03b234d61126 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.344017 Aug 29 15:41:54.509686 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1703/3627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:54 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:54.519290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27ee359f-f7cc-4c1d-9b76-9ceb806c1c93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Calling method '.version_select at 0x7fb0e288d1f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.574817 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27ee359f-f7cc-4c1d-9b76-9ceb806c1c93 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115589098" status: 202 len: 0 microversion: 2.1 time: 0.063771 Aug 29 15:41:54.581301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1704/3628] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:41:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115589098 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:54.591104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.592411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:54.601177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.601851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.602409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.603232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.605711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.606428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.627017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:54.635456 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1987b581-c0c2-47ad-a7ad-249bba441976 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 0.812325 Aug 29 15:41:54.642420 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1925/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:54.649068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf8dd89d-675d-4109-9f43-44c39d0f8808 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e26e5280>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCyqblKdWnR77dcdAFwWyzc8czKb79LpfDCDvKQFhbhW6ICjlQlvsX71dvZoy+R3rDEIKFXi4F/HULB3DgzeVC+cpIe0wQ6qSwafJuTylTfkoMPLC1t+char/VhqDUxAw=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf8dd89d-675d-4109-9f43-44c39d0f8808 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 247 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCyqblKdWnR77dcdAFwWyzc8czKb79LpfDCDvKQFhbhW6ICjlQlvsX71dvZoy+R3rDEIKFXi4F/HULB3DgzeVC+cpIe0wQ6qSwafJuTylTfkoMPLC1t+char/VhqDUxAw=="}} Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCyqblKdWnR77dcdAFwWyzc8czKb79LpfDCDvKQFhbhW6ICjlQlvsX71dvZoy+R3rDEIKFXi4F/HULB3DgzeVC+cpIe0wQ6qSwafJuTylTfkoMPLC1t+char/VhqDUxAw=='}}} Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi '' Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:54.658225 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf8dd89d-675d-4109-9f43-44c39d0f8808 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf8dd89d-675d-4109-9f43-44c39d0f8808 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016153 Aug 29 15:41:54.679339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1926/3630] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:54 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:54.704521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8aa3753e-98d8-4f33-9e02-6bfccb8bc8a0 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e267a8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1569401214", "public_key": " "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:54.797011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-8aa3753e-98d8-4f33-9e02-6bfccb8bc8a0 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:54.818952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-8aa3753e-98d8-4f33-9e02-6bfccb8bc8a0 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for user b1111a8787d4470b9fd6cec9f2a0a18d and project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:54.866612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-8aa3753e-98d8-4f33-9e02-6bfccb8bc8a0 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8aa3753e-98d8-4f33-9e02-6bfccb8bc8a0 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 95 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1569401214", "public_key": " "}} Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1569401214', 'public_key': ' '}}} Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.868473 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:54.873239 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:54.885336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8aa3753e-98d8-4f33-9e02-6bfccb8bc8a0 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:54.888642 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8aa3753e-98d8-4f33-9e02-6bfccb8bc8a0 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.213963 Aug 29 15:41:54.891029 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1927/3631] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Aug 29 15:41:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:54.912803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.913822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:54.927875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.932241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.932888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.942110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.943277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.943973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.979472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:55.018746 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31498917-b22d-4e44-b243-bbab0989e628 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1213 microversion: 2.1 time: 0.436044 Aug 29 15:41:55.069801 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1705/3632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:54 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1213 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:55.075058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25a066d9-71b3-4060-8ed6-8e171698eba8 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e2642700>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4VRhrDOh7WIyREjUYArnDer8cTfrvnRlLydR/sn0/tJuuIBRzo9lfApPt+FTcVFIGGX/tyNmRR53fOnCEUq5zsJ0Ty/YA9+aY7fFtpBRdDoKtALuvAN8UsarUrGi/SaA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25a066d9-71b3-4060-8ed6-8e171698eba8 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 507 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4VRhrDOh7WIyREjUYArnDer8cTfrvnRlLydR/sn0/tJuuIBRzo9lfApPt+FTcVFIGGX/tyNmRR53fOnCEUq5zsJ0Ty/YA9+aY7fFtpBRdDoKtALuvAN8UsarUrGi/SaA=="}} Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4VRhrDOh7WIyREjUYArnDer8cTfrvnRlLydR/sn0/tJuuIBRzo9lfApPt+FTcVFIGGX/tyNmRR53fOnCEUq5zsJ0Ty/YA9+aY7fFtpBRdDoKtALuvAN8UsarUrGi/SaA=='}}} Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 15:41:55.088267 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:41:55.091751 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.099167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25a066d9-71b3-4060-8ed6-8e171698eba8 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:55.102178 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25a066d9-71b3-4060-8ed6-8e171698eba8 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.047028 Aug 29 15:41:55.107079 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1706/3633] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:55 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:55.122162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9764ed88-cfc9-4c76-92c8-4a6eb4d634c1 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Action: 'create', calling method: .version_select at 0x7fb0e28850d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1813607261", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:55.174687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-9764ed88-cfc9-4c76-92c8-4a6eb4d634c1 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:55.187161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-9764ed88-cfc9-4c76-92c8-4a6eb4d634c1 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Getting quotas for user b1111a8787d4470b9fd6cec9f2a0a18d and project a791f93738c54fab81cd15aa60db9dc4. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:55.241935 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-9764ed88-cfc9-4c76-92c8-4a6eb4d634c1 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9764ed88-cfc9-4c76-92c8-4a6eb4d634c1 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 118 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1813607261", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1813607261', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:41:55.248673 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:41:55.254187 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.258705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9764ed88-cfc9-4c76-92c8-4a6eb4d634c1 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:55.260428 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9764ed88-cfc9-4c76-92c8-4a6eb4d634c1 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.152339 Aug 29 15:41:55.263594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1707/3634] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:55.274959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-deba3827-7014-4515-9028-ff6a782d8110 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Calling method '.version_select at 0x7fb0e32938b0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:55.299727 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-deba3827-7014-4515-9028-ff6a782d8110 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-338553993 not found for user b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-deba3827-7014-4515-9028-ff6a782d8110 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Request method failure captured: Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-338553993 HTTP/1.1 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4_-HXBa-j4uF39ThKmNe3gbWrjFDESqUs7IzhM5Vg00nXqElvb1D7FATjqnAFkYw22QozGY8Zi_zVPAudgrxl53zyBRa6Jo1fGNJo-2M9JhfZ-6ovOzYqIwA4PZJ9pMruwDgZLlKw9G4xIk_hxXtzv5vzbNA_qI2k9BzreQNhOnAk Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a791f93738c54fab81cd15aa60db9dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a791f93738c54fab81cd15aa60db9dc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a791f93738c54fab81cd15aa60db9dc4"}]}] Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a791f93738c54fab81cd15aa60db9dc4 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-692476326 Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-692476326-project Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: exception: Keypair tempest-keypair-non-existent-338553993 not found for user b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'tempest-keypair-non-existent-338553993'} Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-338553993 not found for user b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.335918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-338553993 not found for user b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-338553993 not found for user b1111a8787d4470b9fd6cec9f2a0a18d Aug 29 15:41:55.340940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:41:55.346869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-deba3827-7014-4515-9028-ff6a782d8110 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] Returning 404 to user: Keypair tempest-keypair-non-existent-338553993 not found for user b1111a8787d4470b9fd6cec9f2a0a18d {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:55.348216 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-deba3827-7014-4515-9028-ff6a782d8110 tempest-KeyPairsNegativeTestJSON-692476326 tempest-KeyPairsNegativeTestJSON-692476326-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-338553993" status: 404 len: 144 microversion: 2.1 time: 0.079729 Aug 29 15:41:55.349532 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1708/3635] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-338553993 => generated 144 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:55.543411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:55.544461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:55.555177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.557287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.558388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:55.559388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.560069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.561439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:55.827763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:55.852822 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-faa64865-500a-4b4b-b01c-87fb341a19a2 tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1511 microversion: 2.1 time: 0.958796 Aug 29 15:41:55.857175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1928/3636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:54 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1511 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:55.879915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:55.881460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:55.905678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.907395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.907955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:55.911021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.911521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.913099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.486464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:56.496826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-455b5a52-53b2-4ead-ba89-7eb5e2a4fbeb tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.970411 Aug 29 15:41:56.509766 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1709/3637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:55 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:56.550705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:56.564418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75de261f-ccab-49ab-9656-478d4144dc16 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 0.699460 Aug 29 15:41:56.566559 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1929/3638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:55 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:56.572812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:56.573655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:56.591226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.594608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.611547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.613365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.618553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.619045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.774210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:56.796041 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a4ab75d-9074-4f0d-9168-3990291cdadf tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1275 microversion: 2.1 time: 0.228078 Aug 29 15:41:56.799984 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1930/3639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:56 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:56.868142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b185f44a-7285-4364-ac30-3f86991b5cad req-1f22f276-e45b-4bba-9d4a-64335d69c142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5994e18c-700e-431a-a391-195d20e48a46", "name": "network-vif-plugged", "status": "completed", "tag": "20f39766-d891-4b25-842c-bb662c25b9d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:56.880829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:56.883050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:56.887734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:56.891665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b185f44a-7285-4364-ac30-3f86991b5cad req-1f22f276-e45b-4bba-9d4a-64335d69c142 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.895591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b185f44a-7285-4364-ac30-3f86991b5cad req-1f22f276-e45b-4bba-9d4a-64335d69c142 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.896299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b185f44a-7285-4364-ac30-3f86991b5cad req-1f22f276-e45b-4bba-9d4a-64335d69c142 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.902409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:56.911013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.912013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.919963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.922369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.927583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.929338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.931920 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b185f44a-7285-4364-ac30-3f86991b5cad req-1f22f276-e45b-4bba-9d4a-64335d69c142 service nova] Creating event network-vif-plugged:20f39766-d891-4b25-842c-bb662c25b9d3 for instance 5994e18c-700e-431a-a391-195d20e48a46 on n-h1-854882-3 Aug 29 15:41:56.942538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b185f44a-7285-4364-ac30-3f86991b5cad req-1f22f276-e45b-4bba-9d4a-64335d69c142 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.427960 Aug 29 15:41:56.944323 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1710/3640] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:57.081173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900c75dc1dd4f5d9cac369d156e2745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe0e5fcbfed48aaaac38493038900d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:57.090388 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6543483-4f08-4bd9-914b-ee110aa332ff tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 200 len: 1469 microversion: 2.1 time: 0.216815 Aug 29 15:41:57.109477 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1931/3641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:56 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 1469 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:57.111101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2956e564-f281-4d72-b64b-8de9bf5d1e15 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Action: 'create', calling method: .version_select at 0x7fb0e27ea3a0>, body: {"keypair": {"name": "tempest-keypair-459653332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHppFsuJw9mcG6//VObkTF6mJBGPzzpr/alMlEZH2R6fuGl20A53OGUM1sN/6oBzAVe5w7Gu5mp1vW2n+QItEhv0ifBEMRJvsB2lwrH+QjP4KDoaEcAGOIqj7zuFePvUw=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:57.119688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-536717052", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "320eb5e1-4f5f-4d0e-ade5-53d1634464aa"}], "security_groups": [{"name": "tempest-securitygroup--873101985"}], "key_name": "tempest-keypair-1958706590", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:57.139218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-2956e564-f281-4d72-b64b-8de9bf5d1e15 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Getting quotas for project 309d278f6e73403493d64a833dcea802. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:57.159444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-2956e564-f281-4d72-b64b-8de9bf5d1e15 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Getting quotas for user bc96cbe7dc5848538bad1b075b301f34 and project 309d278f6e73403493d64a833dcea802. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:57.202975 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2956e564-f281-4d72-b64b-8de9bf5d1e15 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191690 Aug 29 15:41:57.204400 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1711/3642] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:41:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:57.337919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] validate_networks() for [('320eb5e1-4f5f-4d0e-ade5-53d1634464aa', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:57.393797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-af1d2663-f196-4308-80bd-731d0eaf7a2c req-262f984a-6c4f-43d6-9727-e1e6a93d0e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdb7873-a953-4b26-8ffb-139cb096faf1", "name": "network-vif-deleted", "tag": "7a7b8149-cb7f-4f33-8595-700998dd84d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:57.435425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-af1d2663-f196-4308-80bd-731d0eaf7a2c req-262f984a-6c4f-43d6-9727-e1e6a93d0e44 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:57.436301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-af1d2663-f196-4308-80bd-731d0eaf7a2c req-262f984a-6c4f-43d6-9727-e1e6a93d0e44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:57.437327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-af1d2663-f196-4308-80bd-731d0eaf7a2c req-262f984a-6c4f-43d6-9727-e1e6a93d0e44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:57.453931 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-af1d2663-f196-4308-80bd-731d0eaf7a2c req-262f984a-6c4f-43d6-9727-e1e6a93d0e44 service nova] Creating event network-vif-deleted:7a7b8149-cb7f-4f33-8595-700998dd84d9 for instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 on n-h2-854882-3 Aug 29 15:41:57.479946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-af1d2663-f196-4308-80bd-731d0eaf7a2c req-262f984a-6c4f-43d6-9727-e1e6a93d0e44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092641 Aug 29 15:41:57.482566 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1712/3643] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:57.526222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:57.529133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:57.540131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:57.541430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:57.542366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:57.543882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:57.544804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:57.545503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.048086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:58.060773 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-62a8d19b-dc01-4450-bf6f-99090ae7ef6a tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.540145 Aug 29 15:41:58.062579 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1713/3644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:57 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:58.071774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.082319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:58.091207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.104043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.104784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.105754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.115472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.115919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.398539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:58.411834 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ffa55542-c84f-4078-9ae5-dae9da9119c4 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 0.343916 Aug 29 15:41:58.413122 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1714/3645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:58.418063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.419376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:58.431306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.431995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.432514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.433971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.434684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.435378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.490843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:58.491392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:58.491982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:58.492511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:58.492931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:58.523059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.524903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.529710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.530987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.532994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.542510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.627867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for project 069a60f32d554f05b34f429706187490. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:58.645332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Getting quotas for user 48a7b8433888412abc328cbc3aea214b and project 069a60f32d554f05b34f429706187490. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:58.677779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:58.680001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:58.795433 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-15c98d7a-99a9-4f13-8e0c-b897e4428588 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.684599 Aug 29 15:41:58.800150 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1932/3646] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:41:58.815451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.817049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] [instance: 6fdb7873-a953-4b26-8ffb-139cb096faf1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:58.835481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.845413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.846649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.847415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.847942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.848371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.886949 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] HTTP exception thrown: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 could not be found. Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Request method failure captured: Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 HTTP/1.1 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN1XCoIpisSADgZvAkR3dJ6FDx38I70Q7nf-mmA_aHSQKShPE5836H9vhDoD-RaKx7ydXrNF_eo0StK0ZhvR9KL03_mOgqITd1N4zvdhHj_FgC6yEm8uOOpmV7ylSMulFZK9hcp40cidNWeWwmE7K_mmi-iLBTGckSR_J8s4epihPsA Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbe0e5fcbfed48aaaac38493038900d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbe0e5fcbfed48aaaac38493038900d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbe0e5fcbfed48aaaac38493038900d5"}]}] Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fbe0e5fcbfed48aaaac38493038900d5 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1187322066 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: d900c75dc1dd4f5d9cac369d156e2745 Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1187322066-project Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 could not be found. Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fdb7873-a953-4b26-8ffb-139cb096faf1'} Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 could not be found. Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 could not be found. Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:58.894327 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.900068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:58.900068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:58.900068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:58.900068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:58.900068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:58.900068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 could not be found. Aug 29 15:41:58.900068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.902438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] Returning 404 to user: Instance 6fdb7873-a953-4b26-8ffb-139cb096faf1 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:58.904618 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7182ecd9-c07a-4562-abaa-bb422e933fdb tempest-ServersNegativeTestJSON-1187322066 tempest-ServersNegativeTestJSON-1187322066-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1" status: 404 len: 111 microversion: 2.1 time: 0.103427 Aug 29 15:41:58.908398 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1933/3647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/servers/6fdb7873-a953-4b26-8ffb-139cb096faf1 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:58.915215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e473d9e4-154e-4a1f-bf96-eb5d8702263e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.918560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e473d9e4-154e-4a1f-bf96-eb5d8702263e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:59.279610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e473d9e4-154e-4a1f-bf96-eb5d8702263e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:59.305029 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e473d9e4-154e-4a1f-bf96-eb5d8702263e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1237 microversion: 2.1 time: 0.394372 Aug 29 15:41:59.307397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1934/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1237 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:59.331319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f2f91738-933b-4a96-8dcf-17b635f9f360 req-e6ef395c-7517-412d-8df8-c60722956971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5994e18c-700e-431a-a391-195d20e48a46", "name": "network-vif-plugged", "status": "completed", "tag": "f9170cc5-42b5-4589-b4c0-44d8453b3fe6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:59.360113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f2f91738-933b-4a96-8dcf-17b635f9f360 req-e6ef395c-7517-412d-8df8-c60722956971 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.362288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f2f91738-933b-4a96-8dcf-17b635f9f360 req-e6ef395c-7517-412d-8df8-c60722956971 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.367896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f2f91738-933b-4a96-8dcf-17b635f9f360 req-e6ef395c-7517-412d-8df8-c60722956971 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.403020 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f2f91738-933b-4a96-8dcf-17b635f9f360 req-e6ef395c-7517-412d-8df8-c60722956971 service nova] Creating event network-vif-plugged:f9170cc5-42b5-4589-b4c0-44d8453b3fe6 for instance 5994e18c-700e-431a-a391-195d20e48a46 on n-h1-854882-3 Aug 29 15:41:59.421536 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f2f91738-933b-4a96-8dcf-17b635f9f360 req-e6ef395c-7517-412d-8df8-c60722956971 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112090 Aug 29 15:41:59.424739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1935/3649] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:59.460160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:59.483124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:59.519564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.520240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.520612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.521641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.522314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.523538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.757305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:59.775851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4c7b759a-2848-4661-8091-5b0c910b4c79 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 1.358816 Aug 29 15:41:59.791555 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1715/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:59.791555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:59.795956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:59.823436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.824826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.825531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.839809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.839809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.839809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.338478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:00.363636 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f29add80-07f7-497b-aac5-8cb35c1f4e2d tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1334 microversion: 2.1 time: 0.937280 Aug 29 15:42:00.367362 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1936/3651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:59 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1334 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:00.656715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a5e96805-5fae-4a53-b1e1-771ef4fd5d2b tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e26e5550>, body: {"keypair": {"name": "tempest-keypair-1397251787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9sGxIu/rCqMHw4LxO9RXqZQLTYRCEkKgM0pOLnQXeJwewIUP7h0+7yoAhzDQWNeZ8lJ42zI3j5s2Yq541qS+QZMGqTrbZgHKJZVcP9PssMsuowmdu5hOb1Tj8qoQ1Lqg=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:00.696068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a5e96805-5fae-4a53-b1e1-771ef4fd5d2b tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:00.708800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a5e96805-5fae-4a53-b1e1-771ef4fd5d2b tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:00.742369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:00.782171 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a5e96805-5fae-4a53-b1e1-771ef4fd5d2b tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.412870 Aug 29 15:42:00.784460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1937/3652] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Aug 29 15:42:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 416 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:42:00.789764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.790640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:00.799349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.799923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.800463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.801211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.801727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.802144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.975869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:00.995796 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc3ff46b-808e-43aa-abd6-b57742a8441c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1297 microversion: 2.1 time: 0.209892 Aug 29 15:42:01.010967 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1938/3653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1297 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:01.016782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:01.018983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-601acad2-71d5-4401-aad7-030811a88517 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e272c280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.029366 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-601acad2-71d5-4401-aad7-030811a88517 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1397251787" status: 200 len: 513 microversion: 2.2 time: 0.016868 Aug 29 15:42:01.029832 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bdce5e88-fa9a-45ad-bb8b-52a8b1909d76 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 1.249068 Aug 29 15:42:01.031133 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1716/3654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:59 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:01.033994 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1939/3655] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1397251787 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:01.046115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.046776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:01.046940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "575d5735-0c6e-4a1b-91c1-bcbfb263b7c4"}], "security_groups": [{"name": "tempest-securitygroup--138685950"}], "key_name": "tempest-keypair-459653332", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:01.059362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.059856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.060296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.060994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.066666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.067360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.215583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] validate_networks() for [('575d5735-0c6e-4a1b-91c1-bcbfb263b7c4', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:01.697753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:01.712797 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-063d2bb5-3c18-479e-b8c3-5878564fc680 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.679817 Aug 29 15:42:01.714045 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1717/3656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:01.723280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c7dce87-2217-4888-b79f-aed2b3b8be82 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e283ab80>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.773610 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c7dce87-2217-4888-b79f-aed2b3b8be82 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397251787" status: 204 len: 0 microversion: 2.2 time: 0.058209 Aug 29 15:42:01.774496 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1718/3657] 10.222.0.16 () {60 vars in 1261 bytes} [Mon Aug 29 15:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397251787 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:01.779918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.780911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:01.799504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.800091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.805181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.807920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.808464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.808912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.065671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:02.066265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:02.066574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:02.066988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:02.067407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:02.076851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.077342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.078365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.079318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.080389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.080994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.103837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Getting quotas for project 309d278f6e73403493d64a833dcea802. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:02.112853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Getting quotas for user bc96cbe7dc5848538bad1b075b301f34 and project 309d278f6e73403493d64a833dcea802. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:02.135348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:02.138469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:02.223711 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7277483b-2786-4c5c-b410-d9f259ae0e23 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.188085 Aug 29 15:42:02.225594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1940/3658] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:02.244050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f43b785d-be80-4f85-b724-51d082b5a35c req-7986bc80-5c3c-42da-8012-eadf21268599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402f953c-af45-4428-9dd9-f20cf2a32e58", "name": "network-vif-plugged", "status": "completed", "tag": "0e660a77-46b0-4751-b691-b33fb92b20fe"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:02.245513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.293772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f43b785d-be80-4f85-b724-51d082b5a35c req-7986bc80-5c3c-42da-8012-eadf21268599 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.297911 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a8d40d3-3192-4825-918f-6dddc9db18f8 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1668 microversion: 2.1 time: 0.517203 Aug 29 15:42:02.299594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f43b785d-be80-4f85-b724-51d082b5a35c req-7986bc80-5c3c-42da-8012-eadf21268599 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.300319 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1719/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1668 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:02.303452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f43b785d-be80-4f85-b724-51d082b5a35c req-7986bc80-5c3c-42da-8012-eadf21268599 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.355960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b47e8e91-a01e-4ad5-8ca9-dffcaa969ef2 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e30e3940>, body: {"keypair": {"name": "tempest-keypair-1413616062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz/JSXMJj600BCaFfybkGqphzL2mI9Ds6dmF5QE5yTqCO2OuQNq/yiwIRh/BgFicCuXD4CtOvWvoocg4ChEAQKnhQ7OGF+X+d6YonaF+Z0201prWhAeBwZFg8Dw6TZ4cA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:02.367720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f43b785d-be80-4f85-b724-51d082b5a35c req-7986bc80-5c3c-42da-8012-eadf21268599 service nova] Creating event network-vif-plugged:0e660a77-46b0-4751-b691-b33fb92b20fe for instance 402f953c-af45-4428-9dd9-f20cf2a32e58 on n-h2-854882-3 Aug 29 15:42:02.374418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f43b785d-be80-4f85-b724-51d082b5a35c req-7986bc80-5c3c-42da-8012-eadf21268599 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146894 Aug 29 15:42:02.376246 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1941/3660] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:02.388674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b47e8e91-a01e-4ad5-8ca9-dffcaa969ef2 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:02.391351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.394269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.416569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b47e8e91-a01e-4ad5-8ca9-dffcaa969ef2 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:02.425237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.431509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.433289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.444647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.445850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.446785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.454205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:02.474014 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b47e8e91-a01e-4ad5-8ca9-dffcaa969ef2 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.170845 Aug 29 15:42:02.480036 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1720/3661] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Aug 29 15:42:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:42:02.492934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.493892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.508104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.508612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.509054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.510685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.513313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.513581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.605552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.620969 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-078ceb32-bd26-407a-8904-c6f136dda16c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1295 microversion: 2.1 time: 0.243092 Aug 29 15:42:02.626962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1942/3662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1295 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:02.634755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2df3f69d-95fa-4958-99f3-982fa47c17a6 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.635566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2df3f69d-95fa-4958-99f3-982fa47c17a6 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.819857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2df3f69d-95fa-4958-99f3-982fa47c17a6 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.835412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2df3f69d-95fa-4958-99f3-982fa47c17a6 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1225 microversion: 2.1 time: 0.206044 Aug 29 15:42:02.836798 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1943/3663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1225 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:02.844113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.845249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.854607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.855527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.856171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.857250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.858493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.860042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.967107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7b320d1-6917-45de-b7f7-daf08ca54678 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46/ips" status: 200 len: 178 microversion: 2.1 time: 0.127635 Aug 29 15:42:02.977633 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1944/3664] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46/ips => generated 178 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:02.985550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-49518ef7-b369-4761-ba0a-30de36f2f041 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e26fe160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.048461 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-49518ef7-b369-4761-ba0a-30de36f2f041 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413616062" status: 204 len: 0 microversion: 2.2 time: 0.069058 Aug 29 15:42:03.056738 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1945/3665] 10.222.0.16 () {60 vars in 1261 bytes} [Mon Aug 29 15:42:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413616062 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:03.068135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.073865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.096525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.098181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.103996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.105172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.107549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.108845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.345118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:03.357100 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03471044-4fba-4ba4-a0d3-60b28bb20987 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.298707 Aug 29 15:42:03.365617 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1946/3666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.365617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a8ed2eb1-9247-42a9-bd2d-ec2ebf50863e req-342a1a4d-e93b-4640-94af-5d40de2d31da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43283f7-2a32-4a90-a996-e9cc3b2b3108", "tag": "0e2bd384-4bff-4f19-ac19-700f82eeaeef"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:03.379791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a8ed2eb1-9247-42a9-bd2d-ec2ebf50863e req-342a1a4d-e93b-4640-94af-5d40de2d31da service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.380301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a8ed2eb1-9247-42a9-bd2d-ec2ebf50863e req-342a1a4d-e93b-4640-94af-5d40de2d31da service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.380787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a8ed2eb1-9247-42a9-bd2d-ec2ebf50863e req-342a1a4d-e93b-4640-94af-5d40de2d31da service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.413486 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a8ed2eb1-9247-42a9-bd2d-ec2ebf50863e req-342a1a4d-e93b-4640-94af-5d40de2d31da service nova] Creating event network-changed:0e2bd384-4bff-4f19-ac19-700f82eeaeef for instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 on n-h1-854882-3 Aug 29 15:42:03.418861 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a8ed2eb1-9247-42a9-bd2d-ec2ebf50863e req-342a1a4d-e93b-4640-94af-5d40de2d31da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059437 Aug 29 15:42:03.419889 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1947/3667] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:03.428425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.429113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.441758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.442336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.442796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.443534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.443988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.444617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.484745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:03.486228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:03.513518 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d84e861-dff3-4985-bbb2-239bf7af8b06 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1311 microversion: 2.1 time: 1.036328 Aug 29 15:42:03.514413 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1721/3668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1311 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.526446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-700a5999-132c-4322-bc98-10134c8f2041 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e30e3940>, body: {"keypair": {"name": "tempest-keypair-719669660", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:03.586340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-700a5999-132c-4322-bc98-10134c8f2041 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:03.596405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-700a5999-132c-4322-bc98-10134c8f2041 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:03.674338 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0ae629a5-1a4b-46c0-83dd-41a6185e0c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 204 len: 0 microversion: 2.1 time: 0.251326 Aug 29 15:42:03.679216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1948/3669] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:03 2022] DELETE /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:03.679735 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-700a5999-132c-4322-bc98-10134c8f2041 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.159622 Aug 29 15:42:03.681642 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1722/3670] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Aug 29 15:42:03 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:42:03.694933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.695655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.710052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.711013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.721704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.722715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.723392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.724366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.724980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.725593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.725891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.727705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.729700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.731623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.740139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.742246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.886269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:03.898174 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99cc5b89-c743-4871-9468-f9de1d1e44dc tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1295 microversion: 2.1 time: 0.217569 Aug 29 15:42:03.903436 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1949/3671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1295 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.908503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd4ceb13-0f0f-43c5-9379-245dfbcadccc tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e26e6280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.951498 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd4ceb13-0f0f-43c5-9379-245dfbcadccc tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-719669660" status: 204 len: 0 microversion: 2.2 time: 0.046884 Aug 29 15:42:03.953564 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1950/3672] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Aug 29 15:42:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-719669660 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:03.963385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.965756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.983580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.985115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.986353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.988107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.989532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.990416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.101975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.111560 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77a1881e-839c-4a79-99b1-2b13334853d5 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1277 microversion: 2.1 time: 0.156719 Aug 29 15:42:04.112701 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1951/3673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:04.120178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf287098-a402-44c7-b1f8-59aa1cbd6ad8 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e28c3160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1827022375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUdri9hKOF13c5uMEprhKtkOnWJvYHr3GTt/V6N+az96xMOyS+kYHPrxzkO1XRDvlZEitdJ4XOpUVh2AV93Kqan7WGlJj0YneR1BSsVXWQYY8grP7wHRogiSJRTb+FkBg=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:04.158781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bf287098-a402-44c7-b1f8-59aa1cbd6ad8 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:04.175591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bf287098-a402-44c7-b1f8-59aa1cbd6ad8 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:04.220426 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf287098-a402-44c7-b1f8-59aa1cbd6ad8 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.105547 Aug 29 15:42:04.221041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1952/3674] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Aug 29 15:42:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:42:04.237901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2bd8b63c-b6cc-40ac-a2dc-834de873c556 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e26f6310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-581077541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6qdxxrH22CakIoWEs/n5ovpmvopeTDgFNs0y/Jy40gxC/QZF6g4TP+CJqRQiB8OUq6RtTrg+NnJXo+9XlYUC8Gt+SUK3hw7iK8RLeGNOdrqBhlaDrQZx0SgFou33ra5g=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:04.266485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2bd8b63c-b6cc-40ac-a2dc-834de873c556 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:04.274417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2bd8b63c-b6cc-40ac-a2dc-834de873c556 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:04.340863 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2bd8b63c-b6cc-40ac-a2dc-834de873c556 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.110314 Aug 29 15:42:04.342639 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1953/3675] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Aug 29 15:42:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 15:42:04.356581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-118a195d-9873-458c-b8ac-47ba206d41a0 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e26e6280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1688658883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHshPsJwZQIXyF8shWc0yErGKc2/m5PfVNYYVrsrzRQRn0sSbHQxZ+SdHB2M0TpXN/8dvXKw8oWibFIaDX6obOWipE/eUXJo9cjxRJ6uTXfArX9wWlkRxHSJANCPNdiisQ=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:04.402119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-118a195d-9873-458c-b8ac-47ba206d41a0 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:04.413920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-118a195d-9873-458c-b8ac-47ba206d41a0 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:04.473551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-118a195d-9873-458c-b8ac-47ba206d41a0 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.122444 Aug 29 15:42:04.482471 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1954/3676] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Aug 29 15:42:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 15:42:04.483657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.493519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.497728 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae3eca7e-74b6-4b46-bd9a-e837a336fcf7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1674 microversion: 2.1 time: 0.809177 Aug 29 15:42:04.498968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1723/3677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1674 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:04.504598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.508472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6982d976-b417-4e0c-a90c-8c3578ef1776 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e2642940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.516721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.517540 n-d-854882-3 devstack@n-api.service[130001]: WARNING oslo_db.sqlalchemy.utils [None req-6982d976-b417-4e0c-a90c-8c3578ef1776 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:42:04.520774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.521318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.522446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.522921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.523356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.536052 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6982d976-b417-4e0c-a90c-8c3578ef1776 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.035675 Aug 29 15:42:04.543441 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1724/3678] 10.222.0.16 () {60 vars in 1177 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:04.560990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.561953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.587549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.590253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.590919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.592621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.597303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.599444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.777880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.788217 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-335f14da-fbf5-4af9-a400-69ccd24e23d9 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.303936 Aug 29 15:42:04.789214 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1955/3679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:04.794225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f102465a-01f7-44d3-b260-b0895f3ce7eb tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e272c670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.808575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:04.838422 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f102465a-01f7-44d3-b260-b0895f3ce7eb tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1688658883" status: 204 len: 0 microversion: 2.2 time: 0.043421 Aug 29 15:42:04.840910 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1956/3680] 10.222.0.16 () {60 vars in 1321 bytes} [Mon Aug 29 15:42:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1688658883 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:04.852822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-680990e6-bed4-4585-9949-bc1794927108 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e26b4e50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.925197 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-680990e6-bed4-4585-9949-bc1794927108 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-581077541" status: 204 len: 0 microversion: 2.2 time: 0.076975 Aug 29 15:42:04.929993 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1957/3681] 10.222.0.16 () {60 vars in 1318 bytes} [Mon Aug 29 15:42:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-581077541 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:04.941055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.948248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.971419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.972808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.973267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.974646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.975171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.975894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.175248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:05.191559 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-348c76cc-a795-434d-8ea1-f248e50f4082 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.258064 Aug 29 15:42:05.192167 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1958/3682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:05.224203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f4dd7cb-99e2-4168-9a0f-85c01c1b70b5 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e26e5790>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.266384 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4f4dd7cb-99e2-4168-9a0f-85c01c1b70b5 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1827022375" status: 204 len: 0 microversion: 2.2 time: 0.055556 Aug 29 15:42:05.268231 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1959/3683] 10.222.0.16 () {60 vars in 1321 bytes} [Mon Aug 29 15:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1827022375 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:05.283478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.284402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:05.292074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.292863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.293658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.294741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.295374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.295975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.468827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:05.482705 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-038ffd44-ff69-40f2-a3c2-f355d758dbe8 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1277 microversion: 2.1 time: 0.210352 Aug 29 15:42:05.482705 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1960/3684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:05 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:05.517896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3b3fa4e-9146-4098-974d-dd69e75515a4 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e271da60>, body: {"keypair": {"name": "tempest-keypair-916790202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3eFhVWJcuAq0uft3Wm9CM42J3bRYqyeVp+bkRFaslIJ6g5FeRD9DY+3G3T0rpNc6oMKuofnh5kgAnD48F6CyBmWBT8FWl5tjsUuLWyVIIOwKE53XjHVuFGDsDNnGFuIA=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:05.525227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:05.544803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fbba0527-a720-4f52-92de-976a14975803 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1495 microversion: 2.1 time: 0.999952 Aug 29 15:42:05.550949 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1725/3685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1495 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:05.558580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.559703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:05.570140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.571059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.571693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.572845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.574841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.575536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.596114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-f3b3fa4e-9146-4098-974d-dd69e75515a4 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:05.614871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-f3b3fa4e-9146-4098-974d-dd69e75515a4 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:05.667700 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3b3fa4e-9146-4098-974d-dd69e75515a4 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.184415 Aug 29 15:42:05.668526 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1961/3686] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Aug 29 15:42:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:42:05.673422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c6456c7e-4af5-4166-b454-86e1b023d7cd tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.695626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.server_groups [None req-c6456c7e-4af5-4166-b454-86e1b023d7cd tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Querying cell f444391f-7036-4697-bac9-7a9b7c940a18(cell1) for 1 instances {{(pid=130002) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:42:05.699610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6456c7e-4af5-4166-b454-86e1b023d7cd tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.700120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6456c7e-4af5-4166-b454-86e1b023d7cd tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.700573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6456c7e-4af5-4166-b454-86e1b023d7cd tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.721272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c6456c7e-4af5-4166-b454-86e1b023d7cd tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/e2a4d376-db79-41a1-a797-eecaa1147e32" status: 200 len: 221 microversion: 2.1 time: 0.051831 Aug 29 15:42:05.722343 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1962/3687] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:42:05 2022] GET /compute/v2.1/os-server-groups/e2a4d376-db79-41a1-a797-eecaa1147e32 => generated 221 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:05.727071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-201bf691-e59c-4608-b363-a0a86f191a1e tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e2604b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.740017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-201bf691-e59c-4608-b363-a0a86f191a1e tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-916790202" status: 200 len: 512 microversion: 2.2 time: 0.014453 Aug 29 15:42:05.740017 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1963/3688] 10.222.0.16 () {60 vars in 1255 bytes} [Mon Aug 29 15:42:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-916790202 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:05.744272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.744788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:05.751737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.752239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.752826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.753626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.754077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.754514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.785900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:05.974722 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fdb736fb-2347-4160-8968-1873f4538e14 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 204 len: 0 microversion: 2.1 time: 0.233921 Aug 29 15:42:05.975608 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1964/3689] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:05 2022] DELETE /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:05.984526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-368f21c2-6506-480f-ac9d-e6e66f40a01f tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e260af70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.004343 n-d-854882-3 devstack@n-api.service[130002]: WARNING oslo_db.sqlalchemy.utils [None req-368f21c2-6506-480f-ac9d-e6e66f40a01f tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:42:06.019843 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-368f21c2-6506-480f-ac9d-e6e66f40a01f tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.042673 Aug 29 15:42:06.023768 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1965/3690] 10.222.0.16 () {60 vars in 1177 bytes} [Mon Aug 29 15:42:05 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:06.028745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.029523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.049962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.050557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.051126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.051873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.052333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.052767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.234619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.244545 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0ce617f5-ca26-45c3-a04e-e3928d972b92 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1674 microversion: 2.1 time: 0.691799 Aug 29 15:42:06.258251 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1726/3691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:05 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1674 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.268494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.269457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.276249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.276726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.277351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.278555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.279174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.279747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.360874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.372774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0ba1d281-76f4-45eb-8a67-62f90bd47f1e tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.347691 Aug 29 15:42:06.385453 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1966/3692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.385453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a5c1e67-4f33-44b1-bdf7-e65d90fba8aa tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e260aa60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.410014 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a5c1e67-4f33-44b1-bdf7-e65d90fba8aa tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916790202" status: 204 len: 0 microversion: 2.2 time: 0.034448 Aug 29 15:42:06.410686 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1967/3693] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Aug 29 15:42:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916790202 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:06.415741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.416516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.425019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.425590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.426072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.427461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.430428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.431812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.647176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.659154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f94f3da6-1361-435a-9634-026c49d818d6 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.247144 Aug 29 15:42:06.675359 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1968/3694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.681185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Action: 'create', calling method: .version_select at 0x7fb0e26b4af0>, body: {"keypair": {"name": "tempest-keypair-672925235", "type": "x509"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:06.740048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:06.758459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:06.771950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.792322 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bcf96d42-190a-44db-860e-7df8dfc6b1ed tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1501 microversion: 2.1 time: 0.530565 Aug 29 15:42:06.795311 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1727/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1501 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.811484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.processutils [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp0h1rz59q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0h1rz59q/temp.key -subj /CN=46d63ff4182d4208abff51516727cb0c -extensions v3_req_client {{(pid=130002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 15:42:06.813580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.815400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.832570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.834891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.835606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.837379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.839435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.840751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.486567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.processutils [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp0h1rz59q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0h1rz59q/temp.key -subj /CN=46d63ff4182d4208abff51516727cb0c -extensions v3_req_client" returned: 0 in 0.675s {{(pid=130002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 15:42:07.489495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.processutils [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp0h1rz59q/temp.key -password pass: {{(pid=130002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 15:42:07.557475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.processutils [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp0h1rz59q/temp.key -password pass:" returned: 0 in 0.066s {{(pid=130002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 15:42:07.639667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:07.657865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Getting quotas for user 46d63ff4182d4208abff51516727cb0c and project 72c8b7b1bf85460b8da7a6226458fa79. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:07.682006 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-709f5594-9bb1-4512-b8c7-38b1fd6d67c9 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.005299 Aug 29 15:42:07.688976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1969/3696] 10.222.0.16 () {62 vars in 1198 bytes} [Mon Aug 29 15:42:06 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1013 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:07.696016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:07.697110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:07.704700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.705470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.706022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.707190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.707759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.708553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.192329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.206006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:08.212641 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03db07f1-e7f0-4812-aa1b-efe2daf4f3c7 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1653 microversion: 2.1 time: 0.521744 Aug 29 15:42:08.217518 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1970/3697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:07 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1653 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.247315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.250002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.274238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.275189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.276130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.277819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.278891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.279525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.327171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.377800 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bb696ee-e56e-455e-b3a7-91e7cbf7c8c9 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1350 microversion: 2.1 time: 1.580790 Aug 29 15:42:08.378743 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1728/3698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1350 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.386750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2bc8c766-0f7e-4354-9ce6-cd5e0fbe9472 req-6ed1b2e8-e74e-494d-9557-3238620a5ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5994e18c-700e-431a-a391-195d20e48a46", "name": "network-vif-deleted", "tag": "20f39766-d891-4b25-842c-bb662c25b9d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:08.398015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2bc8c766-0f7e-4354-9ce6-cd5e0fbe9472 req-6ed1b2e8-e74e-494d-9557-3238620a5ffa service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.398746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2bc8c766-0f7e-4354-9ce6-cd5e0fbe9472 req-6ed1b2e8-e74e-494d-9557-3238620a5ffa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.399266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2bc8c766-0f7e-4354-9ce6-cd5e0fbe9472 req-6ed1b2e8-e74e-494d-9557-3238620a5ffa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.419469 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2bc8c766-0f7e-4354-9ce6-cd5e0fbe9472 req-6ed1b2e8-e74e-494d-9557-3238620a5ffa service nova] Creating event network-vif-deleted:20f39766-d891-4b25-842c-bb662c25b9d3 for instance 5994e18c-700e-431a-a391-195d20e48a46 on n-h1-854882-3 Aug 29 15:42:08.426445 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2bc8c766-0f7e-4354-9ce6-cd5e0fbe9472 req-6ed1b2e8-e74e-494d-9557-3238620a5ffa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045719 Aug 29 15:42:08.428167 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1729/3699] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:08.436355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.437565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.447959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.448720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.449951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.451517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.453438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.454158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.747751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.768016 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-87d20294-42c1-47d0-a99e-3d6f1a59fce2 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.541007 Aug 29 15:42:08.769438 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1971/3700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.784254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c705d25-6752-4e2a-932f-733bef9d8f77 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e26049d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.802491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c705d25-6752-4e2a-932f-733bef9d8f77 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-672925235" status: 200 len: 1533 microversion: 2.2 time: 0.025701 Aug 29 15:42:08.804758 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1972/3701] 10.222.0.16 () {60 vars in 1255 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-672925235 => generated 1533 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.813983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.815349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.823800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.825704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.826521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.827544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.828904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.830266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.003577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:09.018054 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-987e73ef-e506-493c-8de9-0ac16c2c233c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.587941 Aug 29 15:42:09.018906 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1730/3702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:09.037832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3b8ced16-efc1-45f5-bbac-aabbc5c6cd25 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0e2642160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.044879 n-d-854882-3 devstack@n-api.service[130001]: WARNING oslo_db.sqlalchemy.utils [None req-3b8ced16-efc1-45f5-bbac-aabbc5c6cd25 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:42:09.063986 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3b8ced16-efc1-45f5-bbac-aabbc5c6cd25 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.029910 Aug 29 15:42:09.065155 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1731/3703] 10.222.0.16 () {60 vars in 1177 bytes} [Mon Aug 29 15:42:09 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:09.075100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b683e7c-6f87-476d-afb3-d71159320223 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] Calling method '.version_select at 0x7fb0eb586310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.111003 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b683e7c-6f87-476d-afb3-d71159320223 tempest-KeyPairsV22TestJSON-92666161 tempest-KeyPairsV22TestJSON-92666161-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-672925235" status: 204 len: 0 microversion: 2.2 time: 0.039735 Aug 29 15:42:09.112466 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1732/3704] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Aug 29 15:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-672925235 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:09.243046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.243886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:09.262727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.263477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.264127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.265052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.266248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.266850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.273511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:09.288720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24b880b9-8e13-45c7-ac9d-19741c30a2b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1501 microversion: 2.1 time: 0.476334 Aug 29 15:42:09.289687 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1973/3705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1501 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:09.402908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.403728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:09.421306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.423065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.425180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.429529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.434667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.435515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.938452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:09.964379 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f065aff-5026-4952-bafe-97e60eeb867a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1350 microversion: 2.1 time: 0.565622 Aug 29 15:42:09.965707 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1974/3706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:09 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1350 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.104968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.128980 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ff9b23d-7d71-47c4-8121-05ce9bea0fa4 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1495 microversion: 2.1 time: 0.886988 Aug 29 15:42:10.134494 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1733/3707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:09 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1495 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.148752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-18720f5e-c2c0-4502-991d-e2439ee44342 req-12061d50-202a-4670-9533-78070f91cef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5994e18c-700e-431a-a391-195d20e48a46", "name": "network-vif-unplugged", "status": "completed", "tag": "f9170cc5-42b5-4589-b4c0-44d8453b3fe6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:10.154996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fcd9e543-30dc-403b-bfeb-1f8d1f785f0b req-aca560c6-04e9-48d0-99bf-5dc5231ca297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44f9d37-4725-4888-bee0-1511369e81c0", "tag": "a4093965-06d3-4172-aab2-7a9d1f5652d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:10.169194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fcd9e543-30dc-403b-bfeb-1f8d1f785f0b req-aca560c6-04e9-48d0-99bf-5dc5231ca297 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.170021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fcd9e543-30dc-403b-bfeb-1f8d1f785f0b req-aca560c6-04e9-48d0-99bf-5dc5231ca297 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.171058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fcd9e543-30dc-403b-bfeb-1f8d1f785f0b req-aca560c6-04e9-48d0-99bf-5dc5231ca297 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.185681 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fcd9e543-30dc-403b-bfeb-1f8d1f785f0b req-aca560c6-04e9-48d0-99bf-5dc5231ca297 service nova] Creating event network-changed:a4093965-06d3-4172-aab2-7a9d1f5652d9 for instance b44f9d37-4725-4888-bee0-1511369e81c0 on n-h1-854882-3 Aug 29 15:42:10.186129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-18720f5e-c2c0-4502-991d-e2439ee44342 req-12061d50-202a-4670-9533-78070f91cef6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.190861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-18720f5e-c2c0-4502-991d-e2439ee44342 req-12061d50-202a-4670-9533-78070f91cef6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.191436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-18720f5e-c2c0-4502-991d-e2439ee44342 req-12061d50-202a-4670-9533-78070f91cef6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.193316 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fcd9e543-30dc-403b-bfeb-1f8d1f785f0b req-aca560c6-04e9-48d0-99bf-5dc5231ca297 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226263 Aug 29 15:42:10.198517 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1975/3708] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:10.215942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.216972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.233415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.235075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.236907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.238722 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-18720f5e-c2c0-4502-991d-e2439ee44342 req-12061d50-202a-4670-9533-78070f91cef6 service nova] Creating event network-vif-unplugged:f9170cc5-42b5-4589-b4c0-44d8453b3fe6 for instance 5994e18c-700e-431a-a391-195d20e48a46 on n-h1-854882-3 Aug 29 15:42:10.240895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.242284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.244963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.284297 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-18720f5e-c2c0-4502-991d-e2439ee44342 req-12061d50-202a-4670-9533-78070f91cef6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142116 Aug 29 15:42:10.285739 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1734/3709] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:10.303330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.314398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.323597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.326997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.328051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.329311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.331060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.332538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.849362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.861753 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-192bc1cb-cb3d-4daa-8b4a-29e5824e7621 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.574167 Aug 29 15:42:10.868629 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1735/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.888625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.892594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.909070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.909905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.911039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.913999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.914727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.915334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.962416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:10.962687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.971218 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8f787e2-f050-4dbb-aeda-f0a183445985 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.770896 Aug 29 15:42:10.971817 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1976/3711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.981085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d310916e-4aed-4e91-b74b-31fd61ab42c9 req-27fc2c63-05be-4d93-8b56-f94ef5781542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f3144a-96a8-4482-aa17-c1de1bb09e07", "tag": "b5f8bd97-43a7-478c-8f0b-026892efa88d"}, {"server_uuid": "5994e18c-700e-431a-a391-195d20e48a46", "name": "network-vif-deleted", "tag": "f9170cc5-42b5-4589-b4c0-44d8453b3fe6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:10.989753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.990299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.990883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.991396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lazy-loading 'fault' on Instance uuid 402f953c-af45-4428-9dd9-f20cf2a32e58 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:11.006834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d310916e-4aed-4e91-b74b-31fd61ab42c9 req-27fc2c63-05be-4d93-8b56-f94ef5781542 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.007736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d310916e-4aed-4e91-b74b-31fd61ab42c9 req-27fc2c63-05be-4d93-8b56-f94ef5781542 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.008176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d310916e-4aed-4e91-b74b-31fd61ab42c9 req-27fc2c63-05be-4d93-8b56-f94ef5781542 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.045975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d310916e-4aed-4e91-b74b-31fd61ab42c9 req-27fc2c63-05be-4d93-8b56-f94ef5781542 service nova] Creating event network-changed:b5f8bd97-43a7-478c-8f0b-026892efa88d for instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 on n-h2-854882-3 Aug 29 15:42:11.046946 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d310916e-4aed-4e91-b74b-31fd61ab42c9 req-27fc2c63-05be-4d93-8b56-f94ef5781542 service nova] Creating event network-vif-deleted:f9170cc5-42b5-4589-b4c0-44d8453b3fe6 for instance 5994e18c-700e-431a-a391-195d20e48a46 on n-h1-854882-3 Aug 29 15:42:11.064033 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d310916e-4aed-4e91-b74b-31fd61ab42c9 req-27fc2c63-05be-4d93-8b56-f94ef5781542 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.090604 Aug 29 15:42:11.065291 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1977/3712] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:11.076230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.078486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.091491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.092646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.093334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.095124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.096064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.096957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.171792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aacfc6a126542f2897c3d3e51e736dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a37b020bc46d5b1840e19ad0a997e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.188137 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ebb3657-5fe3-4cc4-a25a-a160f3c10613 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 200 len: 1301 microversion: 2.1 time: 0.314251 Aug 29 15:42:11.196219 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1736/3713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 1301 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:11.207178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.213307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.225013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.237206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.238054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.239415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.240148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.240814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.329681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.330663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.330906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.333558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lazy-loading 'fault' on Instance uuid 5994e18c-700e-431a-a391-195d20e48a46 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:11.431549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c165a4dd4648888d45d44df5acbe2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe151c445bb64766b4a8f2282ed2f1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.455384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f9cabe3-7ada-42b6-bad6-514ebd874ba0 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 200 len: 1303 microversion: 2.1 time: 0.257811 Aug 29 15:42:11.456960 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1737/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 1303 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:11.703595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.717179 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7277057f-739a-4a41-bc48-8bc0ceae6b05 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1350 microversion: 2.1 time: 0.648716 Aug 29 15:42:11.721176 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1978/3715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1350 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:11.886307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.886942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.901255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.901778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.902216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.902925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.903378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.903800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.996692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.999435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.013696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.016760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.018293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.020353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.021111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.022254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.091492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:12.174063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.199244 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cc2df54-5d94-4526-a81d-b040340408ad tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.319272 Aug 29 15:42:12.201180 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1738/3716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:12.221869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.222883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.232232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.233522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.234495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.235411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.236075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.237156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.255320 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] HTTP exception thrown: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Request method failure captured: Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 HTTP/1.1 Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4tiv2ALUBiAzqdaAcU4qsl7KUgMqqqGz4ud4SkwYfDepvyiUyHxfkljh7p1njv9FQ6MXGD_KlpqlazZCbivsnIRauhYFNiBievfKqeFkI7rhKZXxZBGWvRGxmLXA4NwkrOx7oz1Xg1HbkZKNsCiuUlqsgxsKlIKPn6NHgwCfnaRNo Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a37b020bc46d5b1840e19ad0a997e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}] Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3aacfc6a126542f2897c3d3e51e736dc Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '402f953c-af45-4428-9dd9-f20cf2a32e58'} Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.259078 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Returning 404 to user: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-059ef988-57e5-43b6-8aa4-1fa34f442c6d tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 404 len: 111 microversion: 2.1 time: 0.049760 Aug 29 15:42:12.264001 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1739/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.273972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a7fd7ba-d2c5-4fb4-b56b-749af3b266dc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.299515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:12.304921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.server_groups [None req-0a7fd7ba-d2c5-4fb4-b56b-749af3b266dc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Querying cell f444391f-7036-4697-bac9-7a9b7c940a18(cell1) for 1 instances {{(pid=130001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:42:12.305841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a7fd7ba-d2c5-4fb4-b56b-749af3b266dc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.306411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a7fd7ba-d2c5-4fb4-b56b-749af3b266dc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.307102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a7fd7ba-d2c5-4fb4-b56b-749af3b266dc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.324469 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a7fd7ba-d2c5-4fb4-b56b-749af3b266dc tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.056247 Aug 29 15:42:12.325862 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1740/3718] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:12.331568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f6c9dc5b-cfeb-49fe-b7cc-3e7b9bbd39ab req-b8092377-a93a-4f31-8cfb-340c3eef7029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43283f7-2a32-4a90-a996-e9cc3b2b3108", "name": "network-vif-plugged", "status": "completed", "tag": "0e2bd384-4bff-4f19-ac19-700f82eeaeef"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:12.344977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f6c9dc5b-cfeb-49fe-b7cc-3e7b9bbd39ab req-b8092377-a93a-4f31-8cfb-340c3eef7029 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.345984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f6c9dc5b-cfeb-49fe-b7cc-3e7b9bbd39ab req-b8092377-a93a-4f31-8cfb-340c3eef7029 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.346675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f6c9dc5b-cfeb-49fe-b7cc-3e7b9bbd39ab req-b8092377-a93a-4f31-8cfb-340c3eef7029 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.361711 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f6c9dc5b-cfeb-49fe-b7cc-3e7b9bbd39ab req-b8092377-a93a-4f31-8cfb-340c3eef7029 service nova] Creating event network-vif-plugged:0e2bd384-4bff-4f19-ac19-700f82eeaeef for instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 on n-h1-854882-3 Aug 29 15:42:12.368124 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f6c9dc5b-cfeb-49fe-b7cc-3e7b9bbd39ab req-b8092377-a93a-4f31-8cfb-340c3eef7029 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040656 Aug 29 15:42:12.369754 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1741/3719] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:12.377502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e911d69-9fad-4fd2-80bc-b29cfce9e829 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.398054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.server_groups [None req-3e911d69-9fad-4fd2-80bc-b29cfce9e829 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Querying cell f444391f-7036-4697-bac9-7a9b7c940a18(cell1) for 1 instances {{(pid=130001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:42:12.399648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e911d69-9fad-4fd2-80bc-b29cfce9e829 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.400352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e911d69-9fad-4fd2-80bc-b29cfce9e829 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.401062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e911d69-9fad-4fd2-80bc-b29cfce9e829 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.414886 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e911d69-9fad-4fd2-80bc-b29cfce9e829 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/e2a4d376-db79-41a1-a797-eecaa1147e32" status: 200 len: 183 microversion: 2.1 time: 0.043570 Aug 29 15:42:12.416032 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1742/3720] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/os-server-groups/e2a4d376-db79-41a1-a797-eecaa1147e32 => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:12.432424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.434816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.449043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.449560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.449998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.450703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.451155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.451571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.468493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.490146 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfbcf696-a999-40d3-9e3a-dd5cee6c37af tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.501789 Aug 29 15:42:12.490786 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1979/3721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:12.513760 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] HTTP exception thrown: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.514521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.515262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Request method failure captured: Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 HTTP/1.1 Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4tiv2ALUBiAzqdaAcU4qsl7KUgMqqqGz4ud4SkwYfDepvyiUyHxfkljh7p1njv9FQ6MXGD_KlpqlazZCbivsnIRauhYFNiBievfKqeFkI7rhKZXxZBGWvRGxmLXA4NwkrOx7oz1Xg1HbkZKNsCiuUlqsgxsKlIKPn6NHgwCfnaRNo Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a37b020bc46d5b1840e19ad0a997e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}] Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3aacfc6a126542f2897c3d3e51e736dc Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '402f953c-af45-4428-9dd9-f20cf2a32e58'} Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:12.518070 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Returning 404 to user: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30a044aa-7fc1-4a3f-b20a-f5e08bd74e91 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 404 len: 111 microversion: 2.1 time: 0.094916 Aug 29 15:42:12.523317 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1743/3722] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:12 2022] DELETE /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.543531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.544074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.544519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.545370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.545729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.546924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.548112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.549460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] [instance: 402f953c-af45-4428-9dd9-f20cf2a32e58] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.572600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.573104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.577970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.578945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.579452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.580567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.611086 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] HTTP exception thrown: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Request method failure captured: Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 HTTP/1.1 Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4tiv2ALUBiAzqdaAcU4qsl7KUgMqqqGz4ud4SkwYfDepvyiUyHxfkljh7p1njv9FQ6MXGD_KlpqlazZCbivsnIRauhYFNiBievfKqeFkI7rhKZXxZBGWvRGxmLXA4NwkrOx7oz1Xg1HbkZKNsCiuUlqsgxsKlIKPn6NHgwCfnaRNo Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a37b020bc46d5b1840e19ad0a997e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}] Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3aacfc6a126542f2897c3d3e51e736dc Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '402f953c-af45-4428-9dd9-f20cf2a32e58'} Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.612553 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Returning 404 to user: Instance 402f953c-af45-4428-9dd9-f20cf2a32e58 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96d41dc8-4081-4d31-ad46-8932f94746f2 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58" status: 404 len: 111 microversion: 2.1 time: 0.082846 Aug 29 15:42:12.618452 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1744/3723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/402f953c-af45-4428-9dd9-f20cf2a32e58 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.620357 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] HTTP exception thrown: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Request method failure captured: Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 HTTP/1.1 Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN3MUCAUrpd8BXSU3Y_8Xt455pW9s8_CIrs5sSkcsiIhQ-74xg-xK5-Urv78TIItdd3jjO7k90vFz7zXVKDqYkQja5kcGwrr-anarRMv9wDVLGNHA7NwT_91IhS4LDKRUxgMO7l0Ab5VUSQohQFtl1OArd7C8wrLG0w0rn5WNBzZ8yA Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe151c445bb64766b4a8f2282ed2f1de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}] Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f0c165a4dd4648888d45d44df5acbe2b Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '5994e18c-700e-431a-a391-195d20e48a46'} Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.630648 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.636909 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.636909 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.636909 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.636909 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.636909 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.636909 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:12.636909 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.639651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Returning 404 to user: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.641021 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-767ccfa5-017a-4c28-b079-6c13b581952b tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 404 len: 111 microversion: 2.1 time: 0.149281 Aug 29 15:42:12.642254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1980/3724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.645639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfb7c557-3674-4804-95f2-bab38b697172 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.676779 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cfb7c557-3674-4804-95f2-bab38b697172 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] HTTP exception thrown: Instance group 50602290-dd9b-4d51-889a-99b0a4d441e8 could not be found. Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfb7c557-3674-4804-95f2-bab38b697172 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Request method failure captured: Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-server-groups/50602290-dd9b-4d51-889a-99b0a4d441e8 HTTP/1.1 Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4tiv2ALUBiAzqdaAcU4qsl7KUgMqqqGz4ud4SkwYfDepvyiUyHxfkljh7p1njv9FQ6MXGD_KlpqlazZCbivsnIRauhYFNiBievfKqeFkI7rhKZXxZBGWvRGxmLXA4NwkrOx7oz1Xg1HbkZKNsCiuUlqsgxsKlIKPn6NHgwCfnaRNo Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a37b020bc46d5b1840e19ad0a997e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}] Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3aacfc6a126542f2897c3d3e51e736dc Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance group 50602290-dd9b-4d51-889a-99b0a4d441e8 could not be found. Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '50602290-dd9b-4d51-889a-99b0a4d441e8'} Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 50602290-dd9b-4d51-889a-99b0a4d441e8 could not be found. Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 50602290-dd9b-4d51-889a-99b0a4d441e8 could not be found. Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.681647 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 50602290-dd9b-4d51-889a-99b0a4d441e8 could not be found. Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfb7c557-3674-4804-95f2-bab38b697172 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Returning 404 to user: Instance group 50602290-dd9b-4d51-889a-99b0a4d441e8 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cfb7c557-3674-4804-95f2-bab38b697172 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/50602290-dd9b-4d51-889a-99b0a4d441e8" status: 404 len: 117 microversion: 2.1 time: 0.059530 Aug 29 15:42:12.688076 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1745/3725] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:42:12 2022] DELETE /compute/v2.1/os-server-groups/50602290-dd9b-4d51-889a-99b0a4d441e8 => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.699902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66ee4cef-6e87-4b75-b704-e493925c50b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.708767 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-66ee4cef-6e87-4b75-b704-e493925c50b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] HTTP exception thrown: Instance group 80cced2f-7f39-43a9-81aa-fafc02643d93 could not be found. Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66ee4cef-6e87-4b75-b704-e493925c50b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Request method failure captured: Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-server-groups/80cced2f-7f39-43a9-81aa-fafc02643d93 HTTP/1.1 Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN4tiv2ALUBiAzqdaAcU4qsl7KUgMqqqGz4ud4SkwYfDepvyiUyHxfkljh7p1njv9FQ6MXGD_KlpqlazZCbivsnIRauhYFNiBievfKqeFkI7rhKZXxZBGWvRGxmLXA4NwkrOx7oz1Xg1HbkZKNsCiuUlqsgxsKlIKPn6NHgwCfnaRNo Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a37b020bc46d5b1840e19ad0a997e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}] Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3aacfc6a126542f2897c3d3e51e736dc Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance group 80cced2f-7f39-43a9-81aa-fafc02643d93 could not be found. Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '80cced2f-7f39-43a9-81aa-fafc02643d93'} Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 80cced2f-7f39-43a9-81aa-fafc02643d93 could not be found. Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 80cced2f-7f39-43a9-81aa-fafc02643d93 could not be found. Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.712912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.718947 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.718947 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.718947 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.718947 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.718947 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 80cced2f-7f39-43a9-81aa-fafc02643d93 could not be found. Aug 29 15:42:12.718947 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.720550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66ee4cef-6e87-4b75-b704-e493925c50b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Returning 404 to user: Instance group 80cced2f-7f39-43a9-81aa-fafc02643d93 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.722129 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66ee4cef-6e87-4b75-b704-e493925c50b0 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/80cced2f-7f39-43a9-81aa-fafc02643d93" status: 404 len: 117 microversion: 2.1 time: 0.029294 Aug 29 15:42:12.723714 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1981/3726] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:42:12 2022] DELETE /compute/v2.1/os-server-groups/80cced2f-7f39-43a9-81aa-fafc02643d93 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.737291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a9b94ee-930e-4b03-9795-24117d842183 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.750952 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-1a9b94ee-930e-4b03-9795-24117d842183 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] HTTP exception thrown: Instance group a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 could not be found. Aug 29 15:42:12.753036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.753795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a9b94ee-930e-4b03-9795-24117d842183 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Request method failure captured: Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-server-groups/a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 HTTP/1.1 Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4tiv2ALUBiAzqdaAcU4qsl7KUgMqqqGz4ud4SkwYfDepvyiUyHxfkljh7p1njv9FQ6MXGD_KlpqlazZCbivsnIRauhYFNiBievfKqeFkI7rhKZXxZBGWvRGxmLXA4NwkrOx7oz1Xg1HbkZKNsCiuUlqsgxsKlIKPn6NHgwCfnaRNo Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a37b020bc46d5b1840e19ad0a997e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}] Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3aacfc6a126542f2897c3d3e51e736dc Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance group a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 could not be found. Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a9ba85f9-20c5-4e9f-acfc-b55a95e787a4'} Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 could not be found. Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 could not be found. Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.754413 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 could not be found. Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a9b94ee-930e-4b03-9795-24117d842183 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Returning 404 to user: Instance group a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.760393 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a9b94ee-930e-4b03-9795-24117d842183 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a9ba85f9-20c5-4e9f-acfc-b55a95e787a4" status: 404 len: 117 microversion: 2.1 time: 0.029900 Aug 29 15:42:12.762869 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1746/3727] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:42:12 2022] DELETE /compute/v2.1/os-server-groups/a9ba85f9-20c5-4e9f-acfc-b55a95e787a4 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.772106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d6d4152-3741-452c-8916-76aea0ffa3e8 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.803296 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-1d6d4152-3741-452c-8916-76aea0ffa3e8 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] HTTP exception thrown: Instance group 898070da-bf76-46c5-9e1d-8d328d2b1e27 could not be found. Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d6d4152-3741-452c-8916-76aea0ffa3e8 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Request method failure captured: Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-server-groups/898070da-bf76-46c5-9e1d-8d328d2b1e27 HTTP/1.1 Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4tiv2ALUBiAzqdaAcU4qsl7KUgMqqqGz4ud4SkwYfDepvyiUyHxfkljh7p1njv9FQ6MXGD_KlpqlazZCbivsnIRauhYFNiBievfKqeFkI7rhKZXxZBGWvRGxmLXA4NwkrOx7oz1Xg1HbkZKNsCiuUlqsgxsKlIKPn6NHgwCfnaRNo Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a37b020bc46d5b1840e19ad0a997e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a37b020bc46d5b1840e19ad0a997e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a37b020bc46d5b1840e19ad0a997e"}]}] Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 871a37b020bc46d5b1840e19ad0a997e Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1670299514 Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3aacfc6a126542f2897c3d3e51e736dc Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerGroupTestJSON-1670299514-project Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance group 898070da-bf76-46c5-9e1d-8d328d2b1e27 could not be found. Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '898070da-bf76-46c5-9e1d-8d328d2b1e27'} Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 898070da-bf76-46c5-9e1d-8d328d2b1e27 could not be found. Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 898070da-bf76-46c5-9e1d-8d328d2b1e27 could not be found. Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.804874 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:12.810392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:12.810392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:12.810392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:12.810392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:12.810392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 898070da-bf76-46c5-9e1d-8d328d2b1e27 could not be found. Aug 29 15:42:12.810392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:12.810392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d6d4152-3741-452c-8916-76aea0ffa3e8 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Returning 404 to user: Instance group 898070da-bf76-46c5-9e1d-8d328d2b1e27 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:12.811092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d6d4152-3741-452c-8916-76aea0ffa3e8 tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/898070da-bf76-46c5-9e1d-8d328d2b1e27" status: 404 len: 117 microversion: 2.1 time: 0.047301 Aug 29 15:42:12.822508 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1747/3728] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:42:12 2022] DELETE /compute/v2.1/os-server-groups/898070da-bf76-46c5-9e1d-8d328d2b1e27 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:12.827520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b5830d9-66fc-45db-b29b-adc07605ff1c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.889750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b5830d9-66fc-45db-b29b-adc07605ff1c tempest-ServerGroupTestJSON-1670299514 tempest-ServerGroupTestJSON-1670299514-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e2a4d376-db79-41a1-a797-eecaa1147e32" status: 204 len: 0 microversion: 2.1 time: 0.065818 Aug 29 15:42:12.892922 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1748/3729] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:42:12 2022] DELETE /compute/v2.1/os-server-groups/e2a4d376-db79-41a1-a797-eecaa1147e32 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:13.227692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.229414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:13.254161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.255614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.257939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.260578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.261306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.261943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.288636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.289852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.290954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.292107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.292911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.293579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.623688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=28 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:13.808617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:13.819753 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-989e7d86-3e4c-4b8c-8311-51ec7fc21833 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1350 microversion: 2.1 time: 1.076818 Aug 29 15:42:13.822223 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1982/3730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1350 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:13.833369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.835397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:13.851112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.851800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.852711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.853958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.854603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.857528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.280565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:14.293781 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-748cf788-b61b-4e69-8552-7c38a95a4b40 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 1.073920 Aug 29 15:42:14.294387 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1749/3731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:13 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:14.319797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-fae7474a-dbf9-4b20-8b31-16266e2ef0eb req-a81da317-270f-440b-b829-645d43b6c3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402f953c-af45-4428-9dd9-f20cf2a32e58", "name": "network-vif-deleted", "tag": "0e660a77-46b0-4751-b691-b33fb92b20fe"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:14.320845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:14.330490 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3431863e-5ba2-4a21-a781-533cf2b1c4ac tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1317 microversion: 2.1 time: 0.506485 Aug 29 15:42:14.333439 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1983/3732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:13 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:14.355883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fae7474a-dbf9-4b20-8b31-16266e2ef0eb req-a81da317-270f-440b-b829-645d43b6c3e4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.356604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fae7474a-dbf9-4b20-8b31-16266e2ef0eb req-a81da317-270f-440b-b829-645d43b6c3e4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.357510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fae7474a-dbf9-4b20-8b31-16266e2ef0eb req-a81da317-270f-440b-b829-645d43b6c3e4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.370487 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fae7474a-dbf9-4b20-8b31-16266e2ef0eb req-a81da317-270f-440b-b829-645d43b6c3e4 service nova] Creating event network-vif-deleted:0e660a77-46b0-4751-b691-b33fb92b20fe for instance 402f953c-af45-4428-9dd9-f20cf2a32e58 on n-h2-854882-3 Aug 29 15:42:14.376771 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-fae7474a-dbf9-4b20-8b31-16266e2ef0eb req-a81da317-270f-440b-b829-645d43b6c3e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064163 Aug 29 15:42:14.378111 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1750/3733] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:14.847572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:14.848509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:14.851023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:14.862943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.865834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.868720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.869709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.870337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.873372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.258162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b5a55e12-2a9e-449a-8c04-65d22cfe237c req-54eda2cb-8bb9-4a41-b622-4104fde858cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44f9d37-4725-4888-bee0-1511369e81c0", "name": "network-vif-plugged", "status": "completed", "tag": "a4093965-06d3-4172-aab2-7a9d1f5652d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:15.280960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b5a55e12-2a9e-449a-8c04-65d22cfe237c req-54eda2cb-8bb9-4a41-b622-4104fde858cd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.281610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b5a55e12-2a9e-449a-8c04-65d22cfe237c req-54eda2cb-8bb9-4a41-b622-4104fde858cd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.281976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b5a55e12-2a9e-449a-8c04-65d22cfe237c req-54eda2cb-8bb9-4a41-b622-4104fde858cd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.308839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b5a55e12-2a9e-449a-8c04-65d22cfe237c req-54eda2cb-8bb9-4a41-b622-4104fde858cd service nova] Creating event network-vif-plugged:a4093965-06d3-4172-aab2-7a9d1f5652d9 for instance b44f9d37-4725-4888-bee0-1511369e81c0 on n-h1-854882-3 Aug 29 15:42:15.322258 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b5a55e12-2a9e-449a-8c04-65d22cfe237c req-54eda2cb-8bb9-4a41-b622-4104fde858cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069257 Aug 29 15:42:15.322886 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1751/3734] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:15.328332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.338537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:15.368682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.369602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.370255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.371402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.372080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.372712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.643518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.669131 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eff99fd7-4712-4413-90d8-79a6a046164c tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.340582 Aug 29 15:42:15.670077 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1752/3735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:15.679058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.679688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:15.695657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.696676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.697300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.699268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.701703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.704296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.957504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.966593 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3762b27-9bfb-4a95-b378-0a36b0e11004 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1505 microversion: 2.1 time: 0.295677 Aug 29 15:42:15.967866 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1753/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:16.005618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:16.006249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.036467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.039703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.040748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.043793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.048903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.050209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.123885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.127054 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ca17430-9472-4174-baf4-1812f1689bbb tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108/os-instance-actions/req-a9725b09-00ee-4705-9e4e-43ad235db74e" status: 200 len: 313 microversion: 2.1 time: 0.135757 Aug 29 15:42:16.129066 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1754/3737] 10.222.0.16 () {58 vars in 1419 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108/os-instance-actions/req-a9725b09-00ee-4705-9e4e-43ad235db74e => generated 313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:16.145101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:16.150381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.159461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.161169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.162101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.163285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.164030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.164813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.294914 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e81a1190-9f17-4d49-89e1-e4e922d41945 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "POST /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108/action" status: 202 len: 0 microversion: 2.1 time: 0.155396 Aug 29 15:42:16.313082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1755/3738] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:16 2022] POST /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:16.340304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:16.341310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.366400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.367264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.367900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.368834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.369511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.382035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.550160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.560106 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-65e27490-630f-4d2e-baa7-cade598fd50a tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1350 microversion: 2.1 time: 1.718620 Aug 29 15:42:16.568339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1984/3739] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:14 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1350 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:16.693249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:16.694786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.705462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.706503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.707758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.711923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.713483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.715483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.800941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.813963 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9d8454db-46dd-4a1a-b9b0-261a23db24da tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1507 microversion: 2.1 time: 0.496125 Aug 29 15:42:16.829260 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1756/3740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:16 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:17.264698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:17.279122 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ca4ab4b-bb60-4333-9a57-e9f741345b3a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.590811 Aug 29 15:42:17.295509 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1985/3741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:16 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:17.597959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.602082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.609830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5b19dcd4-52c4-4396-8118-849ac0c7d3fb req-7375b2e8-2653-42ee-9842-8e64ef6fac1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f3144a-96a8-4482-aa17-c1de1bb09e07", "name": "network-vif-plugged", "status": "completed", "tag": "b5f8bd97-43a7-478c-8f0b-026892efa88d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:17.629010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.632260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5b19dcd4-52c4-4396-8118-849ac0c7d3fb req-7375b2e8-2653-42ee-9842-8e64ef6fac1c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.632473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.632752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5b19dcd4-52c4-4396-8118-849ac0c7d3fb req-7375b2e8-2653-42ee-9842-8e64ef6fac1c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.633190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5b19dcd4-52c4-4396-8118-849ac0c7d3fb req-7375b2e8-2653-42ee-9842-8e64ef6fac1c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.638052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.640228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.642900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.643577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.647402 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5b19dcd4-52c4-4396-8118-849ac0c7d3fb req-7375b2e8-2653-42ee-9842-8e64ef6fac1c service nova] Creating event network-vif-plugged:b5f8bd97-43a7-478c-8f0b-026892efa88d for instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 on n-h2-854882-3 Aug 29 15:42:17.655631 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5b19dcd4-52c4-4396-8118-849ac0c7d3fb req-7375b2e8-2653-42ee-9842-8e64ef6fac1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050032 Aug 29 15:42:17.656810 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1986/3742] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:17.833346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=60 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:17.838056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.839012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.850747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.859316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.859871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.860928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.861430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.862076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.064647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.076195 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ffa40872-3981-4a49-b99b-eefe1c4dd061 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1350 microversion: 2.1 time: 0.491100 Aug 29 15:42:18.091350 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1757/3743] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1350 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:18.191824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.201328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ee15eb23-a5e5-43c4-96ec-1a84f27e4aa5 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1507 microversion: 2.1 time: 0.368874 Aug 29 15:42:18.206741 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1987/3744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1507 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:18.304030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:18.304653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:18.311188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.312161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.312771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.314505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.315146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.315739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.795360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.818673 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-915120a0-17fe-4443-85f6-e9621ee53fd1 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1362 microversion: 2.1 time: 0.518131 Aug 29 15:42:18.823711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1758/3745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:18 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:19.099792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.101102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.119352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.120183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.121606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.122576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.141534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.142434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.232196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.233502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.246129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.250408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.251079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.254498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.255206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.255880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.484693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.494426 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08e0751f-5b89-44b0-a3b3-73fc8eba0fd4 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1505 microversion: 2.1 time: 0.266898 Aug 29 15:42:19.495560 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1759/3746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:19.502443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.503157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.515724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.516218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.516656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.517580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.518694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.520519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.553696 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] HTTP exception thrown: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Request method failure captured: Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 HTTP/1.1 Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN3MUCAUrpd8BXSU3Y_8Xt455pW9s8_CIrs5sSkcsiIhQ-74xg-xK5-Urv78TIItdd3jjO7k90vFz7zXVKDqYkQja5kcGwrr-anarRMv9wDVLGNHA7NwT_91IhS4LDKRUxgMO7l0Ab5VUSQohQFtl1OArd7C8wrLG0w0rn5WNBzZ8yA Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe151c445bb64766b4a8f2282ed2f1de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}] Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f0c165a4dd4648888d45d44df5acbe2b Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5994e18c-700e-431a-a391-195d20e48a46'} Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:19.563548 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.568586 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.571610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Returning 404 to user: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:19.575490 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2259a13c-3bd6-4679-8f67-39a8d0355c2c tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 404 len: 111 microversion: 2.1 time: 0.076204 Aug 29 15:42:19.577962 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1760/3747] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:19 2022] DELETE /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:19.588488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '.version_select at 0x7fb0e3136c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.590708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.599117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.609145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.610673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.612383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.613421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.614037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.640228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:19.664441 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55b1ae99-96b1-49d6-a9dd-d79795df0409 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.084171 Aug 29 15:42:19.665678 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1761/3748] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108/os-instance-actions => generated 611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:19.672242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.673199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: 5994e18c-700e-431a-a391-195d20e48a46] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.681018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.681794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.682563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.685891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.687685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.688265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.714321 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] HTTP exception thrown: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Request method failure captured: Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 HTTP/1.1 Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN3MUCAUrpd8BXSU3Y_8Xt455pW9s8_CIrs5sSkcsiIhQ-74xg-xK5-Urv78TIItdd3jjO7k90vFz7zXVKDqYkQja5kcGwrr-anarRMv9wDVLGNHA7NwT_91IhS4LDKRUxgMO7l0Ab5VUSQohQFtl1OArd7C8wrLG0w0rn5WNBzZ8yA Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe151c445bb64766b4a8f2282ed2f1de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}] Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f0c165a4dd4648888d45d44df5acbe2b Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5994e18c-700e-431a-a391-195d20e48a46'} Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:19.717807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.724435 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.724435 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:19.724435 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:19.724435 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:19.724435 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:19.724435 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. Aug 29 15:42:19.724435 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.726274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Returning 404 to user: Instance 5994e18c-700e-431a-a391-195d20e48a46 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:19.728350 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b6d2d8b5-1ae0-4eb7-9eb2-7957e714d511 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46" status: 404 len: 111 microversion: 2.1 time: 0.060942 Aug 29 15:42:19.729576 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1762/3749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/5994e18c-700e-431a-a391-195d20e48a46 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:19.735833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.736603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.744621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.745314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.746740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.750037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.750527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.751007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.838520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.849645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:19.871825 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92ea743b-25da-4300-acc6-50bb4d479d08 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1540 microversion: 2.1 time: 0.776452 Aug 29 15:42:19.872457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1988/3750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1540 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:19.887629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.900633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.928555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.931824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.932378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.933131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.933644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.934078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.996016 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] HTTP exception thrown: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Request method failure captured: Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 HTTP/1.1 Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN3MUCAUrpd8BXSU3Y_8Xt455pW9s8_CIrs5sSkcsiIhQ-74xg-xK5-Urv78TIItdd3jjO7k90vFz7zXVKDqYkQja5kcGwrr-anarRMv9wDVLGNHA7NwT_91IhS4LDKRUxgMO7l0Ab5VUSQohQFtl1OArd7C8wrLG0w0rn5WNBzZ8yA Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe151c445bb64766b4a8f2282ed2f1de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}] Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f0c165a4dd4648888d45d44df5acbe2b Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ee636a6e-b71b-4304-98b5-a6a3ce6893e1'} Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:19.998478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:20.004219 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.008544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Returning 404 to user: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:20.010522 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab3b5978-8828-433e-99d0-36960b179a75 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 404 len: 111 microversion: 2.1 time: 0.134436 Aug 29 15:42:20.012084 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1989/3751] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:19 2022] DELETE /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:20.020204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.021706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.033219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.034031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.034651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.043515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.049764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.050625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.082670 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4bac92ca-fe76-4618-959e-1e8a645a7736 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 204 len: 0 microversion: 2.1 time: 0.351571 Aug 29 15:42:20.083370 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1763/3752] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:19 2022] DELETE /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:20.099877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.101749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.120841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.121342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.121814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.122533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.122984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.123408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.287683 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a0154de3-8001-4a50-a4ec-db71dfac6ffd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202842 Aug 29 15:42:20.288534 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1764/3753] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:20.298756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.299971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] [instance: ee636a6e-b71b-4304-98b5-a6a3ce6893e1] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.325660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.326361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.329791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.330822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.331505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.335616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.363046 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] HTTP exception thrown: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Request method failure captured: Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 HTTP/1.1 Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN3MUCAUrpd8BXSU3Y_8Xt455pW9s8_CIrs5sSkcsiIhQ-74xg-xK5-Urv78TIItdd3jjO7k90vFz7zXVKDqYkQja5kcGwrr-anarRMv9wDVLGNHA7NwT_91IhS4LDKRUxgMO7l0Ab5VUSQohQFtl1OArd7C8wrLG0w0rn5WNBzZ8yA Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe151c445bb64766b4a8f2282ed2f1de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe151c445bb64766b4a8f2282ed2f1de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe151c445bb64766b4a8f2282ed2f1de"}]}] Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fe151c445bb64766b4a8f2282ed2f1de Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestMultiNic-1735601978 Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f0c165a4dd4648888d45d44df5acbe2b Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestMultiNic-1735601978-project Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ee636a6e-b71b-4304-98b5-a6a3ce6893e1'} Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:20.367281 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.372711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:20.372711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:20.372711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:20.372711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:20.372711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:20.372711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. Aug 29 15:42:20.372711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:20.374962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] Returning 404 to user: Instance ee636a6e-b71b-4304-98b5-a6a3ce6893e1 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:20.377115 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f31fa18a-84ac-4711-a385-df1e1ec61d41 tempest-ServersTestMultiNic-1735601978 tempest-ServersTestMultiNic-1735601978-project] 10.222.0.16 "GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1" status: 404 len: 111 microversion: 2.1 time: 0.087366 Aug 29 15:42:20.378858 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1765/3754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/ee636a6e-b71b-4304-98b5-a6a3ce6893e1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:20.391943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.395875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.410383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.411177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.411795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.412841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.414524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.416505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.471697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.479585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3aa945d6-3653-4de9-85ab-76bc27618ca7 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1548 microversion: 2.1 time: 0.466230 Aug 29 15:42:20.480168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1990/3755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1548 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:20.503790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.504612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.518651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.519371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.520001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.522105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.522480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.522920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.700966 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ecd811fb-e56b-4c78-aa1d-7c9ac68f7b9a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201485 Aug 29 15:42:20.702657 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1991/3756] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:22.069057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.078136 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-560a6b70-28de-4790-9a12-4d9ee2983326 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1511 microversion: 2.1 time: 1.696499 Aug 29 15:42:22.091911 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1766/3757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1511 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:23.106827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:23.107369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:23.117938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-635f7e47-15f8-4439-a3e7-e953a4fd1452 req-5fcd355a-77dd-4a51-adec-19654bbc4cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f3144a-96a8-4482-aa17-c1de1bb09e07", "tag": "b5f8bd97-43a7-478c-8f0b-026892efa88d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:23.165282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:23.168644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:23.169099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:23.175104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:23.176680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-635f7e47-15f8-4439-a3e7-e953a4fd1452 req-5fcd355a-77dd-4a51-adec-19654bbc4cd1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:23.177175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-635f7e47-15f8-4439-a3e7-e953a4fd1452 req-5fcd355a-77dd-4a51-adec-19654bbc4cd1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:23.177641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-635f7e47-15f8-4439-a3e7-e953a4fd1452 req-5fcd355a-77dd-4a51-adec-19654bbc4cd1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:23.178528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:23.179008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:23.221113 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-635f7e47-15f8-4439-a3e7-e953a4fd1452 req-5fcd355a-77dd-4a51-adec-19654bbc4cd1 service nova] Creating event network-changed:b5f8bd97-43a7-478c-8f0b-026892efa88d for instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 on n-h2-854882-3 Aug 29 15:42:23.227750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-635f7e47-15f8-4439-a3e7-e953a4fd1452 req-5fcd355a-77dd-4a51-adec-19654bbc4cd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115524 Aug 29 15:42:23.234074 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1767/3758] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:23.564413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:23.575111 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3922dbbc-9cf2-4063-b298-f34b1baea575 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1511 microversion: 2.1 time: 0.479065 Aug 29 15:42:23.591482 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1992/3759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:23 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:24.606760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:24.607558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:24.627107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:24.627107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:24.627107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:24.627107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:24.627107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:24.627107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:25.021838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6c138e67fa4aa9805412ba7283592c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340e062377e49ff99fabbc16cc73c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:25.036417 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-809de66b-c241-492b-9238-c5b52e3be995 tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 200 len: 1469 microversion: 2.1 time: 0.434777 Aug 29 15:42:25.037660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1768/3760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:24 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 1469 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:25.156938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e1db673e-3e38-43ba-83fb-7cd881df35dd req-21400492-2245-429d-b697-41b525c98b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43283f7-2a32-4a90-a996-e9cc3b2b3108", "name": "network-vif-deleted", "tag": "0e2bd384-4bff-4f19-ac19-700f82eeaeef"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:25.187778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e1db673e-3e38-43ba-83fb-7cd881df35dd req-21400492-2245-429d-b697-41b525c98b55 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:25.188658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e1db673e-3e38-43ba-83fb-7cd881df35dd req-21400492-2245-429d-b697-41b525c98b55 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:25.189266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e1db673e-3e38-43ba-83fb-7cd881df35dd req-21400492-2245-429d-b697-41b525c98b55 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:25.230756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:25.235848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e1db673e-3e38-43ba-83fb-7cd881df35dd req-21400492-2245-429d-b697-41b525c98b55 service nova] Creating event network-vif-deleted:0e2bd384-4bff-4f19-ac19-700f82eeaeef for instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 on n-h1-854882-3 Aug 29 15:42:25.250940 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e1db673e-3e38-43ba-83fb-7cd881df35dd req-21400492-2245-429d-b697-41b525c98b55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100587 Aug 29 15:42:25.254474 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1993/3761] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:26.063954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:26.065308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] [instance: b43283f7-2a32-4a90-a996-e9cc3b2b3108] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:26.081459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:26.082221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:26.082842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:26.088054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:26.088823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:26.089261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:26.128349 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] HTTP exception thrown: Instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 could not be found. Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Request method failure captured: Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 HTTP/1.1 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN47vEMQJYK4oHfHzWTkAUhyrOk-SusWt_H7Rptr6Tz9NXHapGKFW9VsGuoN-yhj0nkQY1VI1oiHVy3BPm64UcnvyvMZmUiUpfBZOGdDLYDzyBlZeuhq2T7CO58gfu_zopdURu6WupC2307-I1VAiJ6vgD46-TUC9rcnogQ8YPYHVU0 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0340e062377e49ff99fabbc16cc73c9a Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-InstanceActionsTestJSON-1962753965 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0340e062377e49ff99fabbc16cc73c9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0340e062377e49ff99fabbc16cc73c9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0340e062377e49ff99fabbc16cc73c9a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0340e062377e49ff99fabbc16cc73c9a"}]}] Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-InstanceActionsTestJSON-1962753965 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0340e062377e49ff99fabbc16cc73c9a Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1962753965 Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-InstanceActionsTestJSON-1962753965-project Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: bb6c138e67fa4aa9805412ba7283592c Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-InstanceActionsTestJSON-1962753965-project Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 could not be found. Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b43283f7-2a32-4a90-a996-e9cc3b2b3108'} Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 could not be found. Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 could not be found. Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:26.133299 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 could not be found. Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] Returning 404 to user: Instance b43283f7-2a32-4a90-a996-e9cc3b2b3108 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:26.137945 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0dc78867-9065-4a0a-8763-d3fa7e5458ee tempest-InstanceActionsTestJSON-1962753965 tempest-InstanceActionsTestJSON-1962753965-project] 10.222.0.16 "GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108" status: 404 len: 111 microversion: 2.1 time: 0.078246 Aug 29 15:42:26.138607 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1769/3762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:26 2022] GET /compute/v2.1/servers/b43283f7-2a32-4a90-a996-e9cc3b2b3108 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:27.452082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-906eba36-2aa7-47ac-8eaa-846a32097c23 req-c9d08002-88af-403c-a1cf-6e15afd4a61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44f9d37-4725-4888-bee0-1511369e81c0", "tag": "a4093965-06d3-4172-aab2-7a9d1f5652d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:27.476270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-906eba36-2aa7-47ac-8eaa-846a32097c23 req-c9d08002-88af-403c-a1cf-6e15afd4a61e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.482302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-906eba36-2aa7-47ac-8eaa-846a32097c23 req-c9d08002-88af-403c-a1cf-6e15afd4a61e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.483221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-906eba36-2aa7-47ac-8eaa-846a32097c23 req-c9d08002-88af-403c-a1cf-6e15afd4a61e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.517756 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-906eba36-2aa7-47ac-8eaa-846a32097c23 req-c9d08002-88af-403c-a1cf-6e15afd4a61e service nova] Creating event network-changed:a4093965-06d3-4172-aab2-7a9d1f5652d9 for instance b44f9d37-4725-4888-bee0-1511369e81c0 on n-h1-854882-3 Aug 29 15:42:27.533654 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-906eba36-2aa7-47ac-8eaa-846a32097c23 req-c9d08002-88af-403c-a1cf-6e15afd4a61e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087038 Aug 29 15:42:27.534892 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1994/3763] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:30.011755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-245892693", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "7d5edc68-181c-443f-aa2c-d6b433271f4e"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:30.231038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] validate_networks() for [('7d5edc68-181c-443f-aa2c-d6b433271f4e', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:32.358573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:32.360472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:32.361665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:32.362823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:32.364076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:32.386775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.394390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.394909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.395748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.396204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.396651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.455930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Getting quotas for project 0be795a7587c4c2c8e5d71a01f5ba732. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:32.479522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Getting quotas for user f1fd00311fa540658cfd4076c9a88976 and project 0be795a7587c4c2c8e5d71a01f5ba732. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:32.508173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:32.510556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:32.693491 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b305a6d9-422a-4262-be96-e0affcdcb8c3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.006400 Aug 29 15:42:32.703854 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1770/3764] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:32.708556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5d65b40-6c70-4da2-922c-1e3d50608537 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:32.709875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5d65b40-6c70-4da2-922c-1e3d50608537 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:32.921287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b5d65b40-6c70-4da2-922c-1e3d50608537 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:32.929184 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5d65b40-6c70-4da2-922c-1e3d50608537 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1217 microversion: 2.1 time: 0.227659 Aug 29 15:42:32.941725 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1995/3765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:32 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:33.960810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.962144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.979378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.980044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.981690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.989266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.990257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.007273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.324904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:34.356833 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a08a7591-1506-4474-af7d-dd5d6fe1b17a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1213 microversion: 2.1 time: 0.402032 Aug 29 15:42:34.383145 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1771/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1213 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:35.383115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.383749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:35.437029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.439211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.439698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.459374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.461308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.461806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.656312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.666015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa8dfbff-df2b-4c5e-b4b4-50552e034042 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1275 microversion: 2.1 time: 0.287795 Aug 29 15:42:35.681693 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1996/3767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:36.258933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42b060ac-7ff6-4128-a7f5-9471077f8c83 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Action: 'create', calling method: .version_select at 0x7fb0e398da60>, body: {"keypair": {"name": "tempest-keypair-2041361362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb0un9sRW99KMi7P2uWJFsDjuwOZPbA81jwYeoLn7tmEThiEGgpqYsoX4n9ujcjUqsal6tnTdZNQRc9HKQpSd2kd7BkUXHwwpBgZcmZbOxCno3OhgHuWMbIhuSaWFIjwA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:36.299671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-42b060ac-7ff6-4128-a7f5-9471077f8c83 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Getting quotas for project 948fbbd2c9974beb93713e4366834b28. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:36.309852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-42b060ac-7ff6-4128-a7f5-9471077f8c83 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Getting quotas for user 550baba8a2304466962f501a027d7a82 and project 948fbbd2c9974beb93713e4366834b28. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:36.323098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:36.355143 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42b060ac-7ff6-4128-a7f5-9471077f8c83 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.101826 Aug 29 15:42:36.356413 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1772/3768] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:42:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:42:36.687462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.688663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.696992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.698559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.698995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.699708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.700160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.700592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.816948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.825155 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b86b79d2-633a-4c56-a497-2ca6fa229acb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1275 microversion: 2.1 time: 0.141823 Aug 29 15:42:36.825774 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1997/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:37.846898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:37.848079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:37.859488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.860153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.861447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.863841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.864479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.865891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.271682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.284260 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3bf5a209-8d0d-405e-bb7d-66354f3c488d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.442070 Aug 29 15:42:38.310823 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1773/3770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:37 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:39.310226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:39.311132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:39.319177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.319585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.320063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.320745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.321211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.321668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.732890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-809d8454-1097-45f1-89f3-5db181086386 req-4a12faa0-2791-44a7-8e81-273b1d8e7912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1211bb4-7e89-4f66-bfb2-1627015fa0f5", "tag": "de1fb09a-c070-4f6a-826b-d12923c4c7da"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:39.757491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-809d8454-1097-45f1-89f3-5db181086386 req-4a12faa0-2791-44a7-8e81-273b1d8e7912 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.757975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-809d8454-1097-45f1-89f3-5db181086386 req-4a12faa0-2791-44a7-8e81-273b1d8e7912 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.758467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-809d8454-1097-45f1-89f3-5db181086386 req-4a12faa0-2791-44a7-8e81-273b1d8e7912 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.768353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.778737 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-212a0d59-81b1-477d-8c46-b7e66d2f4b38 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.471357 Aug 29 15:42:39.787694 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-809d8454-1097-45f1-89f3-5db181086386 req-4a12faa0-2791-44a7-8e81-273b1d8e7912 service nova] Creating event network-changed:de1fb09a-c070-4f6a-826b-d12923c4c7da for instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 on n-h1-854882-3 Aug 29 15:42:39.789219 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-809d8454-1097-45f1-89f3-5db181086386 req-4a12faa0-2791-44a7-8e81-273b1d8e7912 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059930 Aug 29 15:42:39.792296 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1774/3771] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:39.799487 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1998/3772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:39 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:40.819673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:40.820383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:40.840485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.840974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.841422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:40.842137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.843157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.843584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.150166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.164174 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9e936aa-934b-4abb-bf2d-e0202905d8ca tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.348484 Aug 29 15:42:41.165675 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1775/3773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:40 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:42.185800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:42.187884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:42.198033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.198537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.198984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.199704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.200164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.200600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.594777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-438875214", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2333a069-6c0e-46b9-ad7a-3e167d71292b"}, {"port": "440a4984-7e6a-4508-be31-92e2d9617943", "tag": "port-1"}, {"port": "7e22c1b9-cbff-42a9-a9de-626c90531ec3", "tag": "port-2"}, {"uuid": "487b12b7-b373-4572-aeb2-2c9607001c63", "tag": "net-1"}, {"uuid": "487b12b7-b373-4572-aeb2-2c9607001c63"}, {"uuid": "2fa00bd2-c6a7-4d14-ae5d-bea59fb787a2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2fa00bd2-c6a7-4d14-ae5d-bea59fb787a2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "de8dbfbe-a175-4c73-b429-0f5f6f5fa0af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e92e5d45-b8bf-43c1-89d2-3c5e62d8c7a5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7cbbc01d-9f84-422b-a4f1-b2554efe696c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--437842461"}], "key_name": "tempest-keypair-2041361362", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:42.618870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:42.744870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.762662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-17b1a41b-823e-43d1-acbc-ffb2a5fe3b0d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.578535 Aug 29 15:42:42.763454 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 1999/3774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:42 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:43.331720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] validate_networks() for [('2333a069-6c0e-46b9-ad7a-3e167d71292b', None, None, None, None, None), (None, None, '440a4984-7e6a-4508-be31-92e2d9617943', None, None, None), (None, None, '7e22c1b9-cbff-42a9-a9de-626c90531ec3', None, None, None), ('487b12b7-b373-4572-aeb2-2c9607001c63', None, None, None, None, None), ('487b12b7-b373-4572-aeb2-2c9607001c63', None, None, None, None, None), ('2fa00bd2-c6a7-4d14-ae5d-bea59fb787a2', '10.2.2.100', None, None, None, None), ('2fa00bd2-c6a7-4d14-ae5d-bea59fb787a2', '10.2.2.200', None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:43.785591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.786922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:43.798569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:43.806849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.814800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.815763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.817178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.818074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.818754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.359198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:44.381491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f73ad57e-184f-443d-9640-f73b23f2678d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.600118 Aug 29 15:42:44.382691 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2000/3775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:45.407482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:45.408138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:45.414288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=36 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:45.428185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.429712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.430364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.431368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.432033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.432797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.321642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:46.433170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.444278 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-82a2315f-821a-435b-b083-20bc1ec549c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 1.042091 Aug 29 15:42:46.445509 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2001/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:45 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:47.466500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.467763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.480086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.485479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.486385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.489014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.489565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.492652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.257538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.273104 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-327f288a-d06f-4444-98dc-ea3ba4a44506 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.811465 Aug 29 15:42:48.277110 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2002/3777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:48.549050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:48.552553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:48.553273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:48.554191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:48.555409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:48.570937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.572165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.572801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.573908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.574528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.580831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.615049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Getting quotas for project 948fbbd2c9974beb93713e4366834b28. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:48.626118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Getting quotas for user 550baba8a2304466962f501a027d7a82 and project 948fbbd2c9974beb93713e4366834b28. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:48.815525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1068684321", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:48.899076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:48.902471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='de8dbfbe-a175-4c73-b429-0f5f6f5fa0af',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e92e5d45-b8bf-43c1-89d2-3c5e62d8c7a5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7cbbc01d-9f84-422b-a4f1-b2554efe696c',volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:48.951029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] validate_networks() for [('eedcb164-b8b2-40f8-b59f-095516f56d72', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:49.567582 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08afdf7a-60f6-4e74-8b43-aebf4e53be1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.976800 Aug 29 15:42:49.571210 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1776/3778] 10.222.0.16 () {62 vars in 1189 bytes} [Mon Aug 29 15:42:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 6983 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:42:49.606974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5083d489-ddb7-450d-9c02-0fecfe05c650 req-b1bcfc06-08b2-48d5-a442-1d2755bd8b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1211bb4-7e89-4f66-bfb2-1627015fa0f5", "name": "network-vif-plugged", "status": "completed", "tag": "de1fb09a-c070-4f6a-826b-d12923c4c7da"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:49.634160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5083d489-ddb7-450d-9c02-0fecfe05c650 req-b1bcfc06-08b2-48d5-a442-1d2755bd8b44 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.635381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5083d489-ddb7-450d-9c02-0fecfe05c650 req-b1bcfc06-08b2-48d5-a442-1d2755bd8b44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.636828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5083d489-ddb7-450d-9c02-0fecfe05c650 req-b1bcfc06-08b2-48d5-a442-1d2755bd8b44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.651571 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5083d489-ddb7-450d-9c02-0fecfe05c650 req-b1bcfc06-08b2-48d5-a442-1d2755bd8b44 service nova] Creating event network-vif-plugged:de1fb09a-c070-4f6a-826b-d12923c4c7da for instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 on n-h1-854882-3 Aug 29 15:42:49.661206 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5083d489-ddb7-450d-9c02-0fecfe05c650 req-b1bcfc06-08b2-48d5-a442-1d2755bd8b44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072120 Aug 29 15:42:49.662647 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1777/3779] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:49.672758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.673827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.687619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.688679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.689645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.690628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.691327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.692070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.699732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:50.097696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.113280 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5be09a39-e6e8-45b5-bf10-56a4e76345e1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.448369 Aug 29 15:42:50.116455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1778/3780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:50.131212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c16a642-ffeb-4775-94ac-8850f329261d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.133785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6c16a642-ffeb-4775-94ac-8850f329261d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.287213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c16a642-ffeb-4775-94ac-8850f329261d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.300334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c16a642-ffeb-4775-94ac-8850f329261d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.304910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c16a642-ffeb-4775-94ac-8850f329261d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.307108 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c16a642-ffeb-4775-94ac-8850f329261d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1285 microversion: 2.32 time: 0.189666 Aug 29 15:42:50.308878 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1779/3781] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:50.758712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.759368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.774723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.777216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.778202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.782321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.782955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.783497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.861943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f19115bc-bbb8-4191-8277-7be1e373eb35 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/ips" status: 200 len: 146 microversion: 2.1 time: 0.281165 Aug 29 15:42:50.868665 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1780/3782] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/ips => generated 146 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:51.143262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:51.143942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:51.153352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.153867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.154298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.160358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.160840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.166000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.485291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.509811 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2f668f5-edde-4358-908f-93a1dc010736 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1317 microversion: 2.1 time: 0.374585 Aug 29 15:42:51.512275 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1781/3783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:51.526032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c9aece8-7b01-4f2a-bbcd-37801c2b3e38 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:51.527734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c9aece8-7b01-4f2a-bbcd-37801c2b3e38 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:51.680013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c9aece8-7b01-4f2a-bbcd-37801c2b3e38 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.688744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c9aece8-7b01-4f2a-bbcd-37801c2b3e38 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.697945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c9aece8-7b01-4f2a-bbcd-37801c2b3e38 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.703425 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c9aece8-7b01-4f2a-bbcd-37801c2b3e38 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1285 microversion: 2.32 time: 0.189802 Aug 29 15:42:51.707187 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1782/3784] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:52.542245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.543612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.561343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.562174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.563637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.565709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.566345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.569706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.580405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:52.580930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:52.585017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:52.585865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:52.587033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:52.602164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.602911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.603586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.605321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.606026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.606677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.641041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Getting quotas for project 3f9940a1fec84128b318a5f80884447b. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:52.651251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Getting quotas for user 351e59b6021b44a29665281568960f8b and project 3f9940a1fec84128b318a5f80884447b. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:52.673917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:52.677248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:52.771614 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-edd93825-a9dc-44af-94bb-ee17b792d838 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.492212 Aug 29 15:42:52.773337 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2003/3785] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 4495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:52.780694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.783210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.792834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.793843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.794913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.796100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.797738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.798844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.221647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.236560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.240631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.244323 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d5eef45-b976-41a3-a9eb-1888a8817708 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1519 microversion: 2.32 time: 0.469594 Aug 29 15:42:53.244933 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2004/3786] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:52 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1519 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:53.255845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c7fcc67-da6a-4716-9173-31c9823ca324 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.256744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c7fcc67-da6a-4716-9173-31c9823ca324 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.366392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.378831 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1f11f19-f0dc-47f2-8320-8dd5d11781b2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1507 microversion: 2.1 time: 0.843911 Aug 29 15:42:53.379436 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1783/3787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:52 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1507 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:53.409888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.410336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.436503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.437472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.438099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.439001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.439822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.440428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.460527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c7fcc67-da6a-4716-9173-31c9823ca324 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.469105 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c7fcc67-da6a-4716-9173-31c9823ca324 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1214 microversion: 2.1 time: 0.221883 Aug 29 15:42:53.471240 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2005/3788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:53.481317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.481972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.502344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:53.502970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.506021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.506676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.515578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.516170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.517538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.700848 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9a6cf2a5-37a7-4869-b1dc-689b26adc1dd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 204 len: 0 microversion: 2.1 time: 0.304325 Aug 29 15:42:53.708555 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1784/3789] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:53 2022] DELETE /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:53.720666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7d2f49a-ac16-4777-a3e2-c2815f6b7f10"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:53.726986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.736743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.738797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.740022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.743417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.745804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.746576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.296939 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cf4db8f-f23a-4506-ab8b-40a5e47a41ac tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581388 Aug 29 15:42:54.305545 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1785/3790] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:42:53 2022] POST /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:54.320827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.334410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.347900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.351472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.353189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.356404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.361924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.362664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.531793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.567735 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56eca10a-ba64-4102-b3f4-bf52cf437587 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1507 microversion: 2.1 time: 1.095411 Aug 29 15:42:54.575203 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2006/3791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1507 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:54.584558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.591119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.599794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.607192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.608976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.609950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.610716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.611664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.787177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.830262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.833034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.847071 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40077ee8-15ae-4850-9434-3e68d5ca93df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1593 microversion: 2.32 time: 0.270495 Aug 29 15:42:54.848175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2007/3792] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1593 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:54.855112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.856005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.864955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.865788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.866593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.877601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.878602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.879597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.095465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.106235 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c4880572-9358-49e8-922f-a1340328b745 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1218 microversion: 2.1 time: 0.256800 Aug 29 15:42:55.110457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2008/3793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1218 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:55.129887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:55.140423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.160751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.162652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.165754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.166784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.170477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.171142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.396136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:55.396678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:55.400144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:55.400729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:55.401287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:55.609156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.640939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.643660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.645930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.647856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.650702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.651219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.721380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2825e96b-f196-407e-961d-32a19f705e98 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "POST /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5/action" status: 202 len: 1109 microversion: 2.1 time: 0.609448 Aug 29 15:42:55.725767 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2009/3794] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:55 2022] POST /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5/action => generated 1109 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:42:56.049039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2056700337", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "51c6667a-96b5-4ccd-a82d-ada2aa36f240"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:56.183152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] validate_networks() for [('51c6667a-96b5-4ccd-a82d-ada2aa36f240', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:56.647769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.662444 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8dc42700-3a4c-44ef-b616-17618f02e747 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1665 microversion: 2.1 time: 2.346757 Aug 29 15:42:56.663258 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1786/3795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1665 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:56.668443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.676222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:56.692953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.693630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.694175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.695142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.695833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.696495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.281242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.291175 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e219af9d-3f69-4d3d-ab31-1b1f2e6b7de4 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.626535 Aug 29 15:42:57.294607 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1787/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:57.328288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.328972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.360001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.360424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.360870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.361616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.362278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.365400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.191296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:58.191847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:58.192201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:58.192620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:58.193042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:58.219521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.229854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.230495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.232969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.233487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.233938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.253106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:58.297697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Getting quotas for project b02b576809484d8ba672697987f1447c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:58.312665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Getting quotas for user 84feafb1d3ef4704a583d08c2e17b48c and project b02b576809484d8ba672697987f1447c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:58.349589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Going to run 2 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:58.351875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 527d549f-62d3-4070-b0d1-36393631ebc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:58.418395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=527d549f-62d3-4070-b0d1-36393631ebc4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:58.566697 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6e230f2-f4d2-4ce5-b0f6-b4f5a7b1a769 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.837202 Aug 29 15:42:58.569785 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2010/3797] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:58.583684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.584632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.596900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:58.612288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:58.640110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.640569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.641135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.642378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.643079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.643793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.670006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:58.675212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:58.677849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-240c2be1-a85a-4684-ba7f-1adcbbbac23f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1660 microversion: 2.32 time: 1.380749 Aug 29 15:42:58.678963 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1788/3798] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1660 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:58.693846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b8695561-0992-4bdf-a9e7-8ec38ee14049 req-9f0bf26c-5f00-4edb-b61f-aa5879016cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44f9d37-4725-4888-bee0-1511369e81c0", "name": "network-vif-unplugged", "status": "completed", "tag": "a4093965-06d3-4172-aab2-7a9d1f5652d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:58.729728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8695561-0992-4bdf-a9e7-8ec38ee14049 req-9f0bf26c-5f00-4edb-b61f-aa5879016cbd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.730540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8695561-0992-4bdf-a9e7-8ec38ee14049 req-9f0bf26c-5f00-4edb-b61f-aa5879016cbd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.731190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8695561-0992-4bdf-a9e7-8ec38ee14049 req-9f0bf26c-5f00-4edb-b61f-aa5879016cbd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.780646 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b8695561-0992-4bdf-a9e7-8ec38ee14049 req-9f0bf26c-5f00-4edb-b61f-aa5879016cbd service nova] Creating event network-vif-unplugged:a4093965-06d3-4172-aab2-7a9d1f5652d9 for instance b44f9d37-4725-4888-bee0-1511369e81c0 on n-h1-854882-3 Aug 29 15:42:58.800116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b8695561-0992-4bdf-a9e7-8ec38ee14049 req-9f0bf26c-5f00-4edb-b61f-aa5879016cbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115906 Aug 29 15:42:58.800829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1789/3799] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:58.819986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.821848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.843265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.847765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.848439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.849378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.850052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.850657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.938071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:58.951030 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1d36f5ca-6433-4446-b66a-1d32e6f14fe8 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1272 microversion: 2.1 time: 0.380035 Aug 29 15:42:58.961537 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2011/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:58.965828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.966464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.980236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.980749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.981193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.986145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.990894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.991408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.175330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.184301 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a52f817-2dbc-4b56-907f-7f4d15682219 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1598 microversion: 2.1 time: 0.378134 Aug 29 15:42:59.189704 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1790/3801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1598 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:59.213786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.243566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.247548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Searching by: {'deleted': False, 'project_id': 'b02b576809484d8ba672697987f1447c'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:59.338599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.339582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.341137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.343628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.344358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.344807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.427089 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-258a1dab-a05d-4840-a3df-8f5dd89c1e62 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.235255 Aug 29 15:42:59.428291 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1791/3802] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers => generated 677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:59.727269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1561272571", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "e5f20b4b-0443-4dda-9064-d8c7395b393c"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:59.751299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.761626 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c3ced7fc-5fd3-4a5b-aad4-52a27dfbb178 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.804388 Aug 29 15:42:59.768004 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2012/3803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:59.773794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1f941d72-8e50-4187-9d80-07205cf6a508 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.780123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1f941d72-8e50-4187-9d80-07205cf6a508 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.883585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1f941d72-8e50-4187-9d80-07205cf6a508 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.892166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1f941d72-8e50-4187-9d80-07205cf6a508 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1220 microversion: 2.1 time: 0.122488 Aug 29 15:42:59.896228 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2013/3804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:59.911310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.923014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] validate_networks() for [('e5f20b4b-0443-4dda-9064-d8c7395b393c', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:59.928729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.957540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.959649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.960983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.967019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.967925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.968666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.576051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:00.594180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:00.605066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:00.611283 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c1f04f8-da35-4158-ab49-023d0d92aa1b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1660 microversion: 2.32 time: 0.711287 Aug 29 15:43:00.618936 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2014/3805] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1660 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:00.642739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.645207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:00.672048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.675152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.676481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.678156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.680728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.682212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.636743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.650446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc4aa72a-1f70-4160-a494-db5e846b613e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1314 microversion: 2.1 time: 1.023647 Aug 29 15:43:01.651380 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2015/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:00 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1314 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:01.659521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:01.664716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:01.680267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.683261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.685867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.686057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:01.689157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.698255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.699021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.845696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.846217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.846654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.850936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lazy-loading 'fault' on Instance uuid b44f9d37-4725-4888-bee0-1511369e81c0 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:01.968662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc96cbe7dc5848538bad1b075b301f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '309d278f6e73403493d64a833dcea802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.991574 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d69b3bb8-74ea-4fee-a379-fa99396d90ce tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 200 len: 1315 microversion: 2.1 time: 0.335287 Aug 29 15:43:01.994053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2016/3807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:01 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:02.005518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.008839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.030738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.033750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.035512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.048858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.049377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.051219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.873659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.884944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-395a5071-3c01-4b04-9d0e-43071b60616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.889584 Aug 29 15:43:02.888857 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2017/3808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:01 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:02.908330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.910164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.927618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.928828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.932869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.934957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.938792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.940509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.136923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.157496 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c05fb4d8-9618-43bc-a44c-1a77aac6f225 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1278 microversion: 2.1 time: 0.263116 Aug 29 15:43:03.158787 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2018/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:03.169228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5f501d51-e7ce-43be-9703-504729833d4c req-2351114b-9b11-4370-a28c-32c88a6a5c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44f9d37-4725-4888-bee0-1511369e81c0", "name": "network-vif-deleted", "tag": "a4093965-06d3-4172-aab2-7a9d1f5652d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:03.196301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5f501d51-e7ce-43be-9703-504729833d4c req-2351114b-9b11-4370-a28c-32c88a6a5c20 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.197075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5f501d51-e7ce-43be-9703-504729833d4c req-2351114b-9b11-4370-a28c-32c88a6a5c20 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.199353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5f501d51-e7ce-43be-9703-504729833d4c req-2351114b-9b11-4370-a28c-32c88a6a5c20 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.230373 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5f501d51-e7ce-43be-9703-504729833d4c req-2351114b-9b11-4370-a28c-32c88a6a5c20 service nova] Creating event network-vif-deleted:a4093965-06d3-4172-aab2-7a9d1f5652d9 for instance b44f9d37-4725-4888-bee0-1511369e81c0 on n-h1-854882-3 Aug 29 15:43:03.245523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5f501d51-e7ce-43be-9703-504729833d4c req-2351114b-9b11-4370-a28c-32c88a6a5c20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083415 Aug 29 15:43:03.247791 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2019/3810] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:03.262106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.263249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:03.278207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.281956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.282654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.285279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.285969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.290624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.806357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.822287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.823759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.824982 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1d5edc0-549b-4437-af6f-a7719a870ff5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1706 microversion: 2.32 time: 0.575273 Aug 29 15:43:03.836203 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2020/3811] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1706 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:03.862122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.863036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:03.881417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.882724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.884283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.886411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.887499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.890152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.318347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.329965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dabaccb8-59fc-4535-adac-5da59718aae5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1314 microversion: 2.1 time: 0.486127 Aug 29 15:43:04.331480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2021/3812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:04.359170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7a9bb286-0513-4690-b22a-7bbaff4b058d req-6632b7fe-9645-43b3-818d-bc68e8624255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d476030e-7aa7-4121-893a-4291a3fe3fcb", "tag": "839af9c2-cd37-40bd-a421-42875ad634db"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:04.384459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7a9bb286-0513-4690-b22a-7bbaff4b058d req-6632b7fe-9645-43b3-818d-bc68e8624255 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.384950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7a9bb286-0513-4690-b22a-7bbaff4b058d req-6632b7fe-9645-43b3-818d-bc68e8624255 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.385443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7a9bb286-0513-4690-b22a-7bbaff4b058d req-6632b7fe-9645-43b3-818d-bc68e8624255 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.420674 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7a9bb286-0513-4690-b22a-7bbaff4b058d req-6632b7fe-9645-43b3-818d-bc68e8624255 service nova] Creating event network-changed:839af9c2-cd37-40bd-a421-42875ad634db for instance d476030e-7aa7-4121-893a-4291a3fe3fcb on n-h1-854882-3 Aug 29 15:43:04.428546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7a9bb286-0513-4690-b22a-7bbaff4b058d req-6632b7fe-9645-43b3-818d-bc68e8624255 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093927 Aug 29 15:43:04.433177 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2022/3813] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:04.443189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.456601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] [instance: b44f9d37-4725-4888-bee0-1511369e81c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.468943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.469472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.474361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.476005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.476724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.479677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.503766 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] HTTP exception thrown: Instance b44f9d37-4725-4888-bee0-1511369e81c0 could not be found. Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Request method failure captured: Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 HTTP/1.1 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN5EU_joSRrXiPv83RxnoUOd5HzeszllfUtOYY9avkjY3SdXOEpmNh8AM18VkhuUItSqbuTQMuGNxthYbevao_4UZxkkrtZYmPeqZ5Qc_EuDkZfKDqqxjh1V-2SiYI3W5lYvQJufk00F7_JVI0mKp6tyPqVxxmQHoW2OhB9SF-ja_LM Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 309d278f6e73403493d64a833dcea802 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestFqdnHostnames-1789679187 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/309d278f6e73403493d64a833dcea802"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/309d278f6e73403493d64a833dcea802"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_309d278f6e73403493d64a833dcea802", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/309d278f6e73403493d64a833dcea802"}]}] Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestFqdnHostnames-1789679187 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 309d278f6e73403493d64a833dcea802 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1789679187 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestFqdnHostnames-1789679187-project Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: bc96cbe7dc5848538bad1b075b301f34 Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestFqdnHostnames-1789679187-project Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance b44f9d37-4725-4888-bee0-1511369e81c0 could not be found. Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b44f9d37-4725-4888-bee0-1511369e81c0'} Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44f9d37-4725-4888-bee0-1511369e81c0 could not be found. Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44f9d37-4725-4888-bee0-1511369e81c0 could not be found. Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:04.509458 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:04.516029 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:04.516029 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:04.516029 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:04.516029 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:04.516029 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:04.516029 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44f9d37-4725-4888-bee0-1511369e81c0 could not be found. Aug 29 15:43:04.516029 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:04.517215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Returning 404 to user: Instance b44f9d37-4725-4888-bee0-1511369e81c0 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:04.523641 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab45dde9-9b5f-4c5f-aebe-7fea45e94831 tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0" status: 404 len: 111 microversion: 2.1 time: 0.085674 Aug 29 15:43:04.525962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2023/3814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/b44f9d37-4725-4888-bee0-1511369e81c0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:04.552488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.553294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.555256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:04.556884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:04.557573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:04.558178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:04.558777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:04.560829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.561809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.563256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.564453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.565170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.566123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.585591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.586089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.594393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.595266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.595753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.596195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.652146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Getting quotas for project 883fcc619d694f89960bac6e7cb9c488. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:04.673577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Getting quotas for user 87ab13dbc341434db7373fb4772fdf07 and project 883fcc619d694f89960bac6e7cb9c488. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:04.713492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:04.732898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:04.896351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.910724 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b49778e-a14d-43e1-93a7-1f9a558e45e0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.382736 Aug 29 15:43:04.912973 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2024/3815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:04.929266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.930693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.934553 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f9241e27-ced2-4948-93d1-634da1a4363c tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.499172 Aug 29 15:43:04.944772 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1792/3816] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 5515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:43:04.953534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.969111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.969910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.974246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.976892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.977975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.978119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bce83c4d-84d2-45ea-8a57-64bf046df2cd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] Calling method '.version_select at 0x7fb0e3257160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.034615 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bce83c4d-84d2-45ea-8a57-64bf046df2cd tempest-ServersTestFqdnHostnames-1789679187 tempest-ServersTestFqdnHostnames-1789679187-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459653332" status: 202 len: 0 microversion: 2.1 time: 0.088600 Aug 29 15:43:05.035645 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1793/3817] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459653332 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:43:05.048057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.048717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.066888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.067338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.068020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.071104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.071746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.073971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.216657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.231575 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-221efae7-d597-40b4-b2c6-cc04475c58a1 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1278 microversion: 2.1 time: 0.315358 Aug 29 15:43:05.258959 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2025/3818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1278 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:05.270463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-baceed87-b815-4df4-9739-8a8b6535caf7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.271106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-baceed87-b815-4df4-9739-8a8b6535caf7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.790324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-baceed87-b815-4df4-9739-8a8b6535caf7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.803172 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-baceed87-b815-4df4-9739-8a8b6535caf7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1225 microversion: 2.1 time: 0.541779 Aug 29 15:43:05.815864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2026/3819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1225 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:05.818327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.833785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.859854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.860506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.864248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.867551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.868051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.868521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.702180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:06.719064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:06.724509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:06.728651 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55501823-74be-4909-a19d-e16ac67a4141 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1752 microversion: 2.32 time: 1.691308 Aug 29 15:43:06.731245 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1794/3820] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1752 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:06.750149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:06.751108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:06.753311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:06.762091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.769980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.770702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.772691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.774077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.774757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.897652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:06.916587 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-396dbb50-4fd9-4935-869a-b7691f538544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1314 microversion: 2.1 time: 1.111212 Aug 29 15:43:06.926066 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2027/3821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1314 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:06.937164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:06.938062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:06.952609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.955569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.956139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.959221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.959970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.960645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:07.750473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:07.764364 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8f662a94-41f8-4401-990c-0708d408519b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 1.028948 Aug 29 15:43:07.765224 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1795/3822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:06 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:07.792437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:07.803763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:07.816417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:07.827617 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d80f5936-aba6-4136-805f-bccab4bcce57 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.898061 Aug 29 15:43:07.832628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:07.833131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:07.833601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:07.836673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:07.837131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:07.837593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:07.843579 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2028/3823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:06 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:07.858589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:07.860675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:07.872479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:07.879358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:07.879921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:07.880372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:07.881102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:07.881594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:07.882023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.116752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.135983 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2875e96d-56da-4037-bd7a-ad7637ffed84 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1283 microversion: 2.1 time: 0.365891 Aug 29 15:43:08.151782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1796/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:07 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1283 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:08.163975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:08.164930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:08.176866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.177680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.178330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.179269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.179890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.180414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.186821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:08.253278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:08.295923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.308587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.315547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.318332 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71362817-03c8-4bbe-bb02-3306487029c6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1752 microversion: 2.32 time: 0.470690 Aug 29 15:43:08.321150 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2029/3825] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:07 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1752 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:08.790197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:08.790890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:08.801099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.802067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.802517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.803248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.804149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.804636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.860088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.872477 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ebf3049-75cf-44b3-bad7-af8ca56ef7e9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1314 microversion: 2.1 time: 0.719355 Aug 29 15:43:08.873855 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1797/3826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:08 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:08.891121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:08.891970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:08.907740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.908712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.909381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.910420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.912248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.912767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.134980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:09.154352 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3fbefe09-5061-47a9-b08b-3bc872018b4a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.371377 Aug 29 15:43:09.162568 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2030/3827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:08 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:09.177160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:09.178037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:09.189930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.190908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.191895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.193028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.194021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.194825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.198407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:09.764599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:09.780359 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae460215-6584-4647-8e39-15a15ee387c9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.903009 Aug 29 15:43:09.781685 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1798/3828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:08 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:09.789248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:09.790110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:09.801578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.803338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.804053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.805286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.806231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.807048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.928764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:09.954945 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0556f4e7-77be-41e7-ab5f-36f8f1e031fa tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 0.789922 Aug 29 15:43:09.956507 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2031/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:09 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:09.965703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6ff2dbbf-1b46-400a-8d5c-ca27e4d7f9ff req-4a0523aa-e4fb-4d23-90e9-fd72f6871e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d476030e-7aa7-4121-893a-4291a3fe3fcb", "name": "network-vif-plugged", "status": "completed", "tag": "839af9c2-cd37-40bd-a421-42875ad634db"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:09.980133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6ff2dbbf-1b46-400a-8d5c-ca27e4d7f9ff req-4a0523aa-e4fb-4d23-90e9-fd72f6871e0e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.981841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6ff2dbbf-1b46-400a-8d5c-ca27e4d7f9ff req-4a0523aa-e4fb-4d23-90e9-fd72f6871e0e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.983211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6ff2dbbf-1b46-400a-8d5c-ca27e4d7f9ff req-4a0523aa-e4fb-4d23-90e9-fd72f6871e0e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.019902 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6ff2dbbf-1b46-400a-8d5c-ca27e4d7f9ff req-4a0523aa-e4fb-4d23-90e9-fd72f6871e0e service nova] Creating event network-vif-plugged:839af9c2-cd37-40bd-a421-42875ad634db for instance d476030e-7aa7-4121-893a-4291a3fe3fcb on n-h1-854882-3 Aug 29 15:43:10.071310 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6ff2dbbf-1b46-400a-8d5c-ca27e4d7f9ff req-4a0523aa-e4fb-4d23-90e9-fd72f6871e0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113250 Aug 29 15:43:10.072259 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2032/3830] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:10.087366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:10.088054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:10.106084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.106594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.107580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.108293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.110770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.111408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.352120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.369092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.384517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.390174 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27e88599-bfcd-428c-a478-b7be4ec8df44 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1798 microversion: 2.32 time: 0.607064 Aug 29 15:43:10.405089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1799/3831] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:09 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1798 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:10.415951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:10.418976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:10.441212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.442149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.447422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.448433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.449083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.451198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.668779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.687537 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95a18cc0-c0bb-495c-ac62-aa59ea9c9f3d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1314 microversion: 2.1 time: 0.613917 Aug 29 15:43:10.688180 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2033/3832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:10 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:10.805753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:10.806386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:10.825042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.825588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.826106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.826829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.827302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.827722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.187858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:11.196306 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18b171ad-0784-421c-b88c-c88d62e8aab0 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.394480 Aug 29 15:43:11.196895 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2034/3833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:10 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:11.207605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5bce6d76-8650-4e4f-8c3e-a2b355c71a11 req-b71f5985-0096-4138-86ef-39a6ad2ed390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3eeb77-0a40-4c4e-aa45-79b4cdee3994", "tag": "3bff7eaa-3c08-4a6c-a1a7-aef1324451da"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:11.229265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5bce6d76-8650-4e4f-8c3e-a2b355c71a11 req-b71f5985-0096-4138-86ef-39a6ad2ed390 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.229807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5bce6d76-8650-4e4f-8c3e-a2b355c71a11 req-b71f5985-0096-4138-86ef-39a6ad2ed390 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.230245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5bce6d76-8650-4e4f-8c3e-a2b355c71a11 req-b71f5985-0096-4138-86ef-39a6ad2ed390 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.254459 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5bce6d76-8650-4e4f-8c3e-a2b355c71a11 req-b71f5985-0096-4138-86ef-39a6ad2ed390 service nova] Creating event network-changed:3bff7eaa-3c08-4a6c-a1a7-aef1324451da for instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 on n-h2-854882-3 Aug 29 15:43:11.266478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5bce6d76-8650-4e4f-8c3e-a2b355c71a11 req-b71f5985-0096-4138-86ef-39a6ad2ed390 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068326 Aug 29 15:43:11.267428 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2035/3834] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:11.272580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.273297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.299067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.299564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.300008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.300719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.301172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.301628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.413039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:11.434750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-363a022f-c40a-4339-a237-fe428ca2a191 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 1.027923 Aug 29 15:43:11.448125 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1800/3835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:10 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:11.453631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.456704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.467502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.469049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.469792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.471108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.471988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.472816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.660262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:11.670047 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-84b3cd81-9abb-499e-889f-dfb8c72586b0 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 0.401364 Aug 29 15:43:11.680121 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2036/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:11.710877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.711517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.720267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.721779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.722311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.723732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.724470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.726096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.947862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:11.959959 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2dc40de-b5e9-439e-9a89-42768190d78e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1314 microversion: 2.1 time: 0.253100 Aug 29 15:43:11.961053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2037/3837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:11.978222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e049348a-a024-40f5-8b25-9dc46538f0aa req-751431f9-8279-4e00-a135-2cfc9de4b06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600cda19-111b-4952-9400-334a703d0243", "tag": "88f1873f-9271-466f-9d7e-1fc08f6b5355"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:11.991201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e049348a-a024-40f5-8b25-9dc46538f0aa req-751431f9-8279-4e00-a135-2cfc9de4b06d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.991941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e049348a-a024-40f5-8b25-9dc46538f0aa req-751431f9-8279-4e00-a135-2cfc9de4b06d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.992756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e049348a-a024-40f5-8b25-9dc46538f0aa req-751431f9-8279-4e00-a135-2cfc9de4b06d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.010640 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e049348a-a024-40f5-8b25-9dc46538f0aa req-751431f9-8279-4e00-a135-2cfc9de4b06d service nova] Creating event network-changed:88f1873f-9271-466f-9d7e-1fc08f6b5355 for instance 600cda19-111b-4952-9400-334a703d0243 on n-h1-854882-3 Aug 29 15:43:12.026222 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e049348a-a024-40f5-8b25-9dc46538f0aa req-751431f9-8279-4e00-a135-2cfc9de4b06d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063863 Aug 29 15:43:12.027144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2038/3838] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:12.216970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:12.217791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:12.227410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.231776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.231776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.231776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.231776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.232218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.411595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.420556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71b5c2c4-968e-4950-957b-a4183d3fc951 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.207548 Aug 29 15:43:12.421476 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2039/3839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:12 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:12.461318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:12.465094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:12.496958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.498292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.499388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.500325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.500980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.501651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.626744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.636638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.640962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.643404 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-41048783-0447-402a-a3a4-f6f20eba65df tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1798 microversion: 2.32 time: 1.206475 Aug 29 15:43:12.644530 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1801/3840] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1798 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:12.693559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:12.694198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:12.705515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.705976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.706411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.707113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.707567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.707979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.824678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.838517 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e2be1eb-8572-4ff2-80d2-4ee4cbee3856 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.383545 Aug 29 15:43:12.851083 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2040/3841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:12 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:12.981844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:12.983293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:12.993623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.994202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.997566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.998444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.000553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.001344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.282739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.292673 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f904c28f-81a7-4f54-b7dc-37a99f9fe162 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1499 microversion: 2.1 time: 0.315479 Aug 29 15:43:13.293837 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2041/3842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:12 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1499 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:13.296411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.304137 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e839584e-6e35-48cb-b46a-1d891244547b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 0.615229 Aug 29 15:43:13.313903 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1802/3843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:12 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:13.318065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:13.321583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:13.334082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.336844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.340816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.342194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.344817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.345509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.377947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lazy-loading 'flavor' on Instance uuid d476030e-7aa7-4121-893a-4291a3fe3fcb {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:13.441516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:13.442408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:13.454907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.462187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.463489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.465353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.466017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.470482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.540186 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce85b868-0c5e-4aa9-a1d6-e18f2b8f115c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "POST /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb/action" status: 200 len: 32 microversion: 2.1 time: 0.225183 Aug 29 15:43:13.546092 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2042/3844] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:43:13 2022] POST /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:43:13.557181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:13.558580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:13.575451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.577289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.578005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.579958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.580773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.581326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.889282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.906487 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c399bd7b-eb37-433a-8568-543ac86ae03c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.358810 Aug 29 15:43:13.908731 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2043/3845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:13 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:13.915157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:13.915778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:13.922518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.923006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.923449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.924402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.924595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.925020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.106409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.119519 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58c345c7-c88b-4f64-be99-b049d847321a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.682474 Aug 29 15:43:14.130374 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1803/3846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:13 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:14.142317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:14.143141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:14.149699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.150396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.151095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.151954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.152585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.153172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.205287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.215541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.217059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.218285 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a305c68-f269-4f2a-a7c1-0ceac9b7d2ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1798 microversion: 2.32 time: 0.308601 Aug 29 15:43:14.219025 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2044/3847] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:13 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1798 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:14.223505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f5c8fc18-f7e2-437b-88bd-bad4cd7f3b2b req-56e7f02f-cf99-4fc3-80c0-3922a60585cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d549f-62d3-4070-b0d1-36393631ebc4", "tag": "706f945b-98b4-44b9-8a32-b256bec470cd"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:14.233028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f5c8fc18-f7e2-437b-88bd-bad4cd7f3b2b req-56e7f02f-cf99-4fc3-80c0-3922a60585cd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.233541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f5c8fc18-f7e2-437b-88bd-bad4cd7f3b2b req-56e7f02f-cf99-4fc3-80c0-3922a60585cd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.233981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f5c8fc18-f7e2-437b-88bd-bad4cd7f3b2b req-56e7f02f-cf99-4fc3-80c0-3922a60585cd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.245486 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f5c8fc18-f7e2-437b-88bd-bad4cd7f3b2b req-56e7f02f-cf99-4fc3-80c0-3922a60585cd service nova] Creating event network-changed:706f945b-98b4-44b9-8a32-b256bec470cd for instance 527d549f-62d3-4070-b0d1-36393631ebc4 on n-h2-854882-3 Aug 29 15:43:14.250848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f5c8fc18-f7e2-437b-88bd-bad4cd7f3b2b req-56e7f02f-cf99-4fc3-80c0-3922a60585cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030802 Aug 29 15:43:14.251631 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2045/3848] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:14.327324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:14.328185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:14.335867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.336445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.337038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.338253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.338757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.339358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.533188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.554749 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-270c3692-9a89-4994-9a8c-1a7457d4daa9 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 0.232664 Aug 29 15:43:14.556446 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2046/3849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:14 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:14.624334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:14.691511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:14.928271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:14.929050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:14.936604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.937294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.937932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.938516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.939005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.939432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.021166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.034384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f67a8099-6259-4227-b4b5-6928e14e6a23 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.898363 Aug 29 15:43:15.035283 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1804/3850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:14 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:15.146886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:15.148178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:15.156130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.156871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.157542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.158914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.159625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.160261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.160826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.172373 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b6704ae9-216c-42b4-ba3c-d73da126b3bf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.248078 Aug 29 15:43:15.172974 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2047/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:14 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:15.241546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:15.242238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:15.249314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.250009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.250595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.251392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.251935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.252477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.272096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:15.493566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.511052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.512933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.516247 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c0d1296-8560-4093-be9b-f1639c1b522e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1844 microversion: 2.32 time: 0.277513 Aug 29 15:43:15.517562 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2048/3852] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:15 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1844 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:15.578861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:15.579657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:15.586042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.587048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.588318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.590796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.592230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.592941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.755709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.766446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9ac62eb7-ca1f-4e2b-9834-1ed1caf5d6e7 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 0.192075 Aug 29 15:43:15.768041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2049/3853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:15 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:15.998522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.013073 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b8f3929-3252-456d-a4e2-ef8972656f04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.870923 Aug 29 15:43:16.016379 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1805/3854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:15 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:16.057257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.058034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.066539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=18 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:16.076945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.079750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.080300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.081909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.082859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.091172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.196677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.198296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.208250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.208997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.209790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.210843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.211514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.212545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.413548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.425565 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa27355b-e4a6-4eba-be02-68970008ee0a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.372954 Aug 29 15:43:16.426169 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2050/3855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:16 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:16.547036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.549173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.557355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.558475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.559190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.560208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.560899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.561614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.747313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.759173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.761468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.763051 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db6d7710-31df-4915-a8bf-3def6f49c44f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1844 microversion: 2.32 time: 0.222156 Aug 29 15:43:16.767912 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2051/3856] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:16 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1844 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:16.787952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.788702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.796181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.796738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.797277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.798668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.798668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.799156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.874423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.887732 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5bec7fd-66e0-4b63-91d8-85942e8a2d95 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.695799 Aug 29 15:43:16.901476 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1806/3857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:16 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:16.948900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.958038 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-82b12f79-03db-468f-a6a2-63043a64d642 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 0.173964 Aug 29 15:43:16.959401 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2052/3858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:16 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:17.036203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.036960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.043561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.044158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.045341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.046251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.046759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.047430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.448767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.450053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.460384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.461771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.462475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.463381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.464346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.464945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.657091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.670184 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d1cf6b87-0cf2-4b80-afaa-0584afa95602 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.226383 Aug 29 15:43:17.680809 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2053/3859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.767109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4e4517d8-d958-4812-b5d5-6171bb3991c7 req-1b778aac-f9a7-465f-8453-40fced8f2c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3eeb77-0a40-4c4e-aa45-79b4cdee3994", "name": "network-vif-plugged", "status": "completed", "tag": "3bff7eaa-3c08-4a6c-a1a7-aef1324451da"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:17.777513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e4517d8-d958-4812-b5d5-6171bb3991c7 req-1b778aac-f9a7-465f-8453-40fced8f2c30 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.778408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e4517d8-d958-4812-b5d5-6171bb3991c7 req-1b778aac-f9a7-465f-8453-40fced8f2c30 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.779647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e4517d8-d958-4812-b5d5-6171bb3991c7 req-1b778aac-f9a7-465f-8453-40fced8f2c30 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.799128 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4e4517d8-d958-4812-b5d5-6171bb3991c7 req-1b778aac-f9a7-465f-8453-40fced8f2c30 service nova] Creating event network-vif-plugged:3bff7eaa-3c08-4a6c-a1a7-aef1324451da for instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 on n-h2-854882-3 Aug 29 15:43:17.808472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4e4517d8-d958-4812-b5d5-6171bb3991c7 req-1b778aac-f9a7-465f-8453-40fced8f2c30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044688 Aug 29 15:43:17.810163 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2054/3860] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:17.819692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.820949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.829298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.830686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.831492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.832683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.833157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.833772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.059452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.075933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e5665f85-389e-4120-8ca3-bc270b414e01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 1.043971 Aug 29 15:43:18.089331 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1807/3861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:18.095012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:18.095641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:18.114214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.114712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.115150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.115864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.116323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.116752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.172241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.184195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.191908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.199428 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83434742-9a5a-4237-ad8e-2b4a12a46ecb tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1844 microversion: 2.32 time: 0.384687 Aug 29 15:43:18.201961 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2055/3862] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1844 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:18.206739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:18.215449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:18.225924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.226848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.227539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.228500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.229182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.230036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.533814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.549096 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a04a4964-ed19-4948-b2c9-123b3dd935fe tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.458185 Aug 29 15:43:18.550156 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1808/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:18 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:18.557453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a891af5f-61e4-4ffc-b24a-7dbecce85df4 req-24734bf3-78fa-498f-9bb4-e55bf6e60846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "5fc71865-e22d-4048-b2b0-9176e6cef769"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:18.581708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a891af5f-61e4-4ffc-b24a-7dbecce85df4 req-24734bf3-78fa-498f-9bb4-e55bf6e60846 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.589103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a891af5f-61e4-4ffc-b24a-7dbecce85df4 req-24734bf3-78fa-498f-9bb4-e55bf6e60846 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.589920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a891af5f-61e4-4ffc-b24a-7dbecce85df4 req-24734bf3-78fa-498f-9bb4-e55bf6e60846 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.614839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a891af5f-61e4-4ffc-b24a-7dbecce85df4 req-24734bf3-78fa-498f-9bb4-e55bf6e60846 service nova] Creating event network-changed:5fc71865-e22d-4048-b2b0-9176e6cef769 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:43:18.634317 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a891af5f-61e4-4ffc-b24a-7dbecce85df4 req-24734bf3-78fa-498f-9bb4-e55bf6e60846 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080365 Aug 29 15:43:18.635398 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1809/3864] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:18.694058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:18.695103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:18.703180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.704026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.704639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.705626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.706259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.706863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.111933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.121183 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed43c2c1-1cee-4cd9-b00a-b798af2541d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.432681 Aug 29 15:43:19.143413 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1810/3865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:18 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:19.160791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:19.161465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:19.172982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.173518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.173966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.174687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.175145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.175575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.475818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.487036 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-191e9351-ba53-4a9f-a1e1-5de736bb4e79 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.334132 Aug 29 15:43:19.488051 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1811/3866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:19 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:19.494669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:19.495784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:19.509692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.514404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.515644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.516743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.517712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.518323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.758618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.772501 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-297385ae-a373-4b7f-9035-c8f9505e2e3b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 1.569309 Aug 29 15:43:19.774040 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2056/3867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:18 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:19.811003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:19.813960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:19.843079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.844276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.844742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.852354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.852991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.853483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.983646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.995463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.997303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.999143 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63a6c0bb-052e-4b56-bdd9-5e3aee9cc476 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1865 microversion: 2.32 time: 0.508920 Aug 29 15:43:19.999924 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1812/3868] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:19 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1865 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:20.005086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.007620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.014881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.015599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.016231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.017104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.017757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.018361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.074194 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03d22bf2-c35c-471b-989b-23c275b9de7d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072652 Aug 29 15:43:20.081188 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1813/3869] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:20.088571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-dae816b2-4df1-4aad-8b57-8a56fb70cb01 req-e517a5be-443c-46fa-9d0c-ae36ecd47bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600cda19-111b-4952-9400-334a703d0243", "name": "network-vif-plugged", "status": "completed", "tag": "88f1873f-9271-466f-9d7e-1fc08f6b5355"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:20.105890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dae816b2-4df1-4aad-8b57-8a56fb70cb01 req-e517a5be-443c-46fa-9d0c-ae36ecd47bc1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.106561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dae816b2-4df1-4aad-8b57-8a56fb70cb01 req-e517a5be-443c-46fa-9d0c-ae36ecd47bc1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.107199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dae816b2-4df1-4aad-8b57-8a56fb70cb01 req-e517a5be-443c-46fa-9d0c-ae36ecd47bc1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.119801 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-dae816b2-4df1-4aad-8b57-8a56fb70cb01 req-e517a5be-443c-46fa-9d0c-ae36ecd47bc1 service nova] Creating event network-vif-plugged:88f1873f-9271-466f-9d7e-1fc08f6b5355 for instance 600cda19-111b-4952-9400-334a703d0243 on n-h1-854882-3 Aug 29 15:43:20.126306 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-dae816b2-4df1-4aad-8b57-8a56fb70cb01 req-e517a5be-443c-46fa-9d0c-ae36ecd47bc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043467 Aug 29 15:43:20.127565 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1814/3870] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:20.134031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.135147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.146316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.146987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.147693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.148582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.149439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.150045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.187049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:20.201313 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-91c6d1e8-3164-42cf-ad0a-1d179a765776 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/c7d2f49a-ac16-4777-a3e2-c2815f6b7f10" status: 200 len: 194 microversion: 2.1 time: 0.072502 Aug 29 15:43:20.202998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1815/3871] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/c7d2f49a-ac16-4777-a3e2-c2815f6b7f10 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:20.208614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.209591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.220124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.220857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.221569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.222482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.223504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.224138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.690176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.706669 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb7d9506-991d-40f6-9170-82d97aa92231 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.501570 Aug 29 15:43:20.707295 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1816/3872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:20.718355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.718666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.721449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.732606 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-22be4f07-a012-4af9-9186-9734da1d1b30 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.937312 Aug 29 15:43:20.735008 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2057/3873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:19 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:20.737609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.738356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.738976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.739855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.746507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.747254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.749885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-af5aceca-e22d-4402-9673-2c3119e5e389 req-7d6ee84b-beda-4f4b-a1a8-4cf36746ab9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "440a4984-7e6a-4508-be31-92e2d9617943"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:20.762618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-af5aceca-e22d-4402-9673-2c3119e5e389 req-7d6ee84b-beda-4f4b-a1a8-4cf36746ab9f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.764456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-af5aceca-e22d-4402-9673-2c3119e5e389 req-7d6ee84b-beda-4f4b-a1a8-4cf36746ab9f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.765357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-af5aceca-e22d-4402-9673-2c3119e5e389 req-7d6ee84b-beda-4f4b-a1a8-4cf36746ab9f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.783256 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-af5aceca-e22d-4402-9673-2c3119e5e389 req-7d6ee84b-beda-4f4b-a1a8-4cf36746ab9f service nova] Creating event network-changed:440a4984-7e6a-4508-be31-92e2d9617943 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:43:20.795793 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-af5aceca-e22d-4402-9673-2c3119e5e389 req-7d6ee84b-beda-4f4b-a1a8-4cf36746ab9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058910 Aug 29 15:43:20.797962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2058/3874] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:20.805797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.807296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.816350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.816925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.817628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.819246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.819846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.820647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.103438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:21.124167 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4345338b-e679-4d8e-b2f4-3276e66acf1a tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1320 microversion: 2.1 time: 0.410534 Aug 29 15:43:21.125606 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1817/3875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1320 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:21.154344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:21.156931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:21.173938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.177976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.179004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.180436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.186984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.188073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.450505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:21.470643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-87a6de21-789b-43da-8418-a2d442a4cfcc tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1325 microversion: 2.1 time: 0.670753 Aug 29 15:43:21.472053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2059/3876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1325 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:21.642874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:21.658943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:21.665180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:21.668433 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-463d6ca3-d407-41bc-a4ff-fce4b3ee338e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1886 microversion: 2.32 time: 0.540806 Aug 29 15:43:21.687420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1818/3877] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:21 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1886 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:21.728402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:21.729477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:21.741921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.743383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.746043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.747036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.747772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.750948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.760944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:21.764441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:21.776595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.785117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.785739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.791695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.795740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.796337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.124993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.143676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d12df893-8167-4140-9472-b34761c01b67 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.385410 Aug 29 15:43:22.157454 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1819/3878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:21 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:22.166446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:22.167335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:22.213117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.215258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.216559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.218897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.219704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.221287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.367259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.375679 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-670d4654-8675-4a89-9cf0-350aa92aca96 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.651312 Aug 29 15:43:22.376276 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2060/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:21 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:22.384071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6cc0df25-ca0b-4bd8-a093-a3de9d11d8f4 req-3c5f3d98-cbbe-41c8-98c2-205274a5070e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527d549f-62d3-4070-b0d1-36393631ebc4", "name": "network-vif-plugged", "status": "completed", "tag": "706f945b-98b4-44b9-8a32-b256bec470cd"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:22.405099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6cc0df25-ca0b-4bd8-a093-a3de9d11d8f4 req-3c5f3d98-cbbe-41c8-98c2-205274a5070e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.405965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6cc0df25-ca0b-4bd8-a093-a3de9d11d8f4 req-3c5f3d98-cbbe-41c8-98c2-205274a5070e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.406669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6cc0df25-ca0b-4bd8-a093-a3de9d11d8f4 req-3c5f3d98-cbbe-41c8-98c2-205274a5070e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.425669 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6cc0df25-ca0b-4bd8-a093-a3de9d11d8f4 req-3c5f3d98-cbbe-41c8-98c2-205274a5070e service nova] Creating event network-vif-plugged:706f945b-98b4-44b9-8a32-b256bec470cd for instance 527d549f-62d3-4070-b0d1-36393631ebc4 on n-h2-854882-3 Aug 29 15:43:22.431986 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6cc0df25-ca0b-4bd8-a093-a3de9d11d8f4 req-3c5f3d98-cbbe-41c8-98c2-205274a5070e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051543 Aug 29 15:43:22.433051 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2061/3880] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:22.494435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:22.495840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:22.518787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.519609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.520317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.521149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.521786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.522331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.678097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.686621 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac734923-cb41-42b4-bae2-33a7cbd1a809 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 200 len: 1508 microversion: 2.1 time: 0.528042 Aug 29 15:43:22.705963 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1820/3881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:22 2022] GET /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 1508 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:22.715515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:22.719786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:22.728398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.742068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.742516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.743273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.743734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.744162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.132876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:23.149647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:23.151793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:23.153333 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3aa27c7-c28a-4e54-b2ab-16fe6e2fba9a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1886 microversion: 2.32 time: 0.445979 Aug 29 15:43:23.155316 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1821/3882] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:22 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1886 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:23.161233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:23.162238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 527d549f-62d3-4070-b0d1-36393631ebc4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:23.170132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.170994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.171769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.172808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.173515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.174173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.250225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:23.259992 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e559e646-d62b-495e-9846-53ebb1c17864 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1521 microversion: 2.1 time: 0.770972 Aug 29 15:43:23.273247 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2062/3883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:22 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1521 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:23.284301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-594ae714-7e05-4948-8530-42e43e70b1ab req-45c8af8a-bbfa-417d-9b10-a10a25da3826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "7e22c1b9-cbff-42a9-a9de-626c90531ec3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:23.305684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-594ae714-7e05-4948-8530-42e43e70b1ab req-45c8af8a-bbfa-417d-9b10-a10a25da3826 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.306481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-594ae714-7e05-4948-8530-42e43e70b1ab req-45c8af8a-bbfa-417d-9b10-a10a25da3826 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.307180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-594ae714-7e05-4948-8530-42e43e70b1ab req-45c8af8a-bbfa-417d-9b10-a10a25da3826 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.322236 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-594ae714-7e05-4948-8530-42e43e70b1ab req-45c8af8a-bbfa-417d-9b10-a10a25da3826 service nova] Creating event network-changed:7e22c1b9-cbff-42a9-a9de-626c90531ec3 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:43:23.328788 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-594ae714-7e05-4948-8530-42e43e70b1ab req-45c8af8a-bbfa-417d-9b10-a10a25da3826 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053990 Aug 29 15:43:23.330030 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2063/3884] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:23.336575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b3dc61-db07-40db-afd6-34ccd2193890"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:23.339469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:23.346328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.347173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.347823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.348750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.350904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.351558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.904728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:23.912816 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8ebdf18-9fa3-4dad-8a30-6eb76dbd4738 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/527d549f-62d3-4070-b0d1-36393631ebc4" status: 200 len: 1320 microversion: 2.1 time: 0.755587 Aug 29 15:43:23.920211 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1822/3885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:23 2022] GET /compute/v2.1/servers/527d549f-62d3-4070-b0d1-36393631ebc4 => generated 1320 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:23.932828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:23.935429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:23.954264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.954998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.955441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.956147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.956598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.957024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.055435 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6432fb85-3a6d-423e-a8f0-9448ce08457e tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "POST /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723791 Aug 29 15:43:24.057021 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2064/3886] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:43:23 2022] POST /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:24.063657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:24.064508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:24.079940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.080449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.080905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.081631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.082086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.088012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.169739 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] HTTP exception thrown: Action 999 not found Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Request method failure captured: Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994/os-instance-actions/999 HTTP/1.1 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN6CYnBIL2_Xqte1HcnnDz6kFQ8AEtmL7BEUZc299BnNCTCuHSkyGsDGSLGnESsIpDMSO7UXgDpoC49GZSnvOCU-Pgc4Wh8Uit9hz1tG2X_MYGbv27kGt5YS3tp15NNQBCVMZXkocFUsXNnv5UJFMNHsj4h7DefE-6FQskqb9QOb3-s Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 883fcc619d694f89960bac6e7cb9c488 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/883fcc619d694f89960bac6e7cb9c488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/883fcc619d694f89960bac6e7cb9c488"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_883fcc619d694f89960bac6e7cb9c488", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/883fcc619d694f89960bac6e7cb9c488"}]}] Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 883fcc619d694f89960bac6e7cb9c488 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-InstanceActionsNegativeTestJSON-1930128955-project Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 87ab13dbc341434db7373fb4772fdf07 Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1930128955-project Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: exception: Action 999 not found Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': '2b3eeb77-0a40-4c4e-aa45-79b4cdee3994', 'id': '999'} Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 29 15:43:24.180449 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.188228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Returning 404 to user: Action 999 not found {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:24.189547 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bedbd902-44f4-4afe-822b-ec5a9cd93971 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.131142 Aug 29 15:43:24.194914 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2065/3887] 10.222.0.16 () {58 vars in 1308 bytes} [Mon Aug 29 15:43:24 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994/os-instance-actions/999 => generated 66 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:43:24.203956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:24.205851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:24.221927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.222611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.223205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.224097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.224667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.225205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.309238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:24.464741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:24.475121 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c63bf785-39f8-467d-918b-f7ec59706509 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.553416 Aug 29 15:43:24.481286 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1823/3888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:23 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:24.490022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:24.495480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:24.521160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.521693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.522133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.522835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.523483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.524077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.878217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:24.898695 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c3bd366f-3d80-4243-8e6c-489217835a02 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.702284 Aug 29 15:43:24.899633 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2066/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:24 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:24.907300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd09df29-6df7-4649-a4be-92c2cc0fff92 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '.version_select at 0x7fb0e297e700>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:24.908705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd09df29-6df7-4649-a4be-92c2cc0fff92 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 405c9fe5-5e32-4017-aa73-35307e6089a8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:24.915330 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-fd09df29-6df7-4649-a4be-92c2cc0fff92 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] HTTP exception thrown: Instance 405c9fe5-5e32-4017-aa73-35307e6089a8 could not be found. Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd09df29-6df7-4649-a4be-92c2cc0fff92 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Request method failure captured: Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/405c9fe5-5e32-4017-aa73-35307e6089a8/os-instance-actions HTTP/1.1 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN6CYnBIL2_Xqte1HcnnDz6kFQ8AEtmL7BEUZc299BnNCTCuHSkyGsDGSLGnESsIpDMSO7UXgDpoC49GZSnvOCU-Pgc4Wh8Uit9hz1tG2X_MYGbv27kGt5YS3tp15NNQBCVMZXkocFUsXNnv5UJFMNHsj4h7DefE-6FQskqb9QOb3-s Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 883fcc619d694f89960bac6e7cb9c488 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/883fcc619d694f89960bac6e7cb9c488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/883fcc619d694f89960bac6e7cb9c488"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_883fcc619d694f89960bac6e7cb9c488", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/883fcc619d694f89960bac6e7cb9c488"}]}] Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 883fcc619d694f89960bac6e7cb9c488 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-InstanceActionsNegativeTestJSON-1930128955-project Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 87ab13dbc341434db7373fb4772fdf07 Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1930128955-project Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 405c9fe5-5e32-4017-aa73-35307e6089a8 could not be found. Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': '405c9fe5-5e32-4017-aa73-35307e6089a8'} Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405c9fe5-5e32-4017-aa73-35307e6089a8 could not be found. Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:24.917973 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405c9fe5-5e32-4017-aa73-35307e6089a8 could not be found. Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405c9fe5-5e32-4017-aa73-35307e6089a8 could not be found. Aug 29 15:43:24.924755 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:43:24.927474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd09df29-6df7-4649-a4be-92c2cc0fff92 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Returning 404 to user: Instance 405c9fe5-5e32-4017-aa73-35307e6089a8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:24.928725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd09df29-6df7-4649-a4be-92c2cc0fff92 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/405c9fe5-5e32-4017-aa73-35307e6089a8/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.027793 Aug 29 15:43:24.929977 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2067/3890] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Aug 29 15:43:24 2022] GET /compute/v2.1/servers/405c9fe5-5e32-4017-aa73-35307e6089a8/os-instance-actions => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:24.940407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:24.941458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:24.949834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.950718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.951374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.952300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.952962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.953649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.984685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:25.092298 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63dd37d1-d191-47b5-a1af-531501bf94ac tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 204 len: 0 microversion: 2.1 time: 0.155896 Aug 29 15:43:25.094325 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2068/3891] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:24 2022] DELETE /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:25.103926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:25.105012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 527d549f-62d3-4070-b0d1-36393631ebc4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:25.113936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.114831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.115520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.116436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.117096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.117811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.389416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.409210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.411257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.412820 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-db55ed3a-85e1-49b3-aa8e-260fb9d4e148 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1886 microversion: 2.32 time: 0.929795 Aug 29 15:43:25.414335 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1824/3892] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:24 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1886 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:25.420147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:25.421033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:25.430559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.431329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.432006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.432990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.433562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.433992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.559318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.570724 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-50dd2831-ac04-4e6a-80c8-cbb174d4ae4d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/527d549f-62d3-4070-b0d1-36393631ebc4" status: 200 len: 1509 microversion: 2.1 time: 0.474566 Aug 29 15:43:25.571320 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2069/3893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:25 2022] GET /compute/v2.1/servers/527d549f-62d3-4070-b0d1-36393631ebc4 => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:25.599954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-cbd18aa3-2b48-443d-bc33-752709eaa7f1 req-2bf5825b-46f4-416d-b4f3-559d1c9eb810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "73384e18-d1b4-4919-9f91-9b5be5de78a8"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:25.630233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cbd18aa3-2b48-443d-bc33-752709eaa7f1 req-2bf5825b-46f4-416d-b4f3-559d1c9eb810 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.630734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cbd18aa3-2b48-443d-bc33-752709eaa7f1 req-2bf5825b-46f4-416d-b4f3-559d1c9eb810 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.631173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cbd18aa3-2b48-443d-bc33-752709eaa7f1 req-2bf5825b-46f4-416d-b4f3-559d1c9eb810 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.645289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-cbd18aa3-2b48-443d-bc33-752709eaa7f1 req-2bf5825b-46f4-416d-b4f3-559d1c9eb810 service nova] Creating event network-changed:73384e18-d1b4-4919-9f91-9b5be5de78a8 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:43:25.650746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-cbd18aa3-2b48-443d-bc33-752709eaa7f1 req-2bf5825b-46f4-416d-b4f3-559d1c9eb810 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059466 Aug 29 15:43:25.651877 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2070/3894] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:25.657217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:25.658168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:25.665087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.665794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.666580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.668301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.668915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.669603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.763360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.790286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42d564ec-7bee-43c6-937d-f3fcf023308b tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1527 microversion: 2.1 time: 0.374419 Aug 29 15:43:25.791634 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1825/3895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:25 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1527 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:25.798957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:25.801268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 527d549f-62d3-4070-b0d1-36393631ebc4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:25.810649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.811350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.811956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.812876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.814391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.815011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.856191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 527d549f-62d3-4070-b0d1-36393631ebc4] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:25.939471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.961887 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f42dd068-26c9-4fa2-b698-30bcbfbf5218 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.308545 Aug 29 15:43:25.965525 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2071/3896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:25 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:25.971363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:25.972198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.001192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.002951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.005073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.008160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.009285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.011357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.051189 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53bdd072-d340-4fb9-807a-dd974ac89bb9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/527d549f-62d3-4070-b0d1-36393631ebc4" status: 204 len: 0 microversion: 2.1 time: 0.256069 Aug 29 15:43:26.052501 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1826/3897] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:25 2022] DELETE /compute/v2.1/servers/527d549f-62d3-4070-b0d1-36393631ebc4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:26.074387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.074985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.081171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.081684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.082144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.082840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.083479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.084091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.144753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: 600cda19-111b-4952-9400-334a703d0243] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:26.245661 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e9411a7-e181-47ae-b89c-536dba8212cf tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243" status: 204 len: 0 microversion: 2.1 time: 0.185342 Aug 29 15:43:26.258428 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1827/3898] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:26 2022] DELETE /compute/v2.1/servers/600cda19-111b-4952-9400-334a703d0243 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:26.441821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.442999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.454474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.458884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.461503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.462341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.463005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.468016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.509427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:26.622211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.635344 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cd6c5afa-f402-461d-a9b7-90defef900df tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.667765 Aug 29 15:43:26.649645 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2072/3899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:25 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:26.649645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1533785077", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "51c6667a-96b5-4ccd-a82d-ada2aa36f240"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:26.727828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] validate_networks() for [('51c6667a-96b5-4ccd-a82d-ada2aa36f240', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:26.806576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.819635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.823751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.824969 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-613fa3e3-59be-4de8-86aa-18906de0644f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1886 microversion: 2.32 time: 0.388581 Aug 29 15:43:26.826094 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1828/3900] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:26 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1886 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:26.835132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.841013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.854496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.857427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.858082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.859638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.861022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.862988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.354366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.366309 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-299564c3-cee4-4bb2-bfa3-0f71d24bf0e4 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1527 microversion: 2.1 time: 0.534168 Aug 29 15:43:27.380690 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1829/3901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:26 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1527 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:27.385982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:27.387978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:27.404063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.404555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.404986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.407826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.408329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.408763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.030752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:28.042899 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c79e9a93-2d5d-4c1a-8f03-0c8414c52d77 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.659420 Aug 29 15:43:28.045414 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1830/3902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:27 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:28.055960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:28.057674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:28.072033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.074919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.075576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.076470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.078978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.079646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.493597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:28.511412 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da3893d2-300e-4d46-8612-267a5c0552b0 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1514 microversion: 2.1 time: 0.463548 Aug 29 15:43:28.525988 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1831/3903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:28 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:28.533226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d5ac00bf-5d63-47f4-b491-a0b6fa1c1646 req-42763de5-6203-4a77-bd0c-124b1c328104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "4325930b-2a2c-4ca8-bc3a-407ed5756ffb"}, {"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "afc9aaaa-e70e-40e4-b278-80e3ce884a8d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:28.554031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d5ac00bf-5d63-47f4-b491-a0b6fa1c1646 req-42763de5-6203-4a77-bd0c-124b1c328104 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.554836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d5ac00bf-5d63-47f4-b491-a0b6fa1c1646 req-42763de5-6203-4a77-bd0c-124b1c328104 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.565887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d5ac00bf-5d63-47f4-b491-a0b6fa1c1646 req-42763de5-6203-4a77-bd0c-124b1c328104 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.585471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d5ac00bf-5d63-47f4-b491-a0b6fa1c1646 req-42763de5-6203-4a77-bd0c-124b1c328104 service nova] Creating event network-changed:4325930b-2a2c-4ca8-bc3a-407ed5756ffb for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:43:28.594305 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d5ac00bf-5d63-47f4-b491-a0b6fa1c1646 req-42763de5-6203-4a77-bd0c-124b1c328104 service nova] Creating event network-changed:afc9aaaa-e70e-40e4-b278-80e3ce884a8d for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:43:28.606510 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d5ac00bf-5d63-47f4-b491-a0b6fa1c1646 req-42763de5-6203-4a77-bd0c-124b1c328104 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077456 Aug 29 15:43:28.613953 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1832/3904] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:28.619891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:28.623964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:28.634725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.638327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.639037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.646891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.647754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.648385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.833580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:28.834439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:28.835242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:28.835807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:28.836233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:28.855729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.857548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.860690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.861813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.864977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.866360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.921643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Getting quotas for project b02b576809484d8ba672697987f1447c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:28.932168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:28.935980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Getting quotas for user 84feafb1d3ef4704a583d08c2e17b48c and project b02b576809484d8ba672697987f1447c. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:28.956937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Going to run 2 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:28.961131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:29.007424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=ddbb01f8-6816-4ccd-90e4-03666c8e02da,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:29.128349 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-843eb690-6305-4e6c-a323-cec1c6b40a87 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.489156 Aug 29 15:43:29.129680 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2073/3905] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 2493 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:43:29.139821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:29.140825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:29.175846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.176946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.177855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.179049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.179796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.181203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.269436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.287768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.297901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.301565 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-61f0f126-df19-4bd3-a6d0-51648d9bd891 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.684751 Aug 29 15:43:29.304160 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1833/3906] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:28 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:29.317844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:29.321016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:29.348762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.350712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.354047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.355864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.359798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.360554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.093507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:30.102038 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1832a3a0-7bd2-4361-a429-b7ee67c2450f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.796495 Aug 29 15:43:30.106596 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1834/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:29 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:30.117802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:30.127960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:30.138935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Searching by: {'deleted': False, 'project_id': 'b02b576809484d8ba672697987f1447c'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:43:30.162163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:30.175997 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bea7c29f-4425-4280-882d-a246136c46d6 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1527 microversion: 2.1 time: 1.044810 Aug 29 15:43:30.188398 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2074/3908] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:29 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1527 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:30.191781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:30.195038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:30.202800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.207729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.209819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.210300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.211051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.221842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.223524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.239425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.239718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.241066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.242087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.242836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.316707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:43:30.388529 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73d40077-da66-4413-aae9-bcc16acd1233 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.280285 Aug 29 15:43:30.406213 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1835/3909] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:43:30 2022] GET /compute/v2.1/servers => generated 1337 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:30.412625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:30.430404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:30.439986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.440785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.441608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.442629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.443623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.444422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.072116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:31.126126 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a84a356-c33e-40d8-9627-fadb064deb86 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1520 microversion: 2.1 time: 0.936348 Aug 29 15:43:31.146944 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2075/3910] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:30 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1520 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:31.176249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:31.190235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:31.207122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.211034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.212795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.214929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.216398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.219195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.438834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:31.449884 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-49112af2-d87e-4acf-b501-8f4da24db28d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1270 microversion: 2.1 time: 0.299430 Aug 29 15:43:31.451286 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2076/3911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:31 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:31.457492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e515b0fd-59a1-44d1-bd28-2797d37802aa req-b668f1c4-bb50-4327-8d4d-7e0acb167887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "67328c13-10eb-4d44-bc25-a7da9c8b6192"}, {"server_uuid": "527d549f-62d3-4070-b0d1-36393631ebc4", "name": "network-vif-deleted", "tag": "706f945b-98b4-44b9-8a32-b256bec470cd"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:31.480273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:31.492147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e515b0fd-59a1-44d1-bd28-2797d37802aa req-b668f1c4-bb50-4327-8d4d-7e0acb167887 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.492522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:31.492794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e515b0fd-59a1-44d1-bd28-2797d37802aa req-b668f1c4-bb50-4327-8d4d-7e0acb167887 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.493672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e515b0fd-59a1-44d1-bd28-2797d37802aa req-b668f1c4-bb50-4327-8d4d-7e0acb167887 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.519524 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e515b0fd-59a1-44d1-bd28-2797d37802aa req-b668f1c4-bb50-4327-8d4d-7e0acb167887 service nova] Creating event network-changed:67328c13-10eb-4d44-bc25-a7da9c8b6192 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:43:31.521098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:31.522527 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e515b0fd-59a1-44d1-bd28-2797d37802aa req-b668f1c4-bb50-4327-8d4d-7e0acb167887 service nova] Creating event network-vif-deleted:706f945b-98b4-44b9-8a32-b256bec470cd for instance 527d549f-62d3-4070-b0d1-36393631ebc4 on n-h2-854882-3 Aug 29 15:43:31.531605 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f53f7986-a138-4644-9366-2ddc805facd7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 1.114887 Aug 29 15:43:31.532582 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1836/3912] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:30 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:31.548715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-10c607f8-9bdf-43b0-93ee-3795c7680140 req-93991fc6-ef6a-477b-8de5-ea42698bdd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3eeb77-0a40-4c4e-aa45-79b4cdee3994", "name": "network-vif-deleted", "tag": "3bff7eaa-3c08-4a6c-a1a7-aef1324451da"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:31.554146 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e515b0fd-59a1-44d1-bd28-2797d37802aa req-b668f1c4-bb50-4327-8d4d-7e0acb167887 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.101297 Aug 29 15:43:31.555999 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2077/3913] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:31.570313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:31.571299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:31.586207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10c607f8-9bdf-43b0-93ee-3795c7680140 req-93991fc6-ef6a-477b-8de5-ea42698bdd04 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.586692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10c607f8-9bdf-43b0-93ee-3795c7680140 req-93991fc6-ef6a-477b-8de5-ea42698bdd04 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.587125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10c607f8-9bdf-43b0-93ee-3795c7680140 req-93991fc6-ef6a-477b-8de5-ea42698bdd04 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.593328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.596147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.596737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.597707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.610136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.610777 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-10c607f8-9bdf-43b0-93ee-3795c7680140 req-93991fc6-ef6a-477b-8de5-ea42698bdd04 service nova] Creating event network-vif-deleted:3bff7eaa-3c08-4a6c-a1a7-aef1324451da for instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 on n-h2-854882-3 Aug 29 15:43:31.611187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.630415 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-10c607f8-9bdf-43b0-93ee-3795c7680140 req-93991fc6-ef6a-477b-8de5-ea42698bdd04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096498 Aug 29 15:43:31.631080 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1837/3914] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:31.636278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:31.636982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:31.650231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.650721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.651162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.651865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.652318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.652745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.714829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:31.727621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.728115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.728556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.729008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lazy-loading 'fault' on Instance uuid 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:31.883312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ab13dbc341434db7373fb4772fdf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883fcc619d694f89960bac6e7cb9c488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:31.893556 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-810d23a2-294b-4f13-bdf3-7ae487c4d663 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 200 len: 1315 microversion: 2.1 time: 0.261259 Aug 29 15:43:31.902362 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1838/3915] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:31 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:32.150579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:32.151217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:32.171357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.172100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.173265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.180622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.181370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.190214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.551908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:32.571318 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c481f3f6-0b63-4ffb-acfb-5ed662f0d6c7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1520 microversion: 2.1 time: 0.424714 Aug 29 15:43:32.571926 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1839/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:32 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:32.580507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:32.581182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:32.591277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.592352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.592966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.593956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.594583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.595172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.618136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:32.627607 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8220255f-b3ae-476a-b273-8dcb30d14bdb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 1.070273 Aug 29 15:43:32.631281 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2078/3917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:31 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:32.636828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:32.645986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:32.671963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.674225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.676221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.676996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.680063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.683591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.720351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:32.730173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8c94d264-8fb0-4b03-af01-69822c5a0d46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1276 microversion: 2.1 time: 0.156438 Aug 29 15:43:32.746110 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1840/3918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:32 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:32.932609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:32.937012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] [instance: 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:32.951403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.951912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.952351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.954496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.956106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.956594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.988000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] HTTP exception thrown: Instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 could not be found. Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Request method failure captured: Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 HTTP/1.1 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN6CYnBIL2_Xqte1HcnnDz6kFQ8AEtmL7BEUZc299BnNCTCuHSkyGsDGSLGnESsIpDMSO7UXgDpoC49GZSnvOCU-Pgc4Wh8Uit9hz1tG2X_MYGbv27kGt5YS3tp15NNQBCVMZXkocFUsXNnv5UJFMNHsj4h7DefE-6FQskqb9QOb3-s Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 883fcc619d694f89960bac6e7cb9c488 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/883fcc619d694f89960bac6e7cb9c488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/883fcc619d694f89960bac6e7cb9c488"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_883fcc619d694f89960bac6e7cb9c488", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/883fcc619d694f89960bac6e7cb9c488"}]}] Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 883fcc619d694f89960bac6e7cb9c488 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1930128955 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-InstanceActionsNegativeTestJSON-1930128955-project Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 87ab13dbc341434db7373fb4772fdf07 Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1930128955-project Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 could not be found. Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2b3eeb77-0a40-4c4e-aa45-79b4cdee3994'} Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 could not be found. Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 could not be found. Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:43:32.990620 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 could not be found. Aug 29 15:43:32.996422 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:43:32.999225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] Returning 404 to user: Instance 2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:33.000514 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4cbf3f20-dcf7-4a6c-ae69-c340026f7132 tempest-InstanceActionsNegativeTestJSON-1930128955 tempest-InstanceActionsNegativeTestJSON-1930128955-project] 10.222.0.16 "GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994" status: 404 len: 111 microversion: 2.1 time: 0.075855 Aug 29 15:43:33.006597 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1841/3919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:32 2022] GET /compute/v2.1/servers/2b3eeb77-0a40-4c4e-aa45-79b4cdee3994 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:33.580432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-aa14418a-0790-42a0-bca1-9928c41fd108 req-9b1d6b9e-9506-4738-9385-e0f91a9f0944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600cda19-111b-4952-9400-334a703d0243", "name": "network-vif-deleted", "tag": "88f1873f-9271-466f-9d7e-1fc08f6b5355"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:33.613372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa14418a-0790-42a0-bca1-9928c41fd108 req-9b1d6b9e-9506-4738-9385-e0f91a9f0944 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.614001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa14418a-0790-42a0-bca1-9928c41fd108 req-9b1d6b9e-9506-4738-9385-e0f91a9f0944 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.616527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa14418a-0790-42a0-bca1-9928c41fd108 req-9b1d6b9e-9506-4738-9385-e0f91a9f0944 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.630693 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-aa14418a-0790-42a0-bca1-9928c41fd108 req-9b1d6b9e-9506-4738-9385-e0f91a9f0944 service nova] Creating event network-vif-deleted:88f1873f-9271-466f-9d7e-1fc08f6b5355 for instance 600cda19-111b-4952-9400-334a703d0243 on n-h1-854882-3 Aug 29 15:43:33.636418 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-aa14418a-0790-42a0-bca1-9928c41fd108 req-9b1d6b9e-9506-4738-9385-e0f91a9f0944 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067529 Aug 29 15:43:33.637458 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1842/3920] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:33.654315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:33.655449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:33.663507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.664492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.666242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.667437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.668127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.668765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.924526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:33.939138 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da28c77f-bfc8-4020-bd5d-8d5cfa069e14 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1520 microversion: 2.1 time: 0.294683 Aug 29 15:43:33.941077 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1843/3921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:33 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:33.948129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:33.949531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:33.966580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:33.974439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.981001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.981624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.985543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.987294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.987990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.993045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:33.999028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:34.006800 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-483b6801-0f3b-4989-bb78-58a1a08b7066 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 1.372924 Aug 29 15:43:34.008994 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2079/3922] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:32 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:34.020370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:34.025117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:34.034667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:34.038844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:34.039494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:34.040176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:34.040643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:34.041080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:34.247010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:34.255769 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dbe05403-2c49-4d47-b42f-c4d346485b01 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1276 microversion: 2.1 time: 0.245644 Aug 29 15:43:34.256967 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2080/3923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:34 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:34.262389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fa2c2edd-3347-4410-80fb-7a525bdcd98b req-5dc87bcc-f736-496f-a53d-c72984f8fda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1211bb4-7e89-4f66-bfb2-1627015fa0f5", "name": "network-vif-plugged", "status": "completed", "tag": "de1fb09a-c070-4f6a-826b-d12923c4c7da"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:34.272921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fa2c2edd-3347-4410-80fb-7a525bdcd98b req-5dc87bcc-f736-496f-a53d-c72984f8fda9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:34.273709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fa2c2edd-3347-4410-80fb-7a525bdcd98b req-5dc87bcc-f736-496f-a53d-c72984f8fda9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:34.274315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fa2c2edd-3347-4410-80fb-7a525bdcd98b req-5dc87bcc-f736-496f-a53d-c72984f8fda9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:34.289224 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fa2c2edd-3347-4410-80fb-7a525bdcd98b req-5dc87bcc-f736-496f-a53d-c72984f8fda9 service nova] Creating event network-vif-plugged:de1fb09a-c070-4f6a-826b-d12923c4c7da for instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 on n-h1-854882-3 Aug 29 15:43:34.299168 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fa2c2edd-3347-4410-80fb-7a525bdcd98b req-5dc87bcc-f736-496f-a53d-c72984f8fda9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039049 Aug 29 15:43:34.300066 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2081/3924] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:34.453721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:34.467708 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd0fde72-d0b5-4eca-a218-d677bf467b7e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.525216 Aug 29 15:43:34.482493 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1844/3925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:33 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:34.962562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:34.963289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:34.976566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:34.977901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:34.979514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:34.983155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:34.983858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:34.984505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.035066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:35.036279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:35.048716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.051570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.053926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.058041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.058763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.061932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.678937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.695836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.708714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.710266 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-20112f3b-d417-4665-940b-b09a29620bbb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1520 microversion: 2.1 time: 0.751865 Aug 29 15:43:35.711528 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2082/3926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:34 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1520 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:35.718405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:35.718708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.720103 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-61c1168a-a1e6-4ec4-9885-15817d3495ca tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.688888 Aug 29 15:43:35.730116 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1845/3927] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:35 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:35.740109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:35.741450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:35.742440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:35.748855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.749614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.749780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.750697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.750869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.751484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.751940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.752512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.752727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.753148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.753569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.754181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.950964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.957141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.962524 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d8385249-e732-4d3d-8102-1e7c5ef4c5a2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.230152 Aug 29 15:43:35.973502 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1846/3928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:35 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:35.978359 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ef18903-4b6e-42de-ab60-274fd247da04 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1276 microversion: 2.1 time: 0.263658 Aug 29 15:43:35.993878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2083/3929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:35 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:36.735314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:36.735923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:36.748046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.748531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.749175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:36.750281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.750468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:36.752813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.755998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.756843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.764985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.767665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.768134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.769180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.769780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.770409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.813689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:37.011352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.020660 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d5fa3fdb-a88d-4a73-a4ee-793f73ab19c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1505 microversion: 2.1 time: 0.290477 Aug 29 15:43:37.037148 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1847/3930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:36 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:37.044280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:37.045145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:37.051297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.051983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.052594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.053638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.054267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.054866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.450090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.462440 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9b7ce8da-c954-47e0-905e-cc08a02b82f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.422401 Aug 29 15:43:37.462940 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1848/3931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:37 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:37.468540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:37.469320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:37.475345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.475999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.476634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.477548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.478002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.478478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.715329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.725310 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dfa9487a-5b4c-4a97-95ed-4bf0cefbc6ae tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.261064 Aug 29 15:43:37.726150 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1849/3932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:37 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:37.730866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:37.732070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:37.737905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.739023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.739468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.740167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.744125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.744481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.748130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.760501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.762084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.764070 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7bd5b85-8f0e-4913-aabc-21e83c88fbd6 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 1.020365 Aug 29 15:43:37.765434 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2084/3933] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:36 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:37.956579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.966497 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79316cbf-7d0f-400b-820e-7b1db0fe5428 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 200 len: 1505 microversion: 2.1 time: 0.239085 Aug 29 15:43:37.967830 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1850/3934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:37 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:37.987974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:37.988508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:37.996259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.996966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.998140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.999004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.999931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.000079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.006685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:38.032090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:38.117266 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5bbe6e7b-eafc-4b98-8752-00c03fb62088 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 204 len: 0 microversion: 2.1 time: 0.132844 Aug 29 15:43:38.118478 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2085/3935] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:37 2022] DELETE /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:38.270826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-521798888", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "7d5edc68-181c-443f-aa2c-d6b433271f4e"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:38.328266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] validate_networks() for [('7d5edc68-181c-443f-aa2c-d6b433271f4e', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:38.484057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:38.484775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:38.491195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.491688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.492126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.493013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.493794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.494233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.730485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:38.730941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:38.731411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:38.731851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:38.732811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:38.741687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.742317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.742584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.743309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.743781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.744321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.770421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Getting quotas for project 0be795a7587c4c2c8e5d71a01f5ba732. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:38.775960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Getting quotas for user f1fd00311fa540658cfd4076c9a88976 and project 0be795a7587c4c2c8e5d71a01f5ba732. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:38.788860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:38.791306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:38.836712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ecad365-5624-407c-b23e-92a9a751d8b8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569614 Aug 29 15:43:38.844169 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1851/3936] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:43:38.844169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:38.844169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:38.851241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.851728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.852158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.852849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.853301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.853744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.891194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:38.948632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:39.067505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:39.080588 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ac596e4-8440-4cfa-b01d-1223cc08ecca tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.241845 Aug 29 15:43:39.081299 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1852/3937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:38 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:39.088796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:39.089626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:39.097029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.097665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.098195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.099091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.099763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.100247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.347786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:39.375983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:39.377779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:39.379121 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8a2d9e75-5503-4af2-ad4b-8c8de13206ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.296225 Aug 29 15:43:39.380172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:39.380795 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1853/3938] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:39 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:39.402205 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-88462a79-7183-468c-810d-61cf0f2cb7cb tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 0.922905 Aug 29 15:43:39.405438 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2086/3939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:38 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:39.405647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:39.405647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:39.424484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:39.430944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:39.431127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.431669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.432725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.433527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.434287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.435704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.445079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.447410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.447861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.448842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.449717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.450150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.520301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8239fba-c588-4108-9a59-06c4d7d6858d tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.115245 Aug 29 15:43:39.521544 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2087/3940] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:43:39 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:39.554535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:39.565844 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e0c3b08-45a8-4b09-8bf8-55ce2d855be1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1221 microversion: 2.1 time: 0.182385 Aug 29 15:43:39.567297 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1854/3941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:39 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:39.663283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:39.664261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:39.673784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.674716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.681967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.683001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.684782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.685405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.763150 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d44a289-20dc-495a-a6c8-a1dd4836b0c5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/c7d2f49a-ac16-4777-a3e2-c2815f6b7f10" status: 200 len: 194 microversion: 2.1 time: 0.104612 Aug 29 15:43:39.764281 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2088/3942] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Aug 29 15:43:39 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/c7d2f49a-ac16-4777-a3e2-c2815f6b7f10 => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:39.774469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:39.775046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:39.788998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.789744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.789972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.790676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.791131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.791556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.891739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-db74df2a-6dc7-4821-806f-6a9b9e200174 req-7398548f-34c0-4d27-b915-a417ea3000a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbb01f8-6816-4ccd-90e4-03666c8e02da", "tag": "012c7f0a-ac02-481b-be6f-54e0698c1162"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:39.914063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db74df2a-6dc7-4821-806f-6a9b9e200174 req-7398548f-34c0-4d27-b915-a417ea3000a2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.914459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db74df2a-6dc7-4821-806f-6a9b9e200174 req-7398548f-34c0-4d27-b915-a417ea3000a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.914898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db74df2a-6dc7-4821-806f-6a9b9e200174 req-7398548f-34c0-4d27-b915-a417ea3000a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.937756 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-db74df2a-6dc7-4821-806f-6a9b9e200174 req-7398548f-34c0-4d27-b915-a417ea3000a2 service nova] Creating event network-changed:012c7f0a-ac02-481b-be6f-54e0698c1162 for instance ddbb01f8-6816-4ccd-90e4-03666c8e02da on n-h1-854882-3 Aug 29 15:43:39.955244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-db74df2a-6dc7-4821-806f-6a9b9e200174 req-7398548f-34c0-4d27-b915-a417ea3000a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067832 Aug 29 15:43:39.955862 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2089/3943] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:43:40.026449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lazy-loading 'services' on Instance uuid 91f3144a-96a8-4482-aa17-c1de1bb09e07 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:40.103898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:40.104619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:40.121105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.122444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.123095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.123984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.124675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.125279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.126557 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8719ba5-0062-4374-bf99-06742bc8ba49 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/c7d2f49a-ac16-4777-a3e2-c2815f6b7f10" status: 202 len: 0 microversion: 2.1 time: 0.355199 Aug 29 15:43:40.128088 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1855/3944] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:43:39 2022] DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/c7d2f49a-ac16-4777-a3e2-c2815f6b7f10 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:43:40.410329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:40.412465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:40.441454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.442568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.444619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.446214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.447996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.449348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.789038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:40.804431 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd17c598-82e8-42f3-ae1d-16be52873c1c tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.704574 Aug 29 15:43:40.805363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2090/3945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:40 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:40.821407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:40.822166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:40.844384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.845295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.846122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.847065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.847703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.848325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:41.076886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:41.087409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:41.088859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:41.097053 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9240680c-a420-4469-9cf0-d4e2ce08de91 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.697677 Aug 29 15:43:41.102089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1856/3946] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:40 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:41.111006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:41.111887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:41.122575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:41.123066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:41.123500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:41.124198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:41.124645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:41.125072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:41.258404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:41.285709 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-26ca7fad-8820-4a2a-b943-247fe2efa29e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1275 microversion: 2.1 time: 0.178511 Aug 29 15:43:41.290828 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1857/3947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:41 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:41.304844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4635f201-8466-4dcd-afab-59b8ab141698 req-89f637d0-a236-4809-86ce-f2702a6f1d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1211bb4-7e89-4f66-bfb2-1627015fa0f5", "name": "network-vif-deleted", "tag": "de1fb09a-c070-4f6a-826b-d12923c4c7da"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:41.336305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4635f201-8466-4dcd-afab-59b8ab141698 req-89f637d0-a236-4809-86ce-f2702a6f1d53 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:41.338006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4635f201-8466-4dcd-afab-59b8ab141698 req-89f637d0-a236-4809-86ce-f2702a6f1d53 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:41.341435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4635f201-8466-4dcd-afab-59b8ab141698 req-89f637d0-a236-4809-86ce-f2702a6f1d53 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:41.373613 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4635f201-8466-4dcd-afab-59b8ab141698 req-89f637d0-a236-4809-86ce-f2702a6f1d53 service nova] Creating event network-vif-deleted:de1fb09a-c070-4f6a-826b-d12923c4c7da for instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 on n-h1-854882-3 Aug 29 15:43:41.386588 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4635f201-8466-4dcd-afab-59b8ab141698 req-89f637d0-a236-4809-86ce-f2702a6f1d53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093642 Aug 29 15:43:41.391676 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1858/3948] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:41.836137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:41.839147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:41.866747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:41.867264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:41.870074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:41.872440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:41.872957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:41.875358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:42.047626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:42.076764 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-22aaf5ea-88f2-44c8-9979-679009378805 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1505 microversion: 2.1 time: 1.262575 Aug 29 15:43:42.078608 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2091/3949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:40 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1505 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:42.127331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:42.127977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:42.158545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:42.162094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:42.162626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:42.164847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:42.169561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:42.170258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:42.440683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:42.449135 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e352754b-2eed-4d89-97a7-1d01a8da6440 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.622943 Aug 29 15:43:42.467497 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1859/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:41 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:42.476938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:42.481751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:42.493779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:42.495378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:42.496651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:42.501045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:42.502177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:42.502824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:42.844322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:42.863694 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b6ab4e8-1731-4771-88db-6cfc9c84cb11 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.394601 Aug 29 15:43:42.865021 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1860/3951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:42 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:43.071433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9a5108d0-05e1-4d6e-98a7-e31851caac5a req-f0489dfe-5e04-480b-ba6b-263329ec315f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d", "tag": "1d319702-e97a-4408-bdec-99dbaa1e432a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:43.095742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9a5108d0-05e1-4d6e-98a7-e31851caac5a req-f0489dfe-5e04-480b-ba6b-263329ec315f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.097318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9a5108d0-05e1-4d6e-98a7-e31851caac5a req-f0489dfe-5e04-480b-ba6b-263329ec315f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.098024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9a5108d0-05e1-4d6e-98a7-e31851caac5a req-f0489dfe-5e04-480b-ba6b-263329ec315f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.114104 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9a5108d0-05e1-4d6e-98a7-e31851caac5a req-f0489dfe-5e04-480b-ba6b-263329ec315f service nova] Creating event network-changed:1d319702-e97a-4408-bdec-99dbaa1e432a for instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d on n-h2-854882-3 Aug 29 15:43:43.120491 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9a5108d0-05e1-4d6e-98a7-e31851caac5a req-f0489dfe-5e04-480b-ba6b-263329ec315f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052464 Aug 29 15:43:43.121765 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1861/3952] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:43:43.128529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:43.129556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:43.146801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.147760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.149027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.149981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.150619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.151260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.420838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:43.444584 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b0f3cb1-42c5-4ccd-a2c5-65a39b6f29e1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1485 microversion: 2.1 time: 0.321146 Aug 29 15:43:43.467683 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1862/3953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:43 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1485 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:43.483310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:43.484981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:43.497970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.506262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.507025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.507778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.508361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.508793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.727319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:43.752728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:43.767935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:43.771027 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c4d750ae-79e4-4b37-8e95-0c840795af50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 1.649077 Aug 29 15:43:43.772767 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2092/3954] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:42 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:43.786953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-955188389", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:43.883595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] validate_networks() for [('eedcb164-b8b2-40f8-b59f-095516f56d72', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:44.388756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:44.408898 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7341a12-1958-4fa7-a03d-b951b650a24d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.929335 Aug 29 15:43:44.428720 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1863/3955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:43 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:44.445515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:44.446660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:44.474752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:44.475830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:44.479077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:44.480133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:44.480724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:44.483584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:44.964136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:44.989867 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4028225f-5236-41c6-87ee-7cd727d2121d tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.547377 Aug 29 15:43:44.990706 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1864/3956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:44 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:45.012106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:45.013033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:45.053198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.055153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.057134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.058542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.060612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.061064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.128304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:45.903084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:45.940779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:45.946482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:45.947712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-69cb3da8-613d-4851-9a03-1e078eebed05 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.946644 Aug 29 15:43:45.964742 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1865/3957] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:44 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:45.964742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-81fd1283-5b4e-4d58-8d9d-643d45c291ac req-6ec48223-7fed-45dd-a6bb-7f7a1941ffbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85f0c7f-3281-44a3-a112-f60842476a5d", "tag": "a8e6d8dc-f7c1-4959-b13c-841651abbea4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:45.983612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-81fd1283-5b4e-4d58-8d9d-643d45c291ac req-6ec48223-7fed-45dd-a6bb-7f7a1941ffbf service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.984086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-81fd1283-5b4e-4d58-8d9d-643d45c291ac req-6ec48223-7fed-45dd-a6bb-7f7a1941ffbf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.984509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-81fd1283-5b4e-4d58-8d9d-643d45c291ac req-6ec48223-7fed-45dd-a6bb-7f7a1941ffbf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.005694 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-81fd1283-5b4e-4d58-8d9d-643d45c291ac req-6ec48223-7fed-45dd-a6bb-7f7a1941ffbf service nova] Creating event network-changed:a8e6d8dc-f7c1-4959-b13c-841651abbea4 for instance d85f0c7f-3281-44a3-a112-f60842476a5d on n-h2-854882-3 Aug 29 15:43:46.020948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-81fd1283-5b4e-4d58-8d9d-643d45c291ac req-6ec48223-7fed-45dd-a6bb-7f7a1941ffbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064104 Aug 29 15:43:46.021606 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1866/3958] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:46.032084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.033724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:46.056955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.057626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.058074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.058814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.059383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.059805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.418147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.431922 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4bc2c3b8-0c27-43f0-a12d-6e28ef594e13 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.406389 Aug 29 15:43:46.433371 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1867/3959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:46.450536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.453826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:46.474559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.475059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.475494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.475821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:46.476461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:46.477101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:46.477547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:46.477964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:46.482135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.482717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.483311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.489518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.490037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.490484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.491282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.491820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.492540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.518853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Getting quotas for project 3f9940a1fec84128b318a5f80884447b. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:46.525899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Getting quotas for user 351e59b6021b44a29665281568960f8b and project 3f9940a1fec84128b318a5f80884447b. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:46.542659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:46.546947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:46.611764 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2429039e-72d6-43ae-a304-0859112576ed tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.828950 Aug 29 15:43:46.618876 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2093/3960] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:43:46.627090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55121807-d21d-4686-8a5d-13be4781860d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.627943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55121807-d21d-4686-8a5d-13be4781860d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:46.722766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-55121807-d21d-4686-8a5d-13be4781860d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.732203 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55121807-d21d-4686-8a5d-13be4781860d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1213 microversion: 2.1 time: 0.111990 Aug 29 15:43:46.750050 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2094/3961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:46.910699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.923386 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b11c46a2-0796-4aa1-8d8d-89db8e00fd20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.486151 Aug 29 15:43:46.924683 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1868/3962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:46.979346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.980065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:47.013648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.015357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.019869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.021409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.023498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.027439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.459147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:47.460037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:47.478144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.478665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.479111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.479840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.480299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.480726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.831849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:47.843513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-475f010e-cd0c-4186-acef-574c3949e214 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.386834 Aug 29 15:43:47.858591 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1869/3963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:47 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:47.873456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:47.882608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:47.900238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.904747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.905447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.906306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.907295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.909625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.039656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.056705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4520a3ad-fd42-4abb-b519-7b09a42f423a tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1209 microversion: 2.1 time: 0.193118 Aug 29 15:43:48.057489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1870/3964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:47 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:48.075981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:48.077785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:48.095044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.098670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.099118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.101159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.103481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.106487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.670365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.684546 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-81c07409-87ac-488c-9caf-713bbca809ec tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.618227 Aug 29 15:43:48.698813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1871/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:48 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:48.721278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.734019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.743786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.750274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-47559570-2123-4a55-b43c-ac6c4371e995 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 1.781511 Aug 29 15:43:48.761984 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2095/3966] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:48.869663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:48.870390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:48.873506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:48.886686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:48.901598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.903965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.905793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.907495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.910351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.910985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.086577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.087345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:49.101967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.102627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.104740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.108019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.108824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.109271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.128547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:49.142188 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-530058f7-9ef8-4e7c-ae65-5c5f06f5b5ec tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.273661 Aug 29 15:43:49.144558 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1872/3967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:48 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:49.263349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:49.272402 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8b007f9-237f-4fd2-b01d-d1c3ea344f7c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1265 microversion: 2.1 time: 0.192490 Aug 29 15:43:49.295248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2096/3968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:49.399573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.400011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:49.420705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.421219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.421696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.422415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.422877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.423308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.564872 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bccdae64-80f4-4373-a53d-f7cd59e24568 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/b9b3dc61-db07-40db-afd6-34ccd2193890" status: 200 len: 194 microversion: 2.1 time: 0.173229 Aug 29 15:43:49.565585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1873/3969] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/b9b3dc61-db07-40db-afd6-34ccd2193890 => generated 194 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:49.577115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.577747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:49.604504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.608134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.610153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.611284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.618138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.619082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.809230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lazy-loading 'services' on Instance uuid 91f3144a-96a8-4482-aa17-c1de1bb09e07 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:49.839057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1615433443", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": "none"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:49.944412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:49.945050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:49.945738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:49.946491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:49.947278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:49.974639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.976154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.977346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.978450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.979329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.980021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.995911 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-002193af-5a24-40a0-9c90-6f5cc97aaa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/b9b3dc61-db07-40db-afd6-34ccd2193890" status: 202 len: 0 microversion: 2.1 time: 0.423416 Aug 29 15:43:49.996891 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2097/3970] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:43:49 2022] DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments/b9b3dc61-db07-40db-afd6-34ccd2193890 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:43:50.007754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Getting quotas for project 7d8d815a02904e98a8345d0ff4a234db. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:50.008118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.009040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:50.016168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Getting quotas for user 021819f70ef84630b9e507283c2a50a8 and project 7d8d815a02904e98a8345d0ff4a234db. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:50.029660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.030510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.031159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.032077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.032723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.033343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.035592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:50.038316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:50.115511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:50.153838 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ad73731-1266-4995-9208-d98435e37282 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.565217 Aug 29 15:43:50.154518 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1874/3971] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:43:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:43:50.203172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.204198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:50.237873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.241438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.242967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.245561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.246042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.247956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.724574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.744624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa390444-d270-43b4-8368-a3b69615d342 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.746081 Aug 29 15:43:50.759265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.763171 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2098/3972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:50.767489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.768942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.769915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-18232802-9c06-49f5-9ab9-8bd83e36d32e req-1f92ed46-9e19-4ec5-bc5c-af6fd945b0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbb01f8-6816-4ccd-90e4-03666c8e02da", "name": "network-vif-plugged", "status": "completed", "tag": "012c7f0a-ac02-481b-be6f-54e0698c1162"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:50.784139 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08203d26-7df2-4906-889e-2e36bb63d4dd tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.621527 Aug 29 15:43:50.794035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18232802-9c06-49f5-9ab9-8bd83e36d32e req-1f92ed46-9e19-4ec5-bc5c-af6fd945b0a6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.795638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18232802-9c06-49f5-9ab9-8bd83e36d32e req-1f92ed46-9e19-4ec5-bc5c-af6fd945b0a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.796384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-18232802-9c06-49f5-9ab9-8bd83e36d32e req-1f92ed46-9e19-4ec5-bc5c-af6fd945b0a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.806280 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1875/3973] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:50.817190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.819567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:50.823580 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-18232802-9c06-49f5-9ab9-8bd83e36d32e req-1f92ed46-9e19-4ec5-bc5c-af6fd945b0a6 service nova] Creating event network-vif-plugged:012c7f0a-ac02-481b-be6f-54e0698c1162 for instance ddbb01f8-6816-4ccd-90e4-03666c8e02da on n-h1-854882-3 Aug 29 15:43:50.835101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.835607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.836199 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-18232802-9c06-49f5-9ab9-8bd83e36d32e req-1f92ed46-9e19-4ec5-bc5c-af6fd945b0a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070263 Aug 29 15:43:50.838385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.839162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.839632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.839945 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2099/3974] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:50.845920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.877116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21924117-8a08-4e14-96b4-42f545a1e2b2 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.879036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21924117-8a08-4e14-96b4-42f545a1e2b2 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:51.021700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21924117-8a08-4e14-96b4-42f545a1e2b2 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:51.030541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21924117-8a08-4e14-96b4-42f545a1e2b2 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:51.032024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21924117-8a08-4e14-96b4-42f545a1e2b2 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:51.039410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21924117-8a08-4e14-96b4-42f545a1e2b2 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1281 microversion: 2.47 time: 0.196564 Aug 29 15:43:51.039951 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2100/3975] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:51.050830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.053767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:51.070903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.072213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.087802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.089632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.094106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.094884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.340252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:51.369981 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b0a3daa-e73d-453d-be2c-4ca0ca101dbe tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.558920 Aug 29 15:43:51.372584 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1876/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:51.520823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:51.557306 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3902d3ec-a4c7-4c03-b4b3-bbb2cbe5adc9 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1271 microversion: 2.1 time: 0.513025 Aug 29 15:43:51.558019 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2101/3977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1271 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:51.771559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.772691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:51.784734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.785232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.785704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.786421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.786877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.787302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.815343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.815978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:51.832206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.832824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.833150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.833902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.834364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.834807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.591015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.602040 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dc5aad5d-274b-4147-a55d-86a5a1810f92 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.839773 Aug 29 15:43:52.609952 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1877/3978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:52.618880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:52.619727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:52.635031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.638398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.643372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.644495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.645148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.645785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.712825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.727766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.729303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.730646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0530e3e-7904-4eba-b43c-defc2a7e5827 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.920428 Aug 29 15:43:52.732836 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2102/3979] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:52.741690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:52.749274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:52.760558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.763746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.764208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.764949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.765440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.765882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.799480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:52.821289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.834071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.839807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.843975 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e8989ce-f4a0-400f-b9df-782a859de3d5 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1333 microversion: 2.47 time: 0.232630 Aug 29 15:43:52.847308 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1878/3980] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1333 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:52.862206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:52.864030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:52.880458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.882490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.883972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.885533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.888163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.889457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.048032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:53.062685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cb875795-afb0-4c7f-8cc3-57f573e1ee2b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.324768 Aug 29 15:43:53.063934 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2103/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:53.080503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8089cbb7-8a80-4a5a-b53a-1762aebb01b0 req-4caa4ea1-2702-4bbb-8dcc-e4d61f34e4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d", "name": "network-vif-plugged", "status": "completed", "tag": "1d319702-e97a-4408-bdec-99dbaa1e432a"}, {"server_uuid": "d85f0c7f-3281-44a3-a112-f60842476a5d", "name": "network-vif-plugged", "status": "completed", "tag": "a8e6d8dc-f7c1-4959-b13c-841651abbea4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:53.097431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8089cbb7-8a80-4a5a-b53a-1762aebb01b0 req-4caa4ea1-2702-4bbb-8dcc-e4d61f34e4f4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.097918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8089cbb7-8a80-4a5a-b53a-1762aebb01b0 req-4caa4ea1-2702-4bbb-8dcc-e4d61f34e4f4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.098583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8089cbb7-8a80-4a5a-b53a-1762aebb01b0 req-4caa4ea1-2702-4bbb-8dcc-e4d61f34e4f4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.116997 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8089cbb7-8a80-4a5a-b53a-1762aebb01b0 req-4caa4ea1-2702-4bbb-8dcc-e4d61f34e4f4 service nova] Creating event network-vif-plugged:1d319702-e97a-4408-bdec-99dbaa1e432a for instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d on n-h2-854882-3 Aug 29 15:43:53.118134 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8089cbb7-8a80-4a5a-b53a-1762aebb01b0 req-4caa4ea1-2702-4bbb-8dcc-e4d61f34e4f4 service nova] Creating event network-vif-plugged:a8e6d8dc-f7c1-4959-b13c-841651abbea4 for instance d85f0c7f-3281-44a3-a112-f60842476a5d on n-h2-854882-3 Aug 29 15:43:53.126402 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8089cbb7-8a80-4a5a-b53a-1762aebb01b0 req-4caa4ea1-2702-4bbb-8dcc-e4d61f34e4f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060903 Aug 29 15:43:53.127759 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2104/3982] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:53.301515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6240ac33-a6dc-4f47-84e5-c69f96459178 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Action: 'create', calling method: .version_select at 0x7fb0e26b2ee0>, body: {"keypair": {"name": "tempest-keypair-1475769980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF75ECSdxiyrziO/UgCalSlF1URklNh8BVXn9r4ywsHPjFRqqB6RPTM0cJ+A58iEWhRsTbpL5flJFAYLFsUWGz7FJS+7smpU+JuJDupXORTWnA+EGW6rshzGePBO1o3nfg=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:53.322589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:53.364037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6240ac33-a6dc-4f47-84e5-c69f96459178 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Getting quotas for project d74479e5a17b45fa978b66de4518af3b. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:53.381642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6240ac33-a6dc-4f47-84e5-c69f96459178 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Getting quotas for user 2b12d5ec1e554d2593d349583fa19691 and project d74479e5a17b45fa978b66de4518af3b. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:53.457653 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6240ac33-a6dc-4f47-84e5-c69f96459178 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328050 Aug 29 15:43:53.466530 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2105/3983] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:43:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:53.636603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.637542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:53.649328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.653876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.656344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.657399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.658021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.659676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.708354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:53.724004 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f86af14d-7106-42e9-a23e-442f07a23495 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.873136 Aug 29 15:43:53.727681 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1879/3984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:53.760081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.760784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:53.785764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.787197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.788985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.790195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.795081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.796085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.164858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.186272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.191815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.196076 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a760e7e-b53d-4021-a236-d2c611d48b1a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.440991 Aug 29 15:43:54.197634 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1880/3985] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:54.222313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.226202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:54.240836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.241418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.247286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.248132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.249367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.250077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.250742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.263416 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f7cef39b-27ef-4d1a-b861-de5a6699a7e3 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.621772 Aug 29 15:43:54.264937 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2106/3986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:54.281578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.282653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:54.291389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.292583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.293871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.295405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.296092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.296708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.367982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.379917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.381732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.383529 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-50969f68-bdcf-4930-8ee7-1be02895546c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1339 microversion: 2.47 time: 0.182096 Aug 29 15:43:54.384690 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1881/3987] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:54.687708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-979a938c-ca88-4555-bf5e-8e95dd1b92da req-15119b51-57ae-4cf8-8ec2-9492089981a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d8a297-2bcb-4fde-bee5-a5f478fafdb5", "tag": "7d2e90dc-a34f-437b-8919-e55403d95dad"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:54.710573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-979a938c-ca88-4555-bf5e-8e95dd1b92da req-15119b51-57ae-4cf8-8ec2-9492089981a7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.711219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-979a938c-ca88-4555-bf5e-8e95dd1b92da req-15119b51-57ae-4cf8-8ec2-9492089981a7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.711587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-979a938c-ca88-4555-bf5e-8e95dd1b92da req-15119b51-57ae-4cf8-8ec2-9492089981a7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.734507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-979a938c-ca88-4555-bf5e-8e95dd1b92da req-15119b51-57ae-4cf8-8ec2-9492089981a7 service nova] Creating event network-changed:7d2e90dc-a34f-437b-8919-e55403d95dad for instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 on n-h1-854882-3 Aug 29 15:43:54.748911 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-979a938c-ca88-4555-bf5e-8e95dd1b92da req-15119b51-57ae-4cf8-8ec2-9492089981a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061842 Aug 29 15:43:54.749611 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1882/3988] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:43:54.760479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.761285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:54.779723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.782274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.783226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.783835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.784765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.785500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.786581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.798199 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db40d2ce-f9c4-4aaa-9aab-2605bcc1fde5 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1318 microversion: 2.1 time: 0.528292 Aug 29 15:43:54.813056 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2107/3989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:55.042087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:55.045344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:55.056542 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2e98a309-bbfe-4390-a9f1-6a70a0c50b81 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.304663 Aug 29 15:43:55.070085 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1883/3990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:55.224232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.224869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:55.240160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.242217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.242881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.245914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.246443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.246899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.285636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.286358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:55.298639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.299360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.300010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.300914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.301631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.302298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.774063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:55.787144 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9bbc9486-f231-47b1-859d-30419ce00603 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1317 microversion: 2.1 time: 0.505419 Aug 29 15:43:55.790675 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1884/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:55.804597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.805749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:55.838578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.840593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.841598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.847116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.848260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.848792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.864488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:55.879834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:55.881295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:55.882513 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dc85b445-0c02-4184-8c8b-baae82ef9862 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.663283 Aug 29 15:43:55.889171 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2108/3992] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:55.903204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.906715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:55.918087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.920105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.923917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.926101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.928239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.929724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.052320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.065451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.070414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.078112 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b1d0e220-5ea9-46ea-93b8-fe7131beb6c4 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1339 microversion: 2.47 time: 0.284624 Aug 29 15:43:56.078895 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1885/3993] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:56.090172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.090807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:56.110060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.112936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.113938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.115547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.117988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.118673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.182519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.204618 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-58bdaebd-9d28-4b07-910a-4a5de2f758f9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 200 len: 1507 microversion: 2.1 time: 0.314151 Aug 29 15:43:56.214241 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2109/3994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:56.234471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.235296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:56.269494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.275860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.276575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.277573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.279539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.280179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.501612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:56.690218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.700729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2493461f-8651-4661-ab57-0a54c0286abf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.619728 Aug 29 15:43:56.701893 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1886/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:56.824439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.826708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:56.846392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.848144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.850429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.851670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.853618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.854063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.916744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.948600 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56925e13-d3f7-4c6a-be93-71c509ebb875 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da" status: 200 len: 1507 microversion: 2.1 time: 0.711794 Aug 29 15:43:56.951585 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2110/3996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da => generated 1507 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:56.977491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.985942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.028000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.028542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.028995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.031419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.033193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.037350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.411906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.423869 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-138d6599-1c8a-4113-9828-b7d4a241c1b7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1507 microversion: 2.1 time: 0.614952 Aug 29 15:43:57.424474 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1887/3997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.449005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.450133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.456542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.457287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.457964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.458891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.459522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.461115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.488627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.498013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:57.510033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.511776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.518594 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1553dccb-f6a6-4a13-a992-6d272043e17b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.559722 Aug 29 15:43:57.519761 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2111/3998] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:57.524894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.529751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.549883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.550324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.550765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.551491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.552267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.552702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.631223 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2339b768-83ff-45d7-9234-e58a6e0cc2e9 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da" status: 204 len: 0 microversion: 2.1 time: 0.191697 Aug 29 15:43:57.631821 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1888/3999] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:57 2022] DELETE /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:57.641255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.642329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.649108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.650038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.650831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.651761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.652986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.653708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.673779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.685145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.687321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.688551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1180e254-db65-4f8b-973d-dd9a821d8b40 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1360 microversion: 2.47 time: 0.167475 Aug 29 15:43:57.689561 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2112/4000] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:57.709468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.710290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.721780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.722362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.722897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.723714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.724419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.724917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.771741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:57.866977 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7b5b85ed-221e-42db-9d96-d3d9b5415687 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 204 len: 0 microversion: 2.1 time: 0.175323 Aug 29 15:43:57.871652 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2113/4001] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:57 2022] DELETE /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:57.879131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1650124488"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:57.882735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.894754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.895403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.895856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.896876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.897045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.897554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.897956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.910794 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b2de7b41-2448-452a-b4fc-eef4b98c2513 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1507 microversion: 2.1 time: 0.273197 Aug 29 15:43:57.911930 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1889/4002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.917795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.919207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.926183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.926855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.927601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.928519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.929332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.930323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.127996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:58.136573 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b47c101-a285-46a7-9a94-f8eaf6421215 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.223459 Aug 29 15:43:58.138083 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1890/4003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.143871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-579585919", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1e64f73e-f89b-47cd-b940-ca5327066eff"}], "security_groups": [{"name": "tempest-securitygroup--988901444"}], "key_name": "tempest-keypair-1475769980", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:58.157036 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4309cc84-13ba-432d-ad91-e1be828fdcd7 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "POST /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078/action" status: 202 len: 52 microversion: 2.47 time: 0.283181 Aug 29 15:43:58.157727 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2114/4004] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:43:57 2022] POST /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078/action => generated 52 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:43:58.168824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.169604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.175866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.176356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.176796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.177521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.177990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.178411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.274708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] validate_networks() for [('1e64f73e-f89b-47cd-b940-ca5327066eff', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:58.357209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:58.367049 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6928d664-b51f-4c96-939c-599643cc2430 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da" status: 200 len: 1513 microversion: 2.1 time: 0.207350 Aug 29 15:43:58.368207 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2115/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.384089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:58.388030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.395442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.395981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.396374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.397583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.398252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.398978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.480013 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9fe22526-a019-49f4-a02c-2d170dd9e73b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "PUT /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1079 microversion: 2.1 time: 0.110713 Aug 29 15:43:58.485538 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2116/4006] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:43:58 2022] PUT /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1079 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.490322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.493857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.502265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.503367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.503810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.504525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.504979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.505440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.539733 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fec27b48-4cdd-4267-9e48-5acd79154424 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057659 Aug 29 15:43:58.540357 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2117/4007] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:43:58.546987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.547711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.553967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.554460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.554986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.555994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.556527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.556964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.561460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:58.586421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:58.693979 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8da62732-a7bf-4110-ac46-fb879ef7f66a tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 204 len: 0 microversion: 2.47 time: 0.152052 Aug 29 15:43:58.695441 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2118/4008] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:43:58 2022] DELETE /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:43:58.704108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.706408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.715620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.717314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.718007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.718909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.719676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.720314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.802459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Getting quotas for project d74479e5a17b45fa978b66de4518af3b. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:58.808598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Getting quotas for user 2b12d5ec1e554d2593d349583fa19691 and project d74479e5a17b45fa978b66de4518af3b. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:58.835029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:58.835832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:58.836494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:58.837109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:58.837897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:58.849873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.850892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.851511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.852410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.853028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.853654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.873161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:58.876154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Getting quotas for project d74479e5a17b45fa978b66de4518af3b. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:58.882752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Getting quotas for user 2b12d5ec1e554d2593d349583fa19691 and project d74479e5a17b45fa978b66de4518af3b. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:58.883423 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a7ed2f35-2c61-4693-a066-7f0dabac5cff tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1505 microversion: 2.1 time: 0.186401 Aug 29 15:43:58.884426 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2119/4009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.891503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.892154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.898867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.899361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.899805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.900618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.901301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.901829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.902063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:58.905754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:58.965440 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24f89921-38ce-4bb1-9c5a-c940093d34a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825807 Aug 29 15:43:58.972862 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1891/4010] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:43:58.978879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.982362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.990344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.991402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.992096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.993195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.993929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.995546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.053668 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-405ad0cf-64c8-4030-8ad0-2f9dd5acb692 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078994 Aug 29 15:43:59.059920 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1892/4011] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:43:59.071707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.073651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.094308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.094805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.095241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.095950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.096400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.099466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.158704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.169745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.171529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.173046 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e222f904-6712-47ca-a669-c1f9753cead3 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.287801 Aug 29 15:43:59.174171 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2120/4012] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.227117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.245318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.256963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.258844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.260211 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-977a14dc-5ebf-496a-831f-8881d139053c tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1366 microversion: 2.47 time: 0.201733 Aug 29 15:43:59.260775 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1893/4013] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:59.266320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6100811-62bb-43a1-8feb-d7c699b5300a tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.267083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a6100811-62bb-43a1-8feb-d7c699b5300a tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.328905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a6100811-62bb-43a1-8feb-d7c699b5300a tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.337671 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6100811-62bb-43a1-8feb-d7c699b5300a tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1269 microversion: 2.1 time: 0.075655 Aug 29 15:43:59.349414 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1894/4014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1269 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.352077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.352700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.380014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.382368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.383279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.385379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.386568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.387296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.404136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.416757 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3b57dbd5-584d-4824-a621-56a71fae65c1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1505 microversion: 2.1 time: 0.239515 Aug 29 15:43:59.419869 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2121/4015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.446430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.448807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.461649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.462967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.463789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.465502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.466218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.467065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.510151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:59.665717 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ca89864-7d26-4bd1-bd50-f990b27c7481 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 204 len: 0 microversion: 2.1 time: 0.244165 Aug 29 15:43:59.667506 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2122/4016] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:59 2022] DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:59.681008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.682431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.693868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.694413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.694858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.695580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.696047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.696625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.844053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.855490 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a2055ec-4c87-4a9b-a8b4-cf3187debc3c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.512236 Aug 29 15:43:59.856788 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1895/4017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.862784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:59.865956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.872919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.873671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.874559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.875785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.876481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.877092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.916235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.927094 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb5786f4-f122-49a5-b2b8-a287f7dc3f9d tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da" status: 200 len: 1513 microversion: 2.1 time: 0.257227 Aug 29 15:43:59.927692 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2123/4018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.934802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.935422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.951632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.951632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.952080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.952798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.953259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.954087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.998466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:00.000301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:00.000795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:00.001211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:00.001804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:00.117996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.131391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.131878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.136781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.140231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.140981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.142751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.228583 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-99610e04-c638-427a-8373-8cb3b80fec3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "POST /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d/action" status: 202 len: 1111 microversion: 2.1 time: 0.368107 Aug 29 15:44:00.229278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1896/4019] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:43:59 2022] POST /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d/action => generated 1111 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:44:00.242200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.247937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.248650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.255303 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f4cc590-2cba-4728-bb24-2bb71a86aa7b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1673 microversion: 2.1 time: 0.326457 Aug 29 15:44:00.256808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2124/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1673 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:00.274280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.277020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.277596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.278113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.278834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.279288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.279855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.282103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.297047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.297958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.298407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.299133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.299598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.302866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.744684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.757101 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dffc3c75-d874-460f-8042-88e34de9679e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.499179 Aug 29 15:44:00.758143 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2125/4021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:00.763023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.765995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.788011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.788523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.788975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.790792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.791308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.791754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.942406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.988718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.990329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.991578 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0cae2bb-b0aa-4e0b-9cc0-86f49c3e9335 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1366 microversion: 2.47 time: 0.232412 Aug 29 15:44:00.992217 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2126/4022] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:01.025405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.026208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.071884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.074113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.075199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.076895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.078453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.080452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.180261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.200610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.209674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.214175 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac167e79-e90a-4146-a906-1d10532601ad tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.981593 Aug 29 15:44:01.215107 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1897/4023] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:01.229874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.231322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.248263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.249064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.249825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.250700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.252359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.253051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.283541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:01.342713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.352542 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63cc510f-ba3a-4c9f-8d47-62e121443b87 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1321 microversion: 2.1 time: 0.358986 Aug 29 15:44:01.356244 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2127/4024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.372579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.375493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.393287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.394005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.394596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.395706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.396339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.396944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.523396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.528600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.531903 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-384408c8-ce60-4648-bb17-d2ca0f77a3f2 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.307988 Aug 29 15:44:01.539779 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1898/4025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.540642 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d7e11fd-bfee-4adc-8ca7-373977fd225b tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da" status: 200 len: 1303 microversion: 2.1 time: 0.174890 Aug 29 15:44:01.555055 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2128/4026] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.558466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-abd7f165-9f93-4484-901e-48b6305138d2 req-bd721aa4-922a-4134-9a3c-7e1d318ca91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d", "name": "network-vif-deleted", "tag": "1d319702-e97a-4408-bdec-99dbaa1e432a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:01.563016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4e9177cd-e935-40a0-a261-802fe1672840 req-40fd3df8-3b15-4112-a7c6-9f61193a7e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbb01f8-6816-4ccd-90e4-03666c8e02da", "name": "network-vif-deleted", "tag": "012c7f0a-ac02-481b-be6f-54e0698c1162"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:01.570057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-abd7f165-9f93-4484-901e-48b6305138d2 req-bd721aa4-922a-4134-9a3c-7e1d318ca91c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.571506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-abd7f165-9f93-4484-901e-48b6305138d2 req-bd721aa4-922a-4134-9a3c-7e1d318ca91c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.572128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-abd7f165-9f93-4484-901e-48b6305138d2 req-bd721aa4-922a-4134-9a3c-7e1d318ca91c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.576351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e9177cd-e935-40a0-a261-802fe1672840 req-40fd3df8-3b15-4112-a7c6-9f61193a7e25 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.576738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e9177cd-e935-40a0-a261-802fe1672840 req-40fd3df8-3b15-4112-a7c6-9f61193a7e25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.577320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e9177cd-e935-40a0-a261-802fe1672840 req-40fd3df8-3b15-4112-a7c6-9f61193a7e25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.588915 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-abd7f165-9f93-4484-901e-48b6305138d2 req-bd721aa4-922a-4134-9a3c-7e1d318ca91c service nova] Creating event network-vif-deleted:1d319702-e97a-4408-bdec-99dbaa1e432a for instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d on n-h2-854882-3 Aug 29 15:44:01.591445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4e9177cd-e935-40a0-a261-802fe1672840 req-40fd3df8-3b15-4112-a7c6-9f61193a7e25 service nova] Creating event network-vif-deleted:012c7f0a-ac02-481b-be6f-54e0698c1162 for instance ddbb01f8-6816-4ccd-90e4-03666c8e02da on n-h1-854882-3 Aug 29 15:44:01.595181 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-abd7f165-9f93-4484-901e-48b6305138d2 req-bd721aa4-922a-4134-9a3c-7e1d318ca91c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053413 Aug 29 15:44:01.596126 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1899/4027] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:01.599009 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4e9177cd-e935-40a0-a261-802fe1672840 req-40fd3df8-3b15-4112-a7c6-9f61193a7e25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041133 Aug 29 15:44:01.599808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2129/4028] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:01.602665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.603433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.610582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.611186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.611685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.612441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.613071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.613550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.727277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1681598d-2b45-4709-a33f-7176a51c3960 req-0edaf10c-49a4-42ab-a0ba-427a8c628517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d8a297-2bcb-4fde-bee5-a5f478fafdb5", "name": "network-vif-plugged", "status": "completed", "tag": "7d2e90dc-a34f-437b-8919-e55403d95dad"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:01.751461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1681598d-2b45-4709-a33f-7176a51c3960 req-0edaf10c-49a4-42ab-a0ba-427a8c628517 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.752135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1681598d-2b45-4709-a33f-7176a51c3960 req-0edaf10c-49a4-42ab-a0ba-427a8c628517 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.756070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1681598d-2b45-4709-a33f-7176a51c3960 req-0edaf10c-49a4-42ab-a0ba-427a8c628517 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.775026 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1681598d-2b45-4709-a33f-7176a51c3960 req-0edaf10c-49a4-42ab-a0ba-427a8c628517 service nova] Creating event network-vif-plugged:7d2e90dc-a34f-437b-8919-e55403d95dad for instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 on n-h1-854882-3 Aug 29 15:44:01.780502 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1681598d-2b45-4709-a33f-7176a51c3960 req-0edaf10c-49a4-42ab-a0ba-427a8c628517 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059027 Aug 29 15:44:01.781260 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2130/4029] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:01.786653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.787397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.795107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.795597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.796033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.796741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.797710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.797710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.981074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.989692 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0abda6f3-a6ff-4737-9a1a-1f8ea9ba739e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.207241 Aug 29 15:44:01.990530 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2131/4030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:02.002457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.013468 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0b684e06-ce47-4389-83d8-0cf6f446f35f tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1673 microversion: 2.1 time: 0.415908 Aug 29 15:44:02.014102 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1900/4031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1673 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:02.020558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.021600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:02.028749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.029291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.030161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.032816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.033088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.033992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.111823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.114234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:02.122798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.124282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.125511 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a5c5c38-2f5c-4aa2-8cdb-217de1842f54 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1366 microversion: 2.47 time: 0.109470 Aug 29 15:44:02.129168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2132/4032] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:02.243467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.244098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:02.251058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.251547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.251989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.252742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.253141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.253596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.378226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.378858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:02.386121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.386620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.388024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.388516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.388996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.389433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.461593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.470771 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-781b93aa-dedf-4670-af1b-c3240e40cb7e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1329 microversion: 2.1 time: 0.096566 Aug 29 15:44:02.472550 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2133/4033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:02.560728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.561437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:02.567505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.567987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.568680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.569413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.570113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.570610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.790967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.814511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.816244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.821901 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d4ef74fa-2344-4943-b3f6-624e065fbfe5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.582312 Aug 29 15:44:02.822513 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1901/4034] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:02.838016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.838938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:02.849264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.853052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.857174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:02.857897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.858433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.859009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.859633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.882140 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0426c9f3-66ce-4911-bba3-1430b8ab5128 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.325330 Aug 29 15:44:02.886139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2134/4035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:02.920027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.920604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.921105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.921590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lazy-loading 'fault' on Instance uuid ddbb01f8-6816-4ccd-90e4-03666c8e02da {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:02.999610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84feafb1d3ef4704a583d08c2e17b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02b576809484d8ba672697987f1447c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.008117 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7081f261-e0ff-44c2-94be-bdb7939b40de tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da" status: 200 len: 1308 microversion: 2.1 time: 0.182680 Aug 29 15:44:03.009053 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1902/4036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:03.025151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.025756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:03.033578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.034069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.034532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.034630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.035228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:03.035322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.035680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.036104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.041716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.042838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.043285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.044121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.044445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.044862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.179039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.187880 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fac19626-145c-432b-a329-0c14c892ec9c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.181563 Aug 29 15:44:03.188473 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2135/4037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:03.193470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.194097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:03.200897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.201410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.202007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.202890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.203487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.203920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.271514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.280571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.282034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.283594 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8970aadb-1cbb-4670-8228-04a69ae57cf1 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1366 microversion: 2.47 time: 0.094186 Aug 29 15:44:03.284207 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2136/4038] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:03.383467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.391886 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-84ef56ec-474f-4052-b676-89cb49fc26ca tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1673 microversion: 2.1 time: 0.361941 Aug 29 15:44:03.392471 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1903/4039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1673 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:03.492305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.492924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:03.494827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:03.501457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.501951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.502388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.503089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.503536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.504118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.571823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.579765 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-02321f10-b2f9-4776-b8ba-5c16004b38fb tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1327 microversion: 2.1 time: 0.091547 Aug 29 15:44:03.580356 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2137/4040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:03.854233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.855056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:03.867516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.868008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.868475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.869185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.869724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.870147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.910766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.911408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:03.922533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.925687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.926262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.927209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.927888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.928381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.272657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.290490 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1ba1d581-add8-44dc-956e-f13780e7f830 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1313 microversion: 2.1 time: 0.380154 Aug 29 15:44:04.293708 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2138/4041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:04.321820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.326235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ddbb01f8-6816-4ccd-90e4-03666c8e02da] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.354890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.356626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.360791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.362529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.363092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.365435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.401531 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] HTTP exception thrown: Instance ddbb01f8-6816-4ccd-90e4-03666c8e02da could not be found. Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Request method failure captured: Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da HTTP/1.1 Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN5_crGoymkUmP79fXqZNO0PnNjTvZ2Tz9TAHf9anyC3WW44gekVvWkOKWTkyRQ7FQGBxrnz9lxQt6tI3wQwfSfsnwa5wDzyFeUMP_hvuuq5cMkK30YW3cfSERPZ-7nu7dRgRj7R6PkOIysYzn2KcWA1oIOFU0SJ5_4VKCm25gTUniE Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b02b576809484d8ba672697987f1447c Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MultipleCreateTestJSON-312380165 Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b02b576809484d8ba672697987f1447c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b02b576809484d8ba672697987f1447c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b02b576809484d8ba672697987f1447c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b02b576809484d8ba672697987f1447c"}]}] Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MultipleCreateTestJSON-312380165 Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b02b576809484d8ba672697987f1447c Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MultipleCreateTestJSON-312380165 Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MultipleCreateTestJSON-312380165-project Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 84feafb1d3ef4704a583d08c2e17b48c Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MultipleCreateTestJSON-312380165-project Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ddbb01f8-6816-4ccd-90e4-03666c8e02da could not be found. Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ddbb01f8-6816-4ccd-90e4-03666c8e02da'} Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbb01f8-6816-4ccd-90e4-03666c8e02da could not be found. Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbb01f8-6816-4ccd-90e4-03666c8e02da could not be found. Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:04.405899 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:04.409554 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:04.409554 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:04.409554 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:04.409554 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:04.409554 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:04.409554 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbb01f8-6816-4ccd-90e4-03666c8e02da could not be found. Aug 29 15:44:04.409554 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:04.412762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Returning 404 to user: Instance ddbb01f8-6816-4ccd-90e4-03666c8e02da could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:04.415585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cdda84e7-5ad5-4a76-be7d-57a6ecb51186 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da" status: 404 len: 111 microversion: 2.1 time: 0.120796 Aug 29 15:44:04.418876 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2139/4042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/ddbb01f8-6816-4ccd-90e4-03666c8e02da => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:04.426574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.432914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-dcd7c343-bfb9-4c9e-ab7d-dd74e4fb3436 req-b02573a4-686c-4886-8bc3-45023f86fdba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f3144a-96a8-4482-aa17-c1de1bb09e07", "name": "network-vif-deleted", "tag": "b5f8bd97-43a7-478c-8f0b-026892efa88d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:04.443689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.445489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.448801 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d31e14d0-aaa5-4e6e-a80b-723d357c3b6e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.599216 Aug 29 15:44:04.450730 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1904/4043] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:04.454706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dcd7c343-bfb9-4c9e-ab7d-dd74e4fb3436 req-b02573a4-686c-4886-8bc3-45023f86fdba service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.459020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dcd7c343-bfb9-4c9e-ab7d-dd74e4fb3436 req-b02573a4-686c-4886-8bc3-45023f86fdba service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.461070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dcd7c343-bfb9-4c9e-ab7d-dd74e4fb3436 req-b02573a4-686c-4886-8bc3-45023f86fdba service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.462605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.464495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.468673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:04.481658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.482288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.485186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.486182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.486842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.489411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.490200 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-dcd7c343-bfb9-4c9e-ab7d-dd74e4fb3436 req-b02573a4-686c-4886-8bc3-45023f86fdba service nova] Creating event network-vif-deleted:b5f8bd97-43a7-478c-8f0b-026892efa88d for instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 on n-h2-854882-3 Aug 29 15:44:04.500921 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-dcd7c343-bfb9-4c9e-ab7d-dd74e4fb3436 req-b02573a4-686c-4886-8bc3-45023f86fdba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080560 Aug 29 15:44:04.505721 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2140/4044] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:04.517109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.518058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.521471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:04.531786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.532686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.533704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.534579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.535169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.535729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.612062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.612765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.613348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.613982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lazy-loading 'fault' on Instance uuid bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:04.705174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.714026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.723409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021819f70ef84630b9e507283c2a50a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8d815a02904e98a8345d0ff4a234db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.725225 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b67c28e-a414-4ea2-b783-cad1d3a9aa14 tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 200 len: 1371 microversion: 2.47 time: 0.216563 Aug 29 15:44:04.726030 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2141/4045] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:04.731648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.741511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.755147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.755962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.756598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.757561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.758301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.758966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.843709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.844379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.844926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.845536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lazy-loading 'fault' on Instance uuid 91f3144a-96a8-4482-aa17-c1de1bb09e07 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:04.916565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7b8433888412abc328cbc3aea214b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60f32d554f05b34f429706187490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.929001 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e2840b54-f7b4-400e-b5ab-1fc558077052 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 200 len: 1327 microversion: 2.1 time: 0.201525 Aug 29 15:44:04.935065 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2142/4046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:04.948093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.952119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] [instance: ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.965802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.973268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.973962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.975099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.978033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.978718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.010747 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] HTTP exception thrown: Instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d could not be found. Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Request method failure captured: Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d HTTP/1.1 Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN5_crGoymkUmP79fXqZNO0PnNjTvZ2Tz9TAHf9anyC3WW44gekVvWkOKWTkyRQ7FQGBxrnz9lxQt6tI3wQwfSfsnwa5wDzyFeUMP_hvuuq5cMkK30YW3cfSERPZ-7nu7dRgRj7R6PkOIysYzn2KcWA1oIOFU0SJ5_4VKCm25gTUniE Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b02b576809484d8ba672697987f1447c Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MultipleCreateTestJSON-312380165 Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b02b576809484d8ba672697987f1447c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b02b576809484d8ba672697987f1447c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b02b576809484d8ba672697987f1447c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b02b576809484d8ba672697987f1447c"}]}] Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MultipleCreateTestJSON-312380165 Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b02b576809484d8ba672697987f1447c Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MultipleCreateTestJSON-312380165 Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MultipleCreateTestJSON-312380165-project Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 84feafb1d3ef4704a583d08c2e17b48c Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MultipleCreateTestJSON-312380165-project Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d could not be found. Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d'} Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d could not be found. Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d could not be found. Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:05.014609 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.017683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:05.017683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:05.017683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:05.017683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:05.017683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:05.017683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d could not be found. Aug 29 15:44:05.017683 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.028289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] Returning 404 to user: Instance ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:05.029828 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-62f21d23-77a2-408f-aba4-d9c2ad97ee46 tempest-MultipleCreateTestJSON-312380165 tempest-MultipleCreateTestJSON-312380165-project] 10.222.0.16 "GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d" status: 404 len: 111 microversion: 2.1 time: 0.093538 Aug 29 15:44:05.034629 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2143/4047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/ac31b0fe-9cef-4ad9-a8d8-0b81e9183a0d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:05.039872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.040536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.060852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.061406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.062278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.062566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.063024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.063450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.565840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:05.574958 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a3a03df-edc8-4ac9-b94c-42bc9a98c914 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 1.122425 Aug 29 15:44:05.579996 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1905/4048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.587822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.591251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.608105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.608811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.609421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.612971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.613794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.614352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.836249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:05.848086 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-301279a5-5dc4-4b04-b341-ebdefb6ee73e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1498 microversion: 2.1 time: 0.266742 Aug 29 15:44:05.858962 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1906/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1498 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.876902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.877788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.880904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:05.890643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f53511c6-2ff4-4275-bfcc-29b2b53b9925 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1394 microversion: 2.1 time: 0.854365 Aug 29 15:44:05.901423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.901423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.901423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.901423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.901423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.902047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.903233 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2144/4050] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1394 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.911836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.912961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] [instance: bc1042ba-1d19-43a7-a01b-1cf2c0d6e078] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.920029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.921254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.921877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.923016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.923750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.924345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.943935 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] HTTP exception thrown: Instance bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 could not be found. Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Request method failure captured: Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 HTTP/1.1 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN61nCccR63kM3IqoWTF9uZi_fSARrViI-KjKb8UMKutNJ4vVvhbyWRWXoYMMVYgdxwbZIcV-khX9nQicMekmcA3gX23IidGrDTeroen4cl8pISWgCZvnJ8IOAP9QApdf28QZvoKhukH_qfaUXGGRObdwfdLxj6FBH9YvpuPz-CLsMM Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7d8d815a02904e98a8345d0ff4a234db Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAaction247Test-1059250262 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8d815a02904e98a8345d0ff4a234db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d8d815a02904e98a8345d0ff4a234db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d8d815a02904e98a8345d0ff4a234db", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8d815a02904e98a8345d0ff4a234db"}]}] Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAaction247Test-1059250262 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7d8d815a02904e98a8345d0ff4a234db Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAaction247Test-1059250262 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAaction247Test-1059250262-project Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 021819f70ef84630b9e507283c2a50a8 Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAaction247Test-1059250262-project Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 could not be found. Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'bc1042ba-1d19-43a7-a01b-1cf2c0d6e078'} Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 could not be found. Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 could not be found. Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.947634 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 could not be found. Aug 29 15:44:05.952037 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:05.954683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] Returning 404 to user: Instance bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:05.957980 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6c7df29f-3b70-49de-b1ee-026f4ce3a32d tempest-ServersAaction247Test-1059250262 tempest-ServersAaction247Test-1059250262-project] 10.222.0.16 "GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078" status: 404 len: 111 microversion: 2.47 time: 0.053529 Aug 29 15:44:05.969336 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2145/4051] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/bc1042ba-1d19-43a7-a01b-1cf2c0d6e078 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:44:05.978005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:05.980772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.988648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.989157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.989634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.990501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.990992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.991440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.029730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lazy-loading 'flavor' on Instance uuid 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:06.163178 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-82507491-27dd-4195-9b2a-0ba100501cdc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "POST /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5/action" status: 200 len: 32 microversion: 2.1 time: 0.189239 Aug 29 15:44:06.165079 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2146/4052] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:05 2022] POST /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:44:06.218892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.221822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.245795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.250484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.251175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.252823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.255138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.256527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.288440 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] HTTP exception thrown: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Request method failure captured: Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 HTTP/1.1 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN05VAioCZovOuNCysCh8aBQCefmZtc-cps-ZLlcvykr_eZmmakzs20hOfX56ysw6KyS-77LX3Ks2nBB5Mk9Gk5uKdKuVqMYpYsgGcDETgG2tPbMBJBBjf8hc5ZzQTcyVA0e1ciDR6tApdqNUH6xQ7zXS3BGvQSo3MuuVYYnu99uXOU Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/069a60f32d554f05b34f429706187490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_069a60f32d554f05b34f429706187490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}] Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 48a7b8433888412abc328cbc3aea214b Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '91f3144a-96a8-4482-aa17-c1de1bb09e07'} Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:06.290217 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.294204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:06.294204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:06.294204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:06.294204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:06.294204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:06.294204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:06.294204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.295619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Returning 404 to user: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:06.296632 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c69fba0-fc5e-4015-a550-7dcadf969edd tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 404 len: 111 microversion: 2.1 time: 0.129633 Aug 29 15:44:06.303573 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2147/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:06.313033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.314112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.322542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.323207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.323802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.325288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.326072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.326826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.411413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.426760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.428842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.430475 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb6c7124-9428-45be-9f34-d9c6c4a09596 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.558561 Aug 29 15:44:06.431475 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1907/4054] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:06.436621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-702bdd0f-3c80-4998-9907-d8a33bbf7da5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '.version_select at 0x7fb0eb55f3a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.484045 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-702bdd0f-3c80-4998-9907-d8a33bbf7da5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958706590" status: 202 len: 0 microversion: 2.1 time: 0.050517 Aug 29 15:44:06.484719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1908/4055] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958706590 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:06.606263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.607142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.615712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.616448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.617416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.618364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.619356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.619930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.766064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.795901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c61a1f1f-22a5-4c4f-96c8-e0776e0037bc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.483230 Aug 29 15:44:06.797652 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2148/4056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:06.917959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.919688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.936455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.940127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.940714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.945265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.946682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.947476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.025957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.038821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef211918-de6d-4bee-8206-09357541d086 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.438692 Aug 29 15:44:07.058768 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1909/4057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:07.382689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1e66a9bd-d529-4bf2-a9d5-729c769fa24a req-c2736de3-1844-4f7e-b1cd-cb7261a6cc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c3ccfa-c916-431c-a46a-31110b522c25", "tag": "ce6fc860-871d-41f3-bfc2-72933f8535d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:07.421416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1e66a9bd-d529-4bf2-a9d5-729c769fa24a req-c2736de3-1844-4f7e-b1cd-cb7261a6cc4e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.426404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1e66a9bd-d529-4bf2-a9d5-729c769fa24a req-c2736de3-1844-4f7e-b1cd-cb7261a6cc4e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.427350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1e66a9bd-d529-4bf2-a9d5-729c769fa24a req-c2736de3-1844-4f7e-b1cd-cb7261a6cc4e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.448873 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1e66a9bd-d529-4bf2-a9d5-729c769fa24a req-c2736de3-1844-4f7e-b1cd-cb7261a6cc4e service nova] Creating event network-changed:ce6fc860-871d-41f3-bfc2-72933f8535d3 for instance 36c3ccfa-c916-431c-a46a-31110b522c25 on n-h1-854882-3 Aug 29 15:44:07.466466 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1e66a9bd-d529-4bf2-a9d5-729c769fa24a req-c2736de3-1844-4f7e-b1cd-cb7261a6cc4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090528 Aug 29 15:44:07.468147 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1910/4058] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:07.477421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.479205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:07.497431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.498298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.499150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.504192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.507147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.508582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.968500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.983697 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-792da704-78fd-4f8e-a899-f67dcab58a63 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1394 microversion: 2.1 time: 1.070820 Aug 29 15:44:07.984377 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2149/4059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1394 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:07.995359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.996971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.015842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.017026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.018324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.019495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.021053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.022662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.029262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.045167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:08.047392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.060837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.063326 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8535382f-f450-49cc-8b29-a5ffd67dbce7 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.592909 Aug 29 15:44:08.064559 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1911/4060] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:07 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:08.075531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:08.076536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.086298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.087740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.089323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.090638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.091264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.093053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.404768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.429109 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40787d50-6f81-4dab-9ccf-7766e2717c04 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.363313 Aug 29 15:44:08.446520 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1912/4061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:08.700943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.721089 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2026ce84-e9f0-4da2-ae8e-bd247218be46 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.730067 Aug 29 15:44:08.726163 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2150/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:07 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:09.001517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:09.007454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.008337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.015734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.016450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.017173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.018518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.019138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.019760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.093932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.095121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.106649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.109865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.111312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.117437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.118159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.118777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.264597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.272879 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cfcb295c-c791-41b7-8d91-fe12b3fd2a2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1394 microversion: 2.1 time: 0.272222 Aug 29 15:44:09.273490 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1913/4063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1394 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:09.459335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.460396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.463667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=18 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:09.476776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.478832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.481013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.486831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.487593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.488548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.850715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.868070 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef940ccc-eeab-4b8a-a897-bd6181fa6646 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.413752 Aug 29 15:44:09.873436 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1914/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:09.888168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.889197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.898134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.899101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.899813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.900724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.901426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.902550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.111284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.122297 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-daf8dd69-391c-44f7-a56f-0acbab2fa2ea tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.250626 Aug 29 15:44:10.138824 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1915/4065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:10.407666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-475878212", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": "none"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:10.484589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:10.485100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:10.485853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:10.486720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:10.486720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:10.504851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.505815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.507048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.508122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.508746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.509351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.528772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Getting quotas for project 36a76c5994234bfab19624faf79dccc1. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:10.536140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Getting quotas for user 6f1f36c44f014a95b1a0ce8f43d0a0b2 and project 36a76c5994234bfab19624faf79dccc1. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:10.552787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:10.555045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:10.640012 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-267a153f-dfb6-4f3f-81f4-be90fe1273b0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.498879 Aug 29 15:44:10.641060 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1916/4066] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:44:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:44:10.645231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.651103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.651791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.659327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.659907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.660409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.661219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.661793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.662873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.727204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.735901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.748036 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81bb334c-9463-4998-bd49-b24a29ed020d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 1.655580 Aug 29 15:44:10.752111 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2151/4067] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:10.770557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b53c49a-6e84-4780-8e18-0e0e906fb401 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.773815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b53c49a-6e84-4780-8e18-0e0e906fb401 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.951932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.955931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:10.965638 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-517b6a19-a9c3-4747-9643-63662ed568bd tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1394 microversion: 2.1 time: 0.323286 Aug 29 15:44:10.978302 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1917/4068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1394 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:10.987684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.988904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.996417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.997204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.997843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.999039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.999908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.000524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.105059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b53c49a-6e84-4780-8e18-0e0e906fb401 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.131653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b53c49a-6e84-4780-8e18-0e0e906fb401 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.133380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b53c49a-6e84-4780-8e18-0e0e906fb401 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.141301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b53c49a-6e84-4780-8e18-0e0e906fb401 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8" status: 200 len: 1277 microversion: 2.47 time: 0.380218 Aug 29 15:44:11.142018 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2152/4069] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8 => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:11.150255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.150885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.191995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.192515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.192963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.193725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.197459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.202935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.272476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.293058 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-490b8b97-f9ea-4220-80f3-dde4670bc4a7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.313207 Aug 29 15:44:11.293693 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1918/4070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:11.298743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-330363949", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": "none"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:11.390443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:11.390806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:11.391349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:11.391844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:11.392526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:11.414062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.414662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.419165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.421453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.422110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.423855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.463868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Getting quotas for project 36a76c5994234bfab19624faf79dccc1. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:11.482787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Getting quotas for user 6f1f36c44f014a95b1a0ce8f43d0a0b2 and project 36a76c5994234bfab19624faf79dccc1. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:11.516970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:11.520814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:11.596744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0c3165e-a950-4a5e-9e53-ed6261591d3a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.301935 Aug 29 15:44:11.599275 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1919/4071] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:44:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:44:11.616600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ed30a43-d0da-467d-8c1a-d98dd04d229d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:11.625150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ed30a43-d0da-467d-8c1a-d98dd04d229d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.693432 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ed30a43-d0da-467d-8c1a-d98dd04d229d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "PUT /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 991 microversion: 2.47 time: 0.087493 Aug 29 15:44:11.694894 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1920/4072] 10.222.0.16 () {62 vars in 1297 bytes} [Mon Aug 29 15:44:11 2022] PUT /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:44:11.713447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-86805bb5-c572-47f4-9efe-560ad7177521 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.714914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-86805bb5-c572-47f4-9efe-560ad7177521 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.828077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86805bb5-c572-47f4-9efe-560ad7177521 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.839156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86805bb5-c572-47f4-9efe-560ad7177521 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.840714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86805bb5-c572-47f4-9efe-560ad7177521 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.842507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-86805bb5-c572-47f4-9efe-560ad7177521 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1277 microversion: 2.47 time: 0.133547 Aug 29 15:44:11.863171 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1921/4073] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:11.879895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.896037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.920253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.920700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.921145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.924061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.925219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.925747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.327062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.353673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.355493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.365064 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-98800c98-1482-4479-bf23-6d70f2296a3f tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.499885 Aug 29 15:44:12.367136 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1922/4074] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:12.374416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.375832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.384713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.385660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.387721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.388699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.390529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.391152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.406111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.428619 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dddd8f4c-514a-45a8-a7f6-19d2fa576544 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 1.282064 Aug 29 15:44:12.434293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2153/4075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:12.454376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.455005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.491250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.491751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.492188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.492911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.493366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.498048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.722448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.736925 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1865638d-1f1c-40f3-a567-cba6c7461b2c tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1394 microversion: 2.1 time: 0.368331 Aug 29 15:44:12.738256 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1923/4076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1394 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:12.880155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.881126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.888847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.889336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.889797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.890493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.890942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.891361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.099449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.111658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.123166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.128616 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c87cadb-5e86-4eee-a69b-ffe4af8408bf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1273 microversion: 2.47 time: 0.252972 Aug 29 15:44:13.131402 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1924/4077] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:13.319871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.392049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:13.392230 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-30dfbe85-47f5-4fa1-81f3-7aa59b807cfb tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.941396 Aug 29 15:44:13.392977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:13.394277 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2154/4078] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:13.423493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.424790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.426369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.429921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.430576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.431048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.466667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:13.467810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:13.491121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.491616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.492219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.493093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.493712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.506151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.045570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.079988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.089342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.092125 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1799def0-80dd-47b0-b70e-19d1975d9e07 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.703861 Aug 29 15:44:14.094679 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1925/4079] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:13 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:14.107307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:14.115490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:14.128826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.131772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.134010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.136255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.140005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.140696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.514415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.542915 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9692ea72-eef4-44a3-9acb-bc446261177c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 1.084025 Aug 29 15:44:14.562042 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2155/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:13 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:14.583237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-ad7dfeca-b272-4998-87a5-76f9830a4965 req-cac8c216-142b-4b05-986f-c2336d162ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c3ccfa-c916-431c-a46a-31110b522c25", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fc860-871d-41f3-bfc2-72933f8535d3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:14.655616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ad7dfeca-b272-4998-87a5-76f9830a4965 req-cac8c216-142b-4b05-986f-c2336d162ea5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.656130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ad7dfeca-b272-4998-87a5-76f9830a4965 req-cac8c216-142b-4b05-986f-c2336d162ea5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.656593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ad7dfeca-b272-4998-87a5-76f9830a4965 req-cac8c216-142b-4b05-986f-c2336d162ea5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.711510 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-ad7dfeca-b272-4998-87a5-76f9830a4965 req-cac8c216-142b-4b05-986f-c2336d162ea5 service nova] Creating event network-vif-plugged:ce6fc860-871d-41f3-bfc2-72933f8535d3 for instance 36c3ccfa-c916-431c-a46a-31110b522c25 on n-h1-854882-3 Aug 29 15:44:14.722671 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-ad7dfeca-b272-4998-87a5-76f9830a4965 req-cac8c216-142b-4b05-986f-c2336d162ea5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157849 Aug 29 15:44:14.725734 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2156/4081] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:14.752122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:14.757424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:14.774127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.778750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.781127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.782941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.787339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.788159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.021247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.091825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.095887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.108174 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd3daaa5-f8c7-40e9-82d9-e61ae6742cc4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1337 microversion: 2.47 time: 0.375108 Aug 29 15:44:15.132602 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2157/4082] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:14 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1337 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:15.165821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:15.166482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:15.199199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.199715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.200169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.203248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.203745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.204200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.578617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.602272 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f5b2eed3-7414-42e2-aba1-f9253c967dc6 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1394 microversion: 2.1 time: 1.503913 Aug 29 15:44:15.613481 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1926/4083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:14 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1394 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:15.630116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:15.630738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:15.647742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.648238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.648666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.649519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.649895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.650313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.822357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.838836 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d30a2557-152b-442e-8627-800380294c3f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.697680 Aug 29 15:44:15.840171 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2158/4084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:15 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:15.845636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:15.846545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:15.869925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.871817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.874047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.878351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.879059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.881959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.984280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.996687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.999082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.000867 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cbb2efcf-6338-4201-a429-533a7649d709 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.385671 Aug 29 15:44:16.001858 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1927/4085] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:15 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:16.154792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:16.155904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:16.164902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.166011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.176503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.177430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.177874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.178320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.256129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.267307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.269025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.270316 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b03f586-6317-4aa1-b47a-40d3946b094c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1335 microversion: 2.47 time: 0.121976 Aug 29 15:44:16.278594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1928/4086] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:16 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:16.390470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.402915 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e1fdc7d-41dc-4da6-b552-9a2eda778419 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.561463 Aug 29 15:44:16.421782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2159/4087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:15 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:16.645834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:16.647654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:16.661726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.663138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.665182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.666217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.667427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.669281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.863524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:16.864216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:16.869043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.874369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.875063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.878989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.879930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.880552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.881125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.885338 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a9a05c2-18cb-4e3a-bbb6-a527ce62f4da tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1394 microversion: 2.1 time: 0.247697 Aug 29 15:44:16.886086 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1929/4088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:16 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1394 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:17.026001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.026638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.034010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.034675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.035260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.036187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.036783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.037339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.249517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.262320 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e90b3f28-0533-49b2-9340-1f42de977093 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.400757 Aug 29 15:44:17.265732 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2160/4089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:16 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:17.290526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.295048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.296804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.301892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.303667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.305246 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3c2c2b59-6f37-41f6-bf4a-50543609b8a8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.284132 Aug 29 15:44:17.313923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.313923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.313923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.313923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.313923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.313923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.318043 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1930/4090] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:17.425790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.427295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.434497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.435314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.435951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.437308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.438001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.439635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.470087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.500192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.501973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.503402 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e0537b7-4267-4691-8049-9dfd83e3eb3b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1335 microversion: 2.47 time: 0.213599 Aug 29 15:44:17.505225 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2161/4091] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1335 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:17.629920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.639537 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3bed4baf-1e4a-4fd1-89b9-aab6e18a2e66 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.218369 Aug 29 15:44:17.640278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1931/4092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:17.868649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.869196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.876530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.877104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.877600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.878489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.879181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.879657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] HTTP exception thrown: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Request method failure captured: Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 HTTP/1.1 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN05VAioCZovOuNCysCh8aBQCefmZtc-cps-ZLlcvykr_eZmmakzs20hOfX56ysw6KyS-77LX3Ks2nBB5Mk9Gk5uKdKuVqMYpYsgGcDETgG2tPbMBJBBjf8hc5ZzQTcyVA0e1ciDR6tApdqNUH6xQ7zXS3BGvQSo3MuuVYYnu99uXOU Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/069a60f32d554f05b34f429706187490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_069a60f32d554f05b34f429706187490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}] Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 48a7b8433888412abc328cbc3aea214b Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '91f3144a-96a8-4482-aa17-c1de1bb09e07'} Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:17.902627 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Returning 404 to user: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd22e91c-8ffe-4b02-b700-5ab48d53251b tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 404 len: 111 microversion: 2.1 time: 0.041242 Aug 29 15:44:17.906478 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2162/4093] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:17 2022] DELETE /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:17.912153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.913641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.922630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.923107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.923248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 91f3144a-96a8-4482-aa17-c1de1bb09e07] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.923914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.924459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.925317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.926060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.926916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.934109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.935701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.936345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.937595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.939210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.939946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.965827 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] HTTP exception thrown: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Request method failure captured: Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 HTTP/1.1 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN05VAioCZovOuNCysCh8aBQCefmZtc-cps-ZLlcvykr_eZmmakzs20hOfX56ysw6KyS-77LX3Ks2nBB5Mk9Gk5uKdKuVqMYpYsgGcDETgG2tPbMBJBBjf8hc5ZzQTcyVA0e1ciDR6tApdqNUH6xQ7zXS3BGvQSo3MuuVYYnu99uXOU Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/069a60f32d554f05b34f429706187490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_069a60f32d554f05b34f429706187490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}] Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 48a7b8433888412abc328cbc3aea214b Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '91f3144a-96a8-4482-aa17-c1de1bb09e07'} Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:17.968228 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.972238 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:17.972238 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:17.972238 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:17.972238 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:17.972238 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:17.972238 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. Aug 29 15:44:17.972238 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:17.974629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Returning 404 to user: Instance 91f3144a-96a8-4482-aa17-c1de1bb09e07 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:17.975675 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5318c6ae-45f6-4926-a2a6-58fc1cf0a2f5 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07" status: 404 len: 111 microversion: 2.1 time: 0.059950 Aug 29 15:44:17.976739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2163/4094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/91f3144a-96a8-4482-aa17-c1de1bb09e07 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:18.123710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:18.132131 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cbe48fe-7666-4dca-81a7-622de840eb50 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1574 microversion: 2.1 time: 0.223771 Aug 29 15:44:18.140002 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1932/4095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1574 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:18.164954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.165716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.177008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.179553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.181086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.184780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.185595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.186187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.286472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.287598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.300400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.311184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.311820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.312571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.313439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.315178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.335572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60613df8-3137-4fd9-a97d-6d97d0dd3838 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176607 Aug 29 15:44:18.336398 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2164/4096] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:18.347537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.348331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.367358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.368113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.368714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.369668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.370319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.371531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.816822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:18.832053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:18.833636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:18.848153 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-408f5abc-1309-4306-915f-625b4c6f4721 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.510449 Aug 29 15:44:18.849019 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2165/4097] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:18.866151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.867091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.889713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.893661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.899255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.900582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.901769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.902974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.194846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.205916 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97d3464e-f3bf-485e-a2fe-8b098f159f53 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1516 microversion: 2.1 time: 0.925483 Aug 29 15:44:19.208400 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1933/4098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1516 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:19.215784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:19.216457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.224034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.224775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.225345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.226275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.226880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.227457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.461158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.478861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.491948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.493660 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eaedcdc7-811e-4c40-9eeb-77bec876a577 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1356 microversion: 2.47 time: 0.642308 Aug 29 15:44:19.494573 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2166/4099] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1356 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:19.520112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:19.523553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.532303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.533001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.533733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.541028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.541792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.543328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.643204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.654142 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b78c2a93-f2c0-4bb7-8687-b0a0dbb50383 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.443532 Aug 29 15:44:19.671756 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1934/4100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:19 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:19.762776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:19.763233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:19.763729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:19.764147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:19.764548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:19.875407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:19.876020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.893337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.893975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.894417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.897677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.902733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.904654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.930379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.955103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.960237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.963941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.964744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.965224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.969982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.026595 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-01c66490-de35-46b5-9fba-a4441e19c4aa tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "POST /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf/action" status: 202 len: 1078 microversion: 2.47 time: 0.512114 Aug 29 15:44:20.033469 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2167/4101] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:44:19 2022] POST /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf/action => generated 1078 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 29 15:44:20.084770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.095386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.109846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.114232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.116511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.117206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.117709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.121484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.127505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:20.294948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.324892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.328343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.331066 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0015b4ab-85b1-4a38-82a7-8518e918514d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.281949 Aug 29 15:44:20.333288 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2168/4102] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:20.346668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7d054a21-0fba-48e2-8825-fb4dd76837eb req-2745a26e-9a83-4595-9ca9-e718a8083520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-plugged", "status": "completed", "tag": "4325930b-2a2c-4ca8-bc3a-407ed5756ffb"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:20.359152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7d054a21-0fba-48e2-8825-fb4dd76837eb req-2745a26e-9a83-4595-9ca9-e718a8083520 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.359641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7d054a21-0fba-48e2-8825-fb4dd76837eb req-2745a26e-9a83-4595-9ca9-e718a8083520 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.360056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7d054a21-0fba-48e2-8825-fb4dd76837eb req-2745a26e-9a83-4595-9ca9-e718a8083520 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.374276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7d054a21-0fba-48e2-8825-fb4dd76837eb req-2745a26e-9a83-4595-9ca9-e718a8083520 service nova] Creating event network-vif-plugged:4325930b-2a2c-4ca8-bc3a-407ed5756ffb for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:20.379737 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7d054a21-0fba-48e2-8825-fb4dd76837eb req-2745a26e-9a83-4595-9ca9-e718a8083520 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044341 Aug 29 15:44:20.380700 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2169/4103] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:20.386200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.387325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.394813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.395967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.396441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.397775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.398637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.399977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.563460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.574475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.577566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.581347 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4055b627-9c4d-433e-95df-49474a599255 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.710669 Aug 29 15:44:20.591119 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1935/4104] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:19 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:20.682710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.683685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.693961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:20.702074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.703673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.704668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.707855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.709704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.710939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.078111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.100713 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6c41e40-5cf1-417a-93b0-dbbe8b524048 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1522 microversion: 2.1 time: 0.718656 Aug 29 15:44:21.101300 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2170/4105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1522 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.175585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.187689 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2863ee79-ba76-43d0-b5ba-d6e27a43c634 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.506668 Aug 29 15:44:21.188408 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1936/4106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.357797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.358538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.361142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:21.378130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.381958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.382541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.383420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.384138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.385538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.398152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.398777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.410205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.410693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.411131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.411834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.412280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.412702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.430980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:21.453895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:21.636074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.645598 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7fd0c8bc-1101-45f4-a81a-c8b18270c92d tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1574 microversion: 2.1 time: 0.253975 Aug 29 15:44:21.647000 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1937/4107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:21.653213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-56e8f0a4-60d5-41f1-9071-d08ed839fb62 req-a0d3a833-8e48-4b8e-8ac1-8bf1397195e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c3ccfa-c916-431c-a46a-31110b522c25", "tag": "ce6fc860-871d-41f3-bfc2-72933f8535d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:21.668234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-56e8f0a4-60d5-41f1-9071-d08ed839fb62 req-a0d3a833-8e48-4b8e-8ac1-8bf1397195e7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.669372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-56e8f0a4-60d5-41f1-9071-d08ed839fb62 req-a0d3a833-8e48-4b8e-8ac1-8bf1397195e7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.670015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-56e8f0a4-60d5-41f1-9071-d08ed839fb62 req-a0d3a833-8e48-4b8e-8ac1-8bf1397195e7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.670141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.686777 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-56e8f0a4-60d5-41f1-9071-d08ed839fb62 req-a0d3a833-8e48-4b8e-8ac1-8bf1397195e7 service nova] Creating event network-changed:ce6fc860-871d-41f3-bfc2-72933f8535d3 for instance 36c3ccfa-c916-431c-a46a-31110b522c25 on n-h1-854882-3 Aug 29 15:44:21.689770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.694302 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-56e8f0a4-60d5-41f1-9071-d08ed839fb62 req-a0d3a833-8e48-4b8e-8ac1-8bf1397195e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045238 Aug 29 15:44:21.696088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.697616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d51fb7d-80d8-4f50-ae06-d73f755b0a45 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.345089 Aug 29 15:44:21.701087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1938/4108] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:21.716325 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2171/4109] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:21.724545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.725528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.733941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.735168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.735847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.737074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.737836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.738525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.834798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=14 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:22.001189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.013634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.015799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.017299 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fbfb2026-f1ba-43a3-88ef-c972c39bb26e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.314649 Aug 29 15:44:22.018467 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1939/4110] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:22.129713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:22.130441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:22.146800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.148742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.149213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.149998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.150481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.151042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.215450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:22.216605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:22.228595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.229975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.233324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.234484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.235164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.236996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.469222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.478920 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7ba59ff1-fc44-44c3-a1b1-a243653a139e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1522 microversion: 2.1 time: 0.359738 Aug 29 15:44:22.479955 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2172/4111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:22 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:22.498508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-plugged", "status": "completed", "tag": "440a4984-7e6a-4508-be31-92e2d9617943"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-plugged", "status": "completed", "tag": "67328c13-10eb-4d44-bc25-a7da9c8b6192"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-plugged", "status": "completed", "tag": "7e22c1b9-cbff-42a9-a9de-626c90531ec3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:22.524945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.524945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.528702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.564668 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] Creating event network-vif-plugged:440a4984-7e6a-4508-be31-92e2d9617943 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:22.568501 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] Creating event network-vif-plugged:67328c13-10eb-4d44-bc25-a7da9c8b6192 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:22.569219 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] Creating event network-vif-plugged:7e22c1b9-cbff-42a9-a9de-626c90531ec3 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:22.571800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.581717 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef216b44-0ca5-42a8-9cdd-f6eb8b0c94fd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.371387 Aug 29 15:44:22.584939 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1940/4112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:22 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:22.590076 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5eb7bb9f-d3ca-4b5f-8ed1-d72cad6bbcda req-38da62c8-0144-4887-b8ef-a52009f82955 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090684 Aug 29 15:44:22.591468 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2173/4113] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:22.731337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:22.732065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:22.743531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.745071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.750045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.751547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.752214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.753078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.858103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.881365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.886608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.889973 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-48f05df2-1c1f-4f24-8dfa-1f486e3996f6 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.162557 Aug 29 15:44:22.890717 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1941/4114] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:22 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:23.049068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.050137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.060189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.062220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.062844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.063945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.064593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.065198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.500866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.510250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.536049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.536872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.537555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.539922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.544969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.547343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.720353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.731135 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0089540b-b672-4fb7-8aa1-b7d53e3ac76f tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1522 microversion: 2.1 time: 0.234168 Aug 29 15:44:23.732107 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1942/4115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:23.737969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.738782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.746985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.748139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.748962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.749927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.750539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.751284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.880872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.895290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.896789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.904320 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-657a002b-04bd-4b4a-897a-a97be7815b26 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.863806 Aug 29 15:44:23.905168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2174/4116] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:23.924302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.925031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.926362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.932813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.933349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.933834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.936433 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f37fb13a-d96d-4cec-a184-270aad00659c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.202107 Aug 29 15:44:23.937809 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1943/4117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:23.943326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.944194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.953225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.954574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.954856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.955321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.955748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.956472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.957698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.958313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.959071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.986915 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] HTTP exception thrown: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Request method failure captured: Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 HTTP/1.1 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN05VAioCZovOuNCysCh8aBQCefmZtc-cps-ZLlcvykr_eZmmakzs20hOfX56ysw6KyS-77LX3Ks2nBB5Mk9Gk5uKdKuVqMYpYsgGcDETgG2tPbMBJBBjf8hc5ZzQTcyVA0e1ciDR6tApdqNUH6xQ7zXS3BGvQSo3MuuVYYnu99uXOU Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/069a60f32d554f05b34f429706187490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_069a60f32d554f05b34f429706187490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}] Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 48a7b8433888412abc328cbc3aea214b Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '201caf06-9ac5-4656-af53-fe83b1b5baf8'} Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:23.995845 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Returning 404 to user: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-389c78ed-dd88-4a0a-a74d-7c27976cecd2 tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "DELETE /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 404 len: 111 microversion: 2.1 time: 0.090387 Aug 29 15:44:23.999827 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2175/4118] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:23 2022] DELETE /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:24.013503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.014138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] [instance: 201caf06-9ac5-4656-af53-fe83b1b5baf8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.026339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.027394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.027853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.028596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.029064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.029527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.053964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.066579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.068491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.069902 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1e35981d-31fb-4978-834a-d445d2021c51 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.130746 Aug 29 15:44:24.070675 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1944/4119] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:24.081800 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] HTTP exception thrown: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Request method failure captured: Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 HTTP/1.1 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN05VAioCZovOuNCysCh8aBQCefmZtc-cps-ZLlcvykr_eZmmakzs20hOfX56ysw6KyS-77LX3Ks2nBB5Mk9Gk5uKdKuVqMYpYsgGcDETgG2tPbMBJBBjf8hc5ZzQTcyVA0e1ciDR6tApdqNUH6xQ7zXS3BGvQSo3MuuVYYnu99uXOU Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/069a60f32d554f05b34f429706187490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_069a60f32d554f05b34f429706187490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/069a60f32d554f05b34f429706187490"}]}] Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 069a60f32d554f05b34f429706187490 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-876505098 Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 48a7b8433888412abc328cbc3aea214b Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeTestJSON-876505098-project Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '201caf06-9ac5-4656-af53-fe83b1b5baf8'} Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.084871 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.090068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.090068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.090068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.090068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:24.090068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:24.090068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. Aug 29 15:44:24.090068 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.091642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] Returning 404 to user: Instance 201caf06-9ac5-4656-af53-fe83b1b5baf8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:24.092634 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4bda54b-401a-463f-9a37-a8218b6cb28a tempest-AttachVolumeTestJSON-876505098 tempest-AttachVolumeTestJSON-876505098-project] 10.222.0.16 "GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8" status: 404 len: 111 microversion: 2.1 time: 0.089906 Aug 29 15:44:24.093710 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2176/4120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/201caf06-9ac5-4656-af53-fe83b1b5baf8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:24.663843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-plugged", "status": "completed", "tag": "afc9aaaa-e70e-40e4-b278-80e3ce884a8d"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-plugged", "status": "completed", "tag": "73384e18-d1b4-4919-9f91-9b5be5de78a8"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-plugged", "status": "completed", "tag": "5fc71865-e22d-4048-b2b0-9176e6cef769"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:24.688453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.689153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.689761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.704461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] Creating event network-vif-plugged:afc9aaaa-e70e-40e4-b278-80e3ce884a8d for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:24.719638 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] Creating event network-vif-plugged:73384e18-d1b4-4919-9f91-9b5be5de78a8 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:24.720369 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] Creating event network-vif-plugged:5fc71865-e22d-4048-b2b0-9176e6cef769 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:24.727800 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f0ef568a-48fb-47ca-8fb9-28e40f258ad3 req-25cd9032-8292-4903-a419-d88c4d4a4fa4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067512 Aug 29 15:44:24.729515 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1945/4121] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:24.754484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.755478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.773049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.773870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.774493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.775384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.776081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.789825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.932032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.933279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.946639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.947161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.947607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.953468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.954282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.955053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.428777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.443775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.445520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.447089 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e46d22a4-6ba5-4212-9161-02b1bdca9f7b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.522696 Aug 29 15:44:25.448215 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1946/4122] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:25.453673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.454500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.461958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.462648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.463247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.464094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.464715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.465295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.675152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.686175 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a8e144d-d8f0-4aa8-a23f-992252a25227 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.235302 Aug 29 15:44:25.686988 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1947/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:25.689073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.696699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.697623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.700461 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e58c37d-73be-4ff1-b152-9096e8f85dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1522 microversion: 2.1 time: 0.949928 Aug 29 15:44:25.701623 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2177/4124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1522 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:25.708358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.708843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.709283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.710330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.710798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.711551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.830981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.846221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.851982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.856459 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb2e9dca-1bfb-470c-9976-fc6ce66fdee0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.166527 Aug 29 15:44:25.857853 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1948/4125] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:26.474604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.475395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.491709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.493331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.494031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.496221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.496881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.502038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.718047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.719374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.736603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.737278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.737925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.738788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.739386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.739972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.920940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.951578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.953066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.959893 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-05fc6a62-ddc2-45d8-ac11-1e3bffb360d8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1874 microversion: 2.32 time: 0.488830 Aug 29 15:44:26.977690 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2178/4126] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1874 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:26.994504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.995149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.016832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.017349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.017811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.028841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.031993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.038177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.239757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.256104 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8121e56d-ffe6-4f33-af87-378841c509aa tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.545130 Aug 29 15:44:27.257018 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1949/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:27.262345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bddc35c6-5ae3-4b31-89c4-1540d27260ed req-1edba9a1-c90d-4cc0-98a6-ccdf22a7df9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85f0c7f-3281-44a3-a112-f60842476a5d", "name": "network-vif-plugged", "status": "completed", "tag": "a8e6d8dc-f7c1-4959-b13c-841651abbea4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:27.283738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bddc35c6-5ae3-4b31-89c4-1540d27260ed req-1edba9a1-c90d-4cc0-98a6-ccdf22a7df9a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.286461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bddc35c6-5ae3-4b31-89c4-1540d27260ed req-1edba9a1-c90d-4cc0-98a6-ccdf22a7df9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.287056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bddc35c6-5ae3-4b31-89c4-1540d27260ed req-1edba9a1-c90d-4cc0-98a6-ccdf22a7df9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.315964 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bddc35c6-5ae3-4b31-89c4-1540d27260ed req-1edba9a1-c90d-4cc0-98a6-ccdf22a7df9a service nova] Creating event network-vif-plugged:a8e6d8dc-f7c1-4959-b13c-841651abbea4 for instance d85f0c7f-3281-44a3-a112-f60842476a5d on n-h2-854882-3 Aug 29 15:44:27.328535 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bddc35c6-5ae3-4b31-89c4-1540d27260ed req-1edba9a1-c90d-4cc0-98a6-ccdf22a7df9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070043 Aug 29 15:44:27.329509 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1950/4128] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:27.335315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.336248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.360990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.361931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.362748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.364102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.364978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.365653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.513951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.515884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.529790 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bed1ad28-da91-4cc7-a2fa-0b8b8ed56ec2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1522 microversion: 2.1 time: 0.546681 Aug 29 15:44:27.530666 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2179/4129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:27.558273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.564848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.570020 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-46eed976-cfb6-43a3-9eca-88a86b19ea54 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.235663 Aug 29 15:44:27.583229 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1951/4130] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:27.987062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.987688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.994433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.995197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.995826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.996735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.997427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.998158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.278392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.279010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.298207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.303720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.305410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.308735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.309504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.310097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.344989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.362332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.366482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.368247 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2750c41-cccb-4abc-ac94-6e4cb7cee155 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2828 microversion: 2.32 time: 0.385094 Aug 29 15:44:28.369739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2180/4131] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2828 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:28.394860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.395530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.403485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.406309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.407002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.407952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.408750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.409414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.625472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1e2f766e-d22f-4a9e-a235-afab627bdf4c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.233934 Aug 29 15:44:28.627088 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2181/4132] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610/os-interface => generated 1832 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:28.634536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.637134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.642106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.647857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.648632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.649297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.650314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.650835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.651799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.656080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-662cc3f9-f95f-49f0-8f01-239e76b635de tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.381998 Aug 29 15:44:28.657053 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1952/4133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:28.662347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.665936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.677964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.678696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.679279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.680667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.681276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.682190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.788571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.824845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.830959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.833286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e7ed0cd-7202-42db-ba99-b73faa0b0423 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.175004 Aug 29 15:44:28.848048 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1953/4134] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:29.112426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.127363 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba5b68ce-05f0-4ff6-a9db-f5fbdce86c28 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1522 microversion: 2.1 time: 0.497501 Aug 29 15:44:29.130308 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2182/4135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:29.678061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.679506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.696561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.697428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.698194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.700090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.700847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.702369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.864008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.864862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.878193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.880611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.881699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.883229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.886468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.887265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.080819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.092291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.093998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.095257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c6519cc-eba2-48fc-a4f6-4e3765efa188 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.237254 Aug 29 15:44:30.102362 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2183/4136] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:30.154873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.157117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.178971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.179491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.179944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.180695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.181837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.182297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.466329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.482308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-983bbb38-a1d9-46b4-930d-7186851d0dd4 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.808219 Aug 29 15:44:30.483825 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1954/4137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:30.584598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.594158 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35b4c98a-4a49-45cd-adff-5599a6d6a4fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1507 microversion: 2.1 time: 0.445721 Aug 29 15:44:30.602244 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2184/4138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:30.626465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.627411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.635723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.636532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.637179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.638152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.638983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.639627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.128756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.129426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.138822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.139353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.140238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.141428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.141908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.142550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.250435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.260540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.263106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.267624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4b55647-ae2d-44f3-ac75-68ab01652d0f tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.142958 Aug 29 15:44:31.268430 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2185/4139] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:31.445589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.450633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:31.463429 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f3f94444-be4c-4828-8e93-df400c0aab45 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 200 len: 1507 microversion: 2.1 time: 0.841323 Aug 29 15:44:31.464544 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1955/4140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 1507 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.488960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.490028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.493154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:31.506476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.508126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.516361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.516893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.517404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.518268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.520953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.521490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.524462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.524920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.529616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.530501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.531666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.532610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.609586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:31.676835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:31.774730 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e969f715-d2a4-400b-88f8-967ccf75009b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 204 len: 0 microversion: 2.1 time: 0.291540 Aug 29 15:44:31.775364 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2186/4141] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:31 2022] DELETE /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:31.780740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-38c320b9-217a-401d-ad70-644ab69b616a req-2326c770-4c67-4c88-a423-a5464fba1ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "tag": "5fc71865-e22d-4048-b2b0-9176e6cef769"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:31.798128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38c320b9-217a-401d-ad70-644ab69b616a req-2326c770-4c67-4c88-a423-a5464fba1ffb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.798800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38c320b9-217a-401d-ad70-644ab69b616a req-2326c770-4c67-4c88-a423-a5464fba1ffb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.799292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.799686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38c320b9-217a-401d-ad70-644ab69b616a req-2326c770-4c67-4c88-a423-a5464fba1ffb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.812454 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-becb6765-5b83-4876-996e-ecf0667b5abc tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.309744 Aug 29 15:44:31.818061 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1956/4142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.827774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-38c320b9-217a-401d-ad70-644ab69b616a req-2326c770-4c67-4c88-a423-a5464fba1ffb service nova] Creating event network-changed:5fc71865-e22d-4048-b2b0-9176e6cef769 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:44:31.837102 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-38c320b9-217a-401d-ad70-644ab69b616a req-2326c770-4c67-4c88-a423-a5464fba1ffb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060116 Aug 29 15:44:31.838287 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2187/4143] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:31.932304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1536037552", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "7d5edc68-181c-443f-aa2c-d6b433271f4e"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:32.000622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] validate_networks() for [('7d5edc68-181c-443f-aa2c-d6b433271f4e', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:32.294863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.295590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.308784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.313262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.313825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.315654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.323438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.333422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.538724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.554328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.558291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.559669 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-338b247a-ff36-48be-bb3f-12e2f3501fd4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.270978 Aug 29 15:44:32.567565 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2188/4144] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:32.633970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:32.635061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:32.636443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:32.637126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:32.638952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:32.656944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.658928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.661270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.662712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.664221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.664663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.710486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Getting quotas for project 0be795a7587c4c2c8e5d71a01f5ba732. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:32.724632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Getting quotas for user f1fd00311fa540658cfd4076c9a88976 and project 0be795a7587c4c2c8e5d71a01f5ba732. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:32.754478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:32.770476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:32.819696 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-44ae0e38-7775-4b43-9f6a-bd4c1c05f83a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892004 Aug 29 15:44:32.820669 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1957/4145] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:32.832970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-82eb42f8-03b8-4806-9eba-bb3a1880e322 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.834198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-82eb42f8-03b8-4806-9eba-bb3a1880e322 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.960150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-82eb42f8-03b8-4806-9eba-bb3a1880e322 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.972905 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-82eb42f8-03b8-4806-9eba-bb3a1880e322 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1218 microversion: 2.1 time: 0.144030 Aug 29 15:44:32.974193 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1958/4146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:32.980866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.981908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.009127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.012466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.012996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.013781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.014242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.015339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.408963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-443a80da-a09d-4b3d-b5d3-97acf727d6e0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'create', calling method: .version_select at 0x7fb0e2be4e50>, body: {"keypair": {"name": "tempest-keypair-1973218798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSQ98Mc3BCM4WqCruu6dylpI9gTYtEM7MwnQ+iTONMV7N9XYq9VC5ajSP/XtcuavO3kJMDWfeh5byYAIyMCBr7WslUCjOdGrPif/QKS0ytIFyUPffN0ZIv/lYm55N3YlQ=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:33.441314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-443a80da-a09d-4b3d-b5d3-97acf727d6e0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for project 2c147d42182146409a91f2e0359f2e98. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:33.451825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-443a80da-a09d-4b3d-b5d3-97acf727d6e0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for user a68002795ce541338b30129e6dbb0fb6 and project 2c147d42182146409a91f2e0359f2e98. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:33.527736 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-443a80da-a09d-4b3d-b5d3-97acf727d6e0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.762933 Aug 29 15:44:33.531166 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2189/4147] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:33.589176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.590139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.603235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.604261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.604261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.608651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.609157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.612809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.665993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.677042 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8320968a-2b74-4bbb-ae93-3a761a29a686 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.701312 Aug 29 15:44:33.683579 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1959/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:33.881582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.891962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.893233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.894483 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-06a066a8-369b-4d6a-9990-2bb4fe28b205 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.311312 Aug 29 15:44:33.921679 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2190/4149] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:33.994344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.996045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.015917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.016683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.017269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.018162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.018756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.019321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.209908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.225116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ee6dea7-76c4-4a4a-95b9-5aff83130dd7 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1214 microversion: 2.1 time: 0.234397 Aug 29 15:44:34.226629 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1960/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:34.704406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.705035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.720664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.721185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.721661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.722394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.722855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.723287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.925543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.926166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.936773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.937318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.937792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.938512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.941315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.945479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.098465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.116671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.122228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.125025 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03cf090d-1b19-4240-af49-6b10cf364b14 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.202664 Aug 29 15:44:35.134956 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1961/4151] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:35.145129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4d2a84af-1256-41ac-b143-76d314b8e9bb req-2250f608-35e7-4215-8fc2-b73b94041f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85f0c7f-3281-44a3-a112-f60842476a5d", "name": "network-vif-deleted", "tag": "a8e6d8dc-f7c1-4959-b13c-841651abbea4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:35.173269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4d2a84af-1256-41ac-b143-76d314b8e9bb req-2250f608-35e7-4215-8fc2-b73b94041f25 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.174700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4d2a84af-1256-41ac-b143-76d314b8e9bb req-2250f608-35e7-4215-8fc2-b73b94041f25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.178412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4d2a84af-1256-41ac-b143-76d314b8e9bb req-2250f608-35e7-4215-8fc2-b73b94041f25 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.213353 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4d2a84af-1256-41ac-b143-76d314b8e9bb req-2250f608-35e7-4215-8fc2-b73b94041f25 service nova] Creating event network-vif-deleted:a8e6d8dc-f7c1-4959-b13c-841651abbea4 for instance d85f0c7f-3281-44a3-a112-f60842476a5d on n-h2-854882-3 Aug 29 15:44:35.216562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.219970 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4d2a84af-1256-41ac-b143-76d314b8e9bb req-2250f608-35e7-4215-8fc2-b73b94041f25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083222 Aug 29 15:44:35.220864 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1962/4152] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:35.231961 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b016bba-e5a1-4058-ab43-4b410fb3789c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.531344 Aug 29 15:44:35.245623 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2191/4153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:35.248939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.250109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.257376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.258200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.258803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.259852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.260509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.261117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.353553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.365066 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c6bad53e-66dc-466b-8eef-09e0b866293c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1278 microversion: 2.1 time: 0.120112 Aug 29 15:44:35.366503 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1963/4154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:36.158445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.160046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.172477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.178273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.179056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.180214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.180898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.181586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.256710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.258211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.272965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.277828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.278634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.279258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.280269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.280269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.444674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.454297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.455767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.469063 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-701aff62-8d94-4517-9ab8-2470de2d71d1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.315563 Aug 29 15:44:36.470376 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2192/4155] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:36.475404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.476242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.483331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.484050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.484654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.485653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.486271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.488354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.590096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.601303 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f020265-2986-4a66-a15d-4b72a320eccf tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.348732 Aug 29 15:44:36.602593 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1964/4156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:36.682095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.695368 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-44862c79-2c12-4210-b4d8-c94eb1f064c2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1276 microversion: 2.1 time: 0.223500 Aug 29 15:44:36.709046 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2193/4157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:37.498543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.499862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.512304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.513021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.513589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.514285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.514729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.515206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.624044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.624675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.633233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.634041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.634698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.635721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.636900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.637636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.662075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.693133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.694664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.696186 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2911fdb5-ab5c-4172-a651-d2dc0736c2c8 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.202236 Aug 29 15:44:37.696473 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1965/4158] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:37.717171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.717840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.732984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.742475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.743010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.753375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.753836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.754382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.049862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:38.061766 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f201b5c8-cf17-44e8-b0a5-ed4ebfe69438 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1484 microversion: 2.1 time: 0.442054 Aug 29 15:44:38.076811 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2194/4159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1484 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:38.088051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1981638771", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "495c919e-8bb9-4e7e-b31f-e6fe4e50e138"}], "security_groups": [{"name": "tempest-securitygroup--687131537"}], "key_name": "tempest-keypair-1973218798", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:38.310075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] validate_networks() for [('495c919e-8bb9-4e7e-b31f-e6fe4e50e138', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:38.615635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:38.632955 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc2a329f-dfc3-4870-a642-2958dd541c70 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.919900 Aug 29 15:44:38.633915 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1966/4160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:38.641618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:38.644650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:38.660215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.660752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.661207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.662015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.662608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.663077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.844318 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25dd5c7c-de22-415e-8c5a-406cf1a24916 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "POST /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5/action" status: 202 len: 0 microversion: 2.1 time: 0.163009 Aug 29 15:44:38.852274 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1967/4161] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:38 2022] POST /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:38.869542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:38.871380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:38.902531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.903164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.903636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.904387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.904850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.905303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.053658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.069274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.073962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.077790 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7599822f-622a-4108-9545-e6e5ac60daf0 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.223151 Aug 29 15:44:39.078385 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1968/4162] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:38 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:39.086687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.087587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.097025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.097562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.098076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.098791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.099246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.099704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.570772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.612508 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-11507815-2b2c-467f-8c39-cedc1ae4b5b6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1492 microversion: 2.1 time: 0.532798 Aug 29 15:44:39.615719 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1969/4163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1492 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:39.619643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:39.622199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:39.623127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:39.624982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:39.625446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:39.634507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0c11f877-1d89-40fa-93af-73e785bfe856 req-66d19b25-8d57-4e74-9e36-c351f2c31503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56bb56a-ea3a-4b0a-8136-c65c1e4f111b", "tag": "96e9bb1e-7a45-4d62-be25-f395e8bfce09"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:39.647280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0c11f877-1d89-40fa-93af-73e785bfe856 req-66d19b25-8d57-4e74-9e36-c351f2c31503 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.647955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0c11f877-1d89-40fa-93af-73e785bfe856 req-66d19b25-8d57-4e74-9e36-c351f2c31503 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.648540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0c11f877-1d89-40fa-93af-73e785bfe856 req-66d19b25-8d57-4e74-9e36-c351f2c31503 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.656172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.656172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.656485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.657004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.657525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.657965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.665147 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0c11f877-1d89-40fa-93af-73e785bfe856 req-66d19b25-8d57-4e74-9e36-c351f2c31503 service nova] Creating event network-changed:96e9bb1e-7a45-4d62-be25-f395e8bfce09 for instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b on n-h1-854882-3 Aug 29 15:44:39.671051 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0c11f877-1d89-40fa-93af-73e785bfe856 req-66d19b25-8d57-4e74-9e36-c351f2c31503 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052433 Aug 29 15:44:39.673487 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1970/4164] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:39.679803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.680784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.688915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.689939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.690534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.691396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.691981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.692515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.709657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:39.718096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for user a68002795ce541338b30129e6dbb0fb6 and project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:39.735901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:39.738835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:39.797569 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-707d5a70-ebb5-4466-97d0-b9d4937259b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.719441 Aug 29 15:44:39.798225 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2195/4165] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:39.813920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-edb673c0-b30a-471b-ba4a-cc94758a30c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.814838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-edb673c0-b30a-471b-ba4a-cc94758a30c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.897547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-edb673c0-b30a-471b-ba4a-cc94758a30c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.911161 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-edb673c0-b30a-471b-ba4a-cc94758a30c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1239 microversion: 2.1 time: 0.101042 Aug 29 15:44:39.923516 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2196/4166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1239 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:40.103973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.105128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.115215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.116400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.116920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.117864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.118500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.118926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.124868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.138444 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cce0fe27-31c2-4c32-849a-1b4b1633f137 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.463892 Aug 29 15:44:40.140078 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1971/4167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:40.268769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.292727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.294457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.301371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cd78c0b9-a855-4ff0-aa0e-c5c4f6ac7ec1 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.201258 Aug 29 15:44:40.302655 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2197/4168] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:40.640691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.641323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.658093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.659321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.659782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.660610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.664145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.664711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.935949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.936740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.954893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.955437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.955889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.960960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.964997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.965909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.054889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.077494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6da664b-62bd-4e4c-b078-40dc0b4740f5 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1492 microversion: 2.1 time: 0.442157 Aug 29 15:44:41.079809 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1972/4169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1492 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:41.094385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.111267 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca126435-37b4-40ec-881f-69ecdc4f5d0c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1291 microversion: 2.1 time: 0.175527 Aug 29 15:44:41.112004 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2198/4170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1291 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:41.161666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.162743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.171054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.171792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.173256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.175862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.176553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.177131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.329134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.329717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.349272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.349812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.350262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.351154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.351947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.352501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.515770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.557046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.559552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.569069 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-132c01b7-3f91-47d6-b336-a5e40c147eee tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.244064 Aug 29 15:44:41.574639 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2199/4171] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:41.799862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.811973 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-35b5e76a-7c22-485f-b1cb-9648771bf25c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.654996 Aug 29 15:44:41.812665 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1973/4172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:42.103714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.106777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.113755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.114517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.115253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.116159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.121071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.121811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.132143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.132764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.141364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.145816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.146506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.148539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.150802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.156811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.185870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:42.277496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.289038 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a14e851-2e9e-4685-8fcb-7611957b4cf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1297 microversion: 2.1 time: 0.160702 Aug 29 15:44:42.293503 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1974/4173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1297 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:42.458708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.486344 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-42df0013-688d-4692-91cd-19dbae6580ad tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1492 microversion: 2.1 time: 0.387634 Aug 29 15:44:42.487567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2200/4174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1492 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:42.600867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.602449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.610062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.610904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.612137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.613955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.614615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.615240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.690766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:42.782533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.814922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.818207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.819922 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a44faae-f5fe-4d09-bfed-5ac0eabe18d7 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.223469 Aug 29 15:44:42.834772 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1975/4175] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:42.849062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.856618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.899432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.903104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.907050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.910474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.911201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.911847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.314380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.315366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.328595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:43.331214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.331998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.332710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.333779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.334874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.336384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.344872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.356534 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2fdc17d0-13b7-4687-be58-0b286109926a tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.525882 Aug 29 15:44:43.360370 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2201/4176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:43.515607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.516655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.524437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.525630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.530783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.531773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.532781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.553669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.763473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.786649 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb20fc87-2ac8-4872-9ee7-195666095543 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.478939 Aug 29 15:44:43.787303 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1976/4177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:43.849014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.850587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.859055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.859959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.860718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.861666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.862325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.863043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.036659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.055153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.060109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.061360 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-642ed0d6-e9d4-4f10-8cf4-4e4491c5e634 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.217215 Aug 29 15:44:44.064082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1977/4178] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:44.163012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.200537 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a62f2327-f7c2-4de2-a681-7739ea04d57e tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1498 microversion: 2.1 time: 0.689551 Aug 29 15:44:44.214885 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2202/4179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1498 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:44.239363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.239876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.245880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:44.248757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.249241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.249996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.250867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.254015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.254673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.295831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:44.416214 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d151ad9c-4391-44b5-b2a0-edffac565e26 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 204 len: 0 microversion: 2.1 time: 0.180687 Aug 29 15:44:44.423990 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1978/4180] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:44 2022] DELETE /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:44.431496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.432674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.439332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.440098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.440521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.441274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.441910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.442505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.516240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6fab5713-22c5-44cc-8422-5a6eeaa6a5d0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: .version_select at 0x7fb0e34f4550>, body: {"keypair": {"name": "tempest-keypair-374703299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhIC0C/l9EdGJORmun6nSiuXZ1l531j7hBGYoz1luuFo0Bl1sMs6mJFTRv9+sa2E/6JkB6WQ6aQUBOhFmoW4BDrijB+WJzMmpc1bASRnWapataZ1qk/DogcLg/V2Vb6IA=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:44.575749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6fab5713-22c5-44cc-8422-5a6eeaa6a5d0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:44.583562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6fab5713-22c5-44cc-8422-5a6eeaa6a5d0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:44.605086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.615759 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-449e8c5a-8672-4280-9820-7f37b6c989d2 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.190085 Aug 29 15:44:44.617030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1979/4181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:44.623055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.623214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.625503 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6fab5713-22c5-44cc-8422-5a6eeaa6a5d0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.347033 Aug 29 15:44:44.632028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2203/4182] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:44.651192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.652303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.652974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.654657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.658856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.659388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.809489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.810121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.818024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.818530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.819173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.819932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.820819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.821263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.898357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.914068 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-887fba1d-db34-49be-b2f8-2783a08169f6 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.295903 Aug 29 15:44:44.929502 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1980/4183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.085951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.086581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.094988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.095488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.095927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.096634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.097980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.098749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.161623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.175322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8416f330-568b-4bc1-acad-5be029f15aa8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.371394 Aug 29 15:44:45.176493 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2204/4184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.194365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.213611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.218193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.222187 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a910a8a1-8c69-4440-8052-681b7496ca24 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.140206 Aug 29 15:44:45.223872 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1981/4185] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:45.641847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.643047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.652331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.653073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.653718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.654593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.655191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.655773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.715047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0edcd776-de35-41aa-a6e7-03f1bca45b44 req-3474e481-a17b-4871-9dd5-89a9f4587155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:45.734266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0edcd776-de35-41aa-a6e7-03f1bca45b44 req-3474e481-a17b-4871-9dd5-89a9f4587155 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.734883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0edcd776-de35-41aa-a6e7-03f1bca45b44 req-3474e481-a17b-4871-9dd5-89a9f4587155 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.739889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0edcd776-de35-41aa-a6e7-03f1bca45b44 req-3474e481-a17b-4871-9dd5-89a9f4587155 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.754808 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0edcd776-de35-41aa-a6e7-03f1bca45b44 req-3474e481-a17b-4871-9dd5-89a9f4587155 service nova] Creating event network-changed:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:44:45.761072 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0edcd776-de35-41aa-a6e7-03f1bca45b44 req-3474e481-a17b-4871-9dd5-89a9f4587155 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050358 Aug 29 15:44:45.762052 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1982/4186] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:45.948848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.952748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.964899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.966750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.967434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.968898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.969598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.970720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.104094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.112399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e0a2db09-932c-436c-b039-fbffaf8a917c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.474136 Aug 29 15:44:46.112545 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2205/4187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:46.170484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a159fc32-9c45-417e-b11f-0f1ae7f6f590 req-55c3cffe-4c42-46b6-ae95-38e7ef692125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56bb56a-ea3a-4b0a-8136-c65c1e4f111b", "name": "network-vif-plugged", "status": "completed", "tag": "96e9bb1e-7a45-4d62-be25-f395e8bfce09"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:46.185779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a159fc32-9c45-417e-b11f-0f1ae7f6f590 req-55c3cffe-4c42-46b6-ae95-38e7ef692125 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.186992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a159fc32-9c45-417e-b11f-0f1ae7f6f590 req-55c3cffe-4c42-46b6-ae95-38e7ef692125 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.187660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a159fc32-9c45-417e-b11f-0f1ae7f6f590 req-55c3cffe-4c42-46b6-ae95-38e7ef692125 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.206724 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a159fc32-9c45-417e-b11f-0f1ae7f6f590 req-55c3cffe-4c42-46b6-ae95-38e7ef692125 service nova] Creating event network-vif-plugged:96e9bb1e-7a45-4d62-be25-f395e8bfce09 for instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b on n-h1-854882-3 Aug 29 15:44:46.212993 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a159fc32-9c45-417e-b11f-0f1ae7f6f590 req-55c3cffe-4c42-46b6-ae95-38e7ef692125 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046420 Aug 29 15:44:46.214464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2206/4188] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:46.220876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.221823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.230760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.231508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.232099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.233371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.234016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.234672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.447863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.483336 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cd09e011-da2c-4111-b8cb-34c9f0329a45 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.550466 Aug 29 15:44:46.490472 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1983/4189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:46.496138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.496933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.509277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.510244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.511512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.512336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.512946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.513611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.594500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.603130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.604846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.606218 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bb4306a-9ea2-402c-8356-170f8628b1ec tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.114522 Aug 29 15:44:46.606867 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1984/4190] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:46.611407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.618237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:46.624394 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4dfb5c59-9c83-438c-83fa-012d9a0d333c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.408043 Aug 29 15:44:46.625283 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2207/4191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:46.627607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1312110105", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d897c5c0-df74-4e72-afd9-ed5315eaa2e0"}], "security_groups": [{"name": "tempest-securitygroup--372385287"}], "key_name": "tempest-keypair-374703299", "user_data": "}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:46.744402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] validate_networks() for [('d897c5c0-df74-4e72-afd9-ed5315eaa2e0', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:47.134656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.136140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.143561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.144281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.145096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.146210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.146718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.147104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.273144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:47.274199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:47.274865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:47.275433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:47.275848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:47.285898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.286376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.286804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.287709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.288156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.288571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.309520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:47.315178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:47.328354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:47.330705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:47.377336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.389633 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-85a75c4a-e2af-4c0b-b025-09ceed6e5bd0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.780874 Aug 29 15:44:47.390516 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1985/4192] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:47.395735 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6cac5941-24ee-43f5-bcaf-f5482f4c4870 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.265387 Aug 29 15:44:47.396878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2208/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:47.411282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ddaf4aa8-8b6e-4393-a757-7ea1e2f5c00e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.411909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ddaf4aa8-8b6e-4393-a757-7ea1e2f5c00e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.496269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ddaf4aa8-8b6e-4393-a757-7ea1e2f5c00e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.507431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.508058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.524032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.527778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.528541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.529703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.531727 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ddaf4aa8-8b6e-4393-a757-7ea1e2f5c00e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1241 microversion: 2.1 time: 0.132996 Aug 29 15:44:47.545606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.546195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.551744 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1986/4194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:47.633028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.633936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.646089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.653760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.654725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.655625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.656340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.656961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.849463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.858981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.860952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.862554 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e41114e-3400-43bf-a060-3d273f70cdf4 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.233350 Aug 29 15:44:47.878195 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1987/4195] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:47.887538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.888990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.897648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.898920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.899744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.900756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.902134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.902947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.154430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.178046 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f86aa39c-afb8-4960-b4d4-9d3c42f18177 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.298447 Aug 29 15:44:48.179208 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1988/4196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.215524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.232152 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff8d44ca-afae-4472-aa6f-361d86dfe45d tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.728759 Aug 29 15:44:48.233563 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2209/4197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.419925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.420651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.428073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.428665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.429191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.430214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.431074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.431571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.582892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.585277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.615397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.615898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.616352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.617090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.624460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.625006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.687015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.699632 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b8d1a313-223a-4f7c-b198-f9312c0ca1d6 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1318 microversion: 2.1 time: 0.284441 Aug 29 15:44:48.716501 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1989/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.768904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.781608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-409cb044-64aa-462b-860d-e8ab6ea9803c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1245 microversion: 2.1 time: 0.214919 Aug 29 15:44:48.783173 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2210/4199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1245 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.892024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.892652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.899806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.900530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.901486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.902196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.902648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.903061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.984816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.995602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.997922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.999500 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e1ddb957-76bb-4610-a2c1-c33e8c25d79d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.112453 Aug 29 15:44:49.000170 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1990/4200] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:49.200994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.201869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.208492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.209258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.209788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.210892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.218280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.218863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.253721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.254341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.261690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.262429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.263095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.264015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.264542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.265088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.421017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.426614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:49.434724 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-85adbbeb-cad3-4d6a-8c71-322d26a2cc23 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1504 microversion: 2.1 time: 0.184844 Aug 29 15:44:49.449694 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1991/4201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:49.670188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:49.723664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.724644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.734919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.738933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.739389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.740132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.740585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.741012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.896722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.909153 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ee87e8d-8555-49a7-b4e7-c407e17ffd95 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.712517 Aug 29 15:44:49.924488 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2211/4202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:49.926584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d10d489d-d4e2-459a-a115-95ea85e67905 req-d002c088-8415-4c86-84e9-a3dceb34ccc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d8a297-2bcb-4fde-bee5-a5f478fafdb5", "name": "network-vif-deleted", "tag": "7d2e90dc-a34f-437b-8919-e55403d95dad"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:49.952852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d10d489d-d4e2-459a-a115-95ea85e67905 req-d002c088-8415-4c86-84e9-a3dceb34ccc3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.954089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d10d489d-d4e2-459a-a115-95ea85e67905 req-d002c088-8415-4c86-84e9-a3dceb34ccc3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.954918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d10d489d-d4e2-459a-a115-95ea85e67905 req-d002c088-8415-4c86-84e9-a3dceb34ccc3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.975700 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d10d489d-d4e2-459a-a115-95ea85e67905 req-d002c088-8415-4c86-84e9-a3dceb34ccc3 service nova] Creating event network-vif-deleted:7d2e90dc-a34f-437b-8919-e55403d95dad for instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 on n-h1-854882-3 Aug 29 15:44:49.983979 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d10d489d-d4e2-459a-a115-95ea85e67905 req-d002c088-8415-4c86-84e9-a3dceb34ccc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062762 Aug 29 15:44:49.984844 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2212/4203] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:49.999615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.000788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.009833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.010641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.011285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.012161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.013875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.014621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.124439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.135056 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e000e06b-d4a9-4f47-8939-1a6217835b2e tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1299 microversion: 2.1 time: 0.148342 Aug 29 15:44:50.136174 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2213/4204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1299 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:50.143081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.143670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.146010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:50.153233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.154164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.154808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.156345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.157002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.157499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.277299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.294369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.298458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.308255 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-834fa1a2-6e7b-4aeb-afb3-de7d0096f143 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.170222 Aug 29 15:44:50.309024 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2214/4205] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:50.468056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.472871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.474087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.486794 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79ddfaf7-584b-4133-be26-0d41704cf763 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1509 microversion: 2.1 time: 0.767480 Aug 29 15:44:50.487457 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1992/4206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1509 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:50.499231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.502104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.506303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.507713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.508718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.509963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.514778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.515406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.534190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.534693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.535135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.538397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.539200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.539797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.596900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.597421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.598151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.598952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lazy-loading 'fault' on Instance uuid 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:50.699362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.708811 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-552f7669-3f7c-4883-bfc3-eb625e915265 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 200 len: 1303 microversion: 2.1 time: 0.255774 Aug 29 15:44:50.709943 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2215/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:50.853017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.867002 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f5be7cb1-1d54-478f-a22e-767286b9fcd1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1509 microversion: 2.1 time: 0.357470 Aug 29 15:44:50.867975 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1993/4208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:50.888634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:50.891582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.897942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.898439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.898878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.899843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.900306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.900763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.934145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.935347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.943927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.944512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.945276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.946767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.948746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.954862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.979187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a1b4ce1-df47-48d7-ad27-ad3dd5b5d551 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "PUT /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1081 microversion: 2.1 time: 0.094994 Aug 29 15:44:50.989121 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2216/4209] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:44:50 2022] PUT /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1081 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:50.999472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.000166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.007117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.007613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.008058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.008770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.009234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.009709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.202233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.219901 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e00323fe-a828-4921-91ff-f2b9338490ff tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.288577 Aug 29 15:44:51.241278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1994/4210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:51.257736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.258558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.273010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.273665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.274297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.275724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.276307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.276810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.404076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.430507 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d0611f6e-8570-451b-9273-4a475a3d7594 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1507 microversion: 2.1 time: 0.432559 Aug 29 15:44:51.434991 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2217/4211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:51.448346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.450643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.469039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.470003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.471176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.471735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.472376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.472937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.600080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.618849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.621129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.622486 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea62b36d-4fe3-4542-9857-5357acb38330 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1365 microversion: 2.47 time: 0.185588 Aug 29 15:44:51.629533 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2218/4212] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:51.654873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.656055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.665550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.666033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.668180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.669460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.670325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.670987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.742207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.752890 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df318bc7-17fc-45e9-867a-98f1f702196a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.509639 Aug 29 15:44:51.769737 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1995/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:51.775390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-41a17c9c-2cb3-45ce-af2c-88d8c3150d3e req-93b9af9a-7c3d-481e-acba-15a659677d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-plugged", "status": "completed", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:51.811289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-41a17c9c-2cb3-45ce-af2c-88d8c3150d3e req-93b9af9a-7c3d-481e-acba-15a659677d44 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.813783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-41a17c9c-2cb3-45ce-af2c-88d8c3150d3e req-93b9af9a-7c3d-481e-acba-15a659677d44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.815067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-41a17c9c-2cb3-45ce-af2c-88d8c3150d3e req-93b9af9a-7c3d-481e-acba-15a659677d44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.837284 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-41a17c9c-2cb3-45ce-af2c-88d8c3150d3e req-93b9af9a-7c3d-481e-acba-15a659677d44 service nova] Creating event network-vif-plugged:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:44:51.844585 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-41a17c9c-2cb3-45ce-af2c-88d8c3150d3e req-93b9af9a-7c3d-481e-acba-15a659677d44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072686 Aug 29 15:44:51.845448 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1996/4214] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:51.851680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.853528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: 10d8a297-2bcb-4fde-bee5-a5f478fafdb5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.863279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.864215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.864935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.866042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.867025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.867667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.899379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] HTTP exception thrown: Instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 could not be found. Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Request method failure captured: Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 HTTP/1.1 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN53Xof1kaO7Kev4zVw9iiO-kf9N8TAdiKU0d1i9j6rU4iGmK9EHbdJoNyCtB0LtYveqgaFux9eT2RNfPJctkupWfy7hF2-PenVGwQ-zMxEo51ygKZGuzAkqn_kHcTGhxRuawVUy3DxiZEnA7OMc1vMjl4c3R-OiYE68NXJqVbSpjc8 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 3f9940a1fec84128b318a5f80884447b Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerRescueTestJSON-598404729 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9940a1fec84128b318a5f80884447b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9940a1fec84128b318a5f80884447b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9940a1fec84128b318a5f80884447b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9940a1fec84128b318a5f80884447b"}]}] Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerRescueTestJSON-598404729 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 3f9940a1fec84128b318a5f80884447b Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerRescueTestJSON-598404729 Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerRescueTestJSON-598404729-project Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 351e59b6021b44a29665281568960f8b Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerRescueTestJSON-598404729-project Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 could not be found. Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '10d8a297-2bcb-4fde-bee5-a5f478fafdb5'} Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 could not be found. Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 could not be found. Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:51.902206 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.905862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:51.905862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:51.905862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:51.905862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:51.905862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:51.905862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 could not be found. Aug 29 15:44:51.905862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.907106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Returning 404 to user: Instance 10d8a297-2bcb-4fde-bee5-a5f478fafdb5 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:51.910006 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bbfe329-9f70-431a-92a8-70f5e714bc94 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5" status: 404 len: 111 microversion: 2.1 time: 0.060920 Aug 29 15:44:51.911068 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1997/4215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/10d8a297-2bcb-4fde-bee5-a5f478fafdb5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:51.927609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.931160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.948865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.949764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.951255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.952645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.953579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.955306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.963631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.975862 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dec8f65e-ad98-49b8-b320-8f2e4f45218e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1507 microversion: 2.1 time: 0.335531 Aug 29 15:44:52.001327 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2219/4216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.007557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:52.027573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:52.039834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.061229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.069701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.071166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.072737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.074210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.084998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.143959 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8f07ed39-e21b-4779-8631-5c98b4fd3ee1 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 204 len: 0 microversion: 2.1 time: 0.225188 Aug 29 15:44:52.148797 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1998/4217] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:51 2022] DELETE /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:52.163682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.165120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.174976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.175589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.176382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.177306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.177959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.178454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.220846 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6fabf160-9002-413f-8a07-c00ca68c9440 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "PUT /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1083 microversion: 2.1 time: 0.217061 Aug 29 15:44:52.222279 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2220/4218] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:44:52 2022] PUT /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1083 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.253886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.254987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.262906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.263651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.263989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.264743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.265213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.265727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.464057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.475314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b430d457-c2ce-452d-bea9-009e5a9ef15b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1509 microversion: 2.1 time: 0.228328 Aug 29 15:44:52.477021 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2221/4219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.487460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.489127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.502723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.503817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.504811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.506249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.507440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.508408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.529143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.540679 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d6423dd7-236c-431e-b651-a6b3fd923b42 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1491 microversion: 2.1 time: 0.383903 Aug 29 15:44:52.540679 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 1999/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1491 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.556023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.556790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.578153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.578781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.579198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.580017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.580472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.580900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.756870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.774612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-19bcb5c7-0deb-443f-9e0e-296e95a98f7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.295098 Aug 29 15:44:52.787128 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2222/4221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.795665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.797009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.805586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.806175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.806679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.807503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.808053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.808665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.827387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:52.891984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.893186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.905207 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2275f989-1e19-43f2-80c3-31b7f63f71be tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1509 microversion: 2.1 time: 0.362972 Aug 29 15:44:52.913611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.914506 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2000/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.917250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.924283 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c2b7740-a7e4-463f-a733-7f4b51b22e4b tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1371 microversion: 2.47 time: 0.135289 Aug 29 15:44:52.926325 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2223/4223] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:52.926602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.927793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.939490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.939993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.940601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.941687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.941980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.942408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.946074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.946769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.957310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.958302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.958962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.964589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.965202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.965756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.003709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:53.159078 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a8ffabf-d18b-4baf-8d36-68b3841d18bc tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 204 len: 0 microversion: 2.1 time: 0.227994 Aug 29 15:44:53.163249 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2224/4224] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:52 2022] DELETE /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:53.185588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.187083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.200077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.200739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.201530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.202585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.203121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.203632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.242768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.246260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:53.264368 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1e70b5cd-058b-4896-9786-22c543edcb6b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.346057 Aug 29 15:44:53.265159 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2001/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:53.281605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b56a0cf2-2a91-4061-8775-75ebc80c8b59 req-431960ce-f2fc-410f-aaaf-750697fccce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e977ea80-1a26-4547-a392-9b56b30f50b3", "tag": "b21b8b62-f3a1-4b00-a58c-0b7f487952c5"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:53.293717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b56a0cf2-2a91-4061-8775-75ebc80c8b59 req-431960ce-f2fc-410f-aaaf-750697fccce4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.294336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b56a0cf2-2a91-4061-8775-75ebc80c8b59 req-431960ce-f2fc-410f-aaaf-750697fccce4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.294822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b56a0cf2-2a91-4061-8775-75ebc80c8b59 req-431960ce-f2fc-410f-aaaf-750697fccce4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.318236 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b56a0cf2-2a91-4061-8775-75ebc80c8b59 req-431960ce-f2fc-410f-aaaf-750697fccce4 service nova] Creating event network-changed:b21b8b62-f3a1-4b00-a58c-0b7f487952c5 for instance e977ea80-1a26-4547-a392-9b56b30f50b3 on n-h1-854882-3 Aug 29 15:44:53.329145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b56a0cf2-2a91-4061-8775-75ebc80c8b59 req-431960ce-f2fc-410f-aaaf-750697fccce4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061576 Aug 29 15:44:53.329949 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2002/4226] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:53.357567 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Instance is already in deleting state, ignoring this request Aug 29 15:44:53.358455 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b804add1-9bc0-40a1-a2a4-52a3d51ff6fd tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 204 len: 0 microversion: 2.1 time: 0.182351 Aug 29 15:44:53.359213 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2225/4227] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:53 2022] DELETE /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:53.375821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.376807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.389914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.391234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.393028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.394325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.394992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.397958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.583345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.588121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.589615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.598027 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d504cb49-8d47-4e99-a4f2-92fc4940e200 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1515 microversion: 2.1 time: 0.227780 Aug 29 15:44:53.598027 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2003/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:53 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:53.601652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.602145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.602579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.603281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.603734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.606083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.793824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.801228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.802027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.802325 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d6b9a834-5e9a-4909-a8a2-6d51d506fafd tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1491 microversion: 2.1 time: 0.221382 Aug 29 15:44:53.803274 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2226/4229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:53 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1491 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:53.810005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.810489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.810968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.811720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.812358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.812873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.954054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.955708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.968289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.969343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.970168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.972179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.973063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.974091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.993228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.006789 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb3b0db8-d712-4507-bd92-12fa3376e12e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1364 microversion: 2.1 time: 0.210912 Aug 29 15:44:54.021609 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2004/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:53 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:54.072050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.083346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.084746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.086943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-012ed324-3b70-4304-9a07-da626379945c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1371 microversion: 2.47 time: 0.141169 Aug 29 15:44:54.088049 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2227/4231] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:53 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:54.286880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.287795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.295637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.296116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.296769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.297546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.297946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.298614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.472580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.481443 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9363f4e-6cb1-43c6-856e-ddd9787c5d49 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.199045 Aug 29 15:44:54.482540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2005/4232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:54.622665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.623559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.626365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=16 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:54.632478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.633003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.633495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.634207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.634663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.635322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.788875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.800063 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df236ddc-77cf-450c-b15a-fafe40a86f6e tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1515 microversion: 2.1 time: 0.182171 Aug 29 15:44:54.800697 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2228/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:54.824150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.824704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.831607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.832095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.832523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.833228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.833688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.834139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.028826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.029474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.029656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.037663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.038511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.039226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.040034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.040789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.041550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.042231 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae23bf08-3dc5-4c98-a7d0-3257ec3e6b3b tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1491 microversion: 2.1 time: 0.221854 Aug 29 15:44:55.058845 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2006/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1491 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:55.116389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.117080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.123582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.124333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.124772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.125539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.125993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.126525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.207712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.209686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.218902 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2cc9691e-c683-4949-87a5-a00f6d4573b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1551 microversion: 2.1 time: 0.194542 Aug 29 15:44:55.219555 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2229/4235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1551 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:55.223072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.227238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.229513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d9f707a-3702-4d20-9260-6da7c1789e23 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1356 microversion: 2.47 time: 0.116732 Aug 29 15:44:55.232129 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2007/4236] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:55.260075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.261161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.263123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.268091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.268974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Searching by: {'deleted': False, 'project_id': '36a76c5994234bfab19624faf79dccc1'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:44:55.273253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.273870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.274489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.275287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.275748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.276899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.282838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.287279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.289246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.290319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.291134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.293303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.412364 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4bcadcc4-cd45-45e8-9c7f-2ac7dc5ecd5f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164641 Aug 29 15:44:55.421554 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2230/4237] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:55.427504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.434489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:44:55.434770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.436020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Searching by: {'deleted': False, 'project_id': 'd74479e5a17b45fa978b66de4518af3b'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:44:55.439909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:55.444779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.445300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.445780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.446552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.447018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.447620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.512614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:44:55.531858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.542768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.543489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.544257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.559435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.561049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.567174 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b64a97d-f4f3-4e5e-823c-c4463441bdb1 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.144259 Aug 29 15:44:55.567782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2231/4238] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers => generated 333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:55.573534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.575954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.583306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.583532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.583943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.584659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.585110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.585622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.624368 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-de688d50-b195-4869-a268-b485c82075d3 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.366800 Aug 29 15:44:55.625928 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2008/4239] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:55.635667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.643114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.644581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Searching by: {'deleted': False, 'project_id': 'd74479e5a17b45fa978b66de4518af3b'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:44:55.651117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.651744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.652391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.653446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.656655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.656655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.694289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:44:55.757090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.780142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.781103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.782040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.097811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.109116 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9f050849-e366-4a9d-851b-ef0015dd1a0d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.539939 Aug 29 15:44:56.120548 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2232/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.131041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.131658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.142613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.143395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.144437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.145258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.145824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.146374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.182869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:56.196732 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e1e6944-4074-4541-a6c4-085ae4403b2e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.568842 Aug 29 15:44:56.197904 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2009/4241] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.203424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.204572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.235552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.236301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.236966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.239173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.239173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.239173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.363817 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-33ce5eb0-4709-4fa2-97f2-0ed200f41eed tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 204 len: 0 microversion: 2.47 time: 0.239881 Aug 29 15:44:56.365004 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2233/4242] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:44:56 2022] DELETE /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:44:56.375975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.376869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.399583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.402697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.403314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.404160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.404815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.405896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.734967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.748223 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dec4280c-5b5e-4502-977d-87eeb51d9651 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1515 microversion: 2.1 time: 0.546062 Aug 29 15:44:56.748223 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2010/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1515 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.764550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b462b2a-bf16-4df0-8164-6662d815725f tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.767539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:56.788770 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b462b2a-bf16-4df0-8164-6662d815725f tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041027 Aug 29 15:44:56.789750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2011/4244] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:56.796080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.796762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.805217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.806412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.807116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.808262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.808891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.809578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.916221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.938917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.940415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.941725 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4d1bc911-9f0f-4af6-8abc-91a276661fc9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1362 microversion: 2.47 time: 0.150973 Aug 29 15:44:56.942298 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2012/4245] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:57.126432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.132880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.162498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.164766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.165510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.168174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.170351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.171899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.276717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:57.497924 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c52583d-621b-40ef-8577-bf67f4f668d0 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 204 len: 0 microversion: 2.1 time: 0.374175 Aug 29 15:44:57.498712 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2013/4246] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:57 2022] DELETE /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:57.519183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.520253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.529332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.530258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.531667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.536673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.537609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.540591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.685625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.733325 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-301a8464-1d46-472d-85ae-7d9945b61fc3 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1491 microversion: 2.1 time: 1.355663 Aug 29 15:44:57.734506 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2234/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1491 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:57.746529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4718db70-64f5-4688-8349-bd961b2ea47d req-14cfc799-73cc-4a9b-9021-2bff27429d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56bb56a-ea3a-4b0a-8136-c65c1e4f111b", "name": "network-vif-deleted", "tag": "96e9bb1e-7a45-4d62-be25-f395e8bfce09"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:57.753201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.760900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4718db70-64f5-4688-8349-bd961b2ea47d req-14cfc799-73cc-4a9b-9021-2bff27429d07 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.761778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4718db70-64f5-4688-8349-bd961b2ea47d req-14cfc799-73cc-4a9b-9021-2bff27429d07 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.762466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4718db70-64f5-4688-8349-bd961b2ea47d req-14cfc799-73cc-4a9b-9021-2bff27429d07 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.783186 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f0758437-08c3-4fcf-8ca0-a03318c4b483 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.277583 Aug 29 15:44:57.784119 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2014/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:57.789362 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4718db70-64f5-4688-8349-bd961b2ea47d req-14cfc799-73cc-4a9b-9021-2bff27429d07 service nova] Creating event network-vif-deleted:96e9bb1e-7a45-4d62-be25-f395e8bfce09 for instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b on n-h1-854882-3 Aug 29 15:44:57.789587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.790114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.798119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.799255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.799707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.800479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.800938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.801360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.807572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4718db70-64f5-4688-8349-bd961b2ea47d req-14cfc799-73cc-4a9b-9021-2bff27429d07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071437 Aug 29 15:44:57.808497 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2235/4249] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:57.834927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.837817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.847529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.848143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.848668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.849612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.850463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.851295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.885976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:57.977828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.986488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.995505 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-76e55426-3bd3-437c-8277-0f5136a22810 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1473 microversion: 2.1 time: 0.176794 Aug 29 15:44:57.996859 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2236/4250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1473 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:58.011016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:58.013865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:58.025003 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-901ea38c-1f0f-4925-bb7a-b21efe359c0e tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1699 microversion: 2.1 time: 0.224137 Aug 29 15:44:58.034860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.035774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.037246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.038341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.038480 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2015/4251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1699 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:58.039457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.040274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.216280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.233740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.236720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.241024 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d049c566-4e2f-4b4d-b337-b7a362e42aae tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1362 microversion: 2.47 time: 0.239305 Aug 29 15:44:58.241982 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2237/4252] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:58.252334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-66354e14-3129-40e3-a33d-37116a936370 req-079bda3d-4f5f-49c0-a325-a219fcde2ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d476030e-7aa7-4121-893a-4291a3fe3fcb", "name": "network-vif-deleted", "tag": "839af9c2-cd37-40bd-a421-42875ad634db"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:58.268579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-66354e14-3129-40e3-a33d-37116a936370 req-079bda3d-4f5f-49c0-a325-a219fcde2ffe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.269050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-66354e14-3129-40e3-a33d-37116a936370 req-079bda3d-4f5f-49c0-a325-a219fcde2ffe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.270016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-66354e14-3129-40e3-a33d-37116a936370 req-079bda3d-4f5f-49c0-a325-a219fcde2ffe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.290150 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-66354e14-3129-40e3-a33d-37116a936370 req-079bda3d-4f5f-49c0-a325-a219fcde2ffe service nova] Creating event network-vif-deleted:839af9c2-cd37-40bd-a421-42875ad634db for instance d476030e-7aa7-4121-893a-4291a3fe3fcb on n-h1-854882-3 Aug 29 15:44:58.298035 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-66354e14-3129-40e3-a33d-37116a936370 req-079bda3d-4f5f-49c0-a325-a219fcde2ffe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050097 Aug 29 15:44:58.299191 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2016/4253] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:58.763612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:58.764987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:58.776218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.776218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.776218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.776218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.776218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.776218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.818040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:58.819103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:58.833005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.834260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.841249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.843933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.845154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.845655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.853597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.863810 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-34503b65-5b8d-4e66-93e8-01a9cab66c2f tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1285 microversion: 2.1 time: 0.104899 Aug 29 15:44:58.878003 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2238/4254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:58 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:59.019692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:59.021054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.043744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.044694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.045608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.046559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.047316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.048934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.050509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.060125 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-41b83406-b409-4cbc-9fb4-6f670d2c7598 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.247279 Aug 29 15:44:59.061427 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2017/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:58 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:59.071712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:59.072698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.083062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.083820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.084537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.085598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.086242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.086822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.205470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.218189 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-53392ff7-efa9-4b8a-b96d-fa6fe139eb20 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1303 microversion: 2.1 time: 0.203296 Aug 29 15:44:59.222271 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2239/4256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:59 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:59.271606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:59.272744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.287608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.288872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.289574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.293138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.293978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.295529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.349757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.357350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.358200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.358862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.359562 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7914c02d-28e0-42ef-a9ee-e34bc9f0b0a2 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1699 microversion: 2.1 time: 0.292104 Aug 29 15:44:59.360171 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2018/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:59 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1699 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:59.360535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lazy-loading 'fault' on Instance uuid 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:59.441985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.454137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.458796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.464500 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c366493f-1d49-49da-b68a-7905a088c6b9 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 200 len: 1367 microversion: 2.47 time: 0.197358 Aug 29 15:44:59.468293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2240/4258] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:59 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:59.890022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:59.890906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.906828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.907370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.910451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.911258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.911741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.912171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.985591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.986612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.987719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.988403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lazy-loading 'fault' on Instance uuid d476030e-7aa7-4121-893a-4291a3fe3fcb {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:00.055491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351e59b6021b44a29665281568960f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9940a1fec84128b318a5f80884447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.071373 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a2751888-f043-426c-a4eb-638c967f1794 tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 200 len: 1304 microversion: 2.1 time: 0.186009 Aug 29 15:45:00.085417 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2019/4259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:59 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.099839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.104715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.125525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.126302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.126907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.130053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.130665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.131077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.240611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.241301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.262633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.263506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.264224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.266045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.270101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.271336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.362668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.363319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.368069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.368668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lazy-loading 'fault' on Instance uuid c56bb56a-ea3a-4b0a-8136-c65c1e4f111b {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:00.469333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fd00311fa540658cfd4076c9a88976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be795a7587c4c2c8e5d71a01f5ba732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.483560 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c7d40cf-686c-4375-87ac-f7c4d944616c tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 200 len: 1308 microversion: 2.1 time: 0.245655 Aug 29 15:45:00.484337 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2020/4260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.498322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.499362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a8c5efe4-bcbd-44e0-8707-19e5b9b25139 req-d7be4e8d-ec32-4df2-a384-47cbbf4ea11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:00.527955 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16f5cbbd-200c-4cb3-a163-29672815843f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.447620 Aug 29 15:45:00.528448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a8c5efe4-bcbd-44e0-8707-19e5b9b25139 req-d7be4e8d-ec32-4df2-a384-47cbbf4ea11a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.529878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2241/4261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.530749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a8c5efe4-bcbd-44e0-8707-19e5b9b25139 req-d7be4e8d-ec32-4df2-a384-47cbbf4ea11a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.533647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a8c5efe4-bcbd-44e0-8707-19e5b9b25139 req-d7be4e8d-ec32-4df2-a384-47cbbf4ea11a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.555552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.556881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.563365 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a8c5efe4-bcbd-44e0-8707-19e5b9b25139 req-d7be4e8d-ec32-4df2-a384-47cbbf4ea11a service nova] Creating event network-changed:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:45:00.568629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.570420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.571419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.573215 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a8c5efe4-bcbd-44e0-8707-19e5b9b25139 req-d7be4e8d-ec32-4df2-a384-47cbbf4ea11a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085863 Aug 29 15:45:00.573726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.575859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.576725 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2021/4262] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:00.577738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.591933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.593664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.607804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.609585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.610138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.612272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.616012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.616608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.650735 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] HTTP exception thrown: Instance 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf could not be found. Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Request method failure captured: Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf HTTP/1.1 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7JIYsTW_oOwDwApUyxCmRhqkek-DSkBwB11I7GSTerlz4sDXCjvU6g2keWaPQziKOI7omyENILwZopdrohC7x7-O6FEvF94mn1Y5pCTLdbbYQcUWsKW6gSPibbglTULMnGrKLqGFtDIq4RmTS28h98S2b501MLdjx1EV9uSkGZWQ0 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 36a76c5994234bfab19624faf79dccc1 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerShowV247Test-1401420404 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a76c5994234bfab19624faf79dccc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a76c5994234bfab19624faf79dccc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a76c5994234bfab19624faf79dccc1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a76c5994234bfab19624faf79dccc1"}]}] Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerShowV247Test-1401420404 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 36a76c5994234bfab19624faf79dccc1 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerShowV247Test-1401420404 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerShowV247Test-1401420404-project Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 6f1f36c44f014a95b1a0ce8f43d0a0b2 Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerShowV247Test-1401420404-project Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf could not be found. Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf'} Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf could not be found. Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf could not be found. Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:00.657558 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:00.662224 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:00.662224 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:00.662224 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:00.662224 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:00.662224 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:00.662224 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf could not be found. Aug 29 15:45:00.662224 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:00.663037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Returning 404 to user: Instance 44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:00.665538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-74c8e60e-74dd-4fc7-ae1f-be4000301b1d tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf" status: 404 len: 111 microversion: 2.47 time: 0.087434 Aug 29 15:45:00.668384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2022/4263] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/44c0c54a-2f83-4ad5-98e1-eaf3dcfbceaf => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:45:00.677761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.679255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.687722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.688441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.700536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.701725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.702502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.703213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.734646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:00.788071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:00.858214 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3994480c-7da7-481d-b389-416b68266b53 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8" status: 204 len: 0 microversion: 2.47 time: 0.184864 Aug 29 15:45:00.861270 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2023/4264] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:45:00 2022] DELETE /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:45:00.872923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.874772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.884479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.886505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.887161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.889315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.891586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.892667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.038650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.043652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.050287 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a0d2ec3-eb09-4f38-8857-b6e2cfca4497 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1699 microversion: 2.1 time: 0.506033 Aug 29 15:45:01.055661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.060654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.062616 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2242/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1699 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:01.064015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55d46923-4272-4d3f-ad15-3a3473eed596 tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8" status: 200 len: 1362 microversion: 2.47 time: 0.201193 Aug 29 15:45:01.065343 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2024/4266] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:01.097619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.098372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] [instance: d476030e-7aa7-4121-893a-4291a3fe3fcb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.106899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.106899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.107605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.108224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.108762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.109266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.125951 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] HTTP exception thrown: Instance d476030e-7aa7-4121-893a-4291a3fe3fcb could not be found. Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Request method failure captured: Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb HTTP/1.1 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN53Xof1kaO7Kev4zVw9iiO-kf9N8TAdiKU0d1i9j6rU4iGmK9EHbdJoNyCtB0LtYveqgaFux9eT2RNfPJctkupWfy7hF2-PenVGwQ-zMxEo51ygKZGuzAkqn_kHcTGhxRuawVUy3DxiZEnA7OMc1vMjl4c3R-OiYE68NXJqVbSpjc8 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3f9940a1fec84128b318a5f80884447b Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerRescueTestJSON-598404729 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9940a1fec84128b318a5f80884447b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9940a1fec84128b318a5f80884447b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9940a1fec84128b318a5f80884447b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9940a1fec84128b318a5f80884447b"}]}] Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerRescueTestJSON-598404729 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3f9940a1fec84128b318a5f80884447b Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerRescueTestJSON-598404729 Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerRescueTestJSON-598404729-project Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 351e59b6021b44a29665281568960f8b Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerRescueTestJSON-598404729-project Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance d476030e-7aa7-4121-893a-4291a3fe3fcb could not be found. Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'd476030e-7aa7-4121-893a-4291a3fe3fcb'} Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d476030e-7aa7-4121-893a-4291a3fe3fcb could not be found. Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d476030e-7aa7-4121-893a-4291a3fe3fcb could not be found. Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.127779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d476030e-7aa7-4121-893a-4291a3fe3fcb could not be found. Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.132559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] Returning 404 to user: Instance d476030e-7aa7-4121-893a-4291a3fe3fcb could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:01.133847 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71df0698-38be-4b7b-81d3-2e9d5197c18c tempest-ServerRescueTestJSON-598404729 tempest-ServerRescueTestJSON-598404729-project] 10.222.0.16 "GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb" status: 404 len: 111 microversion: 2.1 time: 0.040477 Aug 29 15:45:01.134509 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2243/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/d476030e-7aa7-4121-893a-4291a3fe3fcb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:01.509870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.511222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: c56bb56a-ea3a-4b0a-8136-c65c1e4f111b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.524505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.525270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.527081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.527983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.533615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.534074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.550824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.551475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.563988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.564407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.564853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.565700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.566272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.566955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.569600 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] HTTP exception thrown: Instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b could not be found. Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Request method failure captured: Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b HTTP/1.1 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN5lt4d0x5x0-WOGhmwmN5KkQiVIK25XDKNrl_HrfC3mPHmD9tCDtVPR9xDDYVQq-_IySG4iovYtMp3GEZXxKL8EiGjIs9r224Gqc6LSFs2B0ghCNPzfHW-jvsLIofoI4FC8KyBwwgoEFDTeRwuywucMlsR4BxqQQYGl6LCoQa6wk4A Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0be795a7587c4c2c8e5d71a01f5ba732", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}] Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f1fd00311fa540658cfd4076c9a88976 Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b could not be found. Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'c56bb56a-ea3a-4b0a-8136-c65c1e4f111b'} Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b could not be found. Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b could not be found. Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.571373 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b could not be found. Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Returning 404 to user: Instance c56bb56a-ea3a-4b0a-8136-c65c1e4f111b could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:01.575614 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f17fdf0-2c49-4d5f-8678-4a6caec8a6a8 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b" status: 404 len: 111 microversion: 2.1 time: 0.067815 Aug 29 15:45:01.576564 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2025/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/c56bb56a-ea3a-4b0a-8136-c65c1e4f111b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:01.590039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.593931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.614135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.616637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.617516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.618425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.623517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.624475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.666050 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] HTTP exception thrown: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Request method failure captured: Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d HTTP/1.1 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN5lt4d0x5x0-WOGhmwmN5KkQiVIK25XDKNrl_HrfC3mPHmD9tCDtVPR9xDDYVQq-_IySG4iovYtMp3GEZXxKL8EiGjIs9r224Gqc6LSFs2B0ghCNPzfHW-jvsLIofoI4FC8KyBwwgoEFDTeRwuywucMlsR4BxqQQYGl6LCoQa6wk4A Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0be795a7587c4c2c8e5d71a01f5ba732", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}] Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f1fd00311fa540658cfd4076c9a88976 Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd85f0c7f-3281-44a3-a112-f60842476a5d'} Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:01.669363 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.672779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.674436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Returning 404 to user: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:01.675575 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a487139d-c596-4c8c-820d-655f246a6502 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 404 len: 111 microversion: 2.1 time: 0.094140 Aug 29 15:45:01.677443 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2026/4269] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:01 2022] DELETE /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:01.684655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.685437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: d85f0c7f-3281-44a3-a112-f60842476a5d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.704395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.705153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.714153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.717525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.718309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.719219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.751084 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] HTTP exception thrown: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Request method failure captured: Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d HTTP/1.1 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN5lt4d0x5x0-WOGhmwmN5KkQiVIK25XDKNrl_HrfC3mPHmD9tCDtVPR9xDDYVQq-_IySG4iovYtMp3GEZXxKL8EiGjIs9r224Gqc6LSFs2B0ghCNPzfHW-jvsLIofoI4FC8KyBwwgoEFDTeRwuywucMlsR4BxqQQYGl6LCoQa6wk4A Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0be795a7587c4c2c8e5d71a01f5ba732", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}] Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f1fd00311fa540658cfd4076c9a88976 Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd85f0c7f-3281-44a3-a112-f60842476a5d'} Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.752623 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.756418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Returning 404 to user: Instance d85f0c7f-3281-44a3-a112-f60842476a5d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:01.766571 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4572bcf4-1643-444b-bfbc-4e23ccf7031b tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d" status: 404 len: 111 microversion: 2.1 time: 0.085872 Aug 29 15:45:01.770308 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2027/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/d85f0c7f-3281-44a3-a112-f60842476a5d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:01.775287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.775892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.793368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.793793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.794222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.794915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.796324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.796324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.821466 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] HTTP exception thrown: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Request method failure captured: Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 HTTP/1.1 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN5lt4d0x5x0-WOGhmwmN5KkQiVIK25XDKNrl_HrfC3mPHmD9tCDtVPR9xDDYVQq-_IySG4iovYtMp3GEZXxKL8EiGjIs9r224Gqc6LSFs2B0ghCNPzfHW-jvsLIofoI4FC8KyBwwgoEFDTeRwuywucMlsR4BxqQQYGl6LCoQa6wk4A Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0be795a7587c4c2c8e5d71a01f5ba732", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}] Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f1fd00311fa540658cfd4076c9a88976 Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e1211bb4-7e89-4f66-bfb2-1627015fa0f5'} Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:01.839831 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.844684 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.854753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Returning 404 to user: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:01.857355 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-480def04-9bb4-46ff-b135-2b6960c37ed1 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 404 len: 111 microversion: 2.1 time: 0.085888 Aug 29 15:45:01.864451 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2028/4271] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:01 2022] DELETE /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:01.880238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.886236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.888910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] [instance: e1211bb4-7e89-4f66-bfb2-1627015fa0f5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.892409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ece249a1-feab-43b8-b2e8-1eba45656d48 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.345887 Aug 29 15:45:01.893357 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2244/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:01.917802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.922703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.923392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.924289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.926432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.927174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.965159 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] HTTP exception thrown: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Request method failure captured: Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 HTTP/1.1 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN5lt4d0x5x0-WOGhmwmN5KkQiVIK25XDKNrl_HrfC3mPHmD9tCDtVPR9xDDYVQq-_IySG4iovYtMp3GEZXxKL8EiGjIs9r224Gqc6LSFs2B0ghCNPzfHW-jvsLIofoI4FC8KyBwwgoEFDTeRwuywucMlsR4BxqQQYGl6LCoQa6wk4A Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0be795a7587c4c2c8e5d71a01f5ba732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0be795a7587c4c2c8e5d71a01f5ba732", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0be795a7587c4c2c8e5d71a01f5ba732"}]}] Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 0be795a7587c4c2c8e5d71a01f5ba732 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1227644778 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f1fd00311fa540658cfd4076c9a88976 Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1227644778-project Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e1211bb4-7e89-4f66-bfb2-1627015fa0f5'} Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:01.967895 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.971992 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:01.971992 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:01.971992 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:01.971992 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:01.971992 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:01.971992 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. Aug 29 15:45:01.971992 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:01.973703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] Returning 404 to user: Instance e1211bb4-7e89-4f66-bfb2-1627015fa0f5 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:01.974800 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-66f4d1cf-2c68-4429-8448-e2405afe2098 tempest-ServerDiskConfigTestJSON-1227644778 tempest-ServerDiskConfigTestJSON-1227644778-project] 10.222.0.16 "GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5" status: 404 len: 111 microversion: 2.1 time: 0.107684 Aug 29 15:45:01.979624 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2029/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/e1211bb4-7e89-4f66-bfb2-1627015fa0f5 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:02.079685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.086127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.091566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.092478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.103528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.104327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.104916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.106156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.108157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.110013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.110618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.115963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.116653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.117752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.118405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.118991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.184322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.185079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.185707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.186315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lazy-loading 'fault' on Instance uuid 36c3ccfa-c916-431c-a46a-31110b522c25 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:02.236679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.250600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.252987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.255828 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6db8e525-2741-42de-9a83-71110817b83c tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8" status: 200 len: 1362 microversion: 2.47 time: 0.168107 Aug 29 15:45:02.257264 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2030/4274] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:02.625362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b932dcb5-41f3-4179-861b-2236174f727f req-6276fae8-3563-4301-b538-eb16c9812f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c3ccfa-c916-431c-a46a-31110b522c25", "name": "network-vif-deleted", "tag": "ce6fc860-871d-41f3-bfc2-72933f8535d3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:02.628341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b12d5ec1e554d2593d349583fa19691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74479e5a17b45fa978b66de4518af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.637364 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1e8ba63e-63b2-457f-ba72-e78438377880 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 200 len: 1359 microversion: 2.1 time: 0.566103 Aug 29 15:45:02.654304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b932dcb5-41f3-4179-861b-2236174f727f req-6276fae8-3563-4301-b538-eb16c9812f5a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.654304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b932dcb5-41f3-4179-861b-2236174f727f req-6276fae8-3563-4301-b538-eb16c9812f5a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.654940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b932dcb5-41f3-4179-861b-2236174f727f req-6276fae8-3563-4301-b538-eb16c9812f5a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.656363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2245/4275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 1359 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:02.679600 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b932dcb5-41f3-4179-861b-2236174f727f req-6276fae8-3563-4301-b538-eb16c9812f5a service nova] Creating event network-vif-deleted:ce6fc860-871d-41f3-bfc2-72933f8535d3 for instance 36c3ccfa-c916-431c-a46a-31110b522c25 on n-h1-854882-3 Aug 29 15:45:02.686808 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b932dcb5-41f3-4179-861b-2236174f727f req-6276fae8-3563-4301-b538-eb16c9812f5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068060 Aug 29 15:45:02.688700 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2031/4276] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:02.850106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-85099918-0fbc-4b30-825f-b46dbb8827c3 req-0967baf8-b60b-476d-a6de-d483f6877afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e977ea80-1a26-4547-a392-9b56b30f50b3", "name": "network-vif-plugged", "status": "completed", "tag": "b21b8b62-f3a1-4b00-a58c-0b7f487952c5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:02.903951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-85099918-0fbc-4b30-825f-b46dbb8827c3 req-0967baf8-b60b-476d-a6de-d483f6877afc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.912274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-85099918-0fbc-4b30-825f-b46dbb8827c3 req-0967baf8-b60b-476d-a6de-d483f6877afc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.914291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-85099918-0fbc-4b30-825f-b46dbb8827c3 req-0967baf8-b60b-476d-a6de-d483f6877afc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.925025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.926122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.930196 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-85099918-0fbc-4b30-825f-b46dbb8827c3 req-0967baf8-b60b-476d-a6de-d483f6877afc service nova] Creating event network-vif-plugged:b21b8b62-f3a1-4b00-a58c-0b7f487952c5 for instance e977ea80-1a26-4547-a392-9b56b30f50b3 on n-h1-854882-3 Aug 29 15:45:02.937789 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-85099918-0fbc-4b30-825f-b46dbb8827c3 req-0967baf8-b60b-476d-a6de-d483f6877afc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092574 Aug 29 15:45:02.939287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.940082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.940382 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2246/4277] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:02.941283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.942918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.943642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.944433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.286963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:03.287678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:03.315711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.317328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.319938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.323642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.324539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.327291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.377796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.379378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.380066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.380788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lazy-loading 'fault' on Instance uuid ea913cc9-518c-44b6-aa06-22d6fefab6a8 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:03.519498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.530675 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d1f7bdd-9fe3-439d-8fd3-5a0373a45aef tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.612183 Aug 29 15:45:03.531266 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2032/4278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:03.661258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:03.663335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] [instance: 36c3ccfa-c916-431c-a46a-31110b522c25] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:03.666126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.673663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.677526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.679662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.682802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.685994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.686812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.719445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.721506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1f36c44f014a95b1a0ce8f43d0a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a76c5994234bfab19624faf79dccc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.725653 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5eb1e696-d3c3-44c1-9433-b9867b7bb61a tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8" status: 200 len: 1367 microversion: 2.47 time: 0.444282 Aug 29 15:45:03.728309 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2247/4279] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:03 2022] GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8 => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:03.732547 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] HTTP exception thrown: Instance 36c3ccfa-c916-431c-a46a-31110b522c25 could not be found. Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Request method failure captured: Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 HTTP/1.1 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN64zok5ni0-7cQo4rtwwKCtFlk1IJoRUGMZKbIv-tuCo2kccClZRxjLBxx-uSIA4XRQCYKNDI_Mx1pbK88xv0TjlCRhIu80GMqlYTsUxvi8Qooi-KSig-YGJDFhF3dCX1n9n64c4FfQckQ8N43Vb2j2DFVuKhpqweoeDo10S2Tf-7s Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: d74479e5a17b45fa978b66de4518af3b Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-1936734834 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d74479e5a17b45fa978b66de4518af3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d74479e5a17b45fa978b66de4518af3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d74479e5a17b45fa978b66de4518af3b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d74479e5a17b45fa978b66de4518af3b"}]}] Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-1936734834 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: d74479e5a17b45fa978b66de4518af3b Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-1936734834 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-1936734834-project Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 2b12d5ec1e554d2593d349583fa19691 Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-1936734834-project Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 36c3ccfa-c916-431c-a46a-31110b522c25 could not be found. Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '36c3ccfa-c916-431c-a46a-31110b522c25'} Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c3ccfa-c916-431c-a46a-31110b522c25 could not be found. Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c3ccfa-c916-431c-a46a-31110b522c25 could not be found. Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:03.735911 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:03.749635 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:03.749635 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:03.749635 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:03.749635 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:03.749635 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:03.749635 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c3ccfa-c916-431c-a46a-31110b522c25 could not be found. Aug 29 15:45:03.749635 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:03.752591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Returning 404 to user: Instance 36c3ccfa-c916-431c-a46a-31110b522c25 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:03.754206 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73a5959e-2825-40fe-8774-b9b921724e46 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25" status: 404 len: 111 microversion: 2.1 time: 0.097515 Aug 29 15:45:03.758716 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2033/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:03 2022] GET /compute/v2.1/servers/36c3ccfa-c916-431c-a46a-31110b522c25 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:03.767236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e51dc14b-0702-4e21-a084-d5a256356a15 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] Calling method '.version_select at 0x7fb0e3813af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:03.800466 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e51dc14b-0702-4e21-a084-d5a256356a15 tempest-ServersTestJSON-1936734834 tempest-ServersTestJSON-1936734834-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475769980" status: 202 len: 0 microversion: 2.1 time: 0.039310 Aug 29 15:45:03.805122 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2248/4281] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:45:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475769980 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:04.555448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.556127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.574619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.575101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.575539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.580040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.580513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.584302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.769707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.778268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] [instance: ea913cc9-518c-44b6-aa06-22d6fefab6a8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.802996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.806023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.807907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.809921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.810617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.811279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.851857 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] HTTP exception thrown: Instance ea913cc9-518c-44b6-aa06-22d6fefab6a8 could not be found. Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Request method failure captured: Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8 HTTP/1.1 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN7JIYsTW_oOwDwApUyxCmRhqkek-DSkBwB11I7GSTerlz4sDXCjvU6g2keWaPQziKOI7omyENILwZopdrohC7x7-O6FEvF94mn1Y5pCTLdbbYQcUWsKW6gSPibbglTULMnGrKLqGFtDIq4RmTS28h98S2b501MLdjx1EV9uSkGZWQ0 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 36a76c5994234bfab19624faf79dccc1 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerShowV247Test-1401420404 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a76c5994234bfab19624faf79dccc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a76c5994234bfab19624faf79dccc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a76c5994234bfab19624faf79dccc1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a76c5994234bfab19624faf79dccc1"}]}] Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerShowV247Test-1401420404 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 36a76c5994234bfab19624faf79dccc1 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerShowV247Test-1401420404 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerShowV247Test-1401420404-project Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 6f1f36c44f014a95b1a0ce8f43d0a0b2 Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerShowV247Test-1401420404-project Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance ea913cc9-518c-44b6-aa06-22d6fefab6a8 could not be found. Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'ea913cc9-518c-44b6-aa06-22d6fefab6a8'} Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea913cc9-518c-44b6-aa06-22d6fefab6a8 could not be found. Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea913cc9-518c-44b6-aa06-22d6fefab6a8 could not be found. Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:04.854735 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:04.858560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:04.858560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:04.858560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:04.858560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:04.858560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:04.858560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea913cc9-518c-44b6-aa06-22d6fefab6a8 could not be found. Aug 29 15:45:04.858560 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:04.861987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] Returning 404 to user: Instance ea913cc9-518c-44b6-aa06-22d6fefab6a8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:04.863188 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0500bf4-6a83-4d6c-b55c-9216d9a39ddf tempest-ServerShowV247Test-1401420404 tempest-ServerShowV247Test-1401420404-project] 10.222.0.16 "GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8" status: 404 len: 111 microversion: 2.47 time: 0.109291 Aug 29 15:45:04.867518 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2249/4282] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/ea913cc9-518c-44b6-aa06-22d6fefab6a8 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:45:04.911016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.939696 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2adb959a-cd0a-4305-a851-808ba8fd82ae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1366 microversion: 2.1 time: 0.388273 Aug 29 15:45:04.946586 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2034/4283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:05.984409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:05.986544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:05.990773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:05.999869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.000705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.002353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.003442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.004558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.005343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.757046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:06.775696 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cab1b863-385f-44a1-b903-646a11136e68 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1556 microversion: 2.1 time: 0.799846 Aug 29 15:45:06.777851 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2250/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:05 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1556 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:06.810684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:06.813028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:06.826340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:06.841302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=12 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:06.846525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.848014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.849234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.850559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.851861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.852717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.014283 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4612c0f3-16dc-468b-8b0e-419ed326c8c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.213157 Aug 29 15:45:07.017076 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2035/4285] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:45:06 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:07.942199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-464605165", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": "none"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:08.042390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:08.043310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:08.044119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:08.044906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:08.045701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:08.058921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.059826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.060416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.061345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.062316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.062922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.092061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:08.103663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Getting quotas for project 62bf95e66d0847c4beefeba528ebf447. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:08.119739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Getting quotas for user 0d7bfb7936cf4c709466b39a6486bf57 and project 62bf95e66d0847c4beefeba528ebf447. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:08.141408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:08.145308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:08.245623 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56730557-2ff9-4ecd-b9bb-4529532f213d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.552492 Aug 29 15:45:08.256304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2251/4286] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:45:08.290547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a367668d-fa87-44b4-9559-d980b2291fad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.294636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a367668d-fa87-44b4-9559-d980b2291fad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.496762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a367668d-fa87-44b4-9559-d980b2291fad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.522800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a367668d-fa87-44b4-9559-d980b2291fad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.528339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a367668d-fa87-44b4-9559-d980b2291fad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.530946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a367668d-fa87-44b4-9559-d980b2291fad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1277 microversion: 2.57 time: 0.272473 Aug 29 15:45:08.550495 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2036/4287] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:08.817048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5d0ec68b-bb61-4d11-a835-b9fbf5298945 req-8351b160-8a04-42d1-b828-0e22edbe8c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e977ea80-1a26-4547-a392-9b56b30f50b3", "tag": "b21b8b62-f3a1-4b00-a58c-0b7f487952c5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:08.830630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5d0ec68b-bb61-4d11-a835-b9fbf5298945 req-8351b160-8a04-42d1-b828-0e22edbe8c5c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.831352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5d0ec68b-bb61-4d11-a835-b9fbf5298945 req-8351b160-8a04-42d1-b828-0e22edbe8c5c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.832003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5d0ec68b-bb61-4d11-a835-b9fbf5298945 req-8351b160-8a04-42d1-b828-0e22edbe8c5c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.844355 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5d0ec68b-bb61-4d11-a835-b9fbf5298945 req-8351b160-8a04-42d1-b828-0e22edbe8c5c service nova] Creating event network-changed:b21b8b62-f3a1-4b00-a58c-0b7f487952c5 for instance e977ea80-1a26-4547-a392-9b56b30f50b3 on n-h1-854882-3 Aug 29 15:45:08.853346 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5d0ec68b-bb61-4d11-a835-b9fbf5298945 req-8351b160-8a04-42d1-b828-0e22edbe8c5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040672 Aug 29 15:45:08.860277 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2252/4288] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:09.566829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:09.568207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:09.585587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.586994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.588266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.590980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.591972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.593113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.731212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.746050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.748219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.750479 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-355fe7be-db03-4d43-8b38-86977c16ae71 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1329 microversion: 2.57 time: 0.194937 Aug 29 15:45:09.769728 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2037/4289] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:09 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1329 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:10.785610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:10.787295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.810063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.813900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.815376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.815846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.816330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.816765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.061577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.076799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.079686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.081710 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-346fb5f2-4170-4e3e-95fe-a2b224e9a7db tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1335 microversion: 2.57 time: 0.307317 Aug 29 15:45:11.082689 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2253/4290] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:10 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1335 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:12.116331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.117526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.130914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.131974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.132927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.134238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.135107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.135781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.220452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.230305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.232220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.234353 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f2306ead-6d17-4e39-a931-d945438583aa tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1335 microversion: 2.57 time: 0.125098 Aug 29 15:45:12.235435 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2038/4291] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:13.260612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.261280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.284135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.284636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.285079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.285847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.286306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.286738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.471433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.481939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.483981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.488117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e53eee0-da1f-4488-a62f-4a8f20b41b15 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1356 microversion: 2.57 time: 0.232466 Aug 29 15:45:13.488301 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2254/4292] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:13 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1356 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:13.518667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:13.521747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.529529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.530010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.530429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.531114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.531736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.532305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.647908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:13.648427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:13.648970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:13.649598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:13.650080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:13.767869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.783796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.786222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.786827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.787581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.793327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.794058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.886290 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-903c6f2d-a4d8-4cd7-a582-9887135aa975 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "POST /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7/action" status: 202 len: 1137 microversion: 2.57 time: 0.371525 Aug 29 15:45:13.900043 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2039/4293] 10.222.0.16 () {62 vars in 1320 bytes} [Mon Aug 29 15:45:13 2022] POST /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7/action => generated 1137 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:45:13.924002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.924690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.939642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.940238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.940776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.946230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.946819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.947303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.137741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.183162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.185824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.187247 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96f02160-d18d-4e75-bb83-49611d3dacc6 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.277820 Aug 29 15:45:14.211946 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2255/4294] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:13 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:15.211257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.212601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.221165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.222021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.222677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.223580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.224409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.225295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.580348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.596088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.598105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.602704 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-93761897-ba43-4199-9e9d-04e1863c3595 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.395602 Aug 29 15:45:15.623291 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2040/4295] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:15.925119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-831c628f-eeee-4a6d-857d-50c5b40a2581 tempest-ExtensionsTest-1340704256 tempest-ExtensionsTest-1340704256-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.928442 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-831c628f-eeee-4a6d-857d-50c5b40a2581 tempest-ExtensionsTest-1340704256 tempest-ExtensionsTest-1340704256-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.288122 Aug 29 15:45:15.929842 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2256/4296] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:15.939574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-106b8c16-d4d2-4626-83f7-7dd43393fa79 tempest-ExtensionsTest-1340704256 tempest-ExtensionsTest-1340704256-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.943044 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-106b8c16-d4d2-4626-83f7-7dd43393fa79 tempest-ExtensionsTest-1340704256 tempest-ExtensionsTest-1340704256-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007168 Aug 29 15:45:15.944230 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2041/4297] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:45:16.635562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.636471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:16.663442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.666978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.667825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.671910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.672609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.673319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.754437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:16.951243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.966955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.968945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.970548 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac5da3b2-0939-4491-8c88-8263c934dd33 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.343312 Aug 29 15:45:16.987817 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2257/4298] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:18.000516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.001525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.022402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.028952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.030859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.033350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.042413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.043992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.211727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.233271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.240403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.244840 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4ba49d74-06fa-4a65-b814-32cb008283d8 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.251101 Aug 29 15:45:18.246613 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2042/4299] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:19.272196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.273885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.275523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.276584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.285672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.289424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.290137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.290590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.291742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.292477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.293772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.402231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.412991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.414951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.416481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a15525ab-9947-459c-962a-1638c2f6702a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.149462 Aug 29 15:45:19.417962 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2043/4300] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:19.712116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2941e7fe-d1dc-4e20-bccc-f6eef3397b67 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Action: 'create', calling method: .version_select at 0x7fb0eb6aaf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1710166375"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:20.255111 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2941e7fe-d1dc-4e20-bccc-f6eef3397b67 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.990186 Aug 29 15:45:20.273468 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2258/4301] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Aug 29 15:45:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1009 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 15:45:20.274477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-477735c5-19a0-45a6-ac8e-bcd2814db0cd tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e26320d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:20.366437 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-477735c5-19a0-45a6-ac8e-bcd2814db0cd tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 200 len: 345 microversion: 2.1 time: 0.098190 Aug 29 15:45:20.375419 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2044/4302] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:20 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:20.445275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:20.446150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:20.456051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.457049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.457567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.458844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.459398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.460004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.627772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.646144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.653299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.658308 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8cd54c2a-5e03-4b4e-aa18-6d0a9226129b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.217900 Aug 29 15:45:20.658940 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2259/4303] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:20 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:21.394106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96e2ae18-8900-4c0c-981a-e5946195313f tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2558af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.523925 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96e2ae18-8900-4c0c-981a-e5946195313f tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 200 len: 345 microversion: 2.1 time: 0.145576 Aug 29 15:45:21.526133 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2045/4304] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:21.693491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.694309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.706624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.707123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.707737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.709778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.710252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.710679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.862486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.879348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.884135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.886616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb942fa7-df2c-4620-a52f-d4cc5f6b0d53 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.203208 Aug 29 15:45:21.888677 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2260/4305] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:22.542715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c532d6b9-d7a9-418b-b061-4b880fac97c0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e26604c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.617734 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c532d6b9-d7a9-418b-b061-4b880fac97c0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 200 len: 346 microversion: 2.1 time: 0.080489 Aug 29 15:45:22.618568 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2046/4306] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:22.633317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81d307d3-fe0f-45ca-aaaf-1b0983793d09 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Action: 'create', calling method: .version_select at 0x7fb0eb6aa5e0>, body: {"snapshot": {"volume_id": "1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1562513167"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:22.920688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.921786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.929893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.930732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.931696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.932772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.933410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.934149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.039345 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81d307d3-fe0f-45ca-aaaf-1b0983793d09 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.410453 Aug 29 15:45:23.041309 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2261/4307] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Aug 29 15:45:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:23.062828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac739c60-c27c-4cfd-8e65-7ee9e7f81616 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2f8baf0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.115536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.119576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:23.131346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.139268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.140978 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fa146bb1-5113-4c3e-888a-bf9abb250678 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.225152 Aug 29 15:45:23.154213 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2047/4308] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:23.184373 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac739c60-c27c-4cfd-8e65-7ee9e7f81616 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 287 microversion: 2.1 time: 0.129864 Aug 29 15:45:23.193792 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2262/4309] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:23.202484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f74db2a7-5ef6-4a55-a8c0-64dde88c866e tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2660700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.262043 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f74db2a7-5ef6-4a55-a8c0-64dde88c866e tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064932 Aug 29 15:45:23.264271 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2048/4310] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:23.286444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-719cba99-d6cd-4b38-8a62-02807f2916ec tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2f8b9d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.374474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-719cba99-d6cd-4b38-8a62-02807f2916ec tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 287 microversion: 2.1 time: 0.095500 Aug 29 15:45:23.383567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2263/4311] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:23.809611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.810697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.832109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.838547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.839874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.841415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.842417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.844837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.178686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.179806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.201269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.202361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.207149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.209335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.210486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.214845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.237254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.257022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.283636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.289632 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-41b19db1-9653-436a-95a1-bcab80914f64 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2946 microversion: 2.32 time: 0.485902 Aug 29 15:45:24.299382 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2049/4312] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2946 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:24.333808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.338491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.364259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.364382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.364777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.365530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.365993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.366422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.581174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.591187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.599235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.600771 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4efe6ad7-6c0f-4858-9277-5a7f8efe9bf9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.435120 Aug 29 15:45:24.606213 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2264/4313] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:24.615306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0fab5b33-a05b-4e38-bc93-2b586af924b9 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2e17ee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.698136 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0fab5b33-a05b-4e38-bc93-2b586af924b9 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 287 microversion: 2.1 time: 0.089225 Aug 29 15:45:24.699086 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2265/4314] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:24.906980 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b7898e2-01c1-425f-a53f-12b0a4de8c2b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.578042 Aug 29 15:45:24.908090 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2050/4315] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610/os-interface => generated 1832 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:25.670038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.671482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.683503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.685973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.686676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.688710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.689927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.691024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.739505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f33325d-bcd0-4850-abff-fa7a7c7f6e09 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2652820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.814863 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f33325d-bcd0-4850-abff-fa7a7c7f6e09 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 287 microversion: 2.1 time: 0.106168 Aug 29 15:45:25.815938 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2051/4316] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:25.923345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.938247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.941076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.946179 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c467c50d-9b4e-4db1-acb3-87161d2a6ae0 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.303846 Aug 29 15:45:25.946836 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2266/4317] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:26.828658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e09bd342-f5db-42a7-9606-0f27e4ad7999 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e264d790>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.875308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e09bd342-f5db-42a7-9606-0f27e4ad7999 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 288 microversion: 2.1 time: 0.050663 Aug 29 15:45:26.876428 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2052/4318] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 288 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:26.891469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2515c81-3c5d-4298-814e-28b9c58b6673 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0eb766160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.984033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.984639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:27.007166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:27.011431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.012151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.012984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.028010 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b2515c81-3c5d-4298-814e-28b9c58b6673 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 202 len: 0 microversion: 2.1 time: 0.143838 Aug 29 15:45:27.028921 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2267/4319] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:45:26 2022] DELETE /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:27.029379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.030309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.031281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.041367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a855b01-d370-41d3-af2a-b99756aaf582 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e29885e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:27.135209 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a855b01-d370-41d3-af2a-b99756aaf582 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 287 microversion: 2.1 time: 0.101872 Aug 29 15:45:27.137042 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2268/4320] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:27 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:27.273578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.299564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.306230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.318142 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ebe7cd88-bc85-44e6-ba38-3e2f25240900 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.338567 Aug 29 15:45:27.320355 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2053/4321] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:28.149619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5af96972-bdd8-480a-8a77-7920ce4c19ba tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e35c45e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.202653 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5af96972-bdd8-480a-8a77-7920ce4c19ba tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 287 microversion: 2.1 time: 0.057847 Aug 29 15:45:28.203141 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2269/4322] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:28.366174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.366902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.388539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.389047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.389513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.393684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.394395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.397369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.645275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.680294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.683055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.684312 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1fc4ad83-d342-47ee-9892-d36d6eb73197 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.323810 Aug 29 15:45:28.684903 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2054/4323] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:29.223114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c31b0af6-b37d-4e95-8422-4ae6f0e2b77a tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e285e940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.280775 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c31b0af6-b37d-4e95-8422-4ae6f0e2b77a tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 200 len: 287 microversion: 2.1 time: 0.068701 Aug 29 15:45:29.286446 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2270/4324] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:29.636963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3bd5b26f-0b63-47a5-b290-72424ab7dfb1 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Action: 'create', calling method: .version_select at 0x7fb0e2652940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:29.664534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3bd5b26f-0b63-47a5-b290-72424ab7dfb1 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Getting quotas for project 0902daf78513439fb217487d6dd32fef. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:29.673494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3bd5b26f-0b63-47a5-b290-72424ab7dfb1 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Getting quotas for user a8f8403ff3b340869761ae1cfa57ea43 and project 0902daf78513439fb217487d6dd32fef. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:29.712936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.714114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.735043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3bd5b26f-0b63-47a5-b290-72424ab7dfb1 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Getting quotas for project 0902daf78513439fb217487d6dd32fef. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:29.738966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.739860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.741763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.742768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.744493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.745337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.745699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3bd5b26f-0b63-47a5-b290-72424ab7dfb1 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Getting quotas for user a8f8403ff3b340869761ae1cfa57ea43 and project 0902daf78513439fb217487d6dd32fef. Resources: {'server_groups'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:29.798716 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3bd5b26f-0b63-47a5-b290-72424ab7dfb1 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.427936 Aug 29 15:45:29.808256 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2055/4325] 10.222.0.16 () {62 vars in 1214 bytes} [Mon Aug 29 15:45:29 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:45:29.822947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7df8f387-b133-4c80-9483-8aecac105c19 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.851404 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7df8f387-b133-4c80-9483-8aecac105c19 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.041184 Aug 29 15:45:29.851914 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2056/4326] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:45:29.863884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-880c661f-b307-4091-90bd-13677a236f7c tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.890457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.890761 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-880c661f-b307-4091-90bd-13677a236f7c tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/76dfe3e3-eaee-448e-a778-71f4a46917fe" status: 200 len: 235 microversion: 2.64 time: 0.030051 Aug 29 15:45:29.891679 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2057/4327] 10.222.0.16 () {60 vars in 1304 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/os-server-groups/76dfe3e3-eaee-448e-a778-71f4a46917fe => generated 235 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:45:29.901748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.903392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.905352 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-33ffc164-4c61-4314-b344-fd77eaa73c04 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.197751 Aug 29 15:45:29.906592 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2271/4328] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:29.906921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-580769e3-e9c8-42b0-a900-4894dd7fc495 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.965775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-580769e3-e9c8-42b0-a900-4894dd7fc495 tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/76dfe3e3-eaee-448e-a778-71f4a46917fe" status: 204 len: 0 microversion: 2.64 time: 0.065601 Aug 29 15:45:29.966688 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2058/4329] 10.222.0.16 () {60 vars in 1307 bytes} [Mon Aug 29 15:45:29 2022] DELETE /compute/v2.1/os-server-groups/76dfe3e3-eaee-448e-a778-71f4a46917fe => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:45:29.976398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4e0df3f-2f17-4b17-86bd-662fae41a53d tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.983475 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e4e0df3f-2f17-4b17-86bd-662fae41a53d tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] HTTP exception thrown: Instance group 76dfe3e3-eaee-448e-a778-71f4a46917fe could not be found. Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4e0df3f-2f17-4b17-86bd-662fae41a53d tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Request method failure captured: Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/os-server-groups/76dfe3e3-eaee-448e-a778-71f4a46917fe HTTP/1.1 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN8ZG06Ts5X2sFC5u-DL9HwLZE0Qc0fnu0bXEtYW7bARqhcRSkZ9a7XQfOQyjNl1gj9Trm_d0Fzy6y2Q63uoO-seJBFTs1qmDwZuptLRyLCh9RgX6Zzovvv1j9F2u2OGkIamejG8YH7ZzJm5wOsCMaTVlhF2mAPK3Vpp_ys-vcTj8mM Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.64 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 0902daf78513439fb217487d6dd32fef Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerGroup264TestJSON-2121388773 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0902daf78513439fb217487d6dd32fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0902daf78513439fb217487d6dd32fef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0902daf78513439fb217487d6dd32fef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0902daf78513439fb217487d6dd32fef"}]}] Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerGroup264TestJSON-2121388773 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 0902daf78513439fb217487d6dd32fef Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2121388773 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerGroup264TestJSON-2121388773-project Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: a8f8403ff3b340869761ae1cfa57ea43 Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerGroup264TestJSON-2121388773-project Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance group 76dfe3e3-eaee-448e-a778-71f4a46917fe could not be found. Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '76dfe3e3-eaee-448e-a778-71f4a46917fe'} Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 76dfe3e3-eaee-448e-a778-71f4a46917fe could not be found. Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 76dfe3e3-eaee-448e-a778-71f4a46917fe could not be found. Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:29.985428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:29.989434 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:29.989434 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:29.989434 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:29.989434 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:29.989434 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 76dfe3e3-eaee-448e-a778-71f4a46917fe could not be found. Aug 29 15:45:29.989434 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:45:29.991514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4e0df3f-2f17-4b17-86bd-662fae41a53d tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] Returning 404 to user: Instance group 76dfe3e3-eaee-448e-a778-71f4a46917fe could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:29.992653 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e4e0df3f-2f17-4b17-86bd-662fae41a53d tempest-ServerGroup264TestJSON-2121388773 tempest-ServerGroup264TestJSON-2121388773-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/76dfe3e3-eaee-448e-a778-71f4a46917fe" status: 404 len: 117 microversion: 2.64 time: 0.020893 Aug 29 15:45:29.993584 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2272/4330] 10.222.0.16 () {60 vars in 1307 bytes} [Mon Aug 29 15:45:29 2022] DELETE /compute/v2.1/os-server-groups/76dfe3e3-eaee-448e-a778-71f4a46917fe => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:45:30.296104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b447bc4-3c58-4aa6-89f6-0ccb1486609c tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2632ee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.348076 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-1b447bc4-3c58-4aa6-89f6-0ccb1486609c tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] HTTP exception thrown: Snapshot b61ad505-9d86-49a8-8f6d-fa880fd8d7ab could not be found. Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b447bc4-3c58-4aa6-89f6-0ccb1486609c tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Request method failure captured: Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab HTTP/1.1 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN8PodJonqF_eEMzSnXgOHTNjAaDRihYlCYPGPuXb8JW--BDYCOyCEtfgOO_DIJAteIG6yTsolXEauSGuL8V5tksCWCenq299_FsH_PvJ0Sq-NH8KfHRWXURgrdCVOc5PvXTdhPE_zxvGsP8Y3bBCY-WMyMWvZc4tn8ZAUy1LVcla2E Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b2eb9df11664c9b8c6e2b943883ed76", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}] Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 86c365a9cc5b4b558dd02516d266b241 Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: exception: Snapshot b61ad505-9d86-49a8-8f6d-fa880fd8d7ab could not be found. Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'b61ad505-9d86-49a8-8f6d-fa880fd8d7ab'} Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b61ad505-9d86-49a8-8f6d-fa880fd8d7ab could not be found. (HTTP 404) (Request-ID: req-35ad0691-5e31-4014-8fbc-57cf15b457c9) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:45:30.355451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b61ad505-9d86-49a8-8f6d-fa880fd8d7ab could not be found. Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b61ad505-9d86-49a8-8f6d-fa880fd8d7ab could not be found. Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b61ad505-9d86-49a8-8f6d-fa880fd8d7ab could not be found. Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b447bc4-3c58-4aa6-89f6-0ccb1486609c tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Returning 404 to user: Snapshot b61ad505-9d86-49a8-8f6d-fa880fd8d7ab could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b447bc4-3c58-4aa6-89f6-0ccb1486609c tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab" status: 404 len: 111 microversion: 2.1 time: 0.070221 Aug 29 15:45:30.363092 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2059/4331] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/os-snapshots/b61ad505-9d86-49a8-8f6d-fa880fd8d7ab => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:30.373908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f488a0fe-5fbd-4b4b-98e7-429b365b9639 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2f92820>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.516474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f488a0fe-5fbd-4b4b-98e7-429b365b9639 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 202 len: 0 microversion: 2.1 time: 0.149202 Aug 29 15:45:30.517360 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2273/4332] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:45:30 2022] DELETE /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:30.530474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52a797b7-1ece-437a-90e7-a2439d19f8d0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e266c310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.660648 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-52a797b7-1ece-437a-90e7-a2439d19f8d0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 200 len: 345 microversion: 2.1 time: 0.137474 Aug 29 15:45:30.661737 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2060/4333] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:30.935043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.935590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.950640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.953639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.956423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.959068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.961757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.965077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.211450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.229233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.230999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.235864 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c4a1319-28a6-4a9b-a58a-7b32a421e7ad tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.305642 Aug 29 15:45:31.237705 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2274/4334] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:31.678296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13b0772e-2936-4d5e-a962-abf2906c7b38 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2f21ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.788517 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13b0772e-2936-4d5e-a962-abf2906c7b38 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 200 len: 345 microversion: 2.1 time: 0.115916 Aug 29 15:45:31.789756 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2061/4335] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:32.265792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.267123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.301228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.302245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.302951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.309974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.310764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.312408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.601899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.613835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.615313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.616542 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c4c15c9d-5cc8-4e93-8de2-b9589afa7a0e tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.355934 Aug 29 15:45:32.617103 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2275/4336] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:32.807097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c19bba71-b582-4fb6-8c44-a31feea06f87 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2673310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.964661 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c19bba71-b582-4fb6-8c44-a31feea06f87 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 200 len: 345 microversion: 2.1 time: 0.164069 Aug 29 15:45:32.971489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2062/4337] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:33.655156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.656279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.673780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.674648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.675324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.676366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.677151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.677986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.845885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.864375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.866873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.875210 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-577c814f-f1ef-4ad1-9f7e-e21ca494ddc9 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.220038 Aug 29 15:45:33.876683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2276/4338] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:33.982002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb8a9ec6-01c3-4cda-a755-4c699be09ecd tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e26328b0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.083482 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb8a9ec6-01c3-4cda-a755-4c699be09ecd tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 200 len: 345 microversion: 2.1 time: 0.108119 Aug 29 15:45:34.090935 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2063/4339] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:34.438982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1699665255", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "854a1875-ed88-4d82-be39-be4938dff99c"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:34.575106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] validate_networks() for [('854a1875-ed88-4d82-be39-be4938dff99c', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:34.911575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.912046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:34.930247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.933316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.935230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.936291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.938237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.939468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.122622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.133116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.144856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.146567 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bbf3e0e9-e6c4-404a-a56c-187944ed2ebf tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.240565 Aug 29 15:45:35.147371 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2064/4340] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:35.160150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19e978eb-9619-406b-8375-635ce73c71ae tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e26731f0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.216824 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-19e978eb-9619-406b-8375-635ce73c71ae tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] HTTP exception thrown: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19e978eb-9619-406b-8375-635ce73c71ae tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Request method failure captured: Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a HTTP/1.1 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN8PodJonqF_eEMzSnXgOHTNjAaDRihYlCYPGPuXb8JW--BDYCOyCEtfgOO_DIJAteIG6yTsolXEauSGuL8V5tksCWCenq299_FsH_PvJ0Sq-NH8KfHRWXURgrdCVOc5PvXTdhPE_zxvGsP8Y3bBCY-WMyMWvZc4tn8ZAUy1LVcla2E Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b2eb9df11664c9b8c6e2b943883ed76", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}] Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 86c365a9cc5b4b558dd02516d266b241 Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a'} Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. (HTTP 404) (Request-ID: req-203cf68a-28c0-4966-b4b4-d2ddcf5a48fb) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:45:35.219330 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19e978eb-9619-406b-8375-635ce73c71ae tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Returning 404 to user: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:35.226180 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19e978eb-9619-406b-8375-635ce73c71ae tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 404 len: 109 microversion: 2.1 time: 0.074267 Aug 29 15:45:35.233546 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2065/4341] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:35.246598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cda55241-c99c-4c6a-99c3-41ee51ed2bc0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e2673b80>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.304819 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cda55241-c99c-4c6a-99c3-41ee51ed2bc0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] HTTP exception thrown: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cda55241-c99c-4c6a-99c3-41ee51ed2bc0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Request method failure captured: Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a HTTP/1.1 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN8PodJonqF_eEMzSnXgOHTNjAaDRihYlCYPGPuXb8JW--BDYCOyCEtfgOO_DIJAteIG6yTsolXEauSGuL8V5tksCWCenq299_FsH_PvJ0Sq-NH8KfHRWXURgrdCVOc5PvXTdhPE_zxvGsP8Y3bBCY-WMyMWvZc4tn8ZAUy1LVcla2E Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b2eb9df11664c9b8c6e2b943883ed76", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}] Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 86c365a9cc5b4b558dd02516d266b241 Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a'} Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. (HTTP 404) (Request-ID: req-154cb237-5da9-4077-bc6c-082cb609da9c) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:45:35.307323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cda55241-c99c-4c6a-99c3-41ee51ed2bc0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Returning 404 to user: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cda55241-c99c-4c6a-99c3-41ee51ed2bc0 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 404 len: 109 microversion: 2.1 time: 0.072180 Aug 29 15:45:35.312717 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2066/4342] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:45:35 2022] DELETE /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:45:35.321888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.322510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.346747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.347261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.354243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.355112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.357926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.363041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.075969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.089203 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a9b32ee-5958-4126-ac53-486d9d6c00b5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.775839 Aug 29 15:45:36.090660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2067/4343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.114544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b2251ebb-2f6e-4e27-a538-f65764f90b12 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Calling method '.version_select at 0x7fb0e26523a0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.173740 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b2251ebb-2f6e-4e27-a538-f65764f90b12 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] HTTP exception thrown: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b2251ebb-2f6e-4e27-a538-f65764f90b12 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Request method failure captured: Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a HTTP/1.1 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN8PodJonqF_eEMzSnXgOHTNjAaDRihYlCYPGPuXb8JW--BDYCOyCEtfgOO_DIJAteIG6yTsolXEauSGuL8V5tksCWCenq299_FsH_PvJ0Sq-NH8KfHRWXURgrdCVOc5PvXTdhPE_zxvGsP8Y3bBCY-WMyMWvZc4tn8ZAUy1LVcla2E Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b2eb9df11664c9b8c6e2b943883ed76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b2eb9df11664c9b8c6e2b943883ed76", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b2eb9df11664c9b8c6e2b943883ed76"}]}] Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 1b2eb9df11664c9b8c6e2b943883ed76 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-867606586 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 86c365a9cc5b4b558dd02516d266b241 Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-867606586-project Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a'} Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. (HTTP 404) (Request-ID: req-5e64318e-628b-44a6-96fc-45c4bb61462f) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:45:36.176427 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. Aug 29 15:45:36.180203 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:36.184791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b2251ebb-2f6e-4e27-a538-f65764f90b12 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] Returning 404 to user: Volume 1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:36.186084 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b2251ebb-2f6e-4e27-a538-f65764f90b12 tempest-VolumesSnapshotsTestJSON-867606586 tempest-VolumesSnapshotsTestJSON-867606586-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a" status: 404 len: 109 microversion: 2.1 time: 0.093893 Aug 29 15:45:36.186879 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2068/4344] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/os-volumes/1d2f8fc6-3524-4ff8-96b9-08f2369cbc4a => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:36.217071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.218675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.230209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.230701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.237681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.238445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.238920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.239349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.282690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:36.283113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:36.283305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:36.284422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:36.284849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:36.309707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.310548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.312625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.322663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.323901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.327665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.426165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Getting quotas for project e2259cb2720f4b60a478853e8ab3f968. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:36.456741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Getting quotas for user 422e6b467bac4c08a38b62c9e6c76d16 and project e2259cb2720f4b60a478853e8ab3f968. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:36.492264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:36.497488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:36.615373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.626693 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71b13cff-3581-48e6-b9fa-9be3fad8615b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.292338 Aug 29 15:45:36.635470 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2277/4345] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:45:36.636871 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d46f75c-4eb6-4a8b-ab54-ce79f42be586 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.439524 Aug 29 15:45:36.642271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.642780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.650866 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2069/4346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.661149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.662347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.671819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83113c36-bbba-40e2-b7a8-e592a2d8ee36 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.677108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.677658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.678136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.678748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.689162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83113c36-bbba-40e2-b7a8-e592a2d8ee36 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.828331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83113c36-bbba-40e2-b7a8-e592a2d8ee36 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.839231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83113c36-bbba-40e2-b7a8-e592a2d8ee36 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.848370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83113c36-bbba-40e2-b7a8-e592a2d8ee36 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.849833 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83113c36-bbba-40e2-b7a8-e592a2d8ee36 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1259 microversion: 2.21 time: 0.181924 Aug 29 15:45:36.851006 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2070/4347] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:36.862076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.866279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.891010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.891406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.892147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.893084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.895415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.896872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.903163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.916087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.922891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.938339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3914ea0e-1751-4fef-8cd8-05bce31dace4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.290103 Aug 29 15:45:36.950533 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2278/4348] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:37.440605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.451202 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-892b3035-63e1-4fc1-b0f6-90dd029f2343 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.596113 Aug 29 15:45:37.453802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2071/4349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:37.484964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-774615596"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:37.506594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.530679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.534015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.534896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.536610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.539029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.539583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.882123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.883324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.887716 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77984d6c-bb1d-4390-8540-defda590c201 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.389456 Aug 29 15:45:37.891622 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2279/4350] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:37 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 15:45:37.904934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.909819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.910466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.911918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.912401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.917000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.976580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.977644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.990903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.991428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.992384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.996541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.998663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.004036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.113532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.129290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.134641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.138641 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ba0c2e48-d1c0-4a2d-95b0-e9a1647a8601 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1311 microversion: 2.21 time: 0.261595 Aug 29 15:45:38.153416 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2072/4351] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:38.244765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.258444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.259610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.260842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4bd8ca1a-6d87-4c17-9a33-d42bf0fddf31 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.288845 Aug 29 15:45:38.261747 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2280/4352] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:39.163951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.164563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.178666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.181907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.182629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.183949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.193921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.194717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.284821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.285561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.294485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:39.296531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.297272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.297921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.298805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.299967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.300550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.442613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.456549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.458843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.461185 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e3b61d7-2d1a-4056-8d69-a4a94642e217 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.180627 Aug 29 15:45:39.462414 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2281/4353] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:39.652891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.673454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.676796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.678092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cc0c2f39-369e-4107-8c90-608e98cdd229 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1317 microversion: 2.21 time: 0.519392 Aug 29 15:45:39.693520 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2073/4354] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:40.487438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.488832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.511406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.517172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.519318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.520305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.521217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.521880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.624585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.636925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.642800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.644500 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0183c59c-3652-4021-bd48-636a3a432e5a tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.163432 Aug 29 15:45:40.645362 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2282/4355] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:40.705265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.706501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.717814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.718864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.719457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.720396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.721093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.722726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.009896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-26f17056-c6e4-40be-b09b-33513e28bd4b req-a7637514-c49c-4691-ab0f-050bd3f9b00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2921c4-d104-4396-8482-c56c27e6f43a", "tag": "792207f6-63a5-49d9-911a-b815729f545c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:41.020804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-26f17056-c6e4-40be-b09b-33513e28bd4b req-a7637514-c49c-4691-ab0f-050bd3f9b00e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.021640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-26f17056-c6e4-40be-b09b-33513e28bd4b req-a7637514-c49c-4691-ab0f-050bd3f9b00e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.022216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-26f17056-c6e4-40be-b09b-33513e28bd4b req-a7637514-c49c-4691-ab0f-050bd3f9b00e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.035684 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-26f17056-c6e4-40be-b09b-33513e28bd4b req-a7637514-c49c-4691-ab0f-050bd3f9b00e service nova] Creating event network-changed:792207f6-63a5-49d9-911a-b815729f545c for instance 0c2921c4-d104-4396-8482-c56c27e6f43a on n-h1-854882-3 Aug 29 15:45:41.056744 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-26f17056-c6e4-40be-b09b-33513e28bd4b req-a7637514-c49c-4691-ab0f-050bd3f9b00e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036154 Aug 29 15:45:41.057448 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2283/4356] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:41.076343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.088853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.091636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.093916 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-21ff9b02-87b1-4ea1-adf7-8322dc0c16a4 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1359 microversion: 2.21 time: 0.393442 Aug 29 15:45:41.095720 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2074/4357] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1359 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:41.678528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:41.679316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:41.694180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.695066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.695523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.696762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.700012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.700588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.859632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.862889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:41.886456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.891461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.894626 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4a0c76c-6596-44db-aa21-ed4ae5b0b746 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.225271 Aug 29 15:45:41.895810 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2284/4358] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:41 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:42.122553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.124700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.138174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.139310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.140368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.142385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.143456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.144780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.510342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.511208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.522307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.526859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.527715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.529744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.530721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.531445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.563638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:42.578716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:42.589161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:42.601218 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0e28a447-7a94-4d3e-ba35-fddb19b90186 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1359 microversion: 2.21 time: 0.482214 Aug 29 15:45:42.604318 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2075/4359] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:42.615421 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f7bc34c-9444-4a13-94d6-8197639883a3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/ips" status: 200 len: 149 microversion: 2.1 time: 0.110302 Aug 29 15:45:42.622341 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2285/4360] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/ips => generated 149 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:42.920651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.921260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.935334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.935835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.936274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.936996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.937474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.937903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.096375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.106594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.117912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.119985 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57c51526-3ec2-4a5e-af17-66575f27579b tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.203706 Aug 29 15:45:43.121034 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2076/4361] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:43.626578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:43.627280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:43.645097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.646315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.647909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.653970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.654642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.655268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.870685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d508017f-c83a-43bd-b32f-8b3b59f133a1 req-445088de-757a-4126-8264-5a148488c68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-plugged", "status": "completed", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:43.898197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d508017f-c83a-43bd-b32f-8b3b59f133a1 req-445088de-757a-4126-8264-5a148488c68a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.900760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d508017f-c83a-43bd-b32f-8b3b59f133a1 req-445088de-757a-4126-8264-5a148488c68a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.901367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d508017f-c83a-43bd-b32f-8b3b59f133a1 req-445088de-757a-4126-8264-5a148488c68a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.918565 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d508017f-c83a-43bd-b32f-8b3b59f133a1 req-445088de-757a-4126-8264-5a148488c68a service nova] Creating event network-vif-plugged:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:45:43.927116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d508017f-c83a-43bd-b32f-8b3b59f133a1 req-445088de-757a-4126-8264-5a148488c68a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060133 Aug 29 15:45:43.928835 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2077/4362] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:44.151357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.152476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.160560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.161666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.162323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.163255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.163926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.164580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.263686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.278928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.299480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.302675 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a366b6e-12bd-48cc-8eb9-30f685121903 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1359 microversion: 2.21 time: 0.680237 Aug 29 15:45:44.332858 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2286/4363] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:43 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1359 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:44.693016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.727289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.730488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.732339 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97332f49-d8d9-4439-ad3b-3cbfd1dca32d tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1365 microversion: 2.57 time: 0.585642 Aug 29 15:45:44.733190 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2078/4364] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1365 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:45.333035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.335188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.355294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.358158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.359133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.362183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.364174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.365411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.760695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.761951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.787970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.788661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.789262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.791392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.792630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.801828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.342401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.358617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.362612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.365466 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-252fad17-1712-4d02-beaa-e55464bd1454 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1383 microversion: 2.57 time: 0.609173 Aug 29 15:45:46.369175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:46.373893 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2079/4365] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1383 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:46.405138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.416960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.429786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.431655 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b2027a47-e739-494e-a91d-ed4b06076cd1 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1359 microversion: 2.21 time: 1.105455 Aug 29 15:45:46.438598 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2287/4366] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1359 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:46.890600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed30c85d-a76d-407e-9a12-aa57135638b8"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:46.896582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.902596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:46.929843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.930808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.932816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.937964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.939596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.940231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.276083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:47.402788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.404549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.427215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:47.431955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.438433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.442256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.444064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.447818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.453063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.517029 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83c77f8d-73f2-4ecf-98bc-f9f42ae89a94 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633039 Aug 29 15:45:47.518851 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2080/4367] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:45:46 2022] POST /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:47.526708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.541750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.566628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.567045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.567482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.568188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.568642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.569062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.828680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.848282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.881353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.882895 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e71ebf4-8a55-4d4a-a8ad-9249030b5b23 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1371 microversion: 2.57 time: 0.488335 Aug 29 15:45:47.883490 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2288/4368] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1371 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:48.765165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.783838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.797857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.799854 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c5c3764-66b4-41f3-9c50-9f0d3526570a tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1359 microversion: 2.21 time: 1.279240 Aug 29 15:45:48.811816 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2081/4369] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1359 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:48.918648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.919793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.950617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.951137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.951600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.952349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.952804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.953238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.191364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.224609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.230796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.237257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2aeed56-2b9b-4ebf-acf4-77db68bcef34 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1356 microversion: 2.57 time: 0.327459 Aug 29 15:45:49.257765 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2289/4370] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1356 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:49.264701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9815c33f-f475-443c-be49-240da430b676 req-df5ab7d8-ff78-4dee-8765-2e268efca302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2921c4-d104-4396-8482-c56c27e6f43a", "name": "network-vif-plugged", "status": "completed", "tag": "792207f6-63a5-49d9-911a-b815729f545c"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:49.312586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.317850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.323554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9815c33f-f475-443c-be49-240da430b676 req-df5ab7d8-ff78-4dee-8765-2e268efca302 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.324045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9815c33f-f475-443c-be49-240da430b676 req-df5ab7d8-ff78-4dee-8765-2e268efca302 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.324487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9815c33f-f475-443c-be49-240da430b676 req-df5ab7d8-ff78-4dee-8765-2e268efca302 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.354242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.366102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.366926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.367742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.368266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.368711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.400039 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9815c33f-f475-443c-be49-240da430b676 req-df5ab7d8-ff78-4dee-8765-2e268efca302 service nova] Creating event network-vif-plugged:792207f6-63a5-49d9-911a-b815729f545c for instance 0c2921c4-d104-4396-8482-c56c27e6f43a on n-h1-854882-3 Aug 29 15:45:49.420881 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9815c33f-f475-443c-be49-240da430b676 req-df5ab7d8-ff78-4dee-8765-2e268efca302 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162853 Aug 29 15:45:49.422769 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2082/4371] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:49.459618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:49.786897 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4af7e5f9-d0f2-414d-8cf3-33ea15811ddb tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "DELETE /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 204 len: 0 microversion: 2.57 time: 0.515546 Aug 29 15:45:49.791920 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2290/4372] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:45:49 2022] DELETE /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:45:49.813729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.814484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.840502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.841644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.841772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.842179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.842664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.843395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.843854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.844283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.855117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.855727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.863482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.864856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.866752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.869842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.300286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.330123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.347553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.356722 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bfd6af5e-95a9-42a7-ad6e-6af2ce9ca1e4 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1362 microversion: 2.57 time: 0.559446 Aug 29 15:45:50.361373 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2083/4373] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1362 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:50.653628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.668067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.670479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.671905 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f9751b27-637c-4517-8ad1-102c250416b9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1359 microversion: 2.21 time: 0.837090 Aug 29 15:45:50.692630 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2291/4374] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1359 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:51.390784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.394824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:51.421439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.421951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.430162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.434591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.435457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.436120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.566190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:51.589771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:51.606723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:51.620044 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b27d57d-919f-45af-8aa7-9871a0506481 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1362 microversion: 2.57 time: 0.233853 Aug 29 15:45:51.621741 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2084/4375] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:51.702588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.703987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:51.722333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.731789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.734212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.738009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.743753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.744214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.644306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.646102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.671159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.675296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.675832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.680013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.681343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.682037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.771259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.772109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.773539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.775302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lazy-loading 'fault' on Instance uuid 718a5a8a-05da-45c9-86ee-916e720409a7 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:52.829012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.838960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.858583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.860033 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3da82936-2807-4145-bc61-945aee7cd076 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1552 microversion: 2.21 time: 1.163763 Aug 29 15:45:52.861626 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2292/4376] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1552 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:52.869565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.884136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.887374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d7bfb7936cf4c709466b39a6486bf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62bf95e66d0847c4beefeba528ebf447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.892634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcf7e7c4-f72c-42f8-bc40-e472777466e5 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 200 len: 1367 microversion: 2.57 time: 0.252382 Aug 29 15:45:52.895610 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2085/4377] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:52.908534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.911611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.924491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.933037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.933863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.935667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.936344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.937054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.005344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:53.231687 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-123420bc-4385-4c38-bd09-05ef3ec104c6 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 204 len: 0 microversion: 2.21 time: 0.333567 Aug 29 15:45:53.232747 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2086/4378] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:45:52 2022] DELETE /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:45:53.246189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.247500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.255102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.256061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.256792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.257972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.259281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.260214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.260479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-375689133", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8bcffcaa-2f11-4fa0-abb9-119e3c2131d0"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:53.399930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] validate_networks() for [('8bcffcaa-2f11-4fa0-abb9-119e3c2131d0', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:53.609818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.637571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.657019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.665961 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-789cc96a-0e9d-40bc-8f45-230967a7998c tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1558 microversion: 2.21 time: 0.420892 Aug 29 15:45:53.666987 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2087/4379] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1558 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:53.923158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.925718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] [instance: 718a5a8a-05da-45c9-86ee-916e720409a7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.951821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.968623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.971886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.975337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.976703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.978767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.031009 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] HTTP exception thrown: Instance 718a5a8a-05da-45c9-86ee-916e720409a7 could not be found. Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Request method failure captured: Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 HTTP/1.1 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN8D0rhPW4IJZ-M9YVy1cfbqiG8vgal0jr1ucADPBn5YbUcSj5PBirbWvPOgxmfq4dMksbvJE0MST6E1BcNCCHlEd-bO8F6MhfwMbcZ4_pbwl4AB2eomxyE4A7QA2AXjo9DN5HuyOFjRTVkMlIX9I2DCwfJVyoeWRn4GWs7CgLCgyUg Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.57 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 62bf95e66d0847c4beefeba528ebf447 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerShowV257Test-304477757 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62bf95e66d0847c4beefeba528ebf447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62bf95e66d0847c4beefeba528ebf447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62bf95e66d0847c4beefeba528ebf447", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62bf95e66d0847c4beefeba528ebf447"}]}] Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerShowV257Test-304477757 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 62bf95e66d0847c4beefeba528ebf447 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerShowV257Test-304477757 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerShowV257Test-304477757-project Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 0d7bfb7936cf4c709466b39a6486bf57 Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerShowV257Test-304477757-project Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 718a5a8a-05da-45c9-86ee-916e720409a7 could not be found. Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '718a5a8a-05da-45c9-86ee-916e720409a7'} Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718a5a8a-05da-45c9-86ee-916e720409a7 could not be found. Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718a5a8a-05da-45c9-86ee-916e720409a7 could not be found. Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:54.033533 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:54.037468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:54.037468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:54.037468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:54.037468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:54.037468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:54.037468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718a5a8a-05da-45c9-86ee-916e720409a7 could not be found. Aug 29 15:45:54.037468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:45:54.042841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] Returning 404 to user: Instance 718a5a8a-05da-45c9-86ee-916e720409a7 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:54.045511 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed2519ab-8f2d-487f-8e85-d1898eb95c77 tempest-ServerShowV257Test-304477757 tempest-ServerShowV257Test-304477757-project] 10.222.0.16 "GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7" status: 404 len: 111 microversion: 2.57 time: 0.130500 Aug 29 15:45:54.048515 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2088/4380] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/718a5a8a-05da-45c9-86ee-916e720409a7 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:45:54.372077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:54.373045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:54.373739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:54.374169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:54.374601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:54.402220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.402721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.403172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.403919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.404384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.404819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.473852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Getting quotas for project 2b6f6de6c8ae45b4a0d469b6bb28f245. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:54.492463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Getting quotas for user 0556380b71674698b3260103ef247c85 and project 2b6f6de6c8ae45b4a0d469b6bb28f245. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:54.530039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:54.534906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:54.685072 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-da86dde7-7271-4e4c-8c52-07d6684d6f38 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.818841 Aug 29 15:45:54.690705 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2293/4381] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:54.705617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae71d483-9b16-4d25-9636-b0861aa245db tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.707030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae71d483-9b16-4d25-9636-b0861aa245db tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.709723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.710357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.729752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:54.739612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.763888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.764414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.765304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.765889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.782634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.913553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae71d483-9b16-4d25-9636-b0861aa245db tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.923998 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae71d483-9b16-4d25-9636-b0861aa245db tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1215 microversion: 2.1 time: 0.226476 Aug 29 15:45:54.924589 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2089/4382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:55.951503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.952156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.968230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.969026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.969670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.970547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.971158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.978144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.200324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.212163 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1f1c09c-a337-48bd-9504-3277225da964 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1219 microversion: 2.1 time: 0.261926 Aug 29 15:45:56.216240 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2090/4383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.613905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.627681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.633103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.637096 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-27f8fb18-2e5c-46dd-b96e-a76777f7c901 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1558 microversion: 2.21 time: 1.933374 Aug 29 15:45:56.657193 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2294/4384] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1558 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:57.244403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.245025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.271650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.275959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.279299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.281891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.285921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.286614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.627014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.646766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-abafa3ac-391c-4301-804c-df3c5eba01ad tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1285 microversion: 2.1 time: 0.406671 Aug 29 15:45:57.679494 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2091/4385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:57.683972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.684599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.715340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.731005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.753632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.756256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.757058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.760822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.685127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.685781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.707708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.708213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.708634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.709339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.709826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.710250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.437236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.457941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.460269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '422e6b467bac4c08a38b62c9e6c76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2259cb2720f4b60a478853e8ab3f968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.466091 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e110a6c7-4331-4c55-ac86-e092f417e0c9 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 200 len: 1516 microversion: 2.21 time: 1.794577 Aug 29 15:45:59.470354 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2295/4386] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 1516 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:59.504521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b7ef750e-7ab0-48ee-9eee-dfc29b1a96c0 req-15a659b8-0793-4de5-bf23-7c336f56eb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2921c4-d104-4396-8482-c56c27e6f43a", "name": "network-vif-deleted", "tag": "792207f6-63a5-49d9-911a-b815729f545c"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:59.535793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7ef750e-7ab0-48ee-9eee-dfc29b1a96c0 req-15a659b8-0793-4de5-bf23-7c336f56eb16 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.538450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7ef750e-7ab0-48ee-9eee-dfc29b1a96c0 req-15a659b8-0793-4de5-bf23-7c336f56eb16 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.544660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7ef750e-7ab0-48ee-9eee-dfc29b1a96c0 req-15a659b8-0793-4de5-bf23-7c336f56eb16 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.584821 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b7ef750e-7ab0-48ee-9eee-dfc29b1a96c0 req-15a659b8-0793-4de5-bf23-7c336f56eb16 service nova] Creating event network-vif-deleted:792207f6-63a5-49d9-911a-b815729f545c for instance 0c2921c4-d104-4396-8482-c56c27e6f43a on n-h1-854882-3 Aug 29 15:45:59.607243 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b7ef750e-7ab0-48ee-9eee-dfc29b1a96c0 req-15a659b8-0793-4de5-bf23-7c336f56eb16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135219 Aug 29 15:45:59.608958 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2296/4387] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:00.494904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.496456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.514221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.517040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.517842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.518812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.525015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.525776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.553021 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] HTTP exception thrown: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Request method failure captured: Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a HTTP/1.1 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN8dz1z6p6sgZk0FTYhnXOVHNrYzDRqpEY3slqRqH7mZNzdPPx6hH7msjHQy7zqFps6TtKewoBbnv_hQDpBLUMwvXgLxOxJECPX-5MkadIY-afYZjclyqv88yIU4OaMBph6GQBOwhMmEtCp-pY9q95ROAZlT7tBFpu9JDT04DFsia9M Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: e2259cb2720f4b60a478853e8ab3f968 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2259cb2720f4b60a478853e8ab3f968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e2259cb2720f4b60a478853e8ab3f968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e2259cb2720f4b60a478853e8ab3f968", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2259cb2720f4b60a478853e8ab3f968"}]}] Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: e2259cb2720f4b60a478853e8ab3f968 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-InstanceActionsV221TestJSON-1963258084-project Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 422e6b467bac4c08a38b62c9e6c76d16 Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-InstanceActionsV221TestJSON-1963258084-project Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '0c2921c4-d104-4396-8482-c56c27e6f43a'} Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.560134 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.563848 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.569132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Returning 404 to user: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:00.570346 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-97976a28-4970-4612-b799-49e83c639248 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 404 len: 111 microversion: 2.21 time: 0.082309 Aug 29 15:46:00.574031 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2297/4388] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:46:00.581285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '.version_select at 0x7fb0e2f8b040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.586517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.600746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.607413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.610024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.611098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.618865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.623044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.875325 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-64110f66-06d6-4ae9-b7ad-20b7dd0288e8 tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.288462 Aug 29 15:46:00.876625 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2298/4389] 10.222.0.16 () {60 vars in 1337 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a/os-instance-actions => generated 611 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:46:00.895757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.899433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.921539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.936702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.937342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.938238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.940839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.941416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.969377 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] HTTP exception thrown: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Request method failure captured: Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a HTTP/1.1 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN8dz1z6p6sgZk0FTYhnXOVHNrYzDRqpEY3slqRqH7mZNzdPPx6hH7msjHQy7zqFps6TtKewoBbnv_hQDpBLUMwvXgLxOxJECPX-5MkadIY-afYZjclyqv88yIU4OaMBph6GQBOwhMmEtCp-pY9q95ROAZlT7tBFpu9JDT04DFsia9M Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: e2259cb2720f4b60a478853e8ab3f968 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2259cb2720f4b60a478853e8ab3f968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e2259cb2720f4b60a478853e8ab3f968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e2259cb2720f4b60a478853e8ab3f968", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2259cb2720f4b60a478853e8ab3f968"}]}] Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: e2259cb2720f4b60a478853e8ab3f968 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-InstanceActionsV221TestJSON-1963258084-project Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 422e6b467bac4c08a38b62c9e6c76d16 Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-InstanceActionsV221TestJSON-1963258084-project Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '0c2921c4-d104-4396-8482-c56c27e6f43a'} Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:00.976596 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:00.980779 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.985163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Returning 404 to user: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:00.986297 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb7a72bf-6c74-4adb-b1b2-b586596ac52b tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 404 len: 111 microversion: 2.21 time: 0.099524 Aug 29 15:46:00.987509 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2299/4390] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:46:00 2022] DELETE /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:46:01.001370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.002428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] [instance: 0c2921c4-d104-4396-8482-c56c27e6f43a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.020119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.021068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.024688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.030701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.034905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.035673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.114918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] HTTP exception thrown: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Request method failure captured: Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a HTTP/1.1 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN8dz1z6p6sgZk0FTYhnXOVHNrYzDRqpEY3slqRqH7mZNzdPPx6hH7msjHQy7zqFps6TtKewoBbnv_hQDpBLUMwvXgLxOxJECPX-5MkadIY-afYZjclyqv88yIU4OaMBph6GQBOwhMmEtCp-pY9q95ROAZlT7tBFpu9JDT04DFsia9M Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: e2259cb2720f4b60a478853e8ab3f968 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2259cb2720f4b60a478853e8ab3f968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e2259cb2720f4b60a478853e8ab3f968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e2259cb2720f4b60a478853e8ab3f968", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2259cb2720f4b60a478853e8ab3f968"}]}] Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: e2259cb2720f4b60a478853e8ab3f968 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1963258084 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-InstanceActionsV221TestJSON-1963258084-project Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 422e6b467bac4c08a38b62c9e6c76d16 Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-InstanceActionsV221TestJSON-1963258084-project Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '0c2921c4-d104-4396-8482-c56c27e6f43a'} Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.124639 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. Aug 29 15:46:01.128210 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.130427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] Returning 404 to user: Instance 0c2921c4-d104-4396-8482-c56c27e6f43a could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:01.134720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b208e28-37d9-4901-b4a3-e0e851292e4d tempest-InstanceActionsV221TestJSON-1963258084 tempest-InstanceActionsV221TestJSON-1963258084-project] 10.222.0.16 "GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a" status: 404 len: 111 microversion: 2.21 time: 0.141044 Aug 29 15:46:01.137595 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2300/4391] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/0c2921c4-d104-4396-8482-c56c27e6f43a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:46:01.144528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:01.164229 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bddbb134-72b8-4176-97ca-beb751377570 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1315 microversion: 2.1 time: 2.482962 Aug 29 15:46:01.179010 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2092/4392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1315 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:02.187834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.188586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.206051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.210903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.216038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.217182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.219444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.220117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.598074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e12827d3-f117-4b7b-ba9f-bde3739a8f6b req-344d1812-96b3-453f-9c72-74a6472bd78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a109d87f-77aa-4eed-acb9-ae5684d1655e", "tag": "ca650b48-0544-4555-a6fc-794deefb6cd1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:02.628429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e12827d3-f117-4b7b-ba9f-bde3739a8f6b req-344d1812-96b3-453f-9c72-74a6472bd78a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.635370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e12827d3-f117-4b7b-ba9f-bde3739a8f6b req-344d1812-96b3-453f-9c72-74a6472bd78a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.636397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e12827d3-f117-4b7b-ba9f-bde3739a8f6b req-344d1812-96b3-453f-9c72-74a6472bd78a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.664287 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e12827d3-f117-4b7b-ba9f-bde3739a8f6b req-344d1812-96b3-453f-9c72-74a6472bd78a service nova] Creating event network-changed:ca650b48-0544-4555-a6fc-794deefb6cd1 for instance a109d87f-77aa-4eed-acb9-ae5684d1655e on n-h1-854882-3 Aug 29 15:46:02.680761 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e12827d3-f117-4b7b-ba9f-bde3739a8f6b req-344d1812-96b3-453f-9c72-74a6472bd78a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093705 Aug 29 15:46:02.684594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2093/4393] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:04.436990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:04.483314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.494934 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-875ef8e8-1e72-491b-aa37-eace77a28bb6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1315 microversion: 2.1 time: 2.310424 Aug 29 15:46:04.496757 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2301/4394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1315 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:05.522763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:05.540089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.544158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.580895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.585996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.589369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.590549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.591039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.591480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.296637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.309857 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b02374ef-e53b-48a1-9eaa-1638e3493599 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1315 microversion: 2.1 time: 1.789774 Aug 29 15:46:07.312340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2094/4395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1315 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:08.335142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.335692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.348755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:08.352396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.353458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.360086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.361504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.362174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.362839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.814375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a12c6bf2-d16f-4ace-a697-05adb69e0a0f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: .version_select at 0x7fb0eb573430>, body: {"keypair": {"name": "tempest-keypair-624313454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd2fQKFOVAMQYNbtxHET1Rk49/9Odpk7Y5tY6qOGpI3jZz+jQW8wii/swD/xbm8gfbCdBpK6C50G1p+nH8fN3m4VaUZYRitNSZgyQmrjSpzj+peTcUL0n6fvS5a/Ulilg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:08.896294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a12c6bf2-d16f-4ace-a697-05adb69e0a0f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:08.921618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a12c6bf2-d16f-4ace-a697-05adb69e0a0f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:08.982154 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a12c6bf2-d16f-4ace-a697-05adb69e0a0f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171726 Aug 29 15:46:08.984821 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2095/4396] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:46:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:09.941004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.955521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1260468-f2c8-435f-bc8d-d556ffd7026f tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1315 microversion: 2.1 time: 1.623100 Aug 29 15:46:09.958582 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2302/4397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1315 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:10.142095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-dd44ef90-da96-4c23-adf2-4b88ef8fd923 req-608b96c0-1fd4-4b08-a887-1b26ff5d06b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a109d87f-77aa-4eed-acb9-ae5684d1655e", "name": "network-vif-plugged", "status": "completed", "tag": "ca650b48-0544-4555-a6fc-794deefb6cd1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:10.180924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dd44ef90-da96-4c23-adf2-4b88ef8fd923 req-608b96c0-1fd4-4b08-a887-1b26ff5d06b7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.187460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dd44ef90-da96-4c23-adf2-4b88ef8fd923 req-608b96c0-1fd4-4b08-a887-1b26ff5d06b7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.190353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dd44ef90-da96-4c23-adf2-4b88ef8fd923 req-608b96c0-1fd4-4b08-a887-1b26ff5d06b7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.227982 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-dd44ef90-da96-4c23-adf2-4b88ef8fd923 req-608b96c0-1fd4-4b08-a887-1b26ff5d06b7 service nova] Creating event network-vif-plugged:ca650b48-0544-4555-a6fc-794deefb6cd1 for instance a109d87f-77aa-4eed-acb9-ae5684d1655e on n-h1-854882-3 Aug 29 15:46:10.234868 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-dd44ef90-da96-4c23-adf2-4b88ef8fd923 req-608b96c0-1fd4-4b08-a887-1b26ff5d06b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098222 Aug 29 15:46:10.236087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2096/4398] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:10.980843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.981614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.990262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:11.016563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.017070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.019256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.020012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.020479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.020917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.067842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:11.486869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.504444 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-913749ab-a555-4744-90b5-330978e1cbe4 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1315 microversion: 2.1 time: 0.529811 Aug 29 15:46:11.505983 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2303/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:12.550624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.557053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.583216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.584640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.589628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.590680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.594740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.596200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.789680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.790323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.802426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.803125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.804337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.806114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.806834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.808170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.191187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.209055 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cd5f6d4-bbb4-4e39-a237-1ce18f454353 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1502 microversion: 2.1 time: 0.665258 Aug 29 15:46:13.211764 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2097/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1502 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:13.237169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.237943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.246747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.247429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.248150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.249591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.250201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.250971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.273262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.282343 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0ffcd59-d5ea-4209-9f16-0962e4b94e36 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.496868 Aug 29 15:46:13.288332 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2304/4401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:13.321211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-596909113"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:13.324157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.331506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.335116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.335695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.336896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.337612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.338272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.391181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:13.408149 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c209f713-42cc-4d05-b79d-50f8815e4272 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.176002 Aug 29 15:46:13.416469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2098/4402] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Aug 29 15:46:13 2022] DELETE /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e/os-server-password => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:46:13.426367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.426864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.443121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.443613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.447051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.447783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.448246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.448674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.510241 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-95244432-7dd8-48b9-be1c-a667e09573da tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.091955 Aug 29 15:46:13.519217 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2099/4403] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e/os-server-password => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:46:13.528150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.529630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.554156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.556183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.556868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.558972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.560524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.562370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.608957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:13.725276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c5b2476-eb5e-4de8-8af7-d070134dede5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.407508 Aug 29 15:46:13.726460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2305/4404] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:46:13 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 15:46:13.743659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-32cc4daa-5830-4548-8ad1-4fb2b2c6822a tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 204 len: 0 microversion: 2.1 time: 0.221307 Aug 29 15:46:13.748032 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2100/4405] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:13 2022] DELETE /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:13.759730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.760464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.779996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.780781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.781473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.782889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.783553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.784149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.092677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.103361 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83a107b4-ba19-4d30-8f9d-5a97a76ecffd tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1508 microversion: 2.1 time: 0.348387 Aug 29 15:46:14.103812 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2306/4406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1508 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:15.130493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:15.132450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.152130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.154626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.155082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.157084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.158098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.158542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.675873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.693770 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0215b149-15dd-4ceb-a45a-3e72bf0c17ea tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1508 microversion: 2.1 time: 0.571357 Aug 29 15:46:15.695455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2101/4407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:15 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1508 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:15.909748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-718838667", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d897c5c0-df74-4e72-afd9-ed5315eaa2e0"}], "security_groups": [{"name": "tempest-securitygroup--687419697"}], "key_name": "tempest-keypair-624313454", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:16.088270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-73f22549-6ecd-434b-bc70-f584a7e26ad5 req-de82ac74-9270-4361-a996-5bbc3d0afef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-unplugged", "status": "completed", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:16.103880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-73f22549-6ecd-434b-bc70-f584a7e26ad5 req-de82ac74-9270-4361-a996-5bbc3d0afef4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.104370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-73f22549-6ecd-434b-bc70-f584a7e26ad5 req-de82ac74-9270-4361-a996-5bbc3d0afef4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.104804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-73f22549-6ecd-434b-bc70-f584a7e26ad5 req-de82ac74-9270-4361-a996-5bbc3d0afef4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.133959 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-73f22549-6ecd-434b-bc70-f584a7e26ad5 req-de82ac74-9270-4361-a996-5bbc3d0afef4 service nova] Creating event network-vif-unplugged:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:46:16.154800 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-73f22549-6ecd-434b-bc70-f584a7e26ad5 req-de82ac74-9270-4361-a996-5bbc3d0afef4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071065 Aug 29 15:46:16.155760 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2102/4408] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:16.186385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] validate_networks() for [('d897c5c0-df74-4e72-afd9-ed5315eaa2e0', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:46:16.718309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.723074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.744935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.745958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.747756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.748858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.754709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.755168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.084056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0556380b71674698b3260103ef247c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.097304 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bb889486-784f-49ac-af8f-aad23cc5f640 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 200 len: 1466 microversion: 2.1 time: 0.383779 Aug 29 15:46:17.101050 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2103/4409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 1466 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:17.107496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:17.108471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:17.108960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:17.109377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:17.109819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:17.129870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.130511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.130972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.131732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.132209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.132628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.154697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:17.160722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:17.177805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:17.181461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:17.216113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-cf42be43-b6fd-4f63-9341-2334f1829fb2 req-f38b3609-a242-424e-8951-733b2e08a0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a109d87f-77aa-4eed-acb9-ae5684d1655e", "name": "network-vif-deleted", "tag": "ca650b48-0544-4555-a6fc-794deefb6cd1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:17.236473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cf42be43-b6fd-4f63-9341-2334f1829fb2 req-f38b3609-a242-424e-8951-733b2e08a0e1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.237944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cf42be43-b6fd-4f63-9341-2334f1829fb2 req-f38b3609-a242-424e-8951-733b2e08a0e1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.239933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cf42be43-b6fd-4f63-9341-2334f1829fb2 req-f38b3609-a242-424e-8951-733b2e08a0e1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.278242 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-cf42be43-b6fd-4f63-9341-2334f1829fb2 req-f38b3609-a242-424e-8951-733b2e08a0e1 service nova] Creating event network-vif-deleted:ca650b48-0544-4555-a6fc-794deefb6cd1 for instance a109d87f-77aa-4eed-acb9-ae5684d1655e on n-h1-854882-3 Aug 29 15:46:17.290480 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-cf42be43-b6fd-4f63-9341-2334f1829fb2 req-f38b3609-a242-424e-8951-733b2e08a0e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079549 Aug 29 15:46:17.292608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5aa10382-d48b-4647-bfd0-e8161bdbbf71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.385985 Aug 29 15:46:17.293556 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2104/4410] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:17.294157 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2307/4411] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:46:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:46:17.313728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-89c4fe54-ae19-462d-9a20-8f67f3e5e4dc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.330079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-89c4fe54-ae19-462d-9a20-8f67f3e5e4dc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.589873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-89c4fe54-ae19-462d-9a20-8f67f3e5e4dc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.602040 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-89c4fe54-ae19-462d-9a20-8f67f3e5e4dc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1240 microversion: 2.1 time: 0.299869 Aug 29 15:46:17.606087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2105/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1240 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:18.126256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:18.127081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] [instance: a109d87f-77aa-4eed-acb9-ae5684d1655e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.135406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.149885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.151129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.151900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.152447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.152887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.177681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-plugged", "status": "completed", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:18.191951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.192905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.193819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.199980 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] HTTP exception thrown: Instance a109d87f-77aa-4eed-acb9-ae5684d1655e could not be found. Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Request method failure captured: Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e HTTP/1.1 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN8wEeWRAKSNGkb4z544mb6ZJYLJSMbCheyTSypKF9btoiNaPei116zz5eeZogFVpSoAv0CfrOblFB_KIcwZ1jxPAHOJuowxmYw--naqJXCBn8kF6oD8FQKYbfe9SAAN7EgoLNd8jaoGzAH1ZFvmMfvrosKsQ3Du8FRpmhb-i4gNB3E Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 2b6f6de6c8ae45b4a0d469b6bb28f245 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerPasswordTestJSON-901119692 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b6f6de6c8ae45b4a0d469b6bb28f245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b6f6de6c8ae45b4a0d469b6bb28f245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b6f6de6c8ae45b4a0d469b6bb28f245", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b6f6de6c8ae45b4a0d469b6bb28f245"}]}] Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerPasswordTestJSON-901119692 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 2b6f6de6c8ae45b4a0d469b6bb28f245 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerPasswordTestJSON-901119692 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerPasswordTestJSON-901119692-project Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 0556380b71674698b3260103ef247c85 Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerPasswordTestJSON-901119692-project Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance a109d87f-77aa-4eed-acb9-ae5684d1655e could not be found. Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'a109d87f-77aa-4eed-acb9-ae5684d1655e'} Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a109d87f-77aa-4eed-acb9-ae5684d1655e could not be found. Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a109d87f-77aa-4eed-acb9-ae5684d1655e could not be found. Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:18.203477 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a109d87f-77aa-4eed-acb9-ae5684d1655e could not be found. Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:46:18.207251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] Returning 404 to user: Instance a109d87f-77aa-4eed-acb9-ae5684d1655e could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:18.212398 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa37d7e8-54d0-4f48-8249-49a37cc6f7d6 tempest-ServerPasswordTestJSON-901119692 tempest-ServerPasswordTestJSON-901119692-project] 10.222.0.16 "GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e" status: 404 len: 111 microversion: 2.1 time: 0.090491 Aug 29 15:46:18.214986 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2308/4413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:18 2022] GET /compute/v2.1/servers/a109d87f-77aa-4eed-acb9-ae5684d1655e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:18.218407 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] Creating event network-vif-plugged:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:46:18.231570 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056703 Aug 29 15:46:18.232399 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2106/4414] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:18.628815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:18.629484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.668023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.668983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.684194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.685221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.686316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.687919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.052510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.069928 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-138e6da0-fac9-4214-8891-c258c6139eae tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1292 microversion: 2.1 time: 0.441227 Aug 29 15:46:19.077440 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2309/4415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:18 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1292 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:19.982770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.984152 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-26a96699-ada2-4aa2-8f4e-a12cddec3849 req-ec524a53-d22b-4bdc-b907-fa7ed8098e8e service nova] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002034 Aug 29 15:46:19.984618 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2107/4416] 10.222.0.16 () {56 vars in 886 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:46:20.100809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.102625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.122641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.126053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.126749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.132817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.138150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.138879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.895493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:20.940004 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75d954d4-42a3-4915-90bf-e38d579af39d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1298 microversion: 2.1 time: 0.843230 Aug 29 15:46:20.943782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2310/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1298 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:21.989241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:21.990052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.006234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.006733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.007503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.015273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.016371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.021410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.016751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.029196 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c5a1c3b-a14c-4248-b29e-8ea21ffbb727 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1365 microversion: 2.1 time: 1.051729 Aug 29 15:46:23.030479 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2108/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:21 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1365 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:24.055407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.056779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.076502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.077372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.078090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.079671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.087709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.090466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.151231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.165339 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-032e3335-00a3-440b-ba73-0c421c625a9d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1365 microversion: 2.1 time: 1.111852 Aug 29 15:46:25.166269 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2311/4419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1365 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:25.470147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5de7c780-977c-4d88-94e5-596cac40d94f req-abc086b4-ad3b-411e-b1ef-22491f197f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3306b415-8c0a-4823-a389-9a48192c7371", "tag": "f8d96b17-e071-4b44-b519-c050296f55a2"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:25.494738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:25.521119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5de7c780-977c-4d88-94e5-596cac40d94f req-abc086b4-ad3b-411e-b1ef-22491f197f5c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.522078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5de7c780-977c-4d88-94e5-596cac40d94f req-abc086b4-ad3b-411e-b1ef-22491f197f5c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.522882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5de7c780-977c-4d88-94e5-596cac40d94f req-abc086b4-ad3b-411e-b1ef-22491f197f5c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.582402 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5de7c780-977c-4d88-94e5-596cac40d94f req-abc086b4-ad3b-411e-b1ef-22491f197f5c service nova] Creating event network-changed:f8d96b17-e071-4b44-b519-c050296f55a2 for instance 3306b415-8c0a-4823-a389-9a48192c7371 on n-h1-854882-3 Aug 29 15:46:25.603220 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5de7c780-977c-4d88-94e5-596cac40d94f req-abc086b4-ad3b-411e-b1ef-22491f197f5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141380 Aug 29 15:46:25.603862 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2109/4420] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:26.190411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.196382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.213245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.213937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.214512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.215991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.217852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.218613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.876373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.906891 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c03d791e-0de3-47b4-a37f-9c5471587f0a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1365 microversion: 2.1 time: 0.718526 Aug 29 15:46:26.907577 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2312/4421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1365 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:27.929822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:27.946738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.947890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.962089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.966449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.967414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.968805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.973614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.974548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.862326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.882149 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3234efe3-0c28-4d36-b37d-0632cc6261bc tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1365 microversion: 2.1 time: 0.944565 Aug 29 15:46:28.890292 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2110/4422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1365 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:29.913015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.914723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.935301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:29.938502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:29.954321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.957570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.964064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.965366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.967896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.971261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.522692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.537421 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-53c71e20-de20-405b-829a-68532d182bf5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1365 microversion: 2.1 time: 0.631471 Aug 29 15:46:30.538052 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2313/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1365 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:31.450353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-17b2ccf4-c62f-45f1-a6e5-65553c1495b6 req-8fe1ef66-f8a6-4bc8-a2ff-488257ed3700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3306b415-8c0a-4823-a389-9a48192c7371", "name": "network-vif-plugged", "status": "completed", "tag": "f8d96b17-e071-4b44-b519-c050296f55a2"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:31.538258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-17b2ccf4-c62f-45f1-a6e5-65553c1495b6 req-8fe1ef66-f8a6-4bc8-a2ff-488257ed3700 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.540605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-17b2ccf4-c62f-45f1-a6e5-65553c1495b6 req-8fe1ef66-f8a6-4bc8-a2ff-488257ed3700 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.548626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-17b2ccf4-c62f-45f1-a6e5-65553c1495b6 req-8fe1ef66-f8a6-4bc8-a2ff-488257ed3700 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.563163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:31.563918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:31.575436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.577453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.579312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.580951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.581953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.586159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.602120 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-17b2ccf4-c62f-45f1-a6e5-65553c1495b6 req-8fe1ef66-f8a6-4bc8-a2ff-488257ed3700 service nova] Creating event network-vif-plugged:f8d96b17-e071-4b44-b519-c050296f55a2 for instance 3306b415-8c0a-4823-a389-9a48192c7371 on n-h1-854882-3 Aug 29 15:46:31.609205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-17b2ccf4-c62f-45f1-a6e5-65553c1495b6 req-8fe1ef66-f8a6-4bc8-a2ff-488257ed3700 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177840 Aug 29 15:46:31.616185 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2111/4424] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:33.563638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:33.588132 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1686996d-b246-4f1f-95ca-2b402fd87916 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1365 microversion: 2.1 time: 2.020120 Aug 29 15:46:33.589090 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2314/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:31 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1365 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:34.615328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:34.618599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:34.628084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.635168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.637733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.639234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.644147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.644602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.499167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.516642 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-050bb6af-da3b-4c85-a68b-d474b12488e4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1365 microversion: 2.1 time: 0.910601 Aug 29 15:46:35.527659 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2112/4426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:34 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1365 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:36.539832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.540520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:36.559615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.567885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.568968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.578243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.579957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.580435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.649465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.669864 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aeca8e29-a9fa-4c3e-b8f3-5ae9bb0218bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1555 microversion: 2.1 time: 1.134388 Aug 29 15:46:37.679814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2315/4427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1555 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:37.707681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.709538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.728785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.729505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.730154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.731051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.734221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.735459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.021679 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f41bf57-c1fe-4eae-b4f4-1ae28aa17d6d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.318390 Aug 29 15:46:38.022307 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2113/4428] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371/os-interface => generated 285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:38.935005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-69c4f0b2-32b6-4b4f-8d6e-04d0b795844c tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Action: 'create', calling method: .version_select at 0x7fb0e29f5af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2043569346", "metadata": {"Type": "work"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:39.552229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1952019352", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "1bf1d082-91bb-496d-b227-d74b15af35c0"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:39.694046 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-69c4f0b2-32b6-4b4f-8d6e-04d0b795844c tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.274015 Aug 29 15:46:39.704337 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2316/4429] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:46:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1284 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 15:46:39.726218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] validate_networks() for [('1bf1d082-91bb-496d-b227-d74b15af35c0', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:46:39.729201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cba1df54-95dc-4fa4-a16f-aafe26624533 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0eb715e50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:39.859982 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cba1df54-95dc-4fa4-a16f-aafe26624533 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 353 microversion: 2.1 time: 0.154530 Aug 29 15:46:39.860799 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2317/4430] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:39 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:40.879412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-38fea91e-8d28-418c-a157-56bed78f0cfc tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e29f55e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:41.024271 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-38fea91e-8d28-418c-a157-56bed78f0cfc tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 353 microversion: 2.1 time: 0.152177 Aug 29 15:46:41.026323 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2318/4431] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:40 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:42.046770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5543c9e0-eceb-48c0-95fb-a5db60d5b09d tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e2956670>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:42.196478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5543c9e0-eceb-48c0-95fb-a5db60d5b09d tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 354 microversion: 2.1 time: 0.160113 Aug 29 15:46:42.198676 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2319/4432] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:42 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:42.224928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70f2e82b-2e0e-495c-91f6-1602bb814e53 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e29f5ca0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:42.362546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70f2e82b-2e0e-495c-91f6-1602bb814e53 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 354 microversion: 2.1 time: 0.151798 Aug 29 15:46:42.363980 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2320/4433] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:42 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:42.393369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70bd3f28-4d44-48ac-b7d8-34d3254297d3 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e2e179d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:42.499735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:42.500268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:42.500632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:42.501046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:42.501493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:42.528509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:42.529581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:42.530623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:42.536864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:42.537783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:42.538986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:42.597172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Getting quotas for project c694100bb1f945b79ae0010754b82add. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:42.619009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Getting quotas for user 3dd53cf1dd3343d989e650620d853c0c and project c694100bb1f945b79ae0010754b82add. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:42.627813 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70bd3f28-4d44-48ac-b7d8-34d3254297d3 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 202 len: 0 microversion: 2.1 time: 0.247865 Aug 29 15:46:42.628562 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2321/4434] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:46:42 2022] DELETE /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:42.638178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1c5ecf42-3ed2-4154-87a7-11d0af102ca3 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e29943a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:42.686808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:42.691753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:42.783043 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1c5ecf42-3ed2-4154-87a7-11d0af102ca3 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 353 microversion: 2.1 time: 0.150155 Aug 29 15:46:42.783806 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2322/4435] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:42 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:42.807995 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc3fcdc0-92e9-4abc-a632-6582ef3c226b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.779583 Aug 29 15:46:42.811157 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2114/4436] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:46:42.822571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35776bc4-13a1-4de1-a7c1-a883b56cab3c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:42.823453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35776bc4-13a1-4de1-a7c1-a883b56cab3c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:42.826477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:43.148690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35776bc4-13a1-4de1-a7c1-a883b56cab3c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:43.215506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35776bc4-13a1-4de1-a7c1-a883b56cab3c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:43.234587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35776bc4-13a1-4de1-a7c1-a883b56cab3c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:43.238960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35776bc4-13a1-4de1-a7c1-a883b56cab3c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1262 microversion: 2.26 time: 0.420636 Aug 29 15:46:43.246279 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2323/4437] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:42 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1262 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:43.638246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b8573966-0ea1-4db4-a504-d46e545b83a2 req-d891a0a3-5c42-4be4-8060-d1f878613ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3306b415-8c0a-4823-a389-9a48192c7371", "tag": "f8d96b17-e071-4b44-b519-c050296f55a2"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:43.664955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8573966-0ea1-4db4-a504-d46e545b83a2 req-d891a0a3-5c42-4be4-8060-d1f878613ba8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:43.665856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8573966-0ea1-4db4-a504-d46e545b83a2 req-d891a0a3-5c42-4be4-8060-d1f878613ba8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:43.666509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8573966-0ea1-4db4-a504-d46e545b83a2 req-d891a0a3-5c42-4be4-8060-d1f878613ba8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:43.679560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=5,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:43.694334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b8573966-0ea1-4db4-a504-d46e545b83a2 req-d891a0a3-5c42-4be4-8060-d1f878613ba8 service nova] Creating event network-changed:f8d96b17-e071-4b44-b519-c050296f55a2 for instance 3306b415-8c0a-4823-a389-9a48192c7371 on n-h1-854882-3 Aug 29 15:46:43.712810 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b8573966-0ea1-4db4-a504-d46e545b83a2 req-d891a0a3-5c42-4be4-8060-d1f878613ba8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083578 Aug 29 15:46:43.714401 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2115/4438] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:43.798584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4601c08c-6bed-49b9-897f-1fa6046e14d1 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e3813f70>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:43.924793 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4601c08c-6bed-49b9-897f-1fa6046e14d1 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 353 microversion: 2.1 time: 0.130456 Aug 29 15:46:43.927304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2324/4439] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:43 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:44.303067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d1fe074-7a20-42a4-975f-c481eb6f84f3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:44.305463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6d1fe074-7a20-42a4-975f-c481eb6f84f3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:44.681355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d1fe074-7a20-42a4-975f-c481eb6f84f3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.693901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d1fe074-7a20-42a4-975f-c481eb6f84f3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.695879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d1fe074-7a20-42a4-975f-c481eb6f84f3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.697067 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d1fe074-7a20-42a4-975f-c481eb6f84f3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1262 microversion: 2.26 time: 0.408199 Aug 29 15:46:44.706539 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2116/4440] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:44 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1262 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:44.954604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee0c97d6-6d16-4891-8868-0d7d9975b0e7 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e3813940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:45.098680 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ee0c97d6-6d16-4891-8868-0d7d9975b0e7 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 353 microversion: 2.1 time: 0.161852 Aug 29 15:46:45.099655 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2325/4441] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:44 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:45.736631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:45.738401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:45.775847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.776090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.776659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.777860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.778529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.791419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.995145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.009749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.011742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.018158 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9256b215-da5a-462b-9e4e-bdd13ae339e3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1314 microversion: 2.26 time: 0.287157 Aug 29 15:46:46.019249 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2117/4442] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:45 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:46.114636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b14fd5f6-81cb-4168-96bd-de1cdd8d8e3d tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e29f5040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:46.302549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b14fd5f6-81cb-4168-96bd-de1cdd8d8e3d tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 353 microversion: 2.1 time: 0.191975 Aug 29 15:46:46.313007 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2326/4443] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:46 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:46.926419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:46.927869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:46.939090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.939588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.940022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:46.940743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.941198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.941664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.052115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.054650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:47.069645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.079858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.080645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.081603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.082227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.082841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.145049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:47.420775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:47.449260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:47.451974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:47.462088 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-69f6f51d-e442-4ed6-b2d4-a465d1ae4144 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1320 microversion: 2.26 time: 0.414167 Aug 29 15:46:47.462325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:47.466661 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2327/4444] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:47.480814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fbfc9b4a-b7b7-4101-8c29-1294bb1104f1 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e28215e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.496130 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-292f0685-6a0e-4996-9b62-172516cc043b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 0.573410 Aug 29 15:46:47.496900 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2118/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:46 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:47.616860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fbfc9b4a-b7b7-4101-8c29-1294bb1104f1 tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 200 len: 353 microversion: 2.1 time: 0.148304 Aug 29 15:46:47.618777 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2328/4446] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:48.492661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:48.493691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:48.508887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:48.539385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:48.544985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:48.552654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:48.553294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:48.564909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:48.565467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:48.565920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:48.587561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:48.588453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:48.588588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:48.603113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:48.605079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:48.607311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.166542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:49.180794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:49.182685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:49.188715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7fbdda5e-2f6c-443e-bfd5-1ab141f39f97 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.700970 Aug 29 15:46:49.202116 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2119/4447] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:48 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:49.216805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f50ed36e-89b9-4bfe-97e2-2574dddf285e tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Calling method '.version_select at 0x7fb0e3a2dc10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:49.285530 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f50ed36e-89b9-4bfe-97e2-2574dddf285e tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] HTTP exception thrown: Volume ee07d255-4fe6-4bec-9541-ff86ec4549b1 could not be found. Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f50ed36e-89b9-4bfe-97e2-2574dddf285e tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Request method failure captured: Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 HTTP/1.1 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN9eTxtPsoqG1En-0-djID2uXGKlkDufIol-boqeVwRXX-bFqFgDa_irzHeCvxZEhCrdrTa-4WSkSM-kP5SXbkBx4t7pN-gebNAVvHCcatBjvyAA2yZjMCQHP8ECf-p480UuF80GFuCFT6Hap4YMzKOQY7TXQ97XQdUzTofyqUx_yUQ Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 000ed910310c43b5a1b576629945cfba Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesGetTestJSON-191997145 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/000ed910310c43b5a1b576629945cfba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/000ed910310c43b5a1b576629945cfba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_000ed910310c43b5a1b576629945cfba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/000ed910310c43b5a1b576629945cfba"}]}] Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesGetTestJSON-191997145 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 000ed910310c43b5a1b576629945cfba Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesGetTestJSON-191997145 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesGetTestJSON-191997145-project Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f4f7c8f24789434982e5e2a279077449 Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesGetTestJSON-191997145-project Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume ee07d255-4fe6-4bec-9541-ff86ec4549b1 could not be found. Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ee07d255-4fe6-4bec-9541-ff86ec4549b1'} Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee07d255-4fe6-4bec-9541-ff86ec4549b1 could not be found. (HTTP 404) (Request-ID: req-7287c203-15c4-43f9-a6c1-80155467b072) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:46:49.288667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee07d255-4fe6-4bec-9541-ff86ec4549b1 could not be found. Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee07d255-4fe6-4bec-9541-ff86ec4549b1 could not be found. Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee07d255-4fe6-4bec-9541-ff86ec4549b1 could not be found. Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f50ed36e-89b9-4bfe-97e2-2574dddf285e tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] Returning 404 to user: Volume ee07d255-4fe6-4bec-9541-ff86ec4549b1 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f50ed36e-89b9-4bfe-97e2-2574dddf285e tempest-VolumesGetTestJSON-191997145 tempest-VolumesGetTestJSON-191997145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1" status: 404 len: 109 microversion: 2.1 time: 0.087076 Aug 29 15:46:49.295295 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2120/4448] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:49 2022] GET /compute/v2.1/os-volumes/ee07d255-4fe6-4bec-9541-ff86ec4549b1 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:50.208316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:50.223209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:50.224679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.266092 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eb7ffcc6-8594-4e22-ab20-7f304723f880 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.740919 Aug 29 15:46:50.275103 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2329/4449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:48 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:50.276504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.281766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.282592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.302202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.302996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.314433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.321925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1003026275"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:50.342705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.380197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.383426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.386241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.387403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.388130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.388639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.986155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.004005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.011935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.018267 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9c06093f-5233-4a5f-90c4-25aa3b817cbc tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.800738 Aug 29 15:46:51.033940 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40a64048-2170-46d1-8a48-5b80bdc8370f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.738317 Aug 29 15:46:51.033940 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2330/4450] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:46:50 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 29 15:46:51.035764 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2121/4451] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:50 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:51.055454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-eac3b4d6-6d2b-46db-b5e9-a7128971b4ea req-b4431f6f-5ec7-46d4-897f-76f2be8b9d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-unplugged", "status": "completed", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:51.071415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:51.074680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:51.077364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eac3b4d6-6d2b-46db-b5e9-a7128971b4ea req-b4431f6f-5ec7-46d4-897f-76f2be8b9d5c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.077880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eac3b4d6-6d2b-46db-b5e9-a7128971b4ea req-b4431f6f-5ec7-46d4-897f-76f2be8b9d5c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.078309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eac3b4d6-6d2b-46db-b5e9-a7128971b4ea req-b4431f6f-5ec7-46d4-897f-76f2be8b9d5c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.097178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.100844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.103910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.107506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.108511 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-eac3b4d6-6d2b-46db-b5e9-a7128971b4ea req-b4431f6f-5ec7-46d4-897f-76f2be8b9d5c service nova] Creating event network-vif-unplugged:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:46:51.110460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.112720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.129986 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-eac3b4d6-6d2b-46db-b5e9-a7128971b4ea req-b4431f6f-5ec7-46d4-897f-76f2be8b9d5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087645 Aug 29 15:46:51.131630 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2331/4452] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:51.949613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.972338 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c053e60-53af-4404-842a-d0011aa9ea03 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 0.925486 Aug 29 15:46:51.977749 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2122/4453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:51 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:52.055245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:52.056941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:52.077311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.084000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.084833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.089525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.092392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.093609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.858425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.882229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.890340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.896215 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8213a96b-dd0d-4680-a9ca-3d115e884645 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.846673 Aug 29 15:46:52.898238 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2332/4454] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:52 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:53.007766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:53.009554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:53.046448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:53.053801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.055284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.055828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.056625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.058001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.058508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.518921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.531966 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-707b35f8-482d-4aa4-bb34-ab9dc74b8582 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1687 microversion: 2.1 time: 0.536496 Aug 29 15:46:53.538630 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2123/4455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:52 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1687 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:53.794015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-df3934e3-0910-4ee0-a227-0edc9051c19c req-f47b96f6-840c-4da6-89a2-a9bf8ab69164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceb2a77a-f101-46e4-ac3f-ac892ad813b5", "tag": "15abd44b-a680-47b5-acbf-c219847a4c77"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:53.804229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:53.840957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df3934e3-0910-4ee0-a227-0edc9051c19c req-f47b96f6-840c-4da6-89a2-a9bf8ab69164 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.845655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df3934e3-0910-4ee0-a227-0edc9051c19c req-f47b96f6-840c-4da6-89a2-a9bf8ab69164 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.846513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df3934e3-0910-4ee0-a227-0edc9051c19c req-f47b96f6-840c-4da6-89a2-a9bf8ab69164 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.880903 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-df3934e3-0910-4ee0-a227-0edc9051c19c req-f47b96f6-840c-4da6-89a2-a9bf8ab69164 service nova] Creating event network-changed:15abd44b-a680-47b5-acbf-c219847a4c77 for instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 on n-h2-854882-3 Aug 29 15:46:53.891337 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-df3934e3-0910-4ee0-a227-0edc9051c19c req-f47b96f6-840c-4da6-89a2-a9bf8ab69164 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100619 Aug 29 15:46:53.895011 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2333/4456] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:53.939774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:53.940813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:53.956742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.958369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.959080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.960166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.966854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.967889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.356960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.371773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.373626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.379874 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bcdabd18-0c20-4b01-b2d0-d7296dbbadd8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.448248 Aug 29 15:46:54.394120 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2124/4457] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:53 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:54.565452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.566862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:54.575026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.576176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.577220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.578626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.579695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.580579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.406940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.410267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.420853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:55.451344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.451836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.452275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.461203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.462198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.462660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.007264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.031627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.041185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.045367 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ca55cd36-d2d1-46b4-9759-8f409d1923f4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.644529 Aug 29 15:46:56.049595 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2125/4458] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:56.203368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.231837 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a04ed95d-e551-4d19-994b-e5b82e4a927c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1687 microversion: 2.1 time: 1.674022 Aug 29 15:46:56.241640 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2334/4459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:54 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1687 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:57.083759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:57.085058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:57.098494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.100615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.103754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.104808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.105485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.106758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.261493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:57.262437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:57.301152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.302412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.310855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.321014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.324805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.327004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.858967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:57.896285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:57.919946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:57.928187 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b1f0ab43-d647-4a35-ab6e-ef9aae7445f8 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.846884 Aug 29 15:46:57.945883 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2126/4460] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:57 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:58.970465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:58.971868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:58.978415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:58.980867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:58.983525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.984311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.984951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.985905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.987291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.988173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.988516 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-27cd8121-d82e-4ed3-af32-28cf53ee10c6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 1.733876 Aug 29 15:46:58.989178 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2335/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:57 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:59.853276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.869806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.890311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.895970 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-405bf598-2867-42d1-b0a4-ec70bbc0439a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.930124 Aug 29 15:46:59.900315 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2127/4462] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:58 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:59.931437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fe785d6e-b3ee-4b3c-9059-1188c52d141e req-7283d0da-9fe0-4d0d-834f-6e862b609ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-plugged", "status": "completed", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:59.948951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe785d6e-b3ee-4b3c-9059-1188c52d141e req-7283d0da-9fe0-4d0d-834f-6e862b609ba0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.953811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe785d6e-b3ee-4b3c-9059-1188c52d141e req-7283d0da-9fe0-4d0d-834f-6e862b609ba0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.956648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe785d6e-b3ee-4b3c-9059-1188c52d141e req-7283d0da-9fe0-4d0d-834f-6e862b609ba0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.002960 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fe785d6e-b3ee-4b3c-9059-1188c52d141e req-7283d0da-9fe0-4d0d-834f-6e862b609ba0 service nova] Creating event network-vif-plugged:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:47:00.017980 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fe785d6e-b3ee-4b3c-9059-1188c52d141e req-7283d0da-9fe0-4d0d-834f-6e862b609ba0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.706227 Aug 29 15:47:00.020223 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2336/4463] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:00.026272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.026899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:00.040735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.041541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.047682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.047682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.048006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.048910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.838290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:00.848344 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76f9dd7f-7fff-4c5f-8b80-483323e3f3b2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 0.827135 Aug 29 15:47:00.851184 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2128/4464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:00.922939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.923687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:00.941185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.941751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.942193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.942913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.943394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.943811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.754171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6e7d8013-19e7-4681-9964-fb616ace531c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'create', calling method: .version_select at 0x7fb0eb629160>, body: {"keypair": {"name": "tempest-keypair-1680339133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaCIWShDAihz7oMCOAq5Sx1IWCG3YlHjD+r+JfWaSaN6BUOtL+q6XrITMAlYZboMmsWo4CdLFdpykTk83NPTuuyMoj04UUCBR99dFmzszy6L0AodyvQZkT0HgJz33EVFQ=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:01.835052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6e7d8013-19e7-4681-9964-fb616ace531c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for project da6f1599da704dbc9ec86f3638638bba. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:01.853727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6e7d8013-19e7-4681-9964-fb616ace531c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for user dc8f7bc05b984ea0a3d96aea8a65d139 and project da6f1599da704dbc9ec86f3638638bba. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:01.935205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6e7d8013-19e7-4681-9964-fb616ace531c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.598188 Aug 29 15:47:01.936090 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2129/4465] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:47:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 600 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 15:47:01.943839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:01.948841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:01.963178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.963671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.966327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.967087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.967553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.967992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.075234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:02.092966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:02.099057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:02.105343 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fcdd23b2-cdd1-4bc0-8a47-b54d59dbaed4 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 1.184405 Aug 29 15:47:02.106000 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2337/4466] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:02.615763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:02.632209 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d54d3746-7c73-4e95-99d2-5cc472b5fc70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 0.689186 Aug 29 15:47:02.639869 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2130/4467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:01 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:02.720889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-50f9aa5b-3288-43b0-8d1e-784ae8afa5ab req-e991899b-3430-4292-b811-14aaf0ab279f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb2a77a-f101-46e4-ac3f-ac892ad813b5", "name": "network-vif-plugged", "status": "completed", "tag": "15abd44b-a680-47b5-acbf-c219847a4c77"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:02.759231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50f9aa5b-3288-43b0-8d1e-784ae8afa5ab req-e991899b-3430-4292-b811-14aaf0ab279f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.768266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50f9aa5b-3288-43b0-8d1e-784ae8afa5ab req-e991899b-3430-4292-b811-14aaf0ab279f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.768847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50f9aa5b-3288-43b0-8d1e-784ae8afa5ab req-e991899b-3430-4292-b811-14aaf0ab279f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.810682 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-50f9aa5b-3288-43b0-8d1e-784ae8afa5ab req-e991899b-3430-4292-b811-14aaf0ab279f service nova] Creating event network-vif-plugged:15abd44b-a680-47b5-acbf-c219847a4c77 for instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 on n-h2-854882-3 Aug 29 15:47:02.822230 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-50f9aa5b-3288-43b0-8d1e-784ae8afa5ab req-e991899b-3430-4292-b811-14aaf0ab279f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105425 Aug 29 15:47:02.823187 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2338/4468] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:03.129008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:03.129785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:03.152645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.156087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.162594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.171094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.171825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.177846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.667795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:03.669129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:03.694508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.699682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.700154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.700912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.701375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.713156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.848445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.870396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.874834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.879387 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25c563e6-4f6c-4c40-b2fb-494ab00a1a7b tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1362 microversion: 2.26 time: 0.754945 Aug 29 15:47:03.881471 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2131/4469] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:03 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1362 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:04.903058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:04.904741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:04.926113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.927768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.929124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.932393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.934271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.934951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.263931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:05.276217 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c9b5f7df-9b63-4e9f-a67a-3ddf38a8b25e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 1.613081 Aug 29 15:47:05.276886 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2339/4470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:03 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:05.331312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:05.347469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:05.349423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:05.352849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-921b2ce0-8a27-4757-88d5-4b75b16bb25c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1546 microversion: 2.26 time: 0.453824 Aug 29 15:47:05.355745 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2132/4471] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:04 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1546 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:05.387434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e34f48b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.403610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.403920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.404366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.404913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:05.436551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.437302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.437794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.438559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.439034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.439473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.493594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.494102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.494555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.539192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.539489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.555381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.628818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:05.692293 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca913927-2c71-4eeb-b7b1-f84398ddc1fa tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-931359366" status: 201 len: 0 microversion: 2.26 time: 0.308744 Aug 29 15:47:05.696397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2340/4472] 10.222.0.16 () {62 vars in 1377 bytes} [Mon Aug 29 15:47:05 2022] PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-931359366 => generated 0 bytes in 314 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:47:05.706506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-64acd9e2-94cb-4886-9be1-9a48c9fc7d91 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e2f39670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.717875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64acd9e2-94cb-4886-9be1-9a48c9fc7d91 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.722003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64acd9e2-94cb-4886-9be1-9a48c9fc7d91 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.723273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64acd9e2-94cb-4886-9be1-9a48c9fc7d91 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.760850 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-64acd9e2-94cb-4886-9be1-9a48c9fc7d91 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-931359366" status: 204 len: 0 microversion: 2.26 time: 0.058498 Aug 29 15:47:05.775221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0eb5a31f0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.781341 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2133/4473] 10.222.0.16 () {60 vars in 1358 bytes} [Mon Aug 29 15:47:05 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-931359366 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:05.799930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.801083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.801782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.802508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:05.815147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.816104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.816825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.820375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.821083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.822945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.878283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.886165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.886981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.908786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:05.937634 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d9d986d1-3ed9-4429-9414-145fd1103263 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 204 len: 0 microversion: 2.26 time: 0.166837 Aug 29 15:47:05.952170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1dbf6e5-e0e3-41ea-ae33-8e3b7ddee084 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e38aaf70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.960161 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2341/4474] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Aug 29 15:47:05 2022] DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:05.972060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1dbf6e5-e0e3-41ea-ae33-8e3b7ddee084 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.973899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1dbf6e5-e0e3-41ea-ae33-8e3b7ddee084 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.984238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1dbf6e5-e0e3-41ea-ae33-8e3b7ddee084 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.003479 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e1dbf6e5-e0e3-41ea-ae33-8e3b7ddee084 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 200 len: 12 microversion: 2.26 time: 0.055298 Aug 29 15:47:06.016266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0eb775310>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.022975 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2134/4475] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:47:05 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 12 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:06.028339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.035073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.035861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.036575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.052881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.054654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.055833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.059362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.061922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.065670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.144592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.145255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.145970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.165058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.165930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.169526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.192974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:06.238980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:06.283042 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3431ad2-b038-4ad0-a549-9e4bb4b047fd tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1739271905" status: 201 len: 0 microversion: 2.26 time: 0.271374 Aug 29 15:47:06.295341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b416e15-264f-4ffc-93fb-246e02e2d133 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e3a2dee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.302771 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2342/4476] 10.222.0.16 () {62 vars in 1380 bytes} [Mon Aug 29 15:47:06 2022] PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1739271905 => generated 0 bytes in 290 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 29 15:47:06.314338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.315346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.317666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b416e15-264f-4ffc-93fb-246e02e2d133 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.321681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b416e15-264f-4ffc-93fb-246e02e2d133 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.322424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b416e15-264f-4ffc-93fb-246e02e2d133 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.330776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.336458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.337259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.338592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.339293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.339968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.347996 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b416e15-264f-4ffc-93fb-246e02e2d133 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 200 len: 36 microversion: 2.26 time: 0.056831 Aug 29 15:47:06.369432 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2135/4477] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:47:06 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 36 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:06.374747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e26734c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.406509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.410973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.411554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.412129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.431261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.440929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.441642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.442553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.443157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.443660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.524873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.525488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.526146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.536222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:06.569332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:06.625175 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c806643b-8922-45ed-8abf-c80d935726d1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1739271905" status: 204 len: 0 microversion: 2.26 time: 0.254399 Aug 29 15:47:06.640257 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2136/4478] 10.222.0.16 () {60 vars in 1364 bytes} [Mon Aug 29 15:47:06 2022] DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1739271905 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:06.666791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3af3744f-0e17-4781-ac01-54d9a2b3f91f tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e3af2b80>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.692873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3af3744f-0e17-4781-ac01-54d9a2b3f91f tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.693362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3af3744f-0e17-4781-ac01-54d9a2b3f91f tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.693842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3af3744f-0e17-4781-ac01-54d9a2b3f91f tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.765573 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3af3744f-0e17-4781-ac01-54d9a2b3f91f tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 200 len: 12 microversion: 2.26 time: 0.114689 Aug 29 15:47:06.771964 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2137/4479] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:47:06 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 12 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:06.795907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e38f4160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.827496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.828405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.829020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.829784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.849200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.858974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.860496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.861722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.862397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.862847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.953689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.955346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.956141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.980988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:07.032384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6fca1d9b-1deb-473a-b91c-3d4d40f8cf05 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 204 len: 0 microversion: 2.26 time: 0.258443 Aug 29 15:47:07.039782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2138/4480] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Aug 29 15:47:06 2022] DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:07.046468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e3af2700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.063422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.064208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.064808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.065630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:07.073508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.074387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.074990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.075877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.076567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.077155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.111244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.112015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.112619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.123591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.124088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.126920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.232348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:07.260141 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9b8bc22a-6ba5-45cb-8eef-8f42d9c04b8c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-909321686" status: 201 len: 0 microversion: 2.26 time: 0.218630 Aug 29 15:47:07.261085 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2139/4481] 10.222.0.16 () {62 vars in 1377 bytes} [Mon Aug 29 15:47:07 2022] PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-909321686 => generated 0 bytes in 220 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:47:07.273779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e3a2d820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.290978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.291852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.294018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.295012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:07.304490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:07.305929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.308216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.308912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.311148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.312507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.313165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.313366 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-02e2e29e-7a51-43ca-af1f-4159a643a8a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 1.003327 Aug 29 15:47:07.319864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2343/4482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:06 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:07.374361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.375061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.375680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.395118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.396002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.396814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.446798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:07.475023 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-90c0f441-b8ec-4060-9fd3-e99a40cbc1db tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1640304834" status: 201 len: 0 microversion: 2.26 time: 0.205052 Aug 29 15:47:07.475023 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2140/4483] 10.222.0.16 () {62 vars in 1380 bytes} [Mon Aug 29 15:47:07 2022] PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1640304834 => generated 0 bytes in 208 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 29 15:47:07.487383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0eb5a3280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.515681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.516591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.520519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.521055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:07.525279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-857720017", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec5ed8da-bbeb-4b6c-bc3f-bffa573d8e89"}], "security_groups": [{"name": "tempest-securitygroup--911251244"}], "key_name": "tempest-keypair-1680339133", "user_data": "}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:07.533625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.535041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.536209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.537438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.538816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.539926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.618091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.619163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.619847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.654272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:07.675445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c3a5d939-1417-42de-b576-9a653cd6ce2c tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 204 len: 0 microversion: 2.26 time: 0.193701 Aug 29 15:47:07.680766 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2344/4484] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Aug 29 15:47:07 2022] DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:07.694287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15836ff9-9f43-4648-8b8e-45e9553ed59a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e2f8bb80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.713841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15836ff9-9f43-4648-8b8e-45e9553ed59a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.714341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15836ff9-9f43-4648-8b8e-45e9553ed59a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.715253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15836ff9-9f43-4648-8b8e-45e9553ed59a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.725479 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-15836ff9-9f43-4648-8b8e-45e9553ed59a tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 200 len: 12 microversion: 2.26 time: 0.043379 Aug 29 15:47:07.726368 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2345/4485] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:47:07 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:07.738672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0eb607a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.748302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.748966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.749634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.750283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:07.756956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.757779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.758382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.759276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.759896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.760482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.819614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.820975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.821624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.837084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:07.863085 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c6a8c5d-ba5b-4e3d-9870-389a8f489358 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 204 len: 0 microversion: 2.26 time: 0.128360 Aug 29 15:47:07.865301 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2346/4486] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Aug 29 15:47:07 2022] DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:07.879492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e34f48b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.911571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.917347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.918325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.918983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:07.930812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.932320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.937658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.938693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.939337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.940090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.981217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] validate_networks() for [('ec5ed8da-bbeb-4b6c-bc3f-bffa573d8e89', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:08.004017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.004517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.005087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.032745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.033234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.033858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.087048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:08.119222 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f758c654-c15d-4ee5-9f3b-734b21d672cf tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1362766631" status: 201 len: 0 microversion: 2.26 time: 0.245372 Aug 29 15:47:08.120192 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2347/4487] 10.222.0.16 () {62 vars in 1380 bytes} [Mon Aug 29 15:47:07 2022] PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-1362766631 => generated 0 bytes in 249 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 15:47:08.135753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e26f68b0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.161963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.162564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.163618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.164124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:08.172987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.177450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.178440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.190534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.191277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.191883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.247150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.247841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.248721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.269372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.270080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.270679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.306804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:08.326968 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dff14905-b055-42ab-8de4-84b6c38ef1ae tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-2105661170" status: 201 len: 0 microversion: 2.26 time: 0.201182 Aug 29 15:47:08.328256 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2348/4488] 10.222.0.16 () {62 vars in 1380 bytes} [Mon Aug 29 15:47:08 2022] PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags/tempest-tag-2105661170 => generated 0 bytes in 203 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 29 15:47:08.342165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Action: 'update_all', calling method: .version_select at 0x7fb0e26f6f70>, body: {"tags": ["tempest-tag-1989902170", "tempest-tag-388807197"]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:08.371106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.372148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.372951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.373620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:08.387073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.387827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.389858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.390920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.395146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.395757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.437988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.438584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.439263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.470391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:08.496858 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b929bf1f-8eb4-4806-bc5c-8202790488b3 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 200 len: 61 microversion: 2.26 time: 0.162051 Aug 29 15:47:08.498128 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2349/4489] 10.222.0.16 () {62 vars in 1312 bytes} [Mon Aug 29 15:47:08 2022] PUT /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 61 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:08.504858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.505833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:08.514827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.515679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.516989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.518818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.519401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.519916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.718974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:08.735319 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-442cc667-7237-44cd-ad71-b523fe8da697 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 0.234841 Aug 29 15:47:08.736862 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2350/4490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:08 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:08.774294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af033cca-0f0c-4176-bd41-e58c4068c4ad tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e356ce50>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.817848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af033cca-0f0c-4176-bd41-e58c4068c4ad tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.825025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af033cca-0f0c-4176-bd41-e58c4068c4ad tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.826006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af033cca-0f0c-4176-bd41-e58c4068c4ad tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.857296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af033cca-0f0c-4176-bd41-e58c4068c4ad tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 200 len: 61 microversion: 2.26 time: 0.118549 Aug 29 15:47:08.869938 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2351/4491] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Aug 29 15:47:08 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 61 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:08.885235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.885777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:08.906328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.906919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.907364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.908079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.908541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.908972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.981146 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a31ef2dd-58e6-4db4-bc64-ac7db4933521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371/ips" status: 200 len: 150 microversion: 2.1 time: 0.107982 Aug 29 15:47:08.983026 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2352/4492] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:08 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371/ips => generated 150 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:08.988714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '.version_select at 0x7fb0e2725430>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.015997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.016575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.017029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.017545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.026024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.026236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.026572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.027780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.028617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.029308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.073729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.074445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.075775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.098850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lazy-loading 'flavor' on Instance uuid ceb2a77a-f101-46e4-ac3f-ac892ad813b5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:09.110566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=88,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:09.135868 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6e4f3e54-894e-4e0b-9d54-dee796e6c1da tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags" status: 204 len: 0 microversion: 2.26 time: 0.151340 Aug 29 15:47:09.138590 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2353/4493] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Aug 29 15:47:08 2022] DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5/tags => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:09.149283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:09.149840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:09.150234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:09.150649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:09.151060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:09.151320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed30c85d-a76d-407e-9a12-aa57135638b8"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:09.156926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.168163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.168905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.169463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.171935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.173588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.174322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.180640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.185544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.186018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.186818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.189620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.192756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.238677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for project da6f1599da704dbc9ec86f3638638bba. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:09.263979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for user dc8f7bc05b984ea0a3d96aea8a65d139 and project da6f1599da704dbc9ec86f3638638bba. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:09.306933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:09.310423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:09.336085 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Invalid volume: volume ed30c85d-a76d-407e-9a12-aa57135638b8 is already attached to instances: e977ea80-1a26-4547-a392-9b56b30f50b3 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371/os-volume_attachments HTTP/1.1 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 74 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: {"volumeAttachment": {"volumeId": "ed30c85d-a76d-407e-9a12-aa57135638b8"}} Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid volume: volume ed30c85d-a76d-407e-9a12-aa57135638b8 is already attached to instances: e977ea80-1a26-4547-a392-9b56b30f50b3 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': '3306b415-8c0a-4823-a389-9a48192c7371', 'body': {'volumeAttachment': {'volumeId': 'ed30c85d-a76d-407e-9a12-aa57135638b8'}}} Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ed30c85d-a76d-407e-9a12-aa57135638b8 is already attached to instances: e977ea80-1a26-4547-a392-9b56b30f50b3 Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:09.340131 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ed30c85d-a76d-407e-9a12-aa57135638b8 is already attached to instances: e977ea80-1a26-4547-a392-9b56b30f50b3 Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ed30c85d-a76d-407e-9a12-aa57135638b8 is already attached to instances: e977ea80-1a26-4547-a392-9b56b30f50b3 Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:09.344725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 400 to user: Invalid volume: volume ed30c85d-a76d-407e-9a12-aa57135638b8 is already attached to instances: e977ea80-1a26-4547-a392-9b56b30f50b3 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:09.346775 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-243273a1-5de1-4372-b4cf-c145f5248cff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.200806 Aug 29 15:47:09.351410 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2354/4494] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:47:09 2022] POST /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371/os-volume_attachments => generated 174 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:09.368490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.369022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.386079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.386584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.387030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.387763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.388223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.388659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.450417 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-293165cb-5068-42dd-ae0b-c979157eab3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.934919 Aug 29 15:47:09.456795 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2141/4495] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:47:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:47:09.473235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.481610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.493968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:09.516465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.516971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.517446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.518148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.518601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.519067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.648581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:09.781720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e43b38c5-afab-4ab9-aed3-ec55301d07c1 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 204 len: 0 microversion: 2.26 time: 0.431240 Aug 29 15:47:09.782749 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2355/4496] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:47:09 2022] DELETE /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:09.811912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ee5d79e-4ee2-4fc7-a9a8-5419970d8740 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.813120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ee5d79e-4ee2-4fc7-a9a8-5419970d8740 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.855387 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9186a7c5-9e67-43b3-bb9c-b3641bc7b807 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 204 len: 0 microversion: 2.1 time: 0.395662 Aug 29 15:47:09.856821 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2142/4497] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:09 2022] DELETE /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:09.867020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.867746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.890497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.892557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.893350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.894144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.894625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.895060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.164207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ee5d79e-4ee2-4fc7-a9a8-5419970d8740 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.183387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ee5d79e-4ee2-4fc7-a9a8-5419970d8740 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.189887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ee5d79e-4ee2-4fc7-a9a8-5419970d8740 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.194108 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ee5d79e-4ee2-4fc7-a9a8-5419970d8740 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1281 microversion: 2.20 time: 0.409954 Aug 29 15:47:10.199786 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2356/4498] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:09 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1281 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:10.218370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:10.220635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:10.234756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.236538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.242301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.244082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.246311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.247522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.624560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.653411 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-64d1e7ee-26fb-468b-8b2d-5a202b44ddac tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 0.794111 Aug 29 15:47:10.656249 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2143/4499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:09 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:10.671270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.672142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:10.672935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:10.683366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.687465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.688784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.689428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.691321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.693010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.693750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.708658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.710701 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-137c0b74-5979-4d6c-98ff-8428c9a94a45 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1552 microversion: 2.26 time: 0.506540 Aug 29 15:47:10.711664 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2357/4500] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:10 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1552 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:11.119032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:11.128898 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5e13aeb8-ea33-4b82-862e-7316625aba38 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1680 microversion: 2.1 time: 0.464330 Aug 29 15:47:11.133222 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2144/4501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:10 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1680 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:11.227610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:11.228517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:11.235634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.244122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.245466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.248511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.249074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.251133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.573591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:11.585075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:11.596626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:11.604296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35ee479a-e9ab-40b5-8aec-c8541d102e69 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1277 microversion: 2.20 time: 0.380827 Aug 29 15:47:11.606230 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2358/4502] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:11 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:11.680476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:11.681996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:11.695120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.696063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.698275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.699262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.700153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.701729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.739377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:11.741360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:11.757570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.758407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.759074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.760439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.764455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.765312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.093565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.112905 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7d34026b-3f74-4695-8b20-475a2f790869 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 0.436530 Aug 29 15:47:12.115174 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2145/4503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:11 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:12.156673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:12.157546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:12.174594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.176737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.177884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.185327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.185948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.186650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.649745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.652037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.669420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.676408 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75ee387c-e116-4f5c-a822-4b69d29193f9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1680 microversion: 2.1 time: 0.524571 Aug 29 15:47:12.681884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2146/4504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:12 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1680 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:12.696933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.697330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:12.697330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:12.706098 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-78f1df4f-9d30-47c4-b627-1c6878908d17 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1552 microversion: 2.26 time: 0.971991 Aug 29 15:47:12.710881 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2359/4505] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:11 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1552 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:12.715913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.718737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.719452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.723250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.726285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.729200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.977614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.984180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:DELETE=2,nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:13.056381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:13.069600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:13.081125 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0aeacf4-6060-40e1-abe1-96d9514a7c49 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1339 microversion: 2.20 time: 0.394809 Aug 29 15:47:13.088401 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2147/4506] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:12 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1339 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:13.136225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.137055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:13.140146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:13.149841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.155304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.157117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.158247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.160335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.161933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.714097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.714916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:13.753634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.754624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.766094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.769372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.772718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.787039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.078656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.078656 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5f042b14-4838-49ac-a3e1-f7bd67c2c365 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1613 microversion: 2.1 time: 0.347808 Aug 29 15:47:14.078656 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2148/4507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:13 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1613 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:14.078656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:14.078656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:14.132569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.148611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.149466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.150413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.158567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.161633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.421796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.439437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.462107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dd53cf1dd3343d989e650620d853c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c694100bb1f945b79ae0010754b82add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.466239 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4424da9-1d0a-456b-bd93-d877fcc0bf83 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 200 len: 1510 microversion: 2.26 time: 0.404872 Aug 29 15:47:14.470514 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2149/4508] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:14 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 1510 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:14.491217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:14.499553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:14.549712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.549712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.549712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.552061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.552643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.553643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.836180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.848593 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a08b8e70-9e7c-4c6f-93d4-d298c432c282 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 1.717335 Aug 29 15:47:14.849204 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2360/4509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:13 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:15.144014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:15.162215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:15.166689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:15.170878 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-524efc68-d1ea-4571-8fab-d28fce902c45 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 0.698737 Aug 29 15:47:15.181807 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2150/4510] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:14 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:15.195814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:15.196912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:15.232761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.235923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.242428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.245783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.247065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.253285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.510269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b26f545a-ef8a-4120-ae94-f7e16361d5ab req-4ddc49c9-74fc-420c-a42c-698faa670759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb2a77a-f101-46e4-ac3f-ac892ad813b5", "name": "network-vif-deleted", "tag": "15abd44b-a680-47b5-acbf-c219847a4c77"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:15.530644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b26f545a-ef8a-4120-ae94-f7e16361d5ab req-4ddc49c9-74fc-420c-a42c-698faa670759 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.531139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b26f545a-ef8a-4120-ae94-f7e16361d5ab req-4ddc49c9-74fc-420c-a42c-698faa670759 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.531580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b26f545a-ef8a-4120-ae94-f7e16361d5ab req-4ddc49c9-74fc-420c-a42c-698faa670759 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.574196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:15.582843 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b26f545a-ef8a-4120-ae94-f7e16361d5ab req-4ddc49c9-74fc-420c-a42c-698faa670759 service nova] Creating event network-vif-deleted:15abd44b-a680-47b5-acbf-c219847a4c77 for instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 on n-h2-854882-3 Aug 29 15:47:15.586542 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3dff3c0-266b-40d2-b6cc-1e8573b2d803 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1613 microversion: 2.1 time: 0.399519 Aug 29 15:47:15.587314 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2151/4511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:15 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1613 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:15.605446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b26f545a-ef8a-4120-ae94-f7e16361d5ab req-4ddc49c9-74fc-420c-a42c-698faa670759 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.741017 Aug 29 15:47:15.608438 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2361/4512] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:15.610329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:15.619459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] [instance: ceb2a77a-f101-46e4-ac3f-ac892ad813b5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:15.642080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.644451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.646854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.651430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.652110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.652708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.704781 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] HTTP exception thrown: Instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 could not be found. Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Request method failure captured: Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 HTTP/1.1 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN9ejkjKlF33z_MCjAdwbK9N85_U8VLVtaltK0kA1wNEC1o1wiuyiSwyMk_EK6u3FgQXyQjacYpgryp4M9pxscew2iSMPw0XOgNiSuOoB9gZqIP41-GA-vMXHImGltUM-Uqtxi2Uhdy3Mvt26Nt6_LbISXiDaefyQGfVG5BeA90LuhU Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.26 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c694100bb1f945b79ae0010754b82add Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerTagsTestJSON-1648542992 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c694100bb1f945b79ae0010754b82add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c694100bb1f945b79ae0010754b82add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c694100bb1f945b79ae0010754b82add", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c694100bb1f945b79ae0010754b82add"}]}] Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerTagsTestJSON-1648542992 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c694100bb1f945b79ae0010754b82add Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerTagsTestJSON-1648542992 Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerTagsTestJSON-1648542992-project Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3dd53cf1dd3343d989e650620d853c0c Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerTagsTestJSON-1648542992-project Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 could not be found. Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ceb2a77a-f101-46e4-ac3f-ac892ad813b5'} Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 could not be found. Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 could not be found. Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:15.721490 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 could not be found. Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] Returning 404 to user: Instance ceb2a77a-f101-46e4-ac3f-ac892ad813b5 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf5d5141-d739-462b-8e04-3978d4842414 tempest-ServerTagsTestJSON-1648542992 tempest-ServerTagsTestJSON-1648542992-project] 10.222.0.16 "GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5" status: 404 len: 111 microversion: 2.26 time: 0.134714 Aug 29 15:47:15.738622 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2152/4513] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:15 2022] GET /compute/v2.1/servers/ceb2a77a-f101-46e4-ac3f-ac892ad813b5 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:15.878334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:15.879029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:15.906483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.910337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.911824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.915149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.915687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.916279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.194511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:16.195470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:16.209203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.213485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.214372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.216478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.216958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.217419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.676043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.695722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.698445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.701531 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63f82f53-6952-46b3-98c1-883f118d7a26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 0.511343 Aug 29 15:47:16.704145 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2153/4514] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:16 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:16.710579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:16.711583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:16.722325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.723579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.724257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.725321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.726051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.728390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.789908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.790866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.791678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.792375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lazy-loading 'fault' on Instance uuid 3306b415-8c0a-4823-a389-9a48192c7371 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:16.861215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.877062 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa43cddc-056b-458a-8f07-cc02c795f14f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 200 len: 1330 microversion: 2.1 time: 0.168299 Aug 29 15:47:16.890551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2154/4515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:16 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 1330 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:16.977925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.993839 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-334c7bc7-38c7-49cf-ae08-31ca0aa87ba2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 1.121374 Aug 29 15:47:16.994682 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2362/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:15 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:17.730725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:17.731622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:17.744691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.752313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9306f3a0-c98e-4c61-84a2-6b4ba2c002b4 req-063ccc81-2cad-4574-96a9-721c97e893af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3306b415-8c0a-4823-a389-9a48192c7371", "name": "network-vif-deleted", "tag": "f8d96b17-e071-4b44-b519-c050296f55a2"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:17.758570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.759645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.760649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.761342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.764104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.776998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9306f3a0-c98e-4c61-84a2-6b4ba2c002b4 req-063ccc81-2cad-4574-96a9-721c97e893af service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.793709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9306f3a0-c98e-4c61-84a2-6b4ba2c002b4 req-063ccc81-2cad-4574-96a9-721c97e893af service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.794543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9306f3a0-c98e-4c61-84a2-6b4ba2c002b4 req-063ccc81-2cad-4574-96a9-721c97e893af service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.821208 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9306f3a0-c98e-4c61-84a2-6b4ba2c002b4 req-063ccc81-2cad-4574-96a9-721c97e893af service nova] Creating event network-vif-deleted:f8d96b17-e071-4b44-b519-c050296f55a2 for instance 3306b415-8c0a-4823-a389-9a48192c7371 on n-h1-854882-3 Aug 29 15:47:17.843181 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9306f3a0-c98e-4c61-84a2-6b4ba2c002b4 req-063ccc81-2cad-4574-96a9-721c97e893af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095129 Aug 29 15:47:17.844646 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2363/4517] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:17.904822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:17.905996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:17.936627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.940390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.941087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.949783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.950610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.951303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.984411 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 HTTP/1.1 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '3306b415-8c0a-4823-a389-9a48192c7371'} Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:17.992476 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:17.996322 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:17.996322 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:17.996322 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:17.996322 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:17.996322 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:17.996322 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:47:17.996322 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.000975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:18.002130 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-15b0c1b3-fc2d-4856-a19b-257d41257e60 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 404 len: 111 microversion: 2.1 time: 0.102283 Aug 29 15:47:18.010198 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2364/4518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:17 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:18.015850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8973493-4825-4c08-98bd-151fd5bd7e8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '.version_select at 0x7fb0e29f54c0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.083577 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8973493-4825-4c08-98bd-151fd5bd7e8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-624313454" status: 202 len: 0 microversion: 2.1 time: 0.071653 Aug 29 15:47:18.084447 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2365/4519] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:47:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-624313454 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:18.091368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.095429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:18.113126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.114112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.115290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.117261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.121718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.122713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.357181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:18.366865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:18.377981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:18.386676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6d78568-d257-4b0b-b7e6-a2c675ea417e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 0.659421 Aug 29 15:47:18.401815 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2155/4520] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:17 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:19.215486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.227958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.248250 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91b51a61-e587-4bdf-868d-452ead3c1035 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 1.162359 Aug 29 15:47:19.251260 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2366/4521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:18 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:19.273787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ffbcc3a9-8f07-4012-b032-152a53ab1a09 req-310ce321-f990-47a0-aaf6-4fbb2792a825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:19.287246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.290794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ffbcc3a9-8f07-4012-b032-152a53ab1a09 req-310ce321-f990-47a0-aaf6-4fbb2792a825 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.291587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ffbcc3a9-8f07-4012-b032-152a53ab1a09 req-310ce321-f990-47a0-aaf6-4fbb2792a825 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.292251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ffbcc3a9-8f07-4012-b032-152a53ab1a09 req-310ce321-f990-47a0-aaf6-4fbb2792a825 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.311311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.320076 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ffbcc3a9-8f07-4012-b032-152a53ab1a09 req-310ce321-f990-47a0-aaf6-4fbb2792a825 service nova] Creating event network-changed:089534cd-a1fd-4322-a9bd-4aef2c5a4503 for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 on n-h1-854882-3 Aug 29 15:47:19.333035 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ffbcc3a9-8f07-4012-b032-152a53ab1a09 req-310ce321-f990-47a0-aaf6-4fbb2792a825 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.689198 Aug 29 15:47:19.334143 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2156/4522] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:19.414531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:19.415179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:19.423169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.427240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.429838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.430680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.432640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.433709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:20.172454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:20.283636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:20.284829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:20.324679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:20.329192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:20.331343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:20.340507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:20.342360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:20.343414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:20.513609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:20.554412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:20.564232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:20.570474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-22ae6a66-3862-45e6-9ab4-75bf42986001 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 1.157647 Aug 29 15:47:20.576307 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2367/4523] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:19 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:21.601007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:21.604346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:21.622351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.623301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.623994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.625000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.627091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.627795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.361671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.391737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.393331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.394569 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e1c30216-eb3e-4b34-ac78-3d3ce7c008d2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 0.799510 Aug 29 15:47:22.406028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2368/4524] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:21 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:22.422016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:22.422908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:22.434946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.435758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.436617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.437895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.438760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.439968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.583594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.605736 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ca5710e3-1461-4360-81f5-eb53651013c7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 2.334446 Aug 29 15:47:22.611449 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2157/4525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:20 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:22.660811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lazy-loading 'services' on Instance uuid e977ea80-1a26-4547-a392-9b56b30f50b3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:22.867519 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe33abae-a067-453f-83c5-a68c98f227d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments/ed30c85d-a76d-407e-9a12-aa57135638b8" status: 202 len: 0 microversion: 2.1 time: 0.458395 Aug 29 15:47:22.876229 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2369/4526] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:47:22 2022] DELETE /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments/ed30c85d-a76d-407e-9a12-aa57135638b8 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:22.880647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:22.883110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:22.915028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.920010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.920841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.922466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.923172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.923809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.047173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9854bf60-14d3-45a6-8667-eb0c012d97af tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171731 Aug 29 15:47:23.054005 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2158/4527] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:22 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:23.427568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:23.428353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:23.442747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.443533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.451820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.453067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.456634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.457349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.634249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:23.634844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:23.654352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.654947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.655612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.656423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.656901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.657344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.343442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.353491 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d19ee8fc-7f31-4351-80f7-852a63eec8fd tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1682 microversion: 2.1 time: 0.724934 Aug 29 15:47:24.381068 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2159/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:23 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1682 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:24.389671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.404343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:24.415368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.416205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.416828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.418027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.430314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.431070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.499860 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fbe00429-b15e-4ceb-aa72-db20a9bc081d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117244 Aug 29 15:47:24.508178 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2160/4529] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:24.868872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.921363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.943868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.956300 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ead8f1c8-5d01-417c-98d9-483a6ab1ae77 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 1.530534 Aug 29 15:47:24.957838 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2370/4530] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:23 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:25.388950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.389691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:25.400451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.401701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.403940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.406678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.407685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.410614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.524823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.531845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:25.556901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.557481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.558998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.560291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.563497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.564505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.651755 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60733415-dc97-46be-ab87-3ec9a7e65d86 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132633 Aug 29 15:47:25.652854 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2371/4531] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:25.984191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.985576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:25.993589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.008196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.008646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.013881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.014778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.015231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.018558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:26.286954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:26.307291 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-106422d0-9e04-42e6-a85a-f948bcbbf0c3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.920582 Aug 29 15:47:26.309951 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2161/4532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:26.532415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:26.533747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:26.544561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.549460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.551571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.553849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.554981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.555771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:26.556572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.569993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:26.571532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:26.585442 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-846f88eb-aa8b-4c89-8dbd-5d7742a1e746 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 0.604936 Aug 29 15:47:26.586041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2372/4533] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:26.656311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-ac8913ef-a01b-413a-a9ae-4bbdc1542b79 req-08884d7e-b337-45c8-82bc-094f7a461474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-unplugged", "status": "completed", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:26.678679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ac8913ef-a01b-413a-a9ae-4bbdc1542b79 req-08884d7e-b337-45c8-82bc-094f7a461474 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.679019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ac8913ef-a01b-413a-a9ae-4bbdc1542b79 req-08884d7e-b337-45c8-82bc-094f7a461474 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.679832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ac8913ef-a01b-413a-a9ae-4bbdc1542b79 req-08884d7e-b337-45c8-82bc-094f7a461474 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.737033 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-ac8913ef-a01b-413a-a9ae-4bbdc1542b79 req-08884d7e-b337-45c8-82bc-094f7a461474 service nova] Creating event network-vif-unplugged:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:47:26.762971 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-ac8913ef-a01b-413a-a9ae-4bbdc1542b79 req-08884d7e-b337-45c8-82bc-094f7a461474 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114445 Aug 29 15:47:26.771191 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2373/4534] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:26.778533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:26.780968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:26.814144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.814655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.815106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.815836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.816302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.816725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.892568 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c0b6140-8979-461f-90d7-7a79da85b09c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118858 Aug 29 15:47:26.893081 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2374/4535] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:26 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:26.942950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:26.957154 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d493f76-6089-4f58-8f04-8f8002ddad81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.427665 Aug 29 15:47:26.959779 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2162/4536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:26 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:27.612288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:27.613065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:27.622378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.622984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.623431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.624162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.624625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.625058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.905356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:27.908220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:27.929965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.930827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.931592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.932546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.933219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.933900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.013589 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-77b952a9-e5ef-46cf-b5d1-72108a9306e9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112154 Aug 29 15:47:28.020011 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2163/4537] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:27 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:28.734384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.743370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.758648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.760868 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94d71b88-40ec-400e-bb08-8f8e7b41a92a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 1.152488 Aug 29 15:47:28.776544 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2375/4538] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:27 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:28.825456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4df3f6d2-0049-4d46-9dc7-353a0b527887 req-98a241ce-0172-459b-9bf4-ed72b405e97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "name": "network-vif-plugged", "status": "completed", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:28.847488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4df3f6d2-0049-4d46-9dc7-353a0b527887 req-98a241ce-0172-459b-9bf4-ed72b405e97b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.848044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4df3f6d2-0049-4d46-9dc7-353a0b527887 req-98a241ce-0172-459b-9bf4-ed72b405e97b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.848553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4df3f6d2-0049-4d46-9dc7-353a0b527887 req-98a241ce-0172-459b-9bf4-ed72b405e97b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.874178 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4df3f6d2-0049-4d46-9dc7-353a0b527887 req-98a241ce-0172-459b-9bf4-ed72b405e97b service nova] Creating event network-vif-plugged:089534cd-a1fd-4322-a9bd-4aef2c5a4503 for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 on n-h1-854882-3 Aug 29 15:47:28.881710 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4df3f6d2-0049-4d46-9dc7-353a0b527887 req-98a241ce-0172-459b-9bf4-ed72b405e97b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059331 Aug 29 15:47:28.882879 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2164/4539] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:29.035207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.041325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.062168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.063295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.063996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.064988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.067291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.071959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.212267 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-615a2601-1a95-4be1-8184-4e1e1f7929f0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177876 Aug 29 15:47:29.224463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2165/4540] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:29.233513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.234143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.262189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.262617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.263076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.263848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.264313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.264743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.280011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:29.540303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.541528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.557994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.559483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.561569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.564172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.565372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.566576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.670383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:29.831119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:29.845687 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d853b197-1707-4ccd-be57-7b31b815ca6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.624956 Aug 29 15:47:29.871520 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2166/4541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:29.889650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.891402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.925004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.928953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.929959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.932702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.934498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.934733 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8c95d73-cdbe-4bee-a8aa-74daaa392689 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 204 len: 0 microversion: 2.32 time: 0.962689 Aug 29 15:47:29.935892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.938371 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2376/4542] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:47:28 2022] DELETE /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:29.952171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.954724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.973871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.976541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.977748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.982536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.984504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.985216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.313461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.330254 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f8a5023-ac15-4721-8147-80aa78937da3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.388707 Aug 29 15:47:30.331072 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2377/4543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:30.344131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.345502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:30.354716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.355488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.356148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.357121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.357880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.360142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.399208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.415796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.427461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.429192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2e9bcbe1-adfe-4c9d-9ce0-54956cad6ae8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1406 microversion: 2.20 time: 0.555790 Aug 29 15:47:30.433852 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2167/4544] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1406 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:30.443149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.447118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:30.475040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.475950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.486258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.489132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.490082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.491881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.586184 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb3b235e-b65a-41e8-b3bf-529a37e6f01b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149262 Aug 29 15:47:30.587439 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2168/4545] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:30 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:30.594943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.596392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:30.608818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.610267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.611282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.613118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.615056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.616535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.911847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.975010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.985207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.991374 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb7a7163-7b7c-4532-9ec8-e21917a4b7e1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2952 microversion: 2.32 time: 0.656271 Aug 29 15:47:31.007536 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2378/4546] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:30 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2952 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:31.300915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.313551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97fa1048-4d73-415e-8fdf-d295d70e5885 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.724383 Aug 29 15:47:31.314750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2169/4547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:30 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:31.336806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:31.341423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.355987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.357287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.358977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.361876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.363572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.364483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.457654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.459468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.472532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.473576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.474217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.481280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.482040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.482742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.490938 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c066d7ad-2462-4b3c-810c-8c79fe42c2bf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.159360 Aug 29 15:47:31.494594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2379/4548] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:31 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:31.511832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.512568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.530476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.531008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.531526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.536232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.536724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.537215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.716592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.738342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.743544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.748959 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d658845-f431-4b45-bf32-c314fa4a92e6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1598 microversion: 2.20 time: 0.296305 Aug 29 15:47:31.750201 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2170/4549] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1598 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:31.755610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.759029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.773485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.774368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.776007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.778158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.779312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.782740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.825530 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-05b351bb-48c5-4222-b3dc-898a7c799b42 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073909 Aug 29 15:47:31.830956 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2171/4550] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:31.836080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.836674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.845141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.845993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.846648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.847565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.848238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.848899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.979225 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8b384c89-700a-4ed6-8681-b9cde56eaa8f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.151508 Aug 29 15:47:31.980030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2172/4551] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:47:32.025861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:32.026871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:32.034002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.035033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.035718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.036761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.038540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.039054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.349802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.360874 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1671 microversion: 2.1 time: 0.860225 Aug 29 15:47:32.375233 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2380/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1671 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:32.376760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:32.378470 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29592e3a-f0d1-439b-ba91-b4e012903413 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002046 Aug 29 15:47:32.379363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2381/4553] 10.222.0.16 () {56 vars in 886 bytes} [Mon Aug 29 15:47:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:47:32.383449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.396598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.399806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.406367 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cf0d55e-0a7b-475f-b705-b3e0591bae59 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2952 microversion: 2.32 time: 0.381952 Aug 29 15:47:32.407194 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2173/4554] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:32 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2952 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:32.840333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:32.842887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:32.854827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.857213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.857781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.859150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.859817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.862904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.935474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-359a2e3c-05dd-4560-a5a9-51e6e4696877 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100634 Aug 29 15:47:32.941832 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2382/4555] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:32 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:47:33.075634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.076712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.088210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.096878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.097340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.098114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.098572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.098996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.163288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:33.278021 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5a9c0bc-e965-4261-8da8-5c9d80c92f87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 204 len: 0 microversion: 2.1 time: 0.206465 Aug 29 15:47:33.279609 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2174/4556] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:33 2022] DELETE /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:33.287745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.288366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.304940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.305474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.305913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.306621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.307069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.307493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.386863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.387573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.397436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.398541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.399161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.400345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.400965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.401633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.701136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:33.715082 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-490fc34b-7bee-4c75-923e-e76371f8c665 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1671 microversion: 2.1 time: 0.332018 Aug 29 15:47:33.715082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2175/4557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1671 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:33.719355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.719970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.732935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.733284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.733935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.735036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.735658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.736293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.941061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:33.958971 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c84ed11-632b-493d-830b-ff6d816f9922 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1680 microversion: 2.1 time: 0.674963 Aug 29 15:47:33.959950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2383/4558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1680 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:34.150119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.166788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.171123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.184645 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-86b09786-fdca-4a2c-bbd5-e1c9f00bc56b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2952 microversion: 2.32 time: 0.469294 Aug 29 15:47:34.187750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2176/4559] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2952 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:34.231410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f50f9bc4-e2d4-4e94-94f2-4088a4a466a7 req-04dee712-68d2-41c0-b592-e734a15e51a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:34.242148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f50f9bc4-e2d4-4e94-94f2-4088a4a466a7 req-04dee712-68d2-41c0-b592-e734a15e51a7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.242914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f50f9bc4-e2d4-4e94-94f2-4088a4a466a7 req-04dee712-68d2-41c0-b592-e734a15e51a7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.243642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f50f9bc4-e2d4-4e94-94f2-4088a4a466a7 req-04dee712-68d2-41c0-b592-e734a15e51a7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.259004 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f50f9bc4-e2d4-4e94-94f2-4088a4a466a7 req-04dee712-68d2-41c0-b592-e734a15e51a7 service nova] Creating event network-changed:089534cd-a1fd-4322-a9bd-4aef2c5a4503 for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 on n-h1-854882-3 Aug 29 15:47:34.265462 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f50f9bc4-e2d4-4e94-94f2-4088a4a466a7 req-04dee712-68d2-41c0-b592-e734a15e51a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042339 Aug 29 15:47:34.266848 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2384/4560] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:34.739785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:34.741344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:34.763778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.764507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.766496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.767470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.770135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.770795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.982188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:34.983880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:34.994871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.996126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.996985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.003831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.004759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.007838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.630225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.646486 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40f01381-676c-4e1f-9c82-e115f24517d7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.916283 Aug 29 15:47:35.648207 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2177/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:34 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:35.659481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:35.665708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:35.683909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.684886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.686505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.690302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.692820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.694008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.861080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.878727 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-80119897-1220-4547-85bf-b610f7afcfb3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1680 microversion: 2.1 time: 0.900945 Aug 29 15:47:35.895829 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2385/4562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:34 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1680 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:35.917965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:35.922592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:35.942837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.942837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.956518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.958223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.959079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.960197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.026973 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7157847c-6092-4623-9938-7882d6c1f2c4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 200 len: 322 microversion: 2.1 time: 0.126155 Aug 29 15:47:36.028756 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2386/4563] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:35 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 322 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:36.040360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:36.042937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:36.063584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.064382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.064897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.066260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.067761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.069917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.799264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:36.822504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:36.826584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:36.829360 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f2c9e8d-8681-440d-bb50-ecaaa3ca5d14 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2910 microversion: 2.32 time: 1.178211 Aug 29 15:47:36.830307 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2178/4564] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:35 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2910 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:36.836915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-unplugged", "status": "completed", "tag": "4325930b-2a2c-4ca8-bc3a-407ed5756ffb"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:36.850293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.851117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.852060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.874192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] Creating event network-vif-unplugged:4325930b-2a2c-4ca8-bc3a-407ed5756ffb for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:36.883821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052069 Aug 29 15:47:36.885155 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2179/4565] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:36.887677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:36.893128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7a3aa1b2-46e1-4b3e-875a-00bda904d724 req-aa754d1e-c78e-46f6-bdad-dd32c10e9694 service nova] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004562 Aug 29 15:47:36.894906 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2180/4566] 10.222.0.16 () {56 vars in 886 bytes} [Mon Aug 29 15:47:36 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:47:36.913090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:36.915492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:36.926603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.927691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.928949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.930421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.931222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.931921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.300488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.310253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.332312 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.297007 Aug 29 15:47:37.333369 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2387/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:36 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:37.339656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.341368 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004795 Aug 29 15:47:37.351593 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2388/4568] 10.222.0.16 () {54 vars in 1035 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2/ => generated 379 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 29 15:47:37.354741 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cddb5c9f-85ce-417e-b058-3e0895cb5603 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1680 microversion: 2.1 time: 0.447067 Aug 29 15:47:37.356021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.356716 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2181/4569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:36 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1680 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:37.360764 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004138 Aug 29 15:47:37.362017 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2389/4570] 10.222.0.16 () {54 vars in 1041 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:37.368280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.369215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:37.381243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.383178 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ac7df47-031b-4bb7-be9d-063f3494ad33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002943 Aug 29 15:47:37.383703 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2390/4571] 10.222.0.16 () {56 vars in 886 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:47:37.390230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.390230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.390230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.390862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.391519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.392714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.738348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.752857 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b9b5fc11-df31-4736-8bbf-e1f3b8f1b07d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.393600 Aug 29 15:47:37.753789 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2182/4572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:37.778536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.779176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:37.793252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.794421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.795208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.797841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.798873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.799536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.857091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.858685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:37.868490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.869955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.870895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.873904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.875520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.877064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.890429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:38.478318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.512933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.517651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.521792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:38.522893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.526456 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9981820e-a2f4-4b32-88fa-6562c3bcd983 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2864 microversion: 2.32 time: 0.673756 Aug 29 15:47:38.528786 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2183/4573] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2864 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:38.585838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-54b8e79b-e30f-4279-ae9a-7746c76fd2ba req-cbd74f0a-3277-4841-9d1f-fa1cc366ad73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-deleted", "tag": "4325930b-2a2c-4ca8-bc3a-407ed5756ffb"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:38.591412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-68057a7a-1a44-4d41-91fa-5609fce8b3a3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.818275 Aug 29 15:47:38.604776 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2391/4574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:38.614788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.622813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.643666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.644902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.657274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.658692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-54b8e79b-e30f-4279-ae9a-7746c76fd2ba req-cbd74f0a-3277-4841-9d1f-fa1cc366ad73 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.659135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.661039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-54b8e79b-e30f-4279-ae9a-7746c76fd2ba req-cbd74f0a-3277-4841-9d1f-fa1cc366ad73 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.661366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.662656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-54b8e79b-e30f-4279-ae9a-7746c76fd2ba req-cbd74f0a-3277-4841-9d1f-fa1cc366ad73 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.663189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.713249 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-54b8e79b-e30f-4279-ae9a-7746c76fd2ba req-cbd74f0a-3277-4841-9d1f-fa1cc366ad73 service nova] Creating event network-vif-deleted:4325930b-2a2c-4ca8-bc3a-407ed5756ffb for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:38.732632 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-54b8e79b-e30f-4279-ae9a-7746c76fd2ba req-cbd74f0a-3277-4841-9d1f-fa1cc366ad73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201414 Aug 29 15:47:38.733701 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2184/4575] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:38.753317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.757887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.774904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.775544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.776042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.776913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.778071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.778516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.935100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.963177 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95210f60-1982-49e7-ad2c-fc187f7a2c92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1613 microversion: 2.1 time: 0.355953 Aug 29 15:47:38.965372 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2392/4576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1613 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:39.004650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-unplugged", "status": "completed", "tag": "67328c13-10eb-4d44-bc25-a7da9c8b6192"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-unplugged", "status": "completed", "tag": "afc9aaaa-e70e-40e4-b278-80e3ce884a8d"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-unplugged", "status": "completed", "tag": "73384e18-d1b4-4919-9f91-9b5be5de78a8"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-unplugged", "status": "completed", "tag": "5fc71865-e22d-4048-b2b0-9176e6cef769"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:39.025019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.026034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.026903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.046743 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Creating event network-vif-unplugged:67328c13-10eb-4d44-bc25-a7da9c8b6192 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:39.047406 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Creating event network-vif-unplugged:afc9aaaa-e70e-40e4-b278-80e3ce884a8d for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:39.047952 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Creating event network-vif-unplugged:73384e18-d1b4-4919-9f91-9b5be5de78a8 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:39.048684 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] Creating event network-vif-unplugged:5fc71865-e22d-4048-b2b0-9176e6cef769 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:39.055068 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c4f919e8-2bf7-4ba7-bcd1-67a0c8b2b3f7 req-e1d29003-f202-4958-9f9a-f595a1884dc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.071654 Aug 29 15:47:39.055939 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2393/4577] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:39.337175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3d2f18c2-1554-459f-9bdd-4e7ea597a427 req-677f45af-c00e-4310-bcf2-fb8e1cbffc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e977ea80-1a26-4547-a392-9b56b30f50b3", "name": "network-vif-deleted", "tag": "b21b8b62-f3a1-4b00-a58c-0b7f487952c5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:39.369114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3d2f18c2-1554-459f-9bdd-4e7ea597a427 req-677f45af-c00e-4310-bcf2-fb8e1cbffc7a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.370268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3d2f18c2-1554-459f-9bdd-4e7ea597a427 req-677f45af-c00e-4310-bcf2-fb8e1cbffc7a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.371284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3d2f18c2-1554-459f-9bdd-4e7ea597a427 req-677f45af-c00e-4310-bcf2-fb8e1cbffc7a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.388193 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3d2f18c2-1554-459f-9bdd-4e7ea597a427 req-677f45af-c00e-4310-bcf2-fb8e1cbffc7a service nova] Creating event network-vif-deleted:b21b8b62-f3a1-4b00-a58c-0b7f487952c5 for instance e977ea80-1a26-4547-a392-9b56b30f50b3 on n-h1-854882-3 Aug 29 15:47:39.397026 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3d2f18c2-1554-459f-9bdd-4e7ea597a427 req-677f45af-c00e-4310-bcf2-fb8e1cbffc7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065361 Aug 29 15:47:39.402447 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2394/4578] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:39.438069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:39.461379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf0ea959-2f9b-414e-a921-ab010b3a0a75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.726230 Aug 29 15:47:39.462447 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2185/4579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:39.579231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:39.580931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:39.604795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.605352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.610401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.615618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.620070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.625628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.791917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-356356738", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "495c919e-8bb9-4e7e-b31f-e6fe4e50e138"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:39.924117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] validate_networks() for [('495c919e-8bb9-4e7e-b31f-e6fe4e50e138', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:40.135388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.160637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.172397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.181472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-62bc9dc4-662f-4a0b-a5ec-0319776e5237 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2704 microversion: 2.32 time: 0.610296 Aug 29 15:47:40.182090 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2395/4580] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:39 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2704 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:40.204262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:40.208315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:40.234806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.236013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.238044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.238950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.253063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.257784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.343712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.350249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.350954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.351623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lazy-loading 'fault' on Instance uuid e977ea80-1a26-4547-a392-9b56b30f50b3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:40.490216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.509763 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b58165c6-e7ce-4a45-b8dc-156b187a9d46 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 200 len: 1331 microversion: 2.1 time: 0.326504 Aug 29 15:47:40.510362 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2396/4581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:40 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 1331 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:40.882828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6c4358dd-8d2c-4a56-b476-0c8e878035b5 req-2152e1e6-47cd-44fe-a49b-cb8c0fb05d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-deleted", "tag": "67328c13-10eb-4d44-bc25-a7da9c8b6192"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:40.909188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6c4358dd-8d2c-4a56-b476-0c8e878035b5 req-2152e1e6-47cd-44fe-a49b-cb8c0fb05d89 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.909705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6c4358dd-8d2c-4a56-b476-0c8e878035b5 req-2152e1e6-47cd-44fe-a49b-cb8c0fb05d89 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.910145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6c4358dd-8d2c-4a56-b476-0c8e878035b5 req-2152e1e6-47cd-44fe-a49b-cb8c0fb05d89 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.939704 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6c4358dd-8d2c-4a56-b476-0c8e878035b5 req-2152e1e6-47cd-44fe-a49b-cb8c0fb05d89 service nova] Creating event network-vif-deleted:67328c13-10eb-4d44-bc25-a7da9c8b6192 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:40.957331 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6c4358dd-8d2c-4a56-b476-0c8e878035b5 req-2152e1e6-47cd-44fe-a49b-cb8c0fb05d89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082785 Aug 29 15:47:40.960540 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2397/4582] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:41.223644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:41.226402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:41.251881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.256730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.259262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.261952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.262674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.263946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.731138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:41.732914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:41.734182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:41.737061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:41.738216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:41.789731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.791703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.795549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.799257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.801916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.804903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.911520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:41.929964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for user a68002795ce541338b30129e6dbb0fb6 and project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:41.965911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:41.969427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:42.051855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.070883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.072483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.076899 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-842a5c12-55aa-466e-b11a-3ebc720180bb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.293307 Aug 29 15:47:42.078045 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2186/4583] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:47:42.079904 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e97877cb-ceea-4370-b0bc-81f5c0d8db3a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2590 microversion: 2.32 time: 0.865626 Aug 29 15:47:42.082433 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2398/4584] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:41 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2590 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:42.100391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2fb1cfca-ad22-4244-8a5f-c9a14e00a3e8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.104029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.104731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:42.111853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fb1cfca-ad22-4244-8a5f-c9a14e00a3e8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:42.121098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.122049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.123055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.124562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.125583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.126603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.152000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 HTTP/1.1 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e977ea80-1a26-4547-a392-9b56b30f50b3'} Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:42.155601 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.161309 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:42.161309 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:42.161309 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:42.161309 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:42.161309 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:42.161309 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:47:42.161309 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.169835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:42.172224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ecb9798-aa6e-41d1-a0a3-4190142188b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 404 len: 111 microversion: 2.1 time: 0.092550 Aug 29 15:47:42.182378 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2187/4585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:42 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:42.194694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7135a8be-928c-42b2-baf2-7c78baf239f4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '.version_select at 0x7fb0e3406040>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.250202 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7135a8be-928c-42b2-baf2-7c78baf239f4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374703299" status: 202 len: 0 microversion: 2.1 time: 0.065605 Aug 29 15:47:42.251862 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2188/4586] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:47:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374703299 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:43.014656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2fb1cfca-ad22-4244-8a5f-c9a14e00a3e8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.027234 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2fb1cfca-ad22-4244-8a5f-c9a14e00a3e8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1214 microversion: 2.1 time: 0.936775 Aug 29 15:47:43.034805 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2399/4587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:42 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1214 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:43.092957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0bcbff69-8d7d-4ade-88b4-80f4c009de1b req-5ce5f5e7-d859-492e-bdec-4b0c85ffc344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-deleted", "tag": "afc9aaaa-e70e-40e4-b278-80e3ce884a8d"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:43.111544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:43.112271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:43.139449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.139945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.148310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0bcbff69-8d7d-4ade-88b4-80f4c009de1b req-5ce5f5e7-d859-492e-bdec-4b0c85ffc344 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.151418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.153325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.155735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0bcbff69-8d7d-4ade-88b4-80f4c009de1b req-5ce5f5e7-d859-492e-bdec-4b0c85ffc344 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.156993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.157654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0bcbff69-8d7d-4ade-88b4-80f4c009de1b req-5ce5f5e7-d859-492e-bdec-4b0c85ffc344 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.163167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.208375 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0bcbff69-8d7d-4ade-88b4-80f4c009de1b req-5ce5f5e7-d859-492e-bdec-4b0c85ffc344 service nova] Creating event network-vif-deleted:afc9aaaa-e70e-40e4-b278-80e3ce884a8d for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:43.228883 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0bcbff69-8d7d-4ade-88b4-80f4c009de1b req-5ce5f5e7-d859-492e-bdec-4b0c85ffc344 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140910 Aug 29 15:47:43.233753 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2189/4588] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:43.910900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.936793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.939273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.950841 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-25d0b30f-b73b-4ae2-b7d6-4841af63f37b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2498 microversion: 2.32 time: 0.843085 Aug 29 15:47:43.951954 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2400/4589] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:43 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2498 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:44.054606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.056007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.070753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.071493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.073028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.074213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.074931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.075509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.368017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.379989 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9a567d73-e11f-4eac-993d-5c3ca22a685a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1284 microversion: 2.1 time: 0.334660 Aug 29 15:47:44.380613 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2190/4590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:44.976151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.976773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.980166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:44.999810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.000452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.000896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.001935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.002399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.002829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.255140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.270183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.271716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.272973 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-392934e5-13a7-47e5-85c1-b945443b5df8 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 2274 microversion: 2.32 time: 0.300803 Aug 29 15:47:45.286041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2401/4591] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 2274 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:45.296042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d10d18ec-5afc-4d41-b60c-bf77066bcec2 req-9c9d7215-c35d-4d97-a2ba-5dd5c5966a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-deleted", "tag": "5fc71865-e22d-4048-b2b0-9176e6cef769"}, {"server_uuid": "e9510898-58bd-4f29-b408-90d76b8b9610", "name": "network-vif-deleted", "tag": "73384e18-d1b4-4919-9f91-9b5be5de78a8"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:45.328428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d10d18ec-5afc-4d41-b60c-bf77066bcec2 req-9c9d7215-c35d-4d97-a2ba-5dd5c5966a5d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.330985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d10d18ec-5afc-4d41-b60c-bf77066bcec2 req-9c9d7215-c35d-4d97-a2ba-5dd5c5966a5d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.331853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d10d18ec-5afc-4d41-b60c-bf77066bcec2 req-9c9d7215-c35d-4d97-a2ba-5dd5c5966a5d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.358760 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d10d18ec-5afc-4d41-b60c-bf77066bcec2 req-9c9d7215-c35d-4d97-a2ba-5dd5c5966a5d service nova] Creating event network-vif-deleted:5fc71865-e22d-4048-b2b0-9176e6cef769 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:45.360105 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d10d18ec-5afc-4d41-b60c-bf77066bcec2 req-9c9d7215-c35d-4d97-a2ba-5dd5c5966a5d service nova] Creating event network-vif-deleted:73384e18-d1b4-4919-9f91-9b5be5de78a8 for instance e9510898-58bd-4f29-b408-90d76b8b9610 on n-h2-854882-3 Aug 29 15:47:45.373568 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d10d18ec-5afc-4d41-b60c-bf77066bcec2 req-9c9d7215-c35d-4d97-a2ba-5dd5c5966a5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081749 Aug 29 15:47:45.374784 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2191/4592] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:45.409770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.410782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.427094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.428334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.428929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.430235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.437763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.438504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.567953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c88ee7fc-6f76-4255-818f-d7e5ed05dfd5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: .version_select at 0x7fb0e3050700>, body: {"keypair": {"name": "tempest-keypair-1100564261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeYV+04hSegjiIi5L8HCV4cMzdfCtQBS1LnzWA3NJpfEhRVeyYZCjFLvBeekP8L1dhbm0fSA9QVrvMg9v3RW6GhPJ3xF7IjpSoh0KsoQcK0Z6FgVK1vdrkagdaSuTw+Yg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:45.621062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c88ee7fc-6f76-4255-818f-d7e5ed05dfd5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:45.648748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c88ee7fc-6f76-4255-818f-d7e5ed05dfd5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:45.688450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:45.722135 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c88ee7fc-6f76-4255-818f-d7e5ed05dfd5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170475 Aug 29 15:47:45.729487 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2192/4593] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:47:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:45.834120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.850904 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d5ed0469-75b3-4315-ac20-8371a5e126de tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1272 microversion: 2.1 time: 0.445863 Aug 29 15:47:45.864412 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2402/4594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:45 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1272 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:46.299039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.302172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.330227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.332886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.333648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.338388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.339388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.340022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.857148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.872139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.873450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.889336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.891663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.893696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.894456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.896097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.898635 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b1db55ee-59ad-457c-a83f-da2b3325131b tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.604044 Aug 29 15:47:46.899466 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2193/4595] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:46.900339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.900941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.902104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.326843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:47.344453 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-162017a9-1b5d-434c-b4ac-8f62a6fe1bf8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1314 microversion: 2.1 time: 0.473581 Aug 29 15:47:47.356169 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2403/4596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:47.874932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1c36e58b-1080-4a34-b909-cceedcfcf9a5 req-45b26c89-144d-4b9f-b297-7d2877968eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb9a407-82b4-40c2-ba1e-ef58bfd63187", "tag": "71729a0b-5c0f-4a43-a173-b074572cc882"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:47.902784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c36e58b-1080-4a34-b909-cceedcfcf9a5 req-45b26c89-144d-4b9f-b297-7d2877968eac service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.904237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c36e58b-1080-4a34-b909-cceedcfcf9a5 req-45b26c89-144d-4b9f-b297-7d2877968eac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.905013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c36e58b-1080-4a34-b909-cceedcfcf9a5 req-45b26c89-144d-4b9f-b297-7d2877968eac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.926552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:47.930083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:47.938731 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1c36e58b-1080-4a34-b909-cceedcfcf9a5 req-45b26c89-144d-4b9f-b297-7d2877968eac service nova] Creating event network-changed:71729a0b-5c0f-4a43-a173-b074572cc882 for instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 on n-h2-854882-3 Aug 29 15:47:47.947002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.949865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.951700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.953809 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1c36e58b-1080-4a34-b909-cceedcfcf9a5 req-45b26c89-144d-4b9f-b297-7d2877968eac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081345 Aug 29 15:47:47.954222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.955057 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2194/4597] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:47.957714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.958347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.246016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.262398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.264206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.266406 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-366deff9-1fd9-4f00-8347-30f7c21aeae2 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.347639 Aug 29 15:47:48.282939 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2404/4598] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:47 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:48.369380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.370116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:48.382598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.383086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.383534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.384222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.384673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.385092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.744253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.752465 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25d029e4-9866-408a-a7b5-37cbbe11113a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1314 microversion: 2.1 time: 0.389364 Aug 29 15:47:48.758317 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2195/4599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:48 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:49.013723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-906804142", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d897c5c0-df74-4e72-afd9-ed5315eaa2e0"}], "security_groups": [{"name": "tempest-securitygroup--1379365030"}], "key_name": "tempest-keypair-1100564261", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:49.151984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] validate_networks() for [('d897c5c0-df74-4e72-afd9-ed5315eaa2e0', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:49.294484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:49.295622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:49.311868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.312227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.312767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.313523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.316560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.317029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.439999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:49.451673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:49.456624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:49.461121 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac14ef8d-ae1c-485c-8eb4-4ebffe070933 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.171551 Aug 29 15:47:49.462321 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2196/4600] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:49 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:49.780673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:49.781289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:49.790128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.795213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.795860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.796768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.797375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.797968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.029801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.045879 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb0b1b25-ca82-4b91-8a69-2748f50dce1c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1314 microversion: 2.1 time: 0.268947 Aug 29 15:47:50.050631 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2197/4601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:49 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:50.402720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:50.403455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:50.404669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:50.405450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:50.406026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:50.433868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.436982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.439205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.443695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.444677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.445719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.474722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:50.490730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:50.492177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:50.492366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:50.521342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.522244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.522954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.524927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.526251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.527325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.559996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:50.568341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:50.676873 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d32dad41-f8e7-4dd9-b50d-2c781c8c78f5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.671880 Aug 29 15:47:50.687502 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2405/4602] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:50.785602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.824906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.829467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.838028 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65061b94-12c9-4b3c-8f8f-084a310c3295 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.353151 Aug 29 15:47:50.839447 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2198/4603] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:50 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:50.850430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3e551d0-24d7-4fa2-b6ca-7d6a4744a521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:50.851734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a3e551d0-24d7-4fa2-b6ca-7d6a4744a521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:50.984154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a3e551d0-24d7-4fa2-b6ca-7d6a4744a521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.994429 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a3e551d0-24d7-4fa2-b6ca-7d6a4744a521 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1241 microversion: 2.1 time: 0.153001 Aug 29 15:47:50.996260 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2199/4604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:50 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:51.076226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:51.076867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:51.090574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.095493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.096826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.098490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.100458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.101489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.390607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:51.407781 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ee025ee-cc28-4026-89f4-cae5f65d5f09 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1314 microversion: 2.1 time: 0.335843 Aug 29 15:47:51.425169 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2200/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:51 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:51.467824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Calling method '.version_select at 0x7fb0e2665280>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:51.470817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.471444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.472145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.504178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.505986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.510605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.541095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.546104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.546791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.558556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b58e3940-43b2-42ad-a1c9-92496fe4f2b2 tempest-PortsAdminExtendedAttrsTestJSON-761110465 tempest-PortsAdminExtendedAttrsTestJSON-761110465-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.851743 Aug 29 15:47:51.560248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2406/4606] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:47:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:51.868049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:51.882894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:51.883902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:51.904674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.908112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.909689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.913630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.916743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.918125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.022324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:52.024660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:52.039379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.041912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.043257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.047401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.050086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.052705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.091900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.113125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.118416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.121680 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88f1c054-d1bc-45e4-9a94-8b32e7d7d442 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.261324 Aug 29 15:47:52.125223 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2201/4607] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:51 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:52.290377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.305069 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-39e59e10-af41-422b-b379-2a0fd5aed26a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1293 microversion: 2.1 time: 0.290706 Aug 29 15:47:52.308946 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2407/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:52 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1293 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:52.428143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:52.429265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:52.437799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.442780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.443503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.444455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.447568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.449909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.684598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-bf10a821-4fcb-4c1d-8ac1-cbea0caa2c87 req-d2c77ea9-720e-4653-9d8d-139fb354f712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb9a407-82b4-40c2-ba1e-ef58bfd63187", "name": "network-vif-plugged", "status": "completed", "tag": "71729a0b-5c0f-4a43-a173-b074572cc882"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:52.702596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bf10a821-4fcb-4c1d-8ac1-cbea0caa2c87 req-d2c77ea9-720e-4653-9d8d-139fb354f712 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.706924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bf10a821-4fcb-4c1d-8ac1-cbea0caa2c87 req-d2c77ea9-720e-4653-9d8d-139fb354f712 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.707711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bf10a821-4fcb-4c1d-8ac1-cbea0caa2c87 req-d2c77ea9-720e-4653-9d8d-139fb354f712 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.735214 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bf10a821-4fcb-4c1d-8ac1-cbea0caa2c87 req-d2c77ea9-720e-4653-9d8d-139fb354f712 service nova] Creating event network-vif-plugged:71729a0b-5c0f-4a43-a173-b074572cc882 for instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 on n-h2-854882-3 Aug 29 15:47:52.750331 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-bf10a821-4fcb-4c1d-8ac1-cbea0caa2c87 req-d2c77ea9-720e-4653-9d8d-139fb354f712 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069910 Aug 29 15:47:52.756451 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2408/4609] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:52.827660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.839362 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6ebd49c-9696-4256-b8d2-e32bea7fa554 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1314 microversion: 2.1 time: 0.415048 Aug 29 15:47:52.840535 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2202/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:52 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:53.154594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:53.155457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:53.177160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.179723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.180451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.182342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.186314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.188762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.332755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:53.334383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:53.376601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.384378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.385127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.386466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.391439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.391954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.452309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.469133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.475233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.479128 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-594d59cb-3380-40a8-bfea-ab6e7ecb3a90 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.330076 Aug 29 15:47:53.481304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2409/4611] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:53 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:53.538463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.551574 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e996c03-28ea-4494-9e09-942b8dcb3086 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1299 microversion: 2.1 time: 0.226641 Aug 29 15:47:53.566721 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2203/4612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:53 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:53.860907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:53.861579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:53.878379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.878950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.879411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.884428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.884735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.885237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.525926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.527929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.559154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.559939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.560700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.561913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.562550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.563164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.693968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.732891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.738382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.741095 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45882a00-ca03-4083-a4b4-c1606a3a1053 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.225090 Aug 29 15:47:54.753438 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2204/4613] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:54.770514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.771646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.783246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.784048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.784871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.786939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.788148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.790332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.943431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.953996 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d520f054-3976-47e3-8eed-81a388c07cb4 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1299 microversion: 2.1 time: 0.208437 Aug 29 15:47:54.965194 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2205/4614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:55.122602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.133067 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a0adb0b8-9623-40f8-9fde-a3488e664eb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1314 microversion: 2.1 time: 1.276294 Aug 29 15:47:55.134026 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2410/4615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:53 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1314 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:55.776782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:55.777724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:55.792025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:55.793055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:55.793725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.794557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:55.803469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:55.804109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.981869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.986274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:55.988571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:55.989300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.002471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.012312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.012888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.014191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.015228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:56.015936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.017969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.022235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:56.023706 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8d7abde8-06e7-4683-a7aa-5f3d8c5c983a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.250842 Aug 29 15:47:56.035159 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2206/4616] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:55 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:56.166023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.166838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.176587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.179459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.180160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.183826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.184638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.185288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.509029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:56.518429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:56.522190 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-edf42e7e-84b2-4412-b476-869c2e2a6dd1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1367 microversion: 2.1 time: 0.544418 Aug 29 15:47:56.526913 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2411/4617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:55 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:56.538383 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a7dd8199-a73e-4eb9-959e-947125cbb78f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1502 microversion: 2.1 time: 0.368402 Aug 29 15:47:56.538383 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2207/4618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1502 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:56.551881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6a97910-a35e-4f39-8a8e-47c92b8c9724 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:56.559000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6a97910-a35e-4f39-8a8e-47c92b8c9724 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.559493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6a97910-a35e-4f39-8a8e-47c92b8c9724 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.559936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6a97910-a35e-4f39-8a8e-47c92b8c9724 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.597881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c6a97910-a35e-4f39-8a8e-47c92b8c9724 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Going to try to stop instance {{(pid=130001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:47:56.674319 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c6a97910-a35e-4f39-8a8e-47c92b8c9724 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187/action" status: 202 len: 0 microversion: 2.1 time: 0.125051 Aug 29 15:47:56.681818 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2208/4619] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:56 2022] POST /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:56.686174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.686866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.694845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.695352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.695800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.701542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.702066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.702522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.751334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:57.065912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:57.066642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:57.081647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.083996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.084455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:57.087687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.089336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.092083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:57.222808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.241938 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12819e31-bad9-4a5e-abb2-5f53224765ca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.558352 Aug 29 15:47:57.257759 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2412/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:57.320763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.346189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.351178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.352469 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1fbf05ef-b913-4f12-bc53-ff3128b5e0c1 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.294400 Aug 29 15:47:57.356642 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2209/4621] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:57 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:57.556518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:57.557765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:57.581334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.582624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.586809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:57.593480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.596857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.600324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.266051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:58.267797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:58.281515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.282022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.282471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.287941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.288477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.289242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.709354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:58.737471 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba3f38ab-0bdb-4cfb-93e4-aa229087fb92 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1367 microversion: 2.1 time: 1.183629 Aug 29 15:47:58.740379 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2413/4622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:57 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1367 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:58.782151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:58.783527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:58.797794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.798937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.800124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.801569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.802561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.803455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.821379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:58.830342 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7890957f-78b8-46f4-94d7-0de37806588e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.568789 Aug 29 15:47:58.842824 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2210/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:58 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:59.236931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:59.276952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:59.288128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:59.294785 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9fbb3b3c-bc6b-4cf1-aef6-56bcc20ef0c5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.548830 Aug 29 15:47:59.298928 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2414/4624] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:58 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:59.422791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5ee14f84-27fb-46d4-a6f6-b85714c36496 req-89130623-83a5-46a4-ad9d-ba611331f42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3881fe52-0c97-4880-b6f7-43ec6e463e69", "tag": "f8927456-a7bb-49f9-8c8a-63804f0e54b1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:59.466892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ee14f84-27fb-46d4-a6f6-b85714c36496 req-89130623-83a5-46a4-ad9d-ba611331f42f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.467411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ee14f84-27fb-46d4-a6f6-b85714c36496 req-89130623-83a5-46a4-ad9d-ba611331f42f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.467863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ee14f84-27fb-46d4-a6f6-b85714c36496 req-89130623-83a5-46a4-ad9d-ba611331f42f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.509773 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5ee14f84-27fb-46d4-a6f6-b85714c36496 req-89130623-83a5-46a4-ad9d-ba611331f42f service nova] Creating event network-changed:f8927456-a7bb-49f9-8c8a-63804f0e54b1 for instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 on n-h1-854882-3 Aug 29 15:47:59.521849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5ee14f84-27fb-46d4-a6f6-b85714c36496 req-89130623-83a5-46a4-ad9d-ba611331f42f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108002 Aug 29 15:47:59.534070 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2211/4625] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:59.768328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:59.770059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:59.807990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.808541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.809255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.810192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.814090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.814852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.871934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:59.873016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:59.897623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.898134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.909616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.911134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.919254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.923288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.386059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:00.399435 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-713a0393-6725-44e0-b35f-244b295aad87 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1367 microversion: 2.1 time: 0.638469 Aug 29 15:48:00.401974 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2415/4626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:59 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1367 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:00.408446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:00.409731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:00.419993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.421266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.422090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.423393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.424065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.424758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.483644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:00.524443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:00.707014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:00.716025 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19d54ed5-0365-43fa-9d74-0da4a7661fc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.851345 Aug 29 15:48:00.716634 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2212/4627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:59 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:01.087597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.105802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.111735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.117643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f149aa71-990b-4b91-8be1-8544b6ef7cb5 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.712995 Aug 29 15:48:01.128133 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2416/4628] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:00 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:01.423401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:01.424133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:01.436506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=12 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:01.441787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.442334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.445051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.448758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.449857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.450781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.741455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:01.742416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:01.757454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.762261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.763112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.766682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.768383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.775092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.875104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.885769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8aba938f-c135-4cef-ae5b-c202ab3df316 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1367 microversion: 2.1 time: 0.466841 Aug 29 15:48:01.898429 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2213/4629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:01 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:02.155898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:02.156853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:02.167579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.170910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.171596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.172569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.186259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.187005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.362441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:02.385893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:02.388100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:02.395079 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-81df13e1-ee4f-40fd-8189-19699924fe50 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.237786 Aug 29 15:48:02.396441 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2214/4630] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:02 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:02.474694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:02.487536 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae3609d0-0a8f-46e3-b364-8b4215904340 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.751054 Aug 29 15:48:02.495411 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2417/4631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:01 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:02.916514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:02.917133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:02.930483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.939054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.939767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.940680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.941301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.941921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.428392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:03.443539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:03.479138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.479810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.485036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.487036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.492190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.494583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.791760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.801897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.804110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.805371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3b4e12e1-07d1-4303-9ed6-cc31f73032ba tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.386791 Aug 29 15:48:03.805989 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2418/4632] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:03 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:03.814605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:03.817285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:03.838160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.839889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.840557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.843039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.844078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.844551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.987432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.003525 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-74132390-0a57-42a4-96b4-9ddd80b9bb06 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1367 microversion: 2.1 time: 1.090783 Aug 29 15:48:04.006152 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2215/4633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:02 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1367 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:04.244309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.264028 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d67fb023-57f1-4529-a2c4-d2989e698ee2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.452858 Aug 29 15:48:04.266452 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2419/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:03 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:04.839903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:04.840873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:04.852324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.854540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.855152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.857286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.858059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.859845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.005860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.020082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.026212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.031234 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-739d99e5-17c0-438c-b8a7-4471e5175173 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.193525 Aug 29 15:48:05.032855 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2216/4635] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:04 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:05.047844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.048208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:05.060551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.061086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.061581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.062328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.065517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.066036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.293363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.294122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:05.309134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.309673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.310120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.310843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.311304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.311729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.567829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.576848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-45e64fdd-f7d9-4186-944a-67d2cef0a093 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1367 microversion: 2.1 time: 0.534727 Aug 29 15:48:05.581532 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2420/4636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1367 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:05.706901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-db9ecf85-5b27-4787-9ea6-25b9178964c9 req-4d361e6a-08c9-4603-9b18-349656a73358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3881fe52-0c97-4880-b6f7-43ec6e463e69", "name": "network-vif-plugged", "status": "completed", "tag": "f8927456-a7bb-49f9-8c8a-63804f0e54b1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:05.727220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db9ecf85-5b27-4787-9ea6-25b9178964c9 req-4d361e6a-08c9-4603-9b18-349656a73358 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.727711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db9ecf85-5b27-4787-9ea6-25b9178964c9 req-4d361e6a-08c9-4603-9b18-349656a73358 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.728157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db9ecf85-5b27-4787-9ea6-25b9178964c9 req-4d361e6a-08c9-4603-9b18-349656a73358 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.744392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.757286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-403adf54-82c7-4f10-ae2a-f29448fcf4ed tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.466739 Aug 29 15:48:05.759065 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2217/4637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:05.773858 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-db9ecf85-5b27-4787-9ea6-25b9178964c9 req-4d361e6a-08c9-4603-9b18-349656a73358 service nova] Creating event network-vif-plugged:f8927456-a7bb-49f9-8c8a-63804f0e54b1 for instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 on n-h1-854882-3 Aug 29 15:48:05.791710 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-db9ecf85-5b27-4787-9ea6-25b9178964c9 req-4d361e6a-08c9-4603-9b18-349656a73358 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086969 Aug 29 15:48:05.794051 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2421/4638] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:06.061830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.062456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:06.094543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.097031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.103081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.107140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.108091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.110283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.482150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:06.504317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:06.508384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:06.510460 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f5a1f5af-a52e-40ed-bd22-bdb359b3ae55 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.454210 Aug 29 15:48:06.514269 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2218/4639] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:06 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:06.602823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.604262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:06.619056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.619567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.620020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.623705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.624578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.628199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.780821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.782005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:06.802288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.803356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.804317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.805484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.806640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.807306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.326730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.339731 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec434663-aae9-4c0e-b58f-3511ce23fa77 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1367 microversion: 2.1 time: 0.741162 Aug 29 15:48:07.340239 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2422/4640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:06 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1367 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:07.371038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.383607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-545a4c58-b314-4337-8696-5a03b4b1b6cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.607918 Aug 29 15:48:07.386030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2219/4641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:06 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:07.550222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:07.554832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:07.585589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.590303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.590810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.594082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.595343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.595922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.919899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:07.920978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:07.931330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.931918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.932490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.945823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.946730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.947469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.046601 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a3460d02-c29d-44f4-a7bf-c7bd342d1919 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/ips" status: 200 len: 151 microversion: 2.20 time: 0.131291 Aug 29 15:48:08.047216 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2220/4642] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Aug 29 15:48:07 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/ips => generated 151 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:48:08.070746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.081100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.082708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.084011 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ed38f32-a73a-4427-874f-8ea1f5bb374c tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.542731 Aug 29 15:48:08.113567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2423/4643] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:07 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:08.381592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.382509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:08.405836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.406571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.407086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.409080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.410268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.415205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.416305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.417110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:08.431288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.431797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.432242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.432991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.433471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.433905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.888107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.917131 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d97c2a83-483d-4496-9095-276e0f5e793a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1556 microversion: 2.1 time: 0.541931 Aug 29 15:48:08.947328 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2221/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1556 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:08.961071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.962280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:08.991119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.997047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.998586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.000149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.003288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.004502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.151184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.166554 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a1a36e7-84b8-4e54-9eb7-0e9c9e2c6279 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.754917 Aug 29 15:48:09.185762 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2424/4645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:09.190893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:09.191553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:09.207310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.207814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.208294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.209016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.209503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.210134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.366095 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9971efd-49c7-4092-a1b5-39f9e97d0bf0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.417349 Aug 29 15:48:09.366557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.373835 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2222/4646] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-interface => generated 284 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:09.420511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.438718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.449365 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-939ae581-3b5a-4ef0-8f9b-189600ebdfce tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1604 microversion: 2.32 time: 0.263728 Aug 29 15:48:09.450563 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2425/4647] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:09 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:10.195470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:10.203095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:10.253781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.259398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.262738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.263760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.264777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.266597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.480041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:10.481538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:10.521027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.522459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.526564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.535744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.545125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.545573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.742472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.743207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.743757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.744514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lazy-loading 'fault' on Instance uuid e9510898-58bd-4f29-b408-90d76b8b9610 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:10.902354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.906761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:10.919212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.936176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.940587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '550baba8a2304466962f501a027d7a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948fbbd2c9974beb93713e4366834b28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.950220 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba42ad66-cff6-404b-b26d-91f119bd1824 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 200 len: 1371 microversion: 2.32 time: 0.475845 Aug 29 15:48:10.951678 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2426/4648] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:10 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 1371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:10.956078 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5e5cc28b-29b9-4a37-9c8f-110714f7a974 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.770287 Aug 29 15:48:10.959365 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2223/4649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:10 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:11.982329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.982953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:11.992585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.994901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:12.000167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.000710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.001192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.001834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.002301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.002729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.042129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.048719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.050508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.052826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.060039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.064363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.121366 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] HTTP exception thrown: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Request method failure captured: Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 HTTP/1.1 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4i8P-YHYh8E1rmTB8oPA5qTZ-Vp8kg4SpPEdJe2foqmmqDMCQ1nPaJeXJ_CgkGQEA5Vjl2NtGeFKGswwXxLhjUIU_fYPiIDFb6djOTB4pmcb2aFDDHg9AKvBB_kn2jmij67xbUUxbNKDv_20l6iF786jkSMzFSfqSEmi0Dzg3Etnw Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 948fbbd2c9974beb93713e4366834b28 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/948fbbd2c9974beb93713e4366834b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/948fbbd2c9974beb93713e4366834b28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_948fbbd2c9974beb93713e4366834b28", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/948fbbd2c9974beb93713e4366834b28"}]}] Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 948fbbd2c9974beb93713e4366834b28 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TaggedBootDevicesTest-19303023-project Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 550baba8a2304466962f501a027d7a82 Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TaggedBootDevicesTest-19303023-project Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e9510898-58bd-4f29-b408-90d76b8b9610'} Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:12.153454 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:12.158537 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:12.158537 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:12.158537 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:12.158537 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:12.158537 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:12.158537 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:12.158537 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:12.173779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Returning 404 to user: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:12.174985 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c19a26ff-dde3-4d3c-9c2a-21b6ad940d3d tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 404 len: 111 microversion: 2.32 time: 0.187274 Aug 29 15:48:12.175744 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2224/4650] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:12.185336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3ead761-fff0-47f1-b9bf-2736ad5bb64a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '.version_select at 0x7fb0e3050af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.224352 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3ead761-fff0-47f1-b9bf-2736ad5bb64a tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041361362" status: 204 len: 0 microversion: 2.32 time: 0.043327 Aug 29 15:48:12.229672 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2225/4651] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041361362 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:48:12.635255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:12.635879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:12.655778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.656266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.657217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.662588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.665912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.666620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.738785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lazy-loading 'flavor' on Instance uuid cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:12.815755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:12.842004 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5084222a-dfff-486d-a9be-e3623e519f49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.862989 Aug 29 15:48:12.870629 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2427/4652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:13.015662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1f0bca67-0062-407e-9de9-4200a5cec0eb req-4b077d72-4898-4504-b584-2f35a3eca23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3881fe52-0c97-4880-b6f7-43ec6e463e69", "tag": "f8927456-a7bb-49f9-8c8a-63804f0e54b1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:13.056556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1f0bca67-0062-407e-9de9-4200a5cec0eb req-4b077d72-4898-4504-b584-2f35a3eca23c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.060643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1f0bca67-0062-407e-9de9-4200a5cec0eb req-4b077d72-4898-4504-b584-2f35a3eca23c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.061199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1f0bca67-0062-407e-9de9-4200a5cec0eb req-4b077d72-4898-4504-b584-2f35a3eca23c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.090544 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1f0bca67-0062-407e-9de9-4200a5cec0eb req-4b077d72-4898-4504-b584-2f35a3eca23c service nova] Creating event network-changed:f8927456-a7bb-49f9-8c8a-63804f0e54b1 for instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 on n-h1-854882-3 Aug 29 15:48:13.104255 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1f0bca67-0062-407e-9de9-4200a5cec0eb req-4b077d72-4898-4504-b584-2f35a3eca23c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098182 Aug 29 15:48:13.107610 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2428/4653] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:13.221324 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf25ef01-8daa-407b-a975-57cb277c98ae tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/action" status: 202 len: 0 microversion: 2.20 time: 0.593096 Aug 29 15:48:13.227276 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2226/4654] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:48:12 2022] POST /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:13.235273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.236019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.283313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.284973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.287907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.289367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.294975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.301434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.876499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.877844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.893913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.894563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.895006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.897335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.897832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.898276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.937775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.948752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.955938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.961614 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40882387-e28d-4136-bc62-60f58ca6bb92 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.732716 Aug 29 15:48:13.968855 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2429/4655] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:14.290658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.308948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-02c0c60f-b8c8-4ad6-b6c3-1621552f5ca3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.438071 Aug 29 15:48:14.311038 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2227/4656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:14.993118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.994807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:15.007998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.010392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.011277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.014215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.016061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.016594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.028128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:15.337091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:15.338649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:15.352914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.354246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.357092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.359678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.360811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.362313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.539813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.556481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.570008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.574678 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2221635f-97b1-4dde-aae2-0f9198ad1a17 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.586266 Aug 29 15:48:15.575558 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2430/4657] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:14 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:15.662706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.672535 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58e4ced5-a7e8-4fe7-b344-8105f63c7a50 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.343809 Aug 29 15:48:15.673143 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2228/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:15 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:16.600204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.601786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.605040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:16.612435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.613298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.614027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.615977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.616698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.617374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.705792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.707519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.719722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:16.725297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.726732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.727516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.730001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.730857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.733210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.950648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.975186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.982216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.987200 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c638e736-c6c3-452a-a366-6d88f3bea6ed tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.392187 Aug 29 15:48:16.992970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2431/4659] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:16 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:17.296529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.310657 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe326edc-3ad5-4be4-8282-dd80834c3c0f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.613881 Aug 29 15:48:17.311964 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2229/4660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:16 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:18.016149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.016533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.034933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.036687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.037147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.040147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.040648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.041078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.338706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.340663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.359576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.363343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.366102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.367195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.380691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.382841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.730316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.743663 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1558a73-68d2-46be-8532-dd0e6517969f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.409269 Aug 29 15:48:18.744860 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2230/4661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:18.778611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.804497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.809315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.812685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f221111d-e207-4095-9cce-13d9dd268abc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.802122 Aug 29 15:48:18.814833 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2432/4662] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:19.784333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.787251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.821899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.823129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.823651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.827340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.828661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.832764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.857801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.858438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.889797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.893696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.897029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.899592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.904738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.905493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.392216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.404427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.413579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.415107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6cafb275-49e2-496e-81e9-dda9c25f75e5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.562156 Aug 29 15:48:20.420747 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2433/4663] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:20.828169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.845473 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7267d4fe-1d6d-46ae-b713-487d7f219e68 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 1.064236 Aug 29 15:48:20.847030 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2231/4664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:21.449960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.451233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.460100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.460842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.461599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.462514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.463780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.464423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.694499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.695837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.714186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.716880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.719284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.722946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.727200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.728211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.741665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.781948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.790503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.792295 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d7d2260-b197-48c9-b851-455f334de154 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.351345 Aug 29 15:48:21.793853 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2434/4665] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:21.799612 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] HTTP exception thrown: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Request method failure captured: Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 HTTP/1.1 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN4i8P-YHYh8E1rmTB8oPA5qTZ-Vp8kg4SpPEdJe2foqmmqDMCQ1nPaJeXJ_CgkGQEA5Vjl2NtGeFKGswwXxLhjUIU_fYPiIDFb6djOTB4pmcb2aFDDHg9AKvBB_kn2jmij67xbUUxbNKDv_20l6iF786jkSMzFSfqSEmi0Dzg3Etnw Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 948fbbd2c9974beb93713e4366834b28 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/948fbbd2c9974beb93713e4366834b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/948fbbd2c9974beb93713e4366834b28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_948fbbd2c9974beb93713e4366834b28", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/948fbbd2c9974beb93713e4366834b28"}]}] Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 948fbbd2c9974beb93713e4366834b28 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TaggedBootDevicesTest-19303023-project Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 550baba8a2304466962f501a027d7a82 Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TaggedBootDevicesTest-19303023-project Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e9510898-58bd-4f29-b408-90d76b8b9610'} Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:21.803018 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.808426 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.811001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Returning 404 to user: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:21.812953 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96d585dc-c81a-4fb4-b915-dcf482852f2e tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 404 len: 111 microversion: 2.32 time: 0.123712 Aug 29 15:48:21.814863 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2232/4666] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:48:21 2022] DELETE /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:21.825282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.826321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] [instance: e9510898-58bd-4f29-b408-90d76b8b9610] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.843343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.844255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.844980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.846808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.847687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.850553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.879271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.880204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.896869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.899556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.902548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.903320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.904348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.904864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.908299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] HTTP exception thrown: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Request method failure captured: Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 HTTP/1.1 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN4i8P-YHYh8E1rmTB8oPA5qTZ-Vp8kg4SpPEdJe2foqmmqDMCQ1nPaJeXJ_CgkGQEA5Vjl2NtGeFKGswwXxLhjUIU_fYPiIDFb6djOTB4pmcb2aFDDHg9AKvBB_kn2jmij67xbUUxbNKDv_20l6iF786jkSMzFSfqSEmi0Dzg3Etnw Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 948fbbd2c9974beb93713e4366834b28 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/948fbbd2c9974beb93713e4366834b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/948fbbd2c9974beb93713e4366834b28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_948fbbd2c9974beb93713e4366834b28", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/948fbbd2c9974beb93713e4366834b28"}]}] Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 948fbbd2c9974beb93713e4366834b28 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TaggedBootDevicesTest-19303023 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TaggedBootDevicesTest-19303023-project Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 550baba8a2304466962f501a027d7a82 Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TaggedBootDevicesTest-19303023-project Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'e9510898-58bd-4f29-b408-90d76b8b9610'} Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:21.910408 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] Returning 404 to user: Instance e9510898-58bd-4f29-b408-90d76b8b9610 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:21.915622 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff548896-04c2-4cdb-b60b-34038f5f11b9 tempest-TaggedBootDevicesTest-19303023 tempest-TaggedBootDevicesTest-19303023-project] 10.222.0.16 "GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610" status: 404 len: 111 microversion: 2.32 time: 0.093395 Aug 29 15:48:21.919314 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2435/4667] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/e9510898-58bd-4f29-b408-90d76b8b9610 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:22.440766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.453183 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7519f51d-43aa-4051-9411-dc978c6202c5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1512 microversion: 2.1 time: 0.585841 Aug 29 15:48:22.469141 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2233/4668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1512 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:22.825921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:22.827967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:22.860500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.862415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.862904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.864654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.873346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.874920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.417624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.479450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:23.480254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:23.486549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.494584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.501253 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9251d1e0-15cf-4c15-b6fc-a63b853ace6c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.689349 Aug 29 15:48:23.513219 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2436/4669] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:22 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:23.517900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.518982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.525544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.527776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.528410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.529229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.094961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.115625 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eed770ba-839b-4041-9bca-3e0deee0c3d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1489 microversion: 2.1 time: 0.642190 Aug 29 15:48:24.116561 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2234/4670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:23 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1489 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:24.155901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:24.159719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.178444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.179251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.182132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.186285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.187133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.187769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.345381 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-455b348a-2057-4a99-a14e-bd7ec653b9fe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 200 len: 156 microversion: 2.1 time: 0.194591 Aug 29 15:48:24.350563 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2437/4671] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:24 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 156 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:24.356328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.358087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.370419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.374399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.374886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.375837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.377222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.378818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.544588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.546084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.559592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.564622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.566751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.568564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.571731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.574202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.798626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.816343 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9fbcecf6-d51e-484e-917a-a3fb7ff3537c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.462913 Aug 29 15:48:24.837136 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2235/4672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:24.856149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.856811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.873570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.874512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.875167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.878443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.879372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.882012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.057770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.072299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.076188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.080012 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac05373c-efc6-45fa-88da-56e3b1ed7c4e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1743 microversion: 2.20 time: 0.542857 Aug 29 15:48:25.082203 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2438/4673] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1743 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:25.497605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.515024 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c830d4fd-5283-4a92-827c-ccc602a558a9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.662983 Aug 29 15:48:25.516596 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2236/4674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:25.549901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.551392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.586866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.587605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.588451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.592650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.593874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.594622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.838750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.849069 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7dfd3a75-8fb5-40c0-b4c2-f9417c850a73 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.307854 Aug 29 15:48:25.865414 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2439/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:25.872899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.873642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.885478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.885996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.886431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.887142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.887594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.888357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.103866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.105152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.117603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.118445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.121242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.122304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.134711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.136048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.198685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.209769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a3e4e01-83cf-4147-a847-7337853151fa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.341167 Aug 29 15:48:26.213475 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2237/4676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:26.548111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1012410448", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "495c919e-8bb9-4e7e-b31f-e6fe4e50e138"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:26.580172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.591230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.594565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.596184 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-44a80ae6-b0bd-471b-bb41-54879e8f7205 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1743 microversion: 2.20 time: 0.496588 Aug 29 15:48:26.597489 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2440/4677] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1743 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:26.706455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] validate_networks() for [('495c919e-8bb9-4e7e-b31f-e6fe4e50e138', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:27.117523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5ce53c08-989e-4179-993d-2062741aa0dd req-7a14fcfb-0139-4d37-b3b7-2de92ca7a1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "name": "network-vif-plugged", "status": "completed", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:27.143760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ce53c08-989e-4179-993d-2062741aa0dd req-7a14fcfb-0139-4d37-b3b7-2de92ca7a1f5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.144562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ce53c08-989e-4179-993d-2062741aa0dd req-7a14fcfb-0139-4d37-b3b7-2de92ca7a1f5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.145771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ce53c08-989e-4179-993d-2062741aa0dd req-7a14fcfb-0139-4d37-b3b7-2de92ca7a1f5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.171981 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5ce53c08-989e-4179-993d-2062741aa0dd req-7a14fcfb-0139-4d37-b3b7-2de92ca7a1f5 service nova] Creating event network-vif-plugged:089534cd-a1fd-4322-a9bd-4aef2c5a4503 for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 on n-h1-854882-3 Aug 29 15:48:27.185334 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5ce53c08-989e-4179-993d-2062741aa0dd req-7a14fcfb-0139-4d37-b3b7-2de92ca7a1f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071792 Aug 29 15:48:27.186458 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2441/4678] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:27.622267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.622982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.655202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.656032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.656750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.658924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.659611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.660265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.305652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.325967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.328077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.330193 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-64fd3671-171e-43a2-9f81-ec05635ef8f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 0.712906 Aug 29 15:48:28.332764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2442/4679] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:28.692956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:28.693561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:28.694083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:28.694507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:28.695051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:28.716098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.716598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.717042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.718404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.718877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.719310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.773641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:28.790947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for user a68002795ce541338b30129e6dbb0fb6 and project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:28.834427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:28.840264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:28.966035 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c272344-a906-4528-a42d-ea8c6851f902 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.424166 Aug 29 15:48:28.966944 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2238/4680] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:28.983277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6dc96c6d-b473-4a50-a5df-a3a3d8cd168a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:28.985619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6dc96c6d-b473-4a50-a5df-a3a3d8cd168a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.094140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6dc96c6d-b473-4a50-a5df-a3a3d8cd168a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.105698 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6dc96c6d-b473-4a50-a5df-a3a3d8cd168a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1215 microversion: 2.1 time: 0.127511 Aug 29 15:48:29.106618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2443/4681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:28 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:29.365107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:29.365107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.390948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.391646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.395806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.397886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.401734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.404752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.127029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d51a576b-63e1-4654-9eb1-cd15406c7243 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:30.127801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d51a576b-63e1-4654-9eb1-cd15406c7243 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:30.370234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d51a576b-63e1-4654-9eb1-cd15406c7243 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.406187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d51a576b-63e1-4654-9eb1-cd15406c7243 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1215 microversion: 2.1 time: 0.267481 Aug 29 15:48:30.411895 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2444/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:30 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:30.441199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.460471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.469237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.475275 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-db74572c-25fd-4974-b8fa-a5483ee328be tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 1.115340 Aug 29 15:48:30.480287 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2239/4683] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:29 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:31.430636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.431465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.444681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.445184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.445723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.446521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.446997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.447457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.513116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.514427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.526545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.534456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.535137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.536167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.536825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.538154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.842189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.863074 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c66274d0-d3ba-46be-9130-a4ae936f24ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1275 microversion: 2.1 time: 0.435674 Aug 29 15:48:31.875152 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2445/4684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1275 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:32.166381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.194761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.196560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.200915 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a4ef8157-9989-4098-9fd6-f95c75ca70da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 0.693719 Aug 29 15:48:32.219015 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2240/4685] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:32.886390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.887138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.912211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.912741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.921688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.926704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.932708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.934276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.181764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.210473 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-feb61779-d1c7-4521-948f-1404edd707a6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1273 microversion: 2.1 time: 0.327929 Aug 29 15:48:33.213226 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2446/4686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:33.230484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.231140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.246709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.247384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.247853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.257200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.260191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.260389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.343287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:34.239411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:34.240684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:34.266592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.267082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.267537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.268479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.268729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.269161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.529402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.549948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.556807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.560506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-603c05bd-4b44-4b70-b774-b52b1574684c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 1.334411 Aug 29 15:48:34.567739 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2241/4687] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:35.218367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.233084 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fbc7f2f8-8bbc-4b21-8f11-9260a4eb6e2b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1315 microversion: 2.1 time: 0.997645 Aug 29 15:48:35.234808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2447/4688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:34 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:35.587980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:35.589201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:35.608664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.609152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.609628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.610339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.610795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.611347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.260641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.261275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.271456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.272458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.273147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.274207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.274892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.275539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.992235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.008059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-33071f0e-c356-4564-aa02-2aea138dec81 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1315 microversion: 2.1 time: 0.751268 Aug 29 15:48:37.021836 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2448/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:37.483626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.494293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.502847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.509375 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8a65fbca-8ab5-4efb-8f4e-832d8e934521 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 1.927627 Aug 29 15:48:37.512958 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2242/4690] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:35 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:37.633169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fe222156-cefe-49c2-89ec-9869f92637fe req-73fa52d9-143f-4da0-9f92-6ef4dc51f472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e438716-de97-482f-842e-ebdb75a24e6b", "tag": "e2089e44-0270-4f41-a47a-1693edd7b379"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:37.656475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe222156-cefe-49c2-89ec-9869f92637fe req-73fa52d9-143f-4da0-9f92-6ef4dc51f472 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.659584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe222156-cefe-49c2-89ec-9869f92637fe req-73fa52d9-143f-4da0-9f92-6ef4dc51f472 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.660473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe222156-cefe-49c2-89ec-9869f92637fe req-73fa52d9-143f-4da0-9f92-6ef4dc51f472 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.688385 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fe222156-cefe-49c2-89ec-9869f92637fe req-73fa52d9-143f-4da0-9f92-6ef4dc51f472 service nova] Creating event network-changed:e2089e44-0270-4f41-a47a-1693edd7b379 for instance 4e438716-de97-482f-842e-ebdb75a24e6b on n-h2-854882-3 Aug 29 15:48:37.701314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fe222156-cefe-49c2-89ec-9869f92637fe req-73fa52d9-143f-4da0-9f92-6ef4dc51f472 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072818 Aug 29 15:48:37.707789 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2449/4691] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:38.029026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:38.029920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.047258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.050641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.052729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.056875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.057756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.059054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.548004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:38.548728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.574514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.575025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.575815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.576530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.576998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.588660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.651164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:38.665196 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f9f20690-7c4f-41c6-92f3-f0feff2d031b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1315 microversion: 2.1 time: 0.635175 Aug 29 15:48:38.665922 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2243/4692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:38 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:39.693350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:39.694055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:39.697327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:39.704421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:39.731563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.744173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.747934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.753741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.754644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.760370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.150463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.171485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.175699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.183538 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-89850d1d-95dc-4a1e-9edf-24b10d963762 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 1.643968 Aug 29 15:48:40.192399 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2450/4693] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:38 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:40.690114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.702274 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c34c94ed-4f48-4a9e-9117-6c57981db7e6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1315 microversion: 2.1 time: 1.015201 Aug 29 15:48:40.710385 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2244/4694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:39 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:41.217528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.218947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:41.225307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.237673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.239344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.240613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.241363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.241855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.245472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.305499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.734642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.735260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:41.799567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.810125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.812691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.821197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.823134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.825922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.633706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:42.645816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:42.651170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:42.656017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8a04bed-fa63-4761-9b8b-9475c18d7c2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 1.443497 Aug 29 15:48:42.658059 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2451/4695] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:42.814759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:42.825415 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-161170df-0f19-4422-85d0-e7e8cc7eae53 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1315 microversion: 2.1 time: 1.097016 Aug 29 15:48:42.832654 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2245/4696] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:43.683712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.684415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:43.700843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.701344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.701820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.702541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.716016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.716584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.862451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.863254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:43.891758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.892259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.892700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.893468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.916846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.919197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.763808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:44.773960 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2973a736-4376-494b-916d-59ab77219463 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1315 microversion: 2.1 time: 0.915452 Aug 29 15:48:44.781469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2246/4697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:45.798818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.799449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:45.810337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.816901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.818696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.819721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.823511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.825049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.931382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.940113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.941653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.942862 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f506f088-4122-4266-ba79-a64af78e0412 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 2.263144 Aug 29 15:48:45.961780 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2452/4698] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:46.594535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-417832d6-6d45-442a-bdd1-63fb53417a39 req-a169b4d6-5bde-48b0-abba-9c88dadc85f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e438716-de97-482f-842e-ebdb75a24e6b", "name": "network-vif-plugged", "status": "completed", "tag": "e2089e44-0270-4f41-a47a-1693edd7b379"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:46.612200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-417832d6-6d45-442a-bdd1-63fb53417a39 req-a169b4d6-5bde-48b0-abba-9c88dadc85f2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.615893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-417832d6-6d45-442a-bdd1-63fb53417a39 req-a169b4d6-5bde-48b0-abba-9c88dadc85f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.616523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-417832d6-6d45-442a-bdd1-63fb53417a39 req-a169b4d6-5bde-48b0-abba-9c88dadc85f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.644926 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-417832d6-6d45-442a-bdd1-63fb53417a39 req-a169b4d6-5bde-48b0-abba-9c88dadc85f2 service nova] Creating event network-vif-plugged:e2089e44-0270-4f41-a47a-1693edd7b379 for instance 4e438716-de97-482f-842e-ebdb75a24e6b on n-h2-854882-3 Aug 29 15:48:46.653830 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-417832d6-6d45-442a-bdd1-63fb53417a39 req-a169b4d6-5bde-48b0-abba-9c88dadc85f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063666 Aug 29 15:48:46.655328 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2453/4699] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:46.883118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:46.884111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:46.904695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=50 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:46.910645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.913589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.915175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.917489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.918737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.922005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.020685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-809407b1-eeb4-401f-ab9a-4bf8293789b9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/ips" status: 200 len: 148 microversion: 2.1 time: 0.151819 Aug 29 15:48:47.022998 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2454/4700] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:48:46 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/ips => generated 148 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:47.053927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:47.059051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:47.078810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.084462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.087168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.092458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.094118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.094832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.124161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:47.145923 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8014c716-ab83-4c23-8809-d6e860f5f79a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1315 microversion: 2.1 time: 1.345634 Aug 29 15:48:47.148498 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2247/4701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:45 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1315 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:48.161453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.170658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:48.171289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:48.172526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.186393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.187164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:48.187651 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a37f7c0-2c5a-4a2e-a275-955a8b663511 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 1.162966 Aug 29 15:48:48.188680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.189173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.189641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.199575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.200226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.200681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.211801 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2455/4702] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:47 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:48.851437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.866064 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83649da0-30b9-4edf-9b69-5cc55efa7846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1502 microversion: 2.1 time: 0.695240 Aug 29 15:48:48.868480 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2248/4703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:48 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1502 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:48.887540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:48.890832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:48.898319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.899090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.899759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.900732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.901451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.902501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.956968 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-853b8111-2ff3-473a-9b14-ddea99c269ab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.070988 Aug 29 15:48:48.964923 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2456/4704] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:48 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:49.221422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.222141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.247786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.248297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.248746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.253898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.255150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.255624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.973409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:49.976980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.991638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.998254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.999261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.000798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.002178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.002963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.119990 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3a241ec5-0099-43f4-9c73-c196a2ff3733 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.152069 Aug 29 15:48:50.121599 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2457/4705] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:49 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:51.132560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:51.135922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:51.161727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.162650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.164554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.165562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.167306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.168437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.187215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.226109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.253831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.260181 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e128680b-cf26-473f-b02f-83b9084a5f0f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 2.043460 Aug 29 15:48:51.273133 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2249/4706] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:51.295618 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d08e16c-5480-427d-98b2-7adc2da21e2c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.160502 Aug 29 15:48:51.299905 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2458/4707] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:51 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:51.300129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7effa944-6ff9-4d83-8c91-d4fdaff971cc"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:51.308371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:51.325821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.330190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.330989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.331971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.335244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.337886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.000721 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-02912d90-bd7a-4509-938c-7c986b575b45 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723489 Aug 29 15:48:52.022560 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2250/4708] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:48:51 2022] POST /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:52.305272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:52.306123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:52.322944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:52.332703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:52.337189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.338049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.341489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.342496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.344719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.346326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.354484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.355262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.356100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.357010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.357882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.358492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.462485 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-225e1381-a4e7-43a3-8b14-b0c587910305 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.154165 Aug 29 15:48:52.480976 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2251/4709] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:52 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:53.489546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:53.492089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:53.530680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.531188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.531638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.548645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.549259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.549748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.686194 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0e22ff43-003f-43ce-acf7-847d36cb3cb7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.201087 Aug 29 15:48:53.686867 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2252/4710] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:53 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:53.746944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:53.766911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:53.778431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:53.783011 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a4dc0fa-72d4-4b54-98c9-5bc1412c3504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 1.482696 Aug 29 15:48:53.786162 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2459/4711] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:52 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:54.702751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:54.713920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:54.742012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.743365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.750560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.753840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.755015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.756042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.816456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:54.818446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:54.885037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.898485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.903792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.907018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.916214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.921902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.024032 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-364430d1-aa2b-4b74-b501-c66bb28579d2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.328685 Aug 29 15:48:55.026149 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2253/4712] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:54 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:56.038139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:56.042528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:56.079021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.082690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.086009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.090559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.091299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.096155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.325862 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a18936a1-124d-44d5-82de-250466d774f7 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.284681 Aug 29 15:48:56.334262 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2254/4713] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:56 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:56.919833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.946975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.951422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.957585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a11df489-a73d-4bf6-a567-8f90e0ed38da tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 2.148105 Aug 29 15:48:56.967374 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2460/4714] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:54 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:57.346527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:57.349019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:57.420479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.421062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.421825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.439149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.440206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.442777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.604838 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7f2c3327-c179-468f-893a-07b25b03d02c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.271089 Aug 29 15:48:57.610802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2255/4715] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:57 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:57.988969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.991166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:58.030464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.030980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.031429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.032157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.032622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.033051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.620086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:58.623876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:58.660731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.661603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.662218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.663953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.664674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.665884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.711914 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3b04a320-2e8f-4224-9fd4-1dee0c8ee91f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.095537 Aug 29 15:48:58.713060 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2256/4716] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:58 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:58.799458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.823132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.830499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.832287 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b31b28b3-a982-426b-bc81-06e4aef7e027 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 0.847864 Aug 29 15:48:58.837537 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2461/4717] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:57 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:59.725725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:59.730054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.764859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.766347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.767107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.771976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.773290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.779275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.862542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.863961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.889090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.893604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.897044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.904366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.907438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.915193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.942027 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8527170-cc3e-4a84-b97d-3d4ff38dc118 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 14 microversion: 2.1 time: 0.203690 Aug 29 15:48:59.950274 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2257/4718] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:59 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:49:00.375092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.392995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.400480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.405150 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa1af2b5-905d-4ed3-bb68-cd08e05f7504 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1738 microversion: 2.20 time: 0.547814 Aug 29 15:49:00.412971 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2462/4719] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1738 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:00.963561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:00.966874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:00.979011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.979502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.985883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.986682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.987163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.987602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.145994 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4d6146a0-bfa0-445c-b75d-a994dfae930b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action" status: 200 len: 8207 microversion: 2.1 time: 0.186546 Aug 29 15:49:01.146835 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2258/4720] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:00 2022] POST /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b/action => generated 8207 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:01.158698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.159221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.170499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.171659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.179720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.180716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.181319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.181820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.440248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.442258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.457538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.458419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.463722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.464942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.465639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.466416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.533578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.540601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:01.559860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-33f8010c-9748-4593-9239-3c6482cd613b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.406999 Aug 29 15:49:01.570682 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2463/4721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:01.604267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.614368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.639072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.639542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.640008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.648508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.649780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.650347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.996433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.011248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.016458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.024856 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4522242d-5fc6-4ca5-b32e-3da07260fdb2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1720 microversion: 2.20 time: 0.590168 Aug 29 15:49:02.025656 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2259/4722] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1720 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:02.142754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.156766 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2810bef1-1110-4932-8978-ba15d71354e9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.554085 Aug 29 15:49:02.165977 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2464/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.190754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.192151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.206204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.206868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.207575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.210846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.211613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.214539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.591365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.614828 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b428b002-c97a-465d-b5df-40ced282bd42 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.426396 Aug 29 15:49:02.616411 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2260/4724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.643980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.645500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.660843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.662102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.664708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.706539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.719651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.051s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.724968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.048943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.049682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.058157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.063894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.069716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.070666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.072244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.072776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.276491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.285771 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-160107d6-cb79-48c0-877a-29d97fa93328 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.648104 Aug 29 15:49:04.294206 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2465/4725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:04.311159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:04.319410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.330690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.344196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.347816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.356561 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-05009540-3c7c-43b7-9c0a-afd4b176be9a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1720 microversion: 2.20 time: 1.310703 Aug 29 15:49:04.360859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.361788 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2261/4726] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1720 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:04.362774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.364569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.367366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.368019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.368622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.501204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Locking {{(pid=130002) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 29 15:49:04.647275 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d87408a-0515-4bc0-877e-914c5aebf91d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.338647 Aug 29 15:49:04.649812 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2466/4727] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:04 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:49:04.656966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.658420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.713135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.722292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.723189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.724915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.734085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.735130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.385792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.386415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.409431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.410482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.411150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.417404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.417979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.418687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.447343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:05.545802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.560954 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-60de4408-b3e5-43c5-bebb-a432dc0f6ac9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.906494 Aug 29 15:49:05.563455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2262/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.598144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:05.622461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.623298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.624096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.691395 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] HTTP exception thrown: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 is locked Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Request method failure captured: Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action HTTP/1.1 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 15 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7gilGWWc6o29gKBNjrobKSdTqLhwFnqSflY2odYo3gGp2Rp54Ukd9KFrzitSKe6QyCWj61U6LPD25i9myJ_STWgTJ2iHrMBfr9pIJzAYvRNmf9W6BST2s-1orSzQrWLqf5-BO88k_4cYDzPD7GzMtvHxV9eEou14q-4QeDxUPNR9A Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c147d42182146409a91f2e0359f2e98", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}] Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a68002795ce541338b30129e6dbb0fb6 Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: {"os-stop": {}} Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 is locked Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5341307c-698b-4787-bc09-6b5d2c2a1824', 'body': {'os-stop': {}}} Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 is locked Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 is locked Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 is locked Aug 29 15:49:05.695964 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.708890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Returning 409 to user: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 is locked {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:05.711364 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5a14298b-28f8-441c-ae12-fc2fad990f85 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 409 len: 107 microversion: 2.1 time: 0.122457 Aug 29 15:49:05.713473 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2263/4729] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:05 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 107 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:49:05.727344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:05.728203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.764008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.766068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.769820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.776489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.779364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.781469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.892994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Unlocking {{(pid=130001) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 15:49:06.061156 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-94027152-c9d5-4696-bea8-fd0c064002f9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.343914 Aug 29 15:49:06.065886 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2264/4730] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:05 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:06.088948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dbedc0dd-dc06-4252-bad1-a545cc4981c0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:06.113003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbedc0dd-dc06-4252-bad1-a545cc4981c0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.114052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbedc0dd-dc06-4252-bad1-a545cc4981c0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.115001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dbedc0dd-dc06-4252-bad1-a545cc4981c0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.178327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dbedc0dd-dc06-4252-bad1-a545cc4981c0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Going to try to stop instance {{(pid=130001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:49:06.285655 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dbedc0dd-dc06-4252-bad1-a545cc4981c0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.209565 Aug 29 15:49:06.287531 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2265/4731] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:06 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:06.301267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.302015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.319126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.319642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.321235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.322026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.322502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.325204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.445711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.459131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.464002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.467210 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fed85a44-c2dd-4be5-be96-59cefa8100af tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1720 microversion: 2.20 time: 1.085940 Aug 29 15:49:06.471542 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2467/4732] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1720 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:07.415849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f3a60fa4-88a7-47a8-92dd-921d478959ea req-f476458d-de86-4b59-9b8d-cef8e92b096c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "name": "network-vif-unplugged", "status": "completed", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:07.476309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f3a60fa4-88a7-47a8-92dd-921d478959ea req-f476458d-de86-4b59-9b8d-cef8e92b096c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.478463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f3a60fa4-88a7-47a8-92dd-921d478959ea req-f476458d-de86-4b59-9b8d-cef8e92b096c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.481763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f3a60fa4-88a7-47a8-92dd-921d478959ea req-f476458d-de86-4b59-9b8d-cef8e92b096c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.516806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.server_external_events [req-f3a60fa4-88a7-47a8-92dd-921d478959ea req-f476458d-de86-4b59-9b8d-cef8e92b096c service nova] Unable to find a host for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055. Dropping event network-vif-unplugged {{(pid=130002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:49:07.518432 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f3a60fa4-88a7-47a8-92dd-921d478959ea req-f476458d-de86-4b59-9b8d-cef8e92b096c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.111397 Aug 29 15:49:07.520003 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2468/4733] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 114 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:49:07.529209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.530779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:07.543857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.546253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.547353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.549206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.550434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.551577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.965730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:07.998098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9614c059-5941-4f15-ae91-709fdfd7effe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 1.702301 Aug 29 15:49:08.030249 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2266/4734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:08.712476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.728967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.731227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.732583 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16d903b8-54ce-4f58-bea0-7fbf4f5ee4c8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1663 microversion: 2.20 time: 1.210920 Aug 29 15:49:08.733184 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2469/4735] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:07 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1663 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:08.757174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6a42dd4-7041-46e2-9232-a244834a2982"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:08.760623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.783518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.784333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.785047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.786886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.788103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.791317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.036782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.038739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.070657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.075777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.078227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.079307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.084167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.085223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.358131 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcbd32d5-5492-408d-b1e5-694da9eb8356 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.605570 Aug 29 15:49:09.364993 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2267/4736] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Aug 29 15:49:08 2022] POST /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 188 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:49:09.736811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:09.736966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.754105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.755262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.758721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.760561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.761610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.765357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.829831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130001) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 15:49:09.994211 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-86b73d98-90bc-4563-ac0d-7fce593338d9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/action" status: 202 len: 0 microversion: 2.20 time: 0.262684 Aug 29 15:49:09.994761 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2268/4737] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:49:09 2022] POST /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:49:10.010866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.011950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.022828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.024300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.025180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.026519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.027478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.029740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.067135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=7,nova_cell1:UPDATE=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:10.446636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.459115 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4bf990f9-592c-4c72-baf8-0eae618507eb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 1.427263 Aug 29 15:49:10.469847 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2470/4738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:10.557738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.611137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.612870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.618107 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5475d58-3bf2-4de6-afab-82bf1c08759b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1749 microversion: 2.20 time: 0.613962 Aug 29 15:49:10.622469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2269/4739] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1749 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:11.487040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.488811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.648854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.651061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.694366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.706268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.708161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.719711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.720332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.720785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.025089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.025805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.026498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.027391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.028015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.028667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.163803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.179566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.181925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.183750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c8f60df3-f14e-40bb-b135-931b23a7182c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1749 microversion: 2.20 time: 0.539425 Aug 29 15:49:12.185285 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2270/4740] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1749 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:13.091672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.140350 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d4b2c5b-beec-4930-8fe6-8932250644d9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 1.658288 Aug 29 15:49:13.146575 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2471/4741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:13.216610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.217623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.256187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.257004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.265562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.266655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.267612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.268246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.410757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7effa944-6ff9-4d83-8c91-d4fdaff971cc"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:13.416739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.447225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.447996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.448688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.467363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.468521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.471777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.754546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Invalid volume: volume 7effa944-6ff9-4d83-8c91-d4fdaff971cc is already attached to instances: 3881fe52-0c97-4880-b6f7-43ec6e463e69 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments HTTP/1.1 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 74 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: {"volumeAttachment": {"volumeId": "7effa944-6ff9-4d83-8c91-d4fdaff971cc"}} Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid volume: volume 7effa944-6ff9-4d83-8c91-d4fdaff971cc is already attached to instances: 3881fe52-0c97-4880-b6f7-43ec6e463e69 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': '3881fe52-0c97-4880-b6f7-43ec6e463e69', 'body': {'volumeAttachment': {'volumeId': '7effa944-6ff9-4d83-8c91-d4fdaff971cc'}}} Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7effa944-6ff9-4d83-8c91-d4fdaff971cc is already attached to instances: 3881fe52-0c97-4880-b6f7-43ec6e463e69 Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:13.757287 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7effa944-6ff9-4d83-8c91-d4fdaff971cc is already attached to instances: 3881fe52-0c97-4880-b6f7-43ec6e463e69 Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7effa944-6ff9-4d83-8c91-d4fdaff971cc is already attached to instances: 3881fe52-0c97-4880-b6f7-43ec6e463e69 Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.761441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 400 to user: Invalid volume: volume 7effa944-6ff9-4d83-8c91-d4fdaff971cc is already attached to instances: 3881fe52-0c97-4880-b6f7-43ec6e463e69 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:13.762572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1d9d5446-8f7b-4e20-ae63-a7bdba562bf3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.368530 Aug 29 15:49:13.767410 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2472/4742] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:49:13 2022] POST /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 174 bytes in 377 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:13.908074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.908795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.920018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.931468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.932202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.935055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.935733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.937978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.083285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.092817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.106354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.108245 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-15b70074-b539-4b2e-8d32-2f5ceafd058c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1749 microversion: 2.20 time: 0.898247 Aug 29 15:49:14.109824 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2271/4743] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1749 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:14.173113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.173774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.191041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lazy-loading 'services' on Instance uuid 3881fe52-0c97-4880-b6f7-43ec6e463e69 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:14.205770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.206850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.211969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.214651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.215144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.215584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.332434 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5d97dad2-5b95-4b5e-bba1-36453c1afd83 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments/7effa944-6ff9-4d83-8c91-d4fdaff971cc" status: 202 len: 0 microversion: 2.1 time: 0.426623 Aug 29 15:49:14.336830 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2473/4744] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:49:13 2022] DELETE /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments/7effa944-6ff9-4d83-8c91-d4fdaff971cc => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:14.348948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.361316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.371160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.379437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.383140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.384947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.386200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.387896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.524279 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b6eb290a-ecdb-4f56-b810-9d6f57f5a6b5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185812 Aug 29 15:49:14.526278 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2474/4745] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:14.638296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.657928 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-962f3ee5-8d32-41fc-9634-4f1bd2e056f8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 0.491424 Aug 29 15:49:14.677206 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2272/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:15.136438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.137075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.153814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.154240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.157515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.160759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.170582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.173917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.538900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.541773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.559485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.560307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.561554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.563369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.566416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.567144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.595001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.615997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.623170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.624624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-edffad36-454c-408c-970d-7ec12af8c366 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.492305 Aug 29 15:49:15.629104 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2475/4747] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:15.660173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-06d5f5ec-b29a-4be6-bd63-5fccda24206f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123602 Aug 29 15:49:15.665813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2273/4748] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:15.688769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.690134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.700945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.701828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.702629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.703677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.704529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.706097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.968732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.980781 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6fab6bb-a4b1-42ae-b8dc-59b7ad84c4a2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 0.300424 Aug 29 15:49:15.995449 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2476/4749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.660741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.662187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.680631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.682633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.707094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.707598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.708045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.716586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.716861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.719718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.720220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.720665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.723617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.724483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.729851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.730733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.841528 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1471fcc8-0b12-4941-8484-5af923c213bd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173008 Aug 29 15:49:16.859806 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2477/4750] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:16.977371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.991250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.994927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:17.005853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.006944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.011020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=48 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:17.011851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9498bbaa-2f2a-43cd-8a2b-b34cab082b5f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.342553 Aug 29 15:49:17.014932 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2274/4751] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:17.026199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.026712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.027276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.030062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.031787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.033685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.740289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:17.752403 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd430354-fffa-4ad5-b035-3bfa3a00e5dc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1656 microversion: 2.1 time: 0.751572 Aug 29 15:49:17.753905 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2478/4752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1656 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:17.776278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-603120e5-12be-4084-b57c-747a1d1a4ace tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:17.791769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603120e5-12be-4084-b57c-747a1d1a4ace tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.793941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603120e5-12be-4084-b57c-747a1d1a4ace tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.795948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603120e5-12be-4084-b57c-747a1d1a4ace tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.858035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.860651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.873274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-603120e5-12be-4084-b57c-747a1d1a4ace tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Going to try to start instance {{(pid=130001) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:49:17.885827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.886541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.886998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.896934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.897639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.898098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.947131 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9cf6916c-8b28-42f4-98ec-3b499fbc5fad tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095826 Aug 29 15:49:17.948297 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2479/4753] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:17.988105 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-603120e5-12be-4084-b57c-747a1d1a4ace tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.209399 Aug 29 15:49:17.992927 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2275/4754] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:17 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:49:18.001351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.002346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.017352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.017883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.023410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.025938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.026445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.030114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.038152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.039138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.062532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.067059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.067979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.074146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.077529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.080792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.449862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.465877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.467883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.471690 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aaeb3915-96cf-4709-98f2-ef1d9ba8888a tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.436725 Aug 29 15:49:18.488553 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2276/4755] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:18.895415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.910425 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91a1a9bf-2173-49e2-b4b9-96f847eed6d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1665 microversion: 2.1 time: 0.911629 Aug 29 15:49:18.919349 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2480/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1665 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:18.968021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.970276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.989800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:19.003848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.005925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.006554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.014397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.015118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.015736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.128975 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eab7380a-5870-4bcf-a2c6-ba367bda3463 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173150 Aug 29 15:49:19.140096 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2277/4757] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:19.496249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.496874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.505019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.509122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.509662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.510617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.514461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.515196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.934331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.934954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.942029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.942528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.942973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.943685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.958259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.958714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.154007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.181810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.189763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.194999 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70e16583-26b6-4367-9535-ece50dd34813 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.702670 Aug 29 15:49:20.202369 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2481/4758] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:20.222325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:20.224835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:20.236533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.237037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.254000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.256659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.259304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.260938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.342289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-431ed352-bb56-478b-a139-dcbe75a07de5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138489 Aug 29 15:49:20.350140 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2482/4759] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:20 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:20.625655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.637931 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14a71a11-d6d4-4fa7-8f15-fa145f9bc11e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1665 microversion: 2.1 time: 0.709273 Aug 29 15:49:20.638911 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2278/4760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1665 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:21.226326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.227813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.239059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.239899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.240496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.242451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.243201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.244280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.374974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.379449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.393082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.394030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.394667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.395671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.396347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.396951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.517410 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-52e0b596-e561-4d65-a45a-c014c1e4f671 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159252 Aug 29 15:49:21.521840 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2279/4761] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:21.658171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.660545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.661893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.668013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:21.671170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.673663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.674119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.674882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.675355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.675802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.681599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.687033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.688680 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-210f21f5-f0d8-45f1-a6cb-27f7625d07b0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.467796 Aug 29 15:49:21.694028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2483/4762] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:22.172805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.186585 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58875e70-ba7b-425e-897d-7956cace774c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.530813 Aug 29 15:49:22.204446 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2280/4763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:22.212397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-173106532", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "09440237-9a78-4b39-a32a-8b46d87cdcb3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:22.214667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:22.218088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:22.232948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.234381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.236173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.236951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.239812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.240315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.325769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] validate_networks() for [('09440237-9a78-4b39-a32a-8b46d87cdcb3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:22.655908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.670048 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1fab46ca-54eb-4989-b6da-3ade46e5995c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.458011 Aug 29 15:49:22.671705 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2281/4764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:22 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:22.684861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:22.691865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:22.706823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.713132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.713938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.714848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.715488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.716704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.792386 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a7a0ec93-01b2-4003-9f30-f8947f8efde7 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118376 Aug 29 15:49:22.794532 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2282/4765] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:22 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:22.804064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:22.809623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:22.831814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.832507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.833131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.834208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.834826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.835409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.936075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Unlocking {{(pid=130001) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 15:49:22.978662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:23.044575 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a4e8050d-01ed-4e24-9d86-d8b20448c18b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.244651 Aug 29 15:49:23.045462 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2283/4766] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:22 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:23.060602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.062159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.085097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.086070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.086722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.087660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.088389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.089040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.634638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:23.635146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:23.635548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:23.635967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:23.636459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:23.656234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.659860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.661974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.666430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.674713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.677376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.769872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.785553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Getting quotas for project f9e9c8c3ae7e473083ac7aaf1758a8a6. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:23.797312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.803509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.804862 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7506e514-9d73-4eda-a331-83fff9119a37 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.758127 Aug 29 15:49:23.811718 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2284/4767] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:23.816835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Getting quotas for user e5bbef967a524d888007bb0fede478c9 and project f9e9c8c3ae7e473083ac7aaf1758a8a6. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:23.825362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.831581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.866489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.867334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.867934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.871720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.882280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.882280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.892632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:23.898088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:24.005748 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-27dc4212-a84a-4565-acf7-15e51d04eab9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.034193 Aug 29 15:49:24.008298 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2484/4768] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:49:24.024566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.027189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.070569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.074986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.076956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.079415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.080649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.082285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.169331 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c73fce3b-1ead-4830-8ba3-fb9bd64dfb9c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.159258 Aug 29 15:49:24.169967 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2485/4769] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:49:24.287912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.288448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.313638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.315070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.319472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.320318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.320813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.321264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.410643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:24.613080 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b85976a-39d3-4b68-a059-0e949bd14aed tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 204 len: 0 microversion: 2.1 time: 0.329961 Aug 29 15:49:24.616688 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2486/4770] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:24 2022] DELETE /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:49:24.636727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1320730442", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "09440237-9a78-4b39-a32a-8b46d87cdcb3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:24.731395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] validate_networks() for [('09440237-9a78-4b39-a32a-8b46d87cdcb3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:25.417750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.443499 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-430552a4-582d-4a02-a392-f8bff992d47e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.630193 Aug 29 15:49:25.445470 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2285/4771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:25.481011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:25.484236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:25.513497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.516939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.519022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.520259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.522109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.524945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.150715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.184131 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-108d6343-e98b-4815-95df-5459f61c5ab3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1680 microversion: 2.1 time: 0.708747 Aug 29 15:49:26.186117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2286/4772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1680 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:26.191777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.215346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.251100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.252213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.257324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.261299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.262638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.265517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.688232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:26.690413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:26.691213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:26.691858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:26.692431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:26.735763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.736462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.738463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.739574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.741287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.742564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.825530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Getting quotas for project f9e9c8c3ae7e473083ac7aaf1758a8a6. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:26.845616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Getting quotas for user e5bbef967a524d888007bb0fede478c9 and project f9e9c8c3ae7e473083ac7aaf1758a8a6. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:26.950483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:26.974709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:27.138296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa536fb6-6e5b-4045-a226-f18a217c4d7d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514930 Aug 29 15:49:27.141159 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2487/4773] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:27.145098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.151978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.153219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.171838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.173738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.175238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.176706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.177506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.178250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.212181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.228756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.234352 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e516d8e2-7099-462f-84f0-ebea387455b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 1.046397 Aug 29 15:49:27.235166 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2287/4774] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:26 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:27.258820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.259698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.272107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.273887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.274553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.275850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.276726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.282114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.996013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.009678 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-415e97dc-87f8-48a6-a72c-168e844cee4a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1680 microversion: 2.1 time: 0.758154 Aug 29 15:49:28.017777 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2288/4775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1680 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:28.032803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1159629781", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "451", "networks": [{"uuid": "09440237-9a78-4b39-a32a-8b46d87cdcb3"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:28.243571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] validate_networks() for [('09440237-9a78-4b39-a32a-8b46d87cdcb3', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:28.670733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.687824 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1c13ab9b-bb08-4988-8704-a50d9c2fbd6b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.545262 Aug 29 15:49:28.688429 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2488/4776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:28.740862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.741529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.764578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.765347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.767255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.768565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.769562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.770736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.679269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.701118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.705297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.712161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:29.713529 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ced06ebe-8904-4666-ab2c-748cc1289d2e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.985735 Aug 29 15:49:29.713876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:29.714602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:29.714728 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2489/4777] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:29.716068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:29.716765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:29.725433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:29.727578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.744623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.747130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.748717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.753508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.754446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.757854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.762133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.763778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.767143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.767143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.778039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.784405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.898694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Getting quotas for project f9e9c8c3ae7e473083ac7aaf1758a8a6. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:29.926071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Getting quotas for user e5bbef967a524d888007bb0fede478c9 and project f9e9c8c3ae7e473083ac7aaf1758a8a6. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:29.982285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:29.984809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:30.097985 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb6ca13f-54c2-4b94-b8cb-17f36d69ba1c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.077019 Aug 29 15:49:30.100020 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2289/4778] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:30.109313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.110761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.120771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.121643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.122366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.123531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.125642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.126410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.339361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.348303 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42287e51-9d87-466e-8e6a-9453d5d21510 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1612 microversion: 2.1 time: 0.246981 Aug 29 15:49:30.357635 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2290/4779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1612 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:30.368025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6ae7c209-6296-4418-a082-a8cd8b4297ba tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.377145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6ae7c209-6296-4418-a082-a8cd8b4297ba tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.493854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6ae7c209-6296-4418-a082-a8cd8b4297ba tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.508062 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6ae7c209-6296-4418-a082-a8cd8b4297ba tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1221 microversion: 2.1 time: 0.148960 Aug 29 15:49:30.508661 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2291/4780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:30.743312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.744123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.755897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.757164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.758350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.762193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.762868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.763431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.902699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.922420 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2157ecd-0e66-428e-b262-db836e732281 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.205702 Aug 29 15:49:30.926828 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2490/4781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:29 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:30.950127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:30.960545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.986316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.988016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.988857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.993799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.996060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.998125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.154129 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b2b37921-a3fe-40d1-8adf-3ba18586505e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.207289 Aug 29 15:49:31.157748 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2491/4782] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:30 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:31.163065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.163781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.194018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.194633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.195084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.195808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.196268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.196696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.265177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.283284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.284793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.286060 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-23d7eb0b-6934-4ce8-b54c-17db7f784ec1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.547011 Aug 29 15:49:31.286630 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2292/4783] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:31.382187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.383083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.394981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.396847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.399286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.400242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.400861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.406175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.526540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.539877 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-116f7e71-ef55-466a-b013-d8110a93820a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1612 microversion: 2.1 time: 0.162336 Aug 29 15:49:31.547080 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2293/4784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1612 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:31.568737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.569925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.584181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.585003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.585687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.586639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.587318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.587964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.008985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.026779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.044332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29fd33eb-6c0c-4aa5-9c24-4a1190e71847 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1217 microversion: 2.1 time: 0.492537 Aug 29 15:49:32.046429 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2294/4785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1217 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:32.054490 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6236a688-844a-45cc-8c51-762e1956cefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1674 microversion: 2.1 time: 0.891296 Aug 29 15:49:32.074012 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2492/4786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1674 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:32.082199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9b688a0c-709b-4b4e-a63a-b6e67984163c req-10b3511d-5925-4411-91e2-246a2c438a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3881fe52-0c97-4880-b6f7-43ec6e463e69", "name": "network-vif-deleted", "tag": "f8927456-a7bb-49f9-8c8a-63804f0e54b1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:32.097180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9b688a0c-709b-4b4e-a63a-b6e67984163c req-10b3511d-5925-4411-91e2-246a2c438a57 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.097687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9b688a0c-709b-4b4e-a63a-b6e67984163c req-10b3511d-5925-4411-91e2-246a2c438a57 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.098439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9b688a0c-709b-4b4e-a63a-b6e67984163c req-10b3511d-5925-4411-91e2-246a2c438a57 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.116653 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9b688a0c-709b-4b4e-a63a-b6e67984163c req-10b3511d-5925-4411-91e2-246a2c438a57 service nova] Creating event network-vif-deleted:f8927456-a7bb-49f9-8c8a-63804f0e54b1 for instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 on n-h1-854882-3 Aug 29 15:49:32.127062 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9b688a0c-709b-4b4e-a63a-b6e67984163c req-10b3511d-5925-4411-91e2-246a2c438a57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075323 Aug 29 15:49:32.128482 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2295/4787] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:32.318028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.318676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.350167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.350610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.351079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.356493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.357071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.364735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.571723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.572758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.590474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.592468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.594526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.597870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.599791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.603888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.708675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.711318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.712092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.714152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lazy-loading 'fault' on Instance uuid 3881fe52-0c97-4880-b6f7-43ec6e463e69 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:33.059152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.071864 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3538b8b2-d931-4b48-b35a-72d25dfc2f41 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 200 len: 1331 microversion: 2.1 time: 0.505892 Aug 29 15:49:33.090469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2296/4788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 1331 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:33.096358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0133a8c5-1ae4-417f-a484-bed1ec5aa0b3 req-3ba382ab-cb4e-4cc0-85d2-6f0a9b94637e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2130dd-0352-4b9e-a769-89e9d5903801", "tag": "fcbf047f-37ab-4718-baa2-344632bfd06b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:33.139848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0133a8c5-1ae4-417f-a484-bed1ec5aa0b3 req-3ba382ab-cb4e-4cc0-85d2-6f0a9b94637e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.142439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0133a8c5-1ae4-417f-a484-bed1ec5aa0b3 req-3ba382ab-cb4e-4cc0-85d2-6f0a9b94637e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.147381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0133a8c5-1ae4-417f-a484-bed1ec5aa0b3 req-3ba382ab-cb4e-4cc0-85d2-6f0a9b94637e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.210619 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0133a8c5-1ae4-417f-a484-bed1ec5aa0b3 req-3ba382ab-cb4e-4cc0-85d2-6f0a9b94637e service nova] Creating event network-changed:fcbf047f-37ab-4718-baa2-344632bfd06b for instance de2130dd-0352-4b9e-a769-89e9d5903801 on n-h1-854882-3 Aug 29 15:49:33.226130 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0133a8c5-1ae4-417f-a484-bed1ec5aa0b3 req-3ba382ab-cb4e-4cc0-85d2-6f0a9b94637e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133658 Aug 29 15:49:33.233173 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2297/4789] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:33.251653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.252454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.261078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.266132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.266845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.267781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.268967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.269752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.304696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.315191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.321194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.326847 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-98a0b709-8484-48e0-854d-2cdc13e6c9f9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 1.014735 Aug 29 15:49:33.329672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2493/4790] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:33.431528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.445609 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-84514219-d797-412b-a73f-8cbb4cdde219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1279 microversion: 2.1 time: 0.206575 Aug 29 15:49:33.453892 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2298/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:33.826290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.826928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.838009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.838425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.838868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.839592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.840051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.840490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.095228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.098092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.112766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.112766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.113080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.121007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.121774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.122389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.148942 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 HTTP/1.1 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3881fe52-0c97-4880-b6f7-43ec6e463e69'} Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:34.151462 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.155959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.155959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:34.155959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:34.155959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:34.155959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:34.155959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:49:34.155959 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.158912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:34.161099 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25f2d540-02a3-4c4b-ab59-8c2dd948bbc5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 404 len: 111 microversion: 2.1 time: 0.070019 Aug 29 15:49:34.166051 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2299/4792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:34.172852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0d05b894-1be7-4602-9109-01d4683dc526 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '.version_select at 0x7fb0e28f80d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.199829 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0d05b894-1be7-4602-9109-01d4683dc526 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100564261" status: 202 len: 0 microversion: 2.1 time: 0.032015 Aug 29 15:49:34.205691 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2300/4793] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100564261 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:34.354478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.355205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.363895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.368683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.369239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.370076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.372158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.372684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.759335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.775585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.778845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.782707 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a14a0f8e-0ad3-46ab-98a1-8945e4ea9552 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1751 microversion: 2.20 time: 0.431017 Aug 29 15:49:34.786041 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2301/4794] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1751 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:34.798311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.802058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.820948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.823088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.823725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.826831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.827321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.831520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.886615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.900681 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c843e5b6-12d3-4179-b3e3-c8c6fbb3eefa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1654 microversion: 2.1 time: 1.569766 Aug 29 15:49:34.903215 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2494/4795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1654 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:34.938633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:34.939327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.958844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.960251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.962375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.965695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.967529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.969768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.093000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:35.102560 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f940d90-16bd-4ad4-b1b0-d6b2671d07d0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1279 microversion: 2.1 time: 0.314955 Aug 29 15:49:35.116797 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2302/4796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:35.145549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f735f928-f4ee-4f8f-8c53-5ad57b32732a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.222329 Aug 29 15:49:35.149468 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2495/4797] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:34 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:35.159176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.159816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.176333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.176890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.177342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.178732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.179203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.179643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.235460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:35.814102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.814307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.832803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.833313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.854165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.861406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.866258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.868235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.050177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.066262 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5915ef61-fb08-423b-b587-98d6f719d65c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1661 microversion: 2.1 time: 0.915305 Aug 29 15:49:36.068160 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2303/4798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1661 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:36.123295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:36.124705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:36.131508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.138853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.139638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.140595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.141275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.141946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.295324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.315046 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53d3e093-aec1-4956-80c8-d7952057e96d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1279 microversion: 2.1 time: 0.195585 Aug 29 15:49:36.322104 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2304/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:36 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:36.396165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.407469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.409160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.410656 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a536729d-27fe-4601-8d6b-f7742e7f3c99 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.602758 Aug 29 15:49:36.411625 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2496/4800] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:37.094134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.095175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.102055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.102820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.103609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.104992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.105692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.106329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.219442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6dcae7a8-0932-43b7-8b4e-867f48a78a66 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: .version_select at 0x7fb0e28138b0>, body: {"keypair": {"name": "tempest-keypair-1630722741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIAyR2O1ILfYR7BXH/mKBa6niQZqc6ahNECnrJkrvTyoDBNvYz7OUj1MArGflJ5GgXC2PEfdsUijinw6rYY3PzATyyj90T2JcozkXzBNHrwMvjPPvG7xMkmtjMKicNglg=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:37.235162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:37.238588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:37.264978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6dcae7a8-0932-43b7-8b4e-867f48a78a66 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:37.286135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6dcae7a8-0932-43b7-8b4e-867f48a78a66 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:37.340474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6dcae7a8-0932-43b7-8b4e-867f48a78a66 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125531 Aug 29 15:49:37.347555 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2497/4801] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:37.349737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.350533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.369467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.370303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.370976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.372100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.372808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.373495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.810169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.830374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9dd26fae-84e2-4b13-93f1-ba0b70d3b96b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.740072 Aug 29 15:49:37.832553 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2305/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:37.840426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.841617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.853782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.855003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.856346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.857544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.858259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.858908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.160095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.172337 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2985605a-54ba-430c-8c87-0c98c0b896da tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 0.829438 Aug 29 15:49:38.172935 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2498/4803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:38.195364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8375b13e-9c24-4474-b7cd-d5b388a92c55 req-99cc5991-8b21-48a6-b4f8-4aa26739e631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2130dd-0352-4b9e-a769-89e9d5903801", "name": "network-vif-plugged", "status": "completed", "tag": "fcbf047f-37ab-4718-baa2-344632bfd06b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:38.212126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8375b13e-9c24-4474-b7cd-d5b388a92c55 req-99cc5991-8b21-48a6-b4f8-4aa26739e631 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.216575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8375b13e-9c24-4474-b7cd-d5b388a92c55 req-99cc5991-8b21-48a6-b4f8-4aa26739e631 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.216575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8375b13e-9c24-4474-b7cd-d5b388a92c55 req-99cc5991-8b21-48a6-b4f8-4aa26739e631 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.218273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:38.240848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8375b13e-9c24-4474-b7cd-d5b388a92c55 req-99cc5991-8b21-48a6-b4f8-4aa26739e631 service nova] Creating event network-vif-plugged:fcbf047f-37ab-4718-baa2-344632bfd06b for instance de2130dd-0352-4b9e-a769-89e9d5903801 on n-h1-854882-3 Aug 29 15:49:38.247829 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8375b13e-9c24-4474-b7cd-d5b388a92c55 req-99cc5991-8b21-48a6-b4f8-4aa26739e631 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073434 Aug 29 15:49:38.253317 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2499/4804] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:38.255480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.259189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:38.260300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:38.270400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.270827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.271196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.271663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.272391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.273000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.273307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.273629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.275116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae23f0a0-a909-4ef6-8d63-0162a3f4cf4d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.440960 Aug 29 15:49:38.276529 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2306/4805] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:38.470028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-aaffb889-4461-4eb5-b6d7-17349f5b70c7 req-ec097fdd-bd49-465b-b00f-f29d6896bd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64693228-8082-4588-82ca-a70469474a30", "tag": "55ea46db-7f75-465c-abd3-cee189c022c3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:38.486166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aaffb889-4461-4eb5-b6d7-17349f5b70c7 req-ec097fdd-bd49-465b-b00f-f29d6896bd21 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.486554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aaffb889-4461-4eb5-b6d7-17349f5b70c7 req-ec097fdd-bd49-465b-b00f-f29d6896bd21 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.495508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aaffb889-4461-4eb5-b6d7-17349f5b70c7 req-ec097fdd-bd49-465b-b00f-f29d6896bd21 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.513716 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-aaffb889-4461-4eb5-b6d7-17349f5b70c7 req-ec097fdd-bd49-465b-b00f-f29d6896bd21 service nova] Creating event network-changed:55ea46db-7f75-465c-abd3-cee189c022c3 for instance 64693228-8082-4588-82ca-a70469474a30 on n-h2-854882-3 Aug 29 15:49:38.519056 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-aaffb889-4461-4eb5-b6d7-17349f5b70c7 req-ec097fdd-bd49-465b-b00f-f29d6896bd21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056244 Aug 29 15:49:38.519834 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2307/4806] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:38.981366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.996393 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92ad9f83-ccb0-41ca-9940-3fc71768e267 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.741230 Aug 29 15:49:38.997361 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2500/4807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:38 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:39.035154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.037713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.051612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.052360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.052966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.055509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.056299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.057054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.195823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.196512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.204480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.204986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.213848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.215874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.216567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.217208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.824501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:39.887184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:39.910248 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-255af92f-75df-4837-b80d-7066c61a20db tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 0.719093 Aug 29 15:49:39.916851 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2501/4808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:39 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:39.924983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.928110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.944009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.945932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.951382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.952609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.953724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.954343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.289489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.304689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.306241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.307509 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c77584f-6364-459a-b5eb-2d8b6dcc0e46 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.389398 Aug 29 15:49:40.308277 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2502/4809] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:39 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:40.501481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:40.568376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-bed8fa2a-0587-47ed-b0d8-d65045df579d req-10c34d91-3094-4355-96e6-20500b8c1297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9960b3-4b32-4c7b-9555-118f5b23b48e", "tag": "568819e3-b36a-4bea-bd58-e6fd6235b844"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:40.597105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bed8fa2a-0587-47ed-b0d8-d65045df579d req-10c34d91-3094-4355-96e6-20500b8c1297 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.597917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bed8fa2a-0587-47ed-b0d8-d65045df579d req-10c34d91-3094-4355-96e6-20500b8c1297 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.598542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bed8fa2a-0587-47ed-b0d8-d65045df579d req-10c34d91-3094-4355-96e6-20500b8c1297 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.627124 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bed8fa2a-0587-47ed-b0d8-d65045df579d req-10c34d91-3094-4355-96e6-20500b8c1297 service nova] Creating event network-changed:568819e3-b36a-4bea-bd58-e6fd6235b844 for instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e on n-h1-854882-3 Aug 29 15:49:40.641803 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-bed8fa2a-0587-47ed-b0d8-d65045df579d req-10c34d91-3094-4355-96e6-20500b8c1297 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086414 Aug 29 15:49:40.648317 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2503/4810] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:40.871903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.883129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-90cb5080-6adf-4243-bfa4-1b69f0107caf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.853890 Aug 29 15:49:40.884912 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2308/4811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:39 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:40.914816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:40.915819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:40.926030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.938279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.944647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:40.945532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:40.951396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.954966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.959695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.960762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.963885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.965370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.970652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.974273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.976325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.976919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.751132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:41.761829 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9a687f8f-64b3-47a5-a525-52bf6b255a8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 0.821488 Aug 29 15:49:41.762430 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2309/4812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:40 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:41.774413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:41.775032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:41.785352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.786050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.786668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.787522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.788126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.788991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.551793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.605133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.615479 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-89f264a9-e118-4867-b2ab-24e58b8aceca tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.705553 Aug 29 15:49:42.616317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.620407 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2504/4813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:40 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:42.645062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:42.645861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:42.650290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.656871 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a132675d-b451-4564-8e58-4f2a8855561d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.893313 Aug 29 15:49:42.661352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.661897 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2310/4814] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:41 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:42.663247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.666940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.668050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.668994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.669761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.784636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:42.785936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:42.806211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.818287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.819042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.819954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.820579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.821200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.382894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.392582 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58d98308-60cf-47dc-a9ed-440a4c34e219 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 0.612419 Aug 29 15:49:43.395659 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2311/4815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:42 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:43.692663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:43.693773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:43.704993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.708586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.709367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.710488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.712443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.713443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.316402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.329775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.335778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.338144 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d778c81-106d-4260-a465-011cf0abb105 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.650027 Aug 29 15:49:44.357809 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2312/4816] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:43 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:44.417378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.418238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.442619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.443961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.444426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.450056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.451773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.452310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.635628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.654585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f759d7e-60d4-4c35-aef5-2a64b9fb2bc0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 2.011456 Aug 29 15:49:44.659317 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2505/4817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:42 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:44.683702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.685029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.695334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:44.716535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.730217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.730711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.741532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.742677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.743158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.623788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:45.635969 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bfe61a34-fee6-470f-ad9a-f3d6c11050d9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 1.224579 Aug 29 15:49:45.639310 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2313/4818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:45.661272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:45.662857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:45.675784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.676531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.677144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.678222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.678839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.679494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.497050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.520828 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12cf3bcb-8b13-4edb-a9b9-848e7442e71e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.841887 Aug 29 15:49:46.524148 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2506/4819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:46.545480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0a2e5005-4f0e-4e0e-aa03-15ab2a15bab5 req-a007c61c-6d43-4b24-a2af-f4c4060d363c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64693228-8082-4588-82ca-a70469474a30", "name": "network-vif-plugged", "status": "completed", "tag": "55ea46db-7f75-465c-abd3-cee189c022c3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:46.577265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0a2e5005-4f0e-4e0e-aa03-15ab2a15bab5 req-a007c61c-6d43-4b24-a2af-f4c4060d363c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.583109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0a2e5005-4f0e-4e0e-aa03-15ab2a15bab5 req-a007c61c-6d43-4b24-a2af-f4c4060d363c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.583859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0a2e5005-4f0e-4e0e-aa03-15ab2a15bab5 req-a007c61c-6d43-4b24-a2af-f4c4060d363c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.646794 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0a2e5005-4f0e-4e0e-aa03-15ab2a15bab5 req-a007c61c-6d43-4b24-a2af-f4c4060d363c service nova] Creating event network-vif-plugged:55ea46db-7f75-465c-abd3-cee189c022c3 for instance 64693228-8082-4588-82ca-a70469474a30 on n-h2-854882-3 Aug 29 15:49:46.661441 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0a2e5005-4f0e-4e0e-aa03-15ab2a15bab5 req-a007c61c-6d43-4b24-a2af-f4c4060d363c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133870 Aug 29 15:49:46.662633 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2507/4820] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:46.694526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:46.697127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:46.729447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.731566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.732192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.734672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.738402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.740591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.025188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.037610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.039078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.046000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa112c6e-a94e-4997-ae6b-326912130822 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 1.403314 Aug 29 15:49:47.046838 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2314/4821] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:45 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:47.307125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:47.402788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.416869 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-330d2757-ac3e-4002-ac7b-ac1b88b9044f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 0.751225 Aug 29 15:49:47.420278 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2508/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:46 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:48.089031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.094110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:48.131922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.136032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.137898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.139074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.150596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.156348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.526682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.556207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.559019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.573330 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f1cdc1a-23ad-4b44-947e-1a7c094589a7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.499389 Aug 29 15:49:48.577667 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2315/4823] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:48.585218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.612474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:48.641494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.645344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.647150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.649309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.650397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.650838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.067429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-41462043", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d897c5c0-df74-4e72-afd9-ed5315eaa2e0"}], "security_groups": [{"name": "tempest-securitygroup--494706397"}], "key_name": "tempest-keypair-1630722741", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:49.397607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] validate_networks() for [('d897c5c0-df74-4e72-afd9-ed5315eaa2e0', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:49.570897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:49.597089 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ba0470a2-2627-4f1e-969e-a5a167cf9c94 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 1.017740 Aug 29 15:49:49.615247 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2316/4824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:49.628638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:49.632970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:49.643550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:49.667842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.669782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.670646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.672181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.673809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.675561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.399813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:50.400872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:50.401883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:50.403059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:50.403683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:50.425188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.426836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.427775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.428791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.429645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.430339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.456891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:50.464254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Getting quotas for user f70ee130e8e74db88b9b7ffd16ed1bd5 and project 10b20946b0cd4fc3b2289200eb839230. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:50.484281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:50.489151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:50.592228 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1ac66c45-5e55-465c-94d7-56701a47cfcd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.172031 Aug 29 15:49:50.593349 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2509/4825] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:49:50.618421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fbe761a6-8b76-46de-a388-1fd73aa96535 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:50.619636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fbe761a6-8b76-46de-a388-1fd73aa96535 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:50.728213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fbe761a6-8b76-46de-a388-1fd73aa96535 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.735655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.743025 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fbe761a6-8b76-46de-a388-1fd73aa96535 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1240 microversion: 2.1 time: 0.136210 Aug 29 15:49:50.745566 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2510/4826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:50 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1240 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:50.757615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:50.758378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:50.765339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.766126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.767196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.769768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.770514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.771203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.800917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.802773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.809990 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3dafe2ae-32b1-4097-a6a1-3fd0d1d69bfc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 1.193294 Aug 29 15:49:50.822791 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2317/4827] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:49 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:51.130223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:51.138910 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b7a6882-2194-43f7-a40c-9bc0af085190 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 0.392027 Aug 29 15:49:51.139692 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2511/4828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:50 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:51.638822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-375bebe3-ca21-4f51-abab-7cd79096774d req-ca6f03f2-14e7-4305-8e94-e934c451335e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9960b3-4b32-4c7b-9555-118f5b23b48e", "name": "network-vif-plugged", "status": "completed", "tag": "568819e3-b36a-4bea-bd58-e6fd6235b844"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:51.663107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-375bebe3-ca21-4f51-abab-7cd79096774d req-ca6f03f2-14e7-4305-8e94-e934c451335e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.663583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-375bebe3-ca21-4f51-abab-7cd79096774d req-ca6f03f2-14e7-4305-8e94-e934c451335e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.664007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-375bebe3-ca21-4f51-abab-7cd79096774d req-ca6f03f2-14e7-4305-8e94-e934c451335e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.696836 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-375bebe3-ca21-4f51-abab-7cd79096774d req-ca6f03f2-14e7-4305-8e94-e934c451335e service nova] Creating event network-vif-plugged:568819e3-b36a-4bea-bd58-e6fd6235b844 for instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e on n-h1-854882-3 Aug 29 15:49:51.710880 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-375bebe3-ca21-4f51-abab-7cd79096774d req-ca6f03f2-14e7-4305-8e94-e934c451335e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077256 Aug 29 15:49:51.712097 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2318/4829] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:51.769175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:51.770543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:51.779409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.779987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.780437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.781361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.782023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.782629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.840458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:51.841183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:51.852565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.853165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.860675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.862439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.865231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.867998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.997955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.008231 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f3388fe-3362-4b27-8bde-341294ec57c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1292 microversion: 2.1 time: 0.244055 Aug 29 15:49:52.014499 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2512/4830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:51 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1292 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:52.161180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.162422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:52.182113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.187984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.188911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.190093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.191406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.196483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.200018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.202339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.208886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.224836 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-300fc9c6-7e39-4937-b4da-ceb4adf544e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.375619 Aug 29 15:49:52.227717 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2319/4831] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:51 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:52.728600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.736990 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-54bd6a4f-dca7-4e92-ac3f-0d8e2451c7ce tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1321 microversion: 2.1 time: 0.580448 Aug 29 15:49:52.737612 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2513/4832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:52 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:53.052275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.054511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.078473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.079403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.081418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.086572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.087585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.089030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.250233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.262505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.267606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.285320 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96daa21c-5c39-48e2-aeb8-cc206b6b47c0 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1298 microversion: 2.1 time: 0.249082 Aug 29 15:49:53.288118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.289174 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2320/4833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1298 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:53.290114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.290873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.291815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.292458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.293155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.651313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.661351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.669359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.672298 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bcaf38a1-07ba-45f6-9264-dbfffc42929d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.420066 Aug 29 15:49:53.680217 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2514/4834] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:53.765777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.767500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.824781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.825630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.826143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.838041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.838635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.839095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.905611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:54.210825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:54.220261 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0456d6f7-03ff-4937-af7f-18ee2cbe8592 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1512 microversion: 2.1 time: 0.464010 Aug 29 15:49:54.220852 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2321/4835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:54.246869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.247858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.256956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.257652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.258170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.258979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.259515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.260100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.312930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.313586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.326525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.327024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.327470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.333537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.334440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.335305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.708358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:54.718058 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c1da20f-f4f9-4d03-8472-319f4f86e634 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1365 microversion: 2.1 time: 0.408931 Aug 29 15:49:54.721899 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2322/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:54.727037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.734515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.750485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.754178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.755074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.755986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.758603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.759297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.804663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:54.818546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b721905-c229-4ca1-a0c4-09da75b8a0e5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1511 microversion: 2.1 time: 0.577786 Aug 29 15:49:54.829886 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2515/4837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:54.840094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.841589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.851420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.852191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.852805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.853773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.854537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.855152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.084004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.095464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.096958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.098181 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c104fde-9829-4e78-bac9-1919f2e47fd7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.375034 Aug 29 15:49:55.098742 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2323/4838] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:55.325196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.335603 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73c67b78-0fef-4da0-99e6-6bc942e1f343 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 200 len: 1512 microversion: 2.1 time: 0.499281 Aug 29 15:49:55.352567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2516/4839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:55.358149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:55.364325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.365539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:49:55.379302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.380014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.380654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.382040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.382709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.383472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.514278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:49:55.650782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.658116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.660693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.661493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.749071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:55.751192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:55.761182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.761743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.763068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.764250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.764517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.765765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.906988 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1bf9b08d-2182-4aff-989f-1fffdc748c85 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.552149 Aug 29 15:49:55.909275 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2324/4840] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:49:55 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:55.924011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b8ca2c11-c11f-4d8b-bc48-768e8e559e5a req-7617bce3-bf3b-454d-bde6-80c3abecff1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddafa5bf-2080-4bd6-b998-c4ee781d6af3", "tag": "6b328ae8-a8f9-438a-b39c-7b5cd2a62885"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:55.959135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8ca2c11-c11f-4d8b-bc48-768e8e559e5a req-7617bce3-bf3b-454d-bde6-80c3abecff1d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.959657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8ca2c11-c11f-4d8b-bc48-768e8e559e5a req-7617bce3-bf3b-454d-bde6-80c3abecff1d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.960061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b8ca2c11-c11f-4d8b-bc48-768e8e559e5a req-7617bce3-bf3b-454d-bde6-80c3abecff1d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.994819 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b8ca2c11-c11f-4d8b-bc48-768e8e559e5a req-7617bce3-bf3b-454d-bde6-80c3abecff1d service nova] Creating event network-changed:6b328ae8-a8f9-438a-b39c-7b5cd2a62885 for instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 on n-h2-854882-3 Aug 29 15:49:56.013553 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b8ca2c11-c11f-4d8b-bc48-768e8e559e5a req-7617bce3-bf3b-454d-bde6-80c3abecff1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099579 Aug 29 15:49:56.015996 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2325/4841] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:56.028809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:56.045813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.048342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-173106532', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:49:56.060466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.061204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.061871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.062779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.063574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.064235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.232271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.248323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:49:56.265890 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99a018f2-1c66-4024-a777-0a04f795af40 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1365 microversion: 2.1 time: 0.523542 Aug 29 15:49:56.269704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2517/4842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:55 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1365 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:56.295102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:56.303170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:56.329009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.338013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.348810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.352541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.356219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.357261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.378110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.390157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.391562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.392099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.656159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.672942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.674612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.676547 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-10f82894-c91e-4750-92c9-33b2be9dd005 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.404332 Aug 29 15:49:56.677478 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2518/4843] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:56 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:57.155941 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e540d7eb-a915-4031-ae29-584b87f2a843 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-173106532" status: 200 len: 1514 microversion: 2.1 time: 1.138618 Aug 29 15:49:57.156483 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2326/4844] 10.222.0.16 () {58 vars in 1261 bytes} [Mon Aug 29 15:49:56 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-173106532 => generated 1514 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:57.181519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.190633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:57.194121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:49:57.206778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.207793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.208571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.209556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.210241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.210744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.293973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.294699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:57.307409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.310413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.311063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.311968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.321204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.322062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.367020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:49:57.455998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:57.480149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:57.503129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.503636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.505024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.714765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:57.725806 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cff6463b-67e1-43f8-8e62-fec3d994c4d5 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1365 microversion: 2.1 time: 0.436196 Aug 29 15:49:57.726420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2327/4845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1365 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:57.740621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.741255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:57.762116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.772837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.773725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.774807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.775362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.775828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.221222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.231162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.243787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.247000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8bc66bd6-9dce-420f-a29b-4a675226acc9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.518664 Aug 29 15:49:58.249481 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2328/4846] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:58.353803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:58.356803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.364117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.364855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.365563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.366506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.367174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.367846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.463171 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3eed14ba-0d58-41f9-9ebb-84b9092aa380 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.112739 Aug 29 15:49:58.468673 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2329/4847] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:58 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:58.481029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.481680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.491541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.492177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.492616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.493416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.494105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.494604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.732371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-185aecf7-477f-407d-b850-05d171e1613e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.557459 Aug 29 15:49:58.734003 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2519/4848] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:58.749469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.750259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.771305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.771892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.772444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.773377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.774122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.777164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.815865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.827722 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-143e309e-14cf-46ee-835b-ae9883f48822 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1671 microversion: 2.1 time: 0.356983 Aug 29 15:49:58.828562 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2330/4849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:58 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1671 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:58.833913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.851984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.852576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.servers [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Removing options 'limit' from query {{(pid=130001) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:49:58.857166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:49:58.867851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.868333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.868777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.869526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.869984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.870405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.956278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.974841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.975341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.975786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.320611 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be992720-5b93-4873-9ba6-e313ac21c35b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.490961 Aug 29 15:49:59.333918 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2331/4850] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 15:49:58 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:59.345704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.347014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:59.358951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.359488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.363585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.367180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.367896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.369723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.576609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.591955 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f49505c-a7ef-4fa5-997f-99128bfa6303 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1365 microversion: 2.1 time: 0.849286 Aug 29 15:49:59.612000 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2520/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:58 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1365 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:59.619285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.631693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.633118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:49:59.635936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.643630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.644601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.645278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.646737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.647459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.648166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.652022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.656045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.657274 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6443e32e-f5b0-4d7b-9865-f2d7481ba070 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.322193 Aug 29 15:49:59.660422 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2332/4852] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:59.781589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:49:59.852537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.853154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:59.871076 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae4bb35a-9a9a-48ad-bc36-7be8c6b5a28b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.256663 Aug 29 15:49:59.872213 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2521/4853] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:59.875560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.877927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.892004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.895665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.924116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.924693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.940680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.964350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.964869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.servers [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Removing options 'limit' from query {{(pid=130002) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:49:59.965457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:49:59.970785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.971839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.972333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.973068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.973556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.973991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.004686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:00.036661 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b91697c5-94df-42f8-9040-cf3fd6d3305f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.149902 Aug 29 15:50:00.037607 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2522/4854] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.052597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.061279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.062236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:00.072501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.073282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.073946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.074990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.075661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.076818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.154973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:00.273921 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26d46360-5dad-4e24-91fc-7bda700b6401 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.221472 Aug 29 15:50:00.288689 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2523/4855] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers => generated 1011 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.299192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.310969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.311769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:00.339842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.340342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.340784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.341550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.342014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.342451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.420062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.431126 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-22cb1d47-b1b7-46fc-8a7a-46a8a5e51e70 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1671 microversion: 2.1 time: 0.583719 Aug 29 15:50:00.431710 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2333/4856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1671 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:00.620792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.623516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:00.647507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.648952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.656178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.663818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.665180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.668317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.688020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:00.829270 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb36a591-421a-4a21-b813-6209e2b1d44a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.539218 Aug 29 15:50:00.833236 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2524/4857] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:00.849196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.849884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:00.859246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.859529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.859980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.860700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.861160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.861654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.231156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.249658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.255853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.259730 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c84b2a5-8ccc-4dd2-89a8-465c82979cc2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.424878 Aug 29 15:50:01.261006 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2525/4858] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:50:01.291325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.303930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.305289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.servers [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Removing options 'limit' from query {{(pid=130002) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:50:01.307722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:01.314166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.314840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.315151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.316047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.316514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.316945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.349272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1fad3ce3-ec69-45bc-8e8f-e12c277c5b48 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.067749 Aug 29 15:50:01.356897 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2526/4859] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:01.366727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.375740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.376445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-173106532', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:01.383836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.384516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.385110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.385994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.386541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.386958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.494720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:01.591157 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8fb9b828-7f9b-4278-91b1-011e0e0c39f0 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-173106532" status: 200 len: 345 microversion: 2.1 time: 0.232278 Aug 29 15:50:01.600495 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2527/4860] 10.222.0.16 () {58 vars in 1240 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-173106532 => generated 345 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:01.606299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.607383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:01.614929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.615707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.616381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.617305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.617995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.618629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.876529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.890609 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ccc2c9e-e235-4830-9708-c2246d4b4e7e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.288608 Aug 29 15:50:01.891852 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2528/4861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:01.898124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef544673-013e-47bf-97bf-dc391f3c7d72 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:01.905122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef544673-013e-47bf-97bf-dc391f3c7d72 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.906045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef544673-013e-47bf-97bf-dc391f3c7d72 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.906707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef544673-013e-47bf-97bf-dc391f3c7d72 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.942453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef544673-013e-47bf-97bf-dc391f3c7d72 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Going to try to stop instance {{(pid=130002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:50:02.015360 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef544673-013e-47bf-97bf-dc391f3c7d72 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "POST /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801/action" status: 202 len: 0 microversion: 2.1 time: 0.108487 Aug 29 15:50:02.022121 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2529/4862] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:50:01 2022] POST /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:50:02.065528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.066289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.090513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.091018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.091464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.092189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.093842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.094694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.387385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:02.405153 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7acdd53a-0f53-46a5-8559-fe672853914f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1521 microversion: 2.1 time: 0.380765 Aug 29 15:50:02.406090 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2530/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:02.410934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c611c78c-55ca-4f11-b7ae-1e9900c70416 req-c0454649-4ce3-4b57-a813-ba2c4638bf02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "name": "network-vif-plugged", "status": "completed", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:02.428070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:02.435055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c611c78c-55ca-4f11-b7ae-1e9900c70416 req-c0454649-4ce3-4b57-a813-ba2c4638bf02 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.435589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c611c78c-55ca-4f11-b7ae-1e9900c70416 req-c0454649-4ce3-4b57-a813-ba2c4638bf02 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.436031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c611c78c-55ca-4f11-b7ae-1e9900c70416 req-c0454649-4ce3-4b57-a813-ba2c4638bf02 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.439650 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79b43824-951e-4e2a-8bee-b1e69c3599f6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1365 microversion: 2.1 time: 1.827116 Aug 29 15:50:02.457935 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2334/4864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1365 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:02.465987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c611c78c-55ca-4f11-b7ae-1e9900c70416 req-c0454649-4ce3-4b57-a813-ba2c4638bf02 service nova] Creating event network-vif-plugged:089534cd-a1fd-4322-a9bd-4aef2c5a4503 for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 on n-h1-854882-3 Aug 29 15:50:02.468669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.469579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.480503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.480731 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c611c78c-55ca-4f11-b7ae-1e9900c70416 req-c0454649-4ce3-4b57-a813-ba2c4638bf02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073527 Aug 29 15:50:02.481002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.481482 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2531/4865] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:02.485832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.489529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.491088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.491834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.214080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:03.223510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:03.226256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:03.228069 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c10ab88-31d4-4542-9b5b-233dbb34dae5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.768097 Aug 29 15:50:03.243638 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2335/4866] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:50:03.428228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.428849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:03.449010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.449544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.450161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.451058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.451671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.452343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.464118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.464818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:03.477616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.478131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.479443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.481531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.482669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.484232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.764660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:03.767324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.778705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-98a226e6-a4ca-4566-ab00-95a36142991d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1365 microversion: 2.1 time: 0.321835 Aug 29 15:50:03.779955 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2336/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:03 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:04.041682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.054121 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-afdd79fd-5081-4cc9-8138-5ceb151a0526 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1521 microversion: 2.1 time: 0.629920 Aug 29 15:50:04.054925 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2532/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:03 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:04.251903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:04.255924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:04.281530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.282041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.282481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.283729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.284202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.284631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.502397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0ef4f303-2599-4686-ade1-cba6391ef5c6 req-fe9ae722-ea68-4a05-ae33-bceba2a793aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddafa5bf-2080-4bd6-b998-c4ee781d6af3", "name": "network-vif-plugged", "status": "completed", "tag": "6b328ae8-a8f9-438a-b39c-7b5cd2a62885"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:04.531520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0ef4f303-2599-4686-ade1-cba6391ef5c6 req-fe9ae722-ea68-4a05-ae33-bceba2a793aa service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.532298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0ef4f303-2599-4686-ade1-cba6391ef5c6 req-fe9ae722-ea68-4a05-ae33-bceba2a793aa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.535441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0ef4f303-2599-4686-ade1-cba6391ef5c6 req-fe9ae722-ea68-4a05-ae33-bceba2a793aa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.563297 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0ef4f303-2599-4686-ade1-cba6391ef5c6 req-fe9ae722-ea68-4a05-ae33-bceba2a793aa service nova] Creating event network-vif-plugged:6b328ae8-a8f9-438a-b39c-7b5cd2a62885 for instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 on n-h2-854882-3 Aug 29 15:50:04.568885 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0ef4f303-2599-4686-ade1-cba6391ef5c6 req-fe9ae722-ea68-4a05-ae33-bceba2a793aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070956 Aug 29 15:50:04.572894 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2533/4869] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:04.804708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:04.805535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:04.827585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.828090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.828538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.829255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.829937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.831223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.882380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.892260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.912993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.918972 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d6da2b32-cffb-4f5d-869e-42492097bc3b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.667650 Aug 29 15:50:04.921560 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2337/4870] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:04 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:50:05.076643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:05.081361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:05.098031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.101162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.101744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.102452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.105587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.106417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.546345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:05.561100 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6445ee84-d447-4c9d-9118-0c08b13c0b8b tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1521 microversion: 2.1 time: 0.488981 Aug 29 15:50:05.573761 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2338/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:05 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:05.704678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:05.717839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:05.725002 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb941470-d4b7-43d2-b29c-d6d804ff355b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1365 microversion: 2.1 time: 0.924453 Aug 29 15:50:05.728953 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2534/4872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:04 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1365 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:05.947068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:05.948467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:05.959657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.961171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.962272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.964857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.966955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.967666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.442621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.482018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.494023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.495352 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5f3fc32-afe1-40ed-b519-285533e1ee3c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1807 microversion: 2.20 time: 0.552204 Aug 29 15:50:06.498794 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2339/4873] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:05 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1807 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:50:06.600320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:06.601212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:06.610727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.612134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.612945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.613978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.614720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.615415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.750971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:06.751620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:06.772165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.772674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.773755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.776896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.777976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.783031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.944685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.990983 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9908511f-4dd7-4e19-b543-de4bdd9c6abd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1521 microversion: 2.1 time: 0.396832 Aug 29 15:50:07.009128 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2535/4874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:06 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:07.164301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:07.180659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-532cf050-9b38-4b5d-89ac-0bfdb245ff8f tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1554 microversion: 2.1 time: 0.432965 Aug 29 15:50:07.203265 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2340/4875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:06 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1554 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:07.211151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.211688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.229156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.233483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.235820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.239342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.244715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.245096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.453322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d10de93b-476c-4e34-9dcb-4447f9dfaa57 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248600 Aug 29 15:50:07.454323 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2536/4876] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:07.521429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.522002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.552412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.553222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.554081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.560341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.561050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.561539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.010128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=10 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:08.017152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.018102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:08.034231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.036022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.036709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.041514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.042309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.044622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.292253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.336226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.354485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.357372 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d1c1ff32-8560-4336-8a6c-d7fcea425793 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1794 microversion: 2.20 time: 0.841763 Aug 29 15:50:08.360724 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2341/4877] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1794 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:50:08.726274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.739959 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-401feaa2-876c-435c-8fbf-b7eb62067d56 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1498 microversion: 2.1 time: 0.730104 Aug 29 15:50:08.755392 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2537/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:08 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1498 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:08.766982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.776488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.777252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:08.807201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.809990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.811314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.815614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.818187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.818833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.885470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:08.959975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:09.011515 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb8d0565-7104-4b6f-b906-e84433d51a5d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.249780 Aug 29 15:50:09.016833 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2342/4879] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Aug 29 15:50:08 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:09.046544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-367e9081-792b-45ae-b1e7-3afbc13b1bb2 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:09.056878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-367e9081-792b-45ae-b1e7-3afbc13b1bb2 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.057621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-367e9081-792b-45ae-b1e7-3afbc13b1bb2 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.058264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-367e9081-792b-45ae-b1e7-3afbc13b1bb2 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.089179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-367e9081-792b-45ae-b1e7-3afbc13b1bb2 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Going to try to start instance {{(pid=130002) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:50:09.171402 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-367e9081-792b-45ae-b1e7-3afbc13b1bb2 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "POST /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801/action" status: 202 len: 0 microversion: 2.1 time: 0.146685 Aug 29 15:50:09.181973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:09.182702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:09.186078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2538/4880] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:50:09 2022] POST /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:50:09.194845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.195443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.195934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.196832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.236457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.242382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.013786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:10.022681 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f33b4561-7676-4133-bca4-dc1164e95f50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1507 microversion: 2.1 time: 0.845341 Aug 29 15:50:10.026099 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2343/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:09 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1507 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:11.049491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:11.050150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:11.064910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.068686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.070578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.073675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.074389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.075731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.441436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=16 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:11.638544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-152e2943-1d5f-4efa-bc80-ad887a2697f9 req-13cd42c7-33ca-4a32-a626-4369bb5d0339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddafa5bf-2080-4bd6-b998-c4ee781d6af3", "tag": "6b328ae8-a8f9-438a-b39c-7b5cd2a62885"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:11.667560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-152e2943-1d5f-4efa-bc80-ad887a2697f9 req-13cd42c7-33ca-4a32-a626-4369bb5d0339 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.667992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-152e2943-1d5f-4efa-bc80-ad887a2697f9 req-13cd42c7-33ca-4a32-a626-4369bb5d0339 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.668430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-152e2943-1d5f-4efa-bc80-ad887a2697f9 req-13cd42c7-33ca-4a32-a626-4369bb5d0339 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.680863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:11.697054 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-152e2943-1d5f-4efa-bc80-ad887a2697f9 req-13cd42c7-33ca-4a32-a626-4369bb5d0339 service nova] Creating event network-changed:6b328ae8-a8f9-438a-b39c-7b5cd2a62885 for instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 on n-h2-854882-3 Aug 29 15:50:11.711537 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-152e2943-1d5f-4efa-bc80-ad887a2697f9 req-13cd42c7-33ca-4a32-a626-4369bb5d0339 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078180 Aug 29 15:50:11.712591 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4fe0d67b-e9b3-47bd-8cd4-17d2d7f12a8a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1507 microversion: 2.1 time: 0.664815 Aug 29 15:50:11.713267 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2539/4882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:11 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:11.715278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2344/4883] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:12.735670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:12.737771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:12.750814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:12.757545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:12.758292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:12.759219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:12.759850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:12.760471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.420390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:13.431541 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc8eece7-043b-471a-b702-9845f5440d12 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1511 microversion: 2.1 time: 0.698571 Aug 29 15:50:13.432166 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2540/4884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:12 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1511 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:13.459113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:13.472625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:13.474507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.servers [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Removing options 'limit' from query {{(pid=130001) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:50:13.476535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:13.478330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.479305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.480771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.482938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.483820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.484681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.486897 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f25e3eb-8afb-4834-b4e4-2e0c69be71fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.035356 Aug 29 15:50:13.503392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:13.511761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:13.521485 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2345/4885] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Aug 29 15:50:13 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:50:13.528557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.530378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.531507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.534047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.535252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.535924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.835483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:13.854163 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e29045f2-a18b-4b0f-9424-edb77f85db58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1511 microversion: 2.1 time: 0.354874 Aug 29 15:50:13.855471 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2541/4886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:13 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:13.876667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:13.878380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:13.887443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.888164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.889166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.890159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.890812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.892380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.310249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:14.320368 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b9a3f0cf-c1d0-44b5-bd33-a00d5751265d tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 200 len: 1512 microversion: 2.1 time: 0.447990 Aug 29 15:50:14.325829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2346/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:13 2022] GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:14.341722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:14.342351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:14.351216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:14.352129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:14.352800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.354832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:14.355550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:14.356316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.696081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:14.707330 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f87e083d-a7c0-4925-9089-bc9ea87694a9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1512 microversion: 2.1 time: 0.370303 Aug 29 15:50:14.710925 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2542/4888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:14 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:14.734427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:14.747123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:14.747832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'ip': '172.20.0.6', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:15.011883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.012494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.012993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.014124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.014414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.014928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.173924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:15.305915 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b4198791-9b70-4af8-bcac-7706b61a8c89 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.6" status: 200 len: 346 microversion: 2.1 time: 0.570175 Aug 29 15:50:15.306911 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2347/4889] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:50:14 2022] GET /compute/v2.1/servers?ip=172.20.0.6 => generated 346 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:15.321164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:15.322675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:15.329165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:15.331914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.333189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.334383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.335340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.336010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.337193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.618408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:15.630884 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d9248b8-14fd-4479-b7a8-6b0dc416faa9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1511 microversion: 2.1 time: 0.312930 Aug 29 15:50:15.633665 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2543/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:15 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:15.666567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:15.668384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:15.684616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.700501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.702594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.711547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.713053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.714709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.049832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:16.057668 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d73e0c0f-2830-431c-8331-3c35c8e7bb09 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 200 len: 1512 microversion: 2.1 time: 0.402225 Aug 29 15:50:16.076775 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2348/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:15 2022] GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:16.084171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:16.084890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:16.094801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.096226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.097486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.098957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.099611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.100446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.621049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:16.629949 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a727f349-2b73-4091-8237-1a6c19d67d50 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1512 microversion: 2.1 time: 0.551720 Aug 29 15:50:16.633835 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2544/4892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:16 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1512 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:16.657806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:16.663074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:16.665742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:16.677183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.679375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.683890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.685871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.687182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.690391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.756926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:16.868250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:16.886610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.887098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.887516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:17.274260 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29a6fb15-ce11-4c89-86f5-b29ffbbf99e3 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.620924 Aug 29 15:50:17.275493 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2349/4893] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:50:16 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:17.310741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:17.316545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:17.329738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:17.730347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:17.730961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:17.731343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:17.732184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:17.732675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:17.733100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:17.994556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:18.125806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-82311b94-cd9e-4155-adfa-da70dbf3f6ef tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.821580 Aug 29 15:50:18.129071 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2545/4894] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Aug 29 15:50:17 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:18.144581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:18.156928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:18.157665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:18.177507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.177507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.177507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.177507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.177507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.177507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.494968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:18.598768 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24dad8b5-e524-461c-87d1-614abdcb0946 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.457818 Aug 29 15:50:18.599991 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2350/4895] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Aug 29 15:50:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:18.613173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:18.626908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:18.629704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:18.645102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.648394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.649096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.653085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.656103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.665575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.819375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:18.944245 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-054f23d1-4da2-4344-b66f-b196573428fa tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.335184 Aug 29 15:50:18.953209 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2546/4896] 10.222.0.16 () {58 vars in 1196 bytes} [Mon Aug 29 15:50:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:18.958767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:18.964611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:18.971499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'name': '-173106532', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:18.991391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.991878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.992310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.993564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.994017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.999294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:19.172437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:19.716718 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-10ba88d1-334c-418d-965f-0c07a1f40080 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-173106532" status: 200 len: 345 microversion: 2.1 time: 0.762159 Aug 29 15:50:19.728425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2351/4897] 10.222.0.16 () {58 vars in 1156 bytes} [Mon Aug 29 15:50:18 2022] GET /compute/v2.1/servers?name=-173106532 => generated 345 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:19.733083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:19.744738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:19.747138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:19.763856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:19.765705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:19.768588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:19.769810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:19.771917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:19.773713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:19.916820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.multi_cell_list [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:19.993940 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4aa5f7e5-0fac-429e-af0c-2dcca165fd3a tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.265955 Aug 29 15:50:19.995021 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2547/4898] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Aug 29 15:50:19 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:20.009208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:20.020421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:20.024385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-17310653', 'deleted': False, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:50:20.035140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=76 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:20.036920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.041708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.042443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.045352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.047015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.049000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.150170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=17 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:20.238580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:50:20.278237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:20.340636 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b81dc786-90a4-45c3-8823-42fd7cec6090 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-17310653" status: 200 len: 345 microversion: 2.1 time: 0.336660 Aug 29 15:50:20.343806 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2352/4899] 10.222.0.16 () {58 vars in 1226 bytes} [Mon Aug 29 15:50:20 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-17310653 => generated 345 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:20.359128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:20.361765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:20.377889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.377889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.377889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.377889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.377889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.377889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.410969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:20.476782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:20.582611 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b1b86617-60cc-451e-b02b-c5f0c025bff9 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 204 len: 0 microversion: 2.1 time: 0.231246 Aug 29 15:50:20.589283 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2548/4900] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:20 2022] DELETE /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:20.599501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:20.603892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:20.627724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.631502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.632061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.638631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.639131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.642633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:21.633227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:21.661709 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d622bd5d-70dd-48f7-965a-2766c8bd2a51 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1518 microversion: 2.1 time: 1.066178 Aug 29 15:50:21.683861 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2353/4901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:20 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1518 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:22.692041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:22.692783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:22.709100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.709634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.710085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:22.710807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.711266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.711719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:23.130131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:23.140431 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e7dd098-72eb-4adb-aaf6-be1cbcff7d58 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1518 microversion: 2.1 time: 0.453306 Aug 29 15:50:23.141069 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2549/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:22 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1518 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:23.485312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-688fac13-3cec-4a11-997c-986d38fefbb6 req-2c5e92bb-b820-4160-99e1-dbcd5dee8e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9960b3-4b32-4c7b-9555-118f5b23b48e", "name": "network-vif-deleted", "tag": "568819e3-b36a-4bea-bd58-e6fd6235b844"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:23.513936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-688fac13-3cec-4a11-997c-986d38fefbb6 req-2c5e92bb-b820-4160-99e1-dbcd5dee8e74 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:23.514416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-688fac13-3cec-4a11-997c-986d38fefbb6 req-2c5e92bb-b820-4160-99e1-dbcd5dee8e74 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:23.520228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-688fac13-3cec-4a11-997c-986d38fefbb6 req-2c5e92bb-b820-4160-99e1-dbcd5dee8e74 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:23.542965 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-688fac13-3cec-4a11-997c-986d38fefbb6 req-2c5e92bb-b820-4160-99e1-dbcd5dee8e74 service nova] Creating event network-vif-deleted:568819e3-b36a-4bea-bd58-e6fd6235b844 for instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e on n-h1-854882-3 Aug 29 15:50:23.558307 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-688fac13-3cec-4a11-997c-986d38fefbb6 req-2c5e92bb-b820-4160-99e1-dbcd5dee8e74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079072 Aug 29 15:50:23.559250 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2354/4903] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:24.163448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:24.164186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:24.176762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.177304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.178039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.179014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.179649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.180260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.259150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.259950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.261332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.262477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lazy-loading 'fault' on Instance uuid 5c9960b3-4b32-4c7b-9555-118f5b23b48e {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:24.396890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:24.404947 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14f7a24e-af07-44f6-ab79-6abbca687baf tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 200 len: 1311 microversion: 2.1 time: 0.245678 Aug 29 15:50:24.409497 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2550/4904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:24 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:25.434080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:25.434780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 5c9960b3-4b32-4c7b-9555-118f5b23b48e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:25.461104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.468788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.472082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:25.480042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.486517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.487182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:25.533975 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] HTTP exception thrown: Instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e could not be found. Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Request method failure captured: Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e HTTP/1.1 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOABwnZ0Hrb4m2M-3IX1E7TC-eG7RanzMmTftQ0VA6z2ZKk3ntmMtZ6Xik5WLD-Nqv6leOPfnw7ot6OevkBbJWX9uSefgIaJ5FyUSkY6gOkiDIUXTOBDn9e3bzBybL6dHdtZ7N4HvrtsfT7WQT6cWuOpgUzNC-SQc5xs6FXhRO-fLMw Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f9e9c8c3ae7e473083ac7aaf1758a8a6 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9e9c8c3ae7e473083ac7aaf1758a8a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}] Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f9e9c8c3ae7e473083ac7aaf1758a8a6 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ListServerFiltersTestJSON-1556220247-project Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e5bbef967a524d888007bb0fede478c9 Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ListServerFiltersTestJSON-1556220247-project Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e could not be found. Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5c9960b3-4b32-4c7b-9555-118f5b23b48e'} Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e could not be found. Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e could not be found. Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.542923 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.548250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.548250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.548250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.548250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:25.548250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:25.548250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e could not be found. Aug 29 15:50:25.548250 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.554484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Returning 404 to user: Instance 5c9960b3-4b32-4c7b-9555-118f5b23b48e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:25.555578 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a469cb3a-fa75-4f3f-8223-c024d7b47dcd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e" status: 404 len: 111 microversion: 2.1 time: 0.125989 Aug 29 15:50:25.556325 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2355/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:25 2022] GET /compute/v2.1/servers/5c9960b3-4b32-4c7b-9555-118f5b23b48e => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:25.565904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:25.566428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:25.579722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.580231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.580673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:25.581417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.583651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.584652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:25.647645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:25.802018 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2fd452d5-f33a-4cf1-853e-56870c621a5c tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "DELETE /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 204 len: 0 microversion: 2.1 time: 0.240865 Aug 29 15:50:25.803060 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2551/4906] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:25 2022] DELETE /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:25.813625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:25.814467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:25.823349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.826588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.827341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:25.828390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.829104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.830505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.346118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:26.355507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1df22ff0-c9f7-4a2a-aaea-230c33053f25 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 200 len: 1518 microversion: 2.1 time: 0.547142 Aug 29 15:50:26.358060 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2356/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:25 2022] GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 1518 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:27.381195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:27.382724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:27.406980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.407850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.410108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.414555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.417489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.418575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.720057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:27.731613 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa2299a4-0583-4a30-8298-afead7d33efe tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 200 len: 1518 microversion: 2.1 time: 0.354517 Aug 29 15:50:27.733189 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2552/4908] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:27 2022] GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:28.758928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:28.760474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:28.774621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:28.784955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.786219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.789655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.792509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.793297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.794801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.900279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7563932f-edd4-4a51-8739-bb869e0b59a2 req-399a767a-44f5-4af9-9d17-c8d6976e3a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64693228-8082-4588-82ca-a70469474a30", "name": "network-vif-deleted", "tag": "55ea46db-7f75-465c-abd3-cee189c022c3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:28.927764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7563932f-edd4-4a51-8739-bb869e0b59a2 req-399a767a-44f5-4af9-9d17-c8d6976e3a99 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.929585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7563932f-edd4-4a51-8739-bb869e0b59a2 req-399a767a-44f5-4af9-9d17-c8d6976e3a99 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.934950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7563932f-edd4-4a51-8739-bb869e0b59a2 req-399a767a-44f5-4af9-9d17-c8d6976e3a99 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.976798 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7563932f-edd4-4a51-8739-bb869e0b59a2 req-399a767a-44f5-4af9-9d17-c8d6976e3a99 service nova] Creating event network-vif-deleted:55ea46db-7f75-465c-abd3-cee189c022c3 for instance 64693228-8082-4588-82ca-a70469474a30 on n-h2-854882-3 Aug 29 15:50:28.994639 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7563932f-edd4-4a51-8739-bb869e0b59a2 req-399a767a-44f5-4af9-9d17-c8d6976e3a99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094538 Aug 29 15:50:28.996085 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2553/4909] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:29.050760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:29.065436 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7fbea2aa-3718-41da-8003-6d1929cbc058 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 200 len: 1476 microversion: 2.1 time: 0.316713 Aug 29 15:50:29.072925 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2357/4910] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:28 2022] GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:30.095403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:30.104892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:30.116583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: 64693228-8082-4588-82ca-a70469474a30] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:30.141031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.141869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.142620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.143786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.144528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.145223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.195993 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] HTTP exception thrown: Instance 64693228-8082-4588-82ca-a70469474a30 could not be found. Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Request method failure captured: Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 HTTP/1.1 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOABwnZ0Hrb4m2M-3IX1E7TC-eG7RanzMmTftQ0VA6z2ZKk3ntmMtZ6Xik5WLD-Nqv6leOPfnw7ot6OevkBbJWX9uSefgIaJ5FyUSkY6gOkiDIUXTOBDn9e3bzBybL6dHdtZ7N4HvrtsfT7WQT6cWuOpgUzNC-SQc5xs6FXhRO-fLMw Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f9e9c8c3ae7e473083ac7aaf1758a8a6 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9e9c8c3ae7e473083ac7aaf1758a8a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}] Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f9e9c8c3ae7e473083ac7aaf1758a8a6 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListServerFiltersTestJSON-1556220247-project Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e5bbef967a524d888007bb0fede478c9 Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListServerFiltersTestJSON-1556220247-project Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 64693228-8082-4588-82ca-a70469474a30 could not be found. Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '64693228-8082-4588-82ca-a70469474a30'} Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64693228-8082-4588-82ca-a70469474a30 could not be found. Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64693228-8082-4588-82ca-a70469474a30 could not be found. Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:30.198903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64693228-8082-4588-82ca-a70469474a30 could not be found. Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Returning 404 to user: Instance 64693228-8082-4588-82ca-a70469474a30 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8e04f6c-3679-4c81-a368-5edb0beed2dd tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30" status: 404 len: 111 microversion: 2.1 time: 0.107238 Aug 29 15:50:30.202986 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2554/4911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:30 2022] GET /compute/v2.1/servers/64693228-8082-4588-82ca-a70469474a30 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:30.215033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:30.215738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:30.229934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:30.233485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.234784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.236248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.237749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.238720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.239630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.341348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:30.673410 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9715e5c4-e0ff-492b-bc37-27d01bb24353 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 204 len: 0 microversion: 2.1 time: 0.464282 Aug 29 15:50:30.678839 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2358/4912] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:30 2022] DELETE /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:30.699827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:30.701694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:30.753927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.754888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.755565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.756744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.757513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.758200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:31.113939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:31.126141 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40cf9006-0642-4d95-aa95-6f577087d3ff tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1517 microversion: 2.1 time: 0.442813 Aug 29 15:50:31.128750 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2555/4913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:30 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1517 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:32.160776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:32.162308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:32.176319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.177913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.179465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.180486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.192752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.195506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.867476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:32.880631 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-01e6c68d-d6a4-41e4-9acd-aeaf36e839c5 tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1517 microversion: 2.1 time: 0.729572 Aug 29 15:50:32.892556 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2359/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:32 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1517 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:33.640967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-17614a01-c91c-463c-97f8-b8a54a7a92e6 req-96fc68c0-19c8-40ab-83d9-a55b379db282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2130dd-0352-4b9e-a769-89e9d5903801", "name": "network-vif-deleted", "tag": "fcbf047f-37ab-4718-baa2-344632bfd06b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:33.672251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-17614a01-c91c-463c-97f8-b8a54a7a92e6 req-96fc68c0-19c8-40ab-83d9-a55b379db282 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.674904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-17614a01-c91c-463c-97f8-b8a54a7a92e6 req-96fc68c0-19c8-40ab-83d9-a55b379db282 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.676106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-17614a01-c91c-463c-97f8-b8a54a7a92e6 req-96fc68c0-19c8-40ab-83d9-a55b379db282 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.706502 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-17614a01-c91c-463c-97f8-b8a54a7a92e6 req-96fc68c0-19c8-40ab-83d9-a55b379db282 service nova] Creating event network-vif-deleted:fcbf047f-37ab-4718-baa2-344632bfd06b for instance de2130dd-0352-4b9e-a769-89e9d5903801 on n-h1-854882-3 Aug 29 15:50:33.722374 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-17614a01-c91c-463c-97f8-b8a54a7a92e6 req-96fc68c0-19c8-40ab-83d9-a55b379db282 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080963 Aug 29 15:50:33.726076 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2556/4915] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:33.928770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:33.929530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:33.968232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.995739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.996346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.005816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.007835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.012581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.181799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.185612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.194192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.195877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lazy-loading 'fault' on Instance uuid de2130dd-0352-4b9e-a769-89e9d5903801 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:34.328848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5bbef967a524d888007bb0fede478c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:34.337997 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-81562111-8fa3-448b-806e-82fd5af2f71e tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 200 len: 1310 microversion: 2.1 time: 0.433285 Aug 29 15:50:34.356928 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2360/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:33 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 1310 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:35.375508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:35.391449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] [instance: de2130dd-0352-4b9e-a769-89e9d5903801] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:35.442463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.444037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.445785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.448751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.453129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.463778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.517752 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] HTTP exception thrown: Instance de2130dd-0352-4b9e-a769-89e9d5903801 could not be found. Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Request method failure captured: Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 HTTP/1.1 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOABwnZ0Hrb4m2M-3IX1E7TC-eG7RanzMmTftQ0VA6z2ZKk3ntmMtZ6Xik5WLD-Nqv6leOPfnw7ot6OevkBbJWX9uSefgIaJ5FyUSkY6gOkiDIUXTOBDn9e3bzBybL6dHdtZ7N4HvrtsfT7WQT6cWuOpgUzNC-SQc5xs6FXhRO-fLMw Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f9e9c8c3ae7e473083ac7aaf1758a8a6 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9e9c8c3ae7e473083ac7aaf1758a8a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e9c8c3ae7e473083ac7aaf1758a8a6"}]}] Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f9e9c8c3ae7e473083ac7aaf1758a8a6 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1556220247 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ListServerFiltersTestJSON-1556220247-project Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e5bbef967a524d888007bb0fede478c9 Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ListServerFiltersTestJSON-1556220247-project Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance de2130dd-0352-4b9e-a769-89e9d5903801 could not be found. Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'de2130dd-0352-4b9e-a769-89e9d5903801'} Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2130dd-0352-4b9e-a769-89e9d5903801 could not be found. Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2130dd-0352-4b9e-a769-89e9d5903801 could not be found. Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:35.521211 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:35.526828 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:35.526828 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:35.526828 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:35.526828 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:35.526828 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:35.526828 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2130dd-0352-4b9e-a769-89e9d5903801 could not be found. Aug 29 15:50:35.526828 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:35.528710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] Returning 404 to user: Instance de2130dd-0352-4b9e-a769-89e9d5903801 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:35.530308 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8451ac1-d652-4ce8-a452-58a27addac0f tempest-ListServerFiltersTestJSON-1556220247 tempest-ListServerFiltersTestJSON-1556220247-project] 10.222.0.16 "GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801" status: 404 len: 111 microversion: 2.1 time: 0.169207 Aug 29 15:50:35.531407 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2557/4917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:35 2022] GET /compute/v2.1/servers/de2130dd-0352-4b9e-a769-89e9d5903801 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:37.053614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:37.054628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:37.079411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.080667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.081271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.082026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.082479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.082898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.887738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:37.909801 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d53ee256-ebf4-4969-83c5-d40fbfcb5783 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.856991 Aug 29 15:50:37.915444 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2361/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:37 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:37.940953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:37.941987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:37.953054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.959716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.960285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.961164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.961739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.962405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:38.656580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:38.672517 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df806aa2-9bc7-4c6d-9674-39e95423f23c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.736189 Aug 29 15:50:38.694497 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2558/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:37 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:38.700105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:38.701467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:38.709711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.710633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.711300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:38.712255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.712950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.713634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.360539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:39.374549 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e5d246d-7fe5-4db2-b949-d0228c8e4e27 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.678480 Aug 29 15:50:39.390652 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2362/4920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:38 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:39.396730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:39.398086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:39.406818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:39.408118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:39.408707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.409719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:39.410344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:39.411173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.056619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:40.073956 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d870854f-c633-4c7e-a466-0cda5374815d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.680914 Aug 29 15:50:40.083774 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2559/4921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:39 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:40.449236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-443035456", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "495c919e-8bb9-4e7e-b31f-e6fe4e50e138"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:40.647480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] validate_networks() for [('495c919e-8bb9-4e7e-b31f-e6fe4e50e138', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:41.078773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:41.079506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:41.097115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.097683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.103574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.105329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.108611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.110975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.233196 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1f0444c8-823a-43f8-9a8b-90e7daaddf26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments/c6a42dd4-7041-46e2-9232-a244834a2982" status: 200 len: 194 microversion: 2.20 time: 0.160011 Aug 29 15:50:41.236740 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2560/4922] 10.222.0.16 () {60 vars in 1454 bytes} [Mon Aug 29 15:50:41 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments/c6a42dd4-7041-46e2-9232-a244834a2982 => generated 194 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:50:41.376450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:41.376957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:41.386221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.386728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.387173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.387890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.388351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.388777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.598545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lazy-loading 'services' on Instance uuid cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:41.767671 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-87ab7a94-efc1-4eb1-878d-77b01d6eeb97 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments/c6a42dd4-7041-46e2-9232-a244834a2982" status: 202 len: 0 microversion: 2.20 time: 0.392160 Aug 29 15:50:41.771194 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2561/4923] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Aug 29 15:50:41 2022] DELETE /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments/c6a42dd4-7041-46e2-9232-a244834a2982 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:41.793518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:41.803541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:41.855724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.860515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.863194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.864777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.867146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.868305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.927890 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6c55bef-66ba-44f1-ae8c-5aa79f0fee26 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147576 Aug 29 15:50:41.928672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2562/4924] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:41 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:50:42.152898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-361eeb35-fead-4b19-82b4-7af546ed31eb tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1079828654", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:42.158314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-361eeb35-fead-4b19-82b4-7af546ed31eb tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] HTTP exception thrown: min_count must be <= max_count Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-361eeb35-fead-4b19-82b4-7af546ed31eb tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Request method failure captured: Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 184 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOBRuiywbPqR1YJjB5cR2ku6xZ7alnhH3C4sVn_pCwsos2HtL1MTgLziH2zY2xHogVDYaepX37DwjJdtJxAu0wL7awC_LFSS2shR4Nu7EaeznkFMwBxmtPZZWjxvv2CsVUDxbTpeMphnot5iG5zHVVScJoSeQKyC8el7EQ72Fq9Xnik Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11a5a735158847d7904ccd9d22d46402", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}] Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 27efc2ddfa5243fea19c5b059350ebd3 Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1079828654", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: exception: min_count must be <= max_count Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1079828654', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 29 15:50:42.160461 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.166601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-361eeb35-fead-4b19-82b4-7af546ed31eb tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Returning 400 to user: min_count must be <= max_count {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:42.167918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-361eeb35-fead-4b19-82b4-7af546ed31eb tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.237781 Aug 29 15:50:42.169498 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2563/4925] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:41 2022] POST /compute/v2.1/servers => generated 74 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:42.271155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9244242-da1b-42d6-adb0-d0c2486186e7 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-922529522", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "max_count": 0}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:42.273137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:42.275001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:42.275814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:42.276531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:42.278119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9244242-da1b-42d6-adb0-d0c2486186e7 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Request method failure captured: Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 167 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOBRuiywbPqR1YJjB5cR2ku6xZ7alnhH3C4sVn_pCwsos2HtL1MTgLziH2zY2xHogVDYaepX37DwjJdtJxAu0wL7awC_LFSS2shR4Nu7EaeznkFMwBxmtPZZWjxvv2CsVUDxbTpeMphnot5iG5zHVVScJoSeQKyC8el7EQ72Fq9Xnik Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11a5a735158847d7904ccd9d22d46402", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}] Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 27efc2ddfa5243fea19c5b059350ebd3 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-922529522", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "max_count": 0}} Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-922529522', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'max_count': 0}}} Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 0 Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:42.303281 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9244242-da1b-42d6-adb0-d0c2486186e7 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9244242-da1b-42d6-adb0-d0c2486186e7 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.038963 Aug 29 15:50:42.319372 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2564/4926] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:50:42.321112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.321112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.321112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.321112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.321112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.346178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.471924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:42.488891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for user a68002795ce541338b30129e6dbb0fb6 and project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:42.491932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b4b3558-18ff-48f9-bd20-b5040b250565 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1302045889", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "max_count": 2.5}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b4b3558-18ff-48f9-bd20-b5040b250565 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Request method failure captured: Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 170 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOBRuiywbPqR1YJjB5cR2ku6xZ7alnhH3C4sVn_pCwsos2HtL1MTgLziH2zY2xHogVDYaepX37DwjJdtJxAu0wL7awC_LFSS2shR4Nu7EaeznkFMwBxmtPZZWjxvv2CsVUDxbTpeMphnot5iG5zHVVScJoSeQKyC8el7EQ72Fq9Xnik Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11a5a735158847d7904ccd9d22d46402", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}] Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 27efc2ddfa5243fea19c5b059350ebd3 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1302045889", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "max_count": 2.5}} Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1302045889', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'max_count': 2.5}}} Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:42.501155 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b4b3558-18ff-48f9-bd20-b5040b250565 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3b4b3558-18ff-48f9-bd20-b5040b250565 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015974 Aug 29 15:50:42.515795 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2565/4927] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:50:42.517227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:42.517227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:42.574538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-21d93044-25b1-41c7-9b6d-1dd328ef749c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.133531 Aug 29 15:50:42.575545 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2363/4928] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:42.586170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8523ccc-6593-45b6-b5c8-bc97d9bc3c4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:42.586796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b8523ccc-6593-45b6-b5c8-bc97d9bc3c4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:42.605844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb61db77-e729-4707-a57f-c968a9f77e57 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-540641290", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 0}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb61db77-e729-4707-a57f-c968a9f77e57 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Request method failure captured: Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 167 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOBRuiywbPqR1YJjB5cR2ku6xZ7alnhH3C4sVn_pCwsos2HtL1MTgLziH2zY2xHogVDYaepX37DwjJdtJxAu0wL7awC_LFSS2shR4Nu7EaeznkFMwBxmtPZZWjxvv2CsVUDxbTpeMphnot5iG5zHVVScJoSeQKyC8el7EQ72Fq9Xnik Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11a5a735158847d7904ccd9d22d46402", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}] Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 27efc2ddfa5243fea19c5b059350ebd3 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-540641290", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 0}} Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-540641290', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'min_count': 0}}} Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 0 Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:42.612410 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:50:42.617636 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.620797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb61db77-e729-4707-a57f-c968a9f77e57 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:42.621889 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb61db77-e729-4707-a57f-c968a9f77e57 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021816 Aug 29 15:50:42.622964 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2364/4929] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:50:42.722756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a6ccfa9-720c-4c14-a7a3-c73c467eaaf2 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-456232263", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 2.5}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a6ccfa9-720c-4c14-a7a3-c73c467eaaf2 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Request method failure captured: Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 169 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOBRuiywbPqR1YJjB5cR2ku6xZ7alnhH3C4sVn_pCwsos2HtL1MTgLziH2zY2xHogVDYaepX37DwjJdtJxAu0wL7awC_LFSS2shR4Nu7EaeznkFMwBxmtPZZWjxvv2CsVUDxbTpeMphnot5iG5zHVVScJoSeQKyC8el7EQ72Fq9Xnik Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11a5a735158847d7904ccd9d22d46402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11a5a735158847d7904ccd9d22d46402", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11a5a735158847d7904ccd9d22d46402"}]}] Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 11a5a735158847d7904ccd9d22d46402 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-266925344 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 27efc2ddfa5243fea19c5b059350ebd3 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-266925344-project Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-456232263", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "min_count": 2.5}} Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-456232263', 'imageRef': '69b80579-025a-47db-8397-1d03ce8a20ab', 'flavorRef': '452', 'min_count': 2.5}}} Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:42.743619 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:50:42.747904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a6ccfa9-720c-4c14-a7a3-c73c467eaaf2 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:42.752406 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a6ccfa9-720c-4c14-a7a3-c73c467eaaf2 tempest-MultipleCreateNegativeTestJSON-266925344 tempest-MultipleCreateNegativeTestJSON-266925344-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031493 Aug 29 15:50:42.753105 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2365/4930] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:50:42.915190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8523ccc-6593-45b6-b5c8-bc97d9bc3c4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:42.941348 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8523ccc-6593-45b6-b5c8-bc97d9bc3c4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1214 microversion: 2.1 time: 0.356830 Aug 29 15:50:42.941348 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2566/4931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:42 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1214 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:42.951095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:42.959748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:42.981172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.983266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.984416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.985098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:43.002785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:43.003257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:43.087973 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88fe4389-84bb-4c6e-9f7e-47a3853fa548 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145213 Aug 29 15:50:43.090131 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2366/4932] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:42 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:50:43.961089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:43.962238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:43.974816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:43.977150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:43.987563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:43.988608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:43.989069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:43.989529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.103897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:44.108310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:44.152781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.155537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.160286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.162766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.164420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.164879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.172571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:44.187392 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-20238694-ec4e-46b7-96f4-e540e27dcd29 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1266 microversion: 2.1 time: 0.230827 Aug 29 15:50:44.202692 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2567/4933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:43 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:44.252912 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e24df27-d928-4b92-ada1-ce9b7790c9c0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155622 Aug 29 15:50:44.254118 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2367/4934] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:44 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:50:45.216298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:45.218049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:45.247951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.250347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.253176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.258373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.267225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:45.270630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:45.275014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.277725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.302708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.306178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.307158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.310868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.312262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.316939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.408090 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-868afefb-e88d-44e7-92b2-2347f353cdbf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145633 Aug 29 15:50:45.420567 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2368/4935] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:45 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:50:45.650879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:45.658270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:45.672005 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ac07a00-7cf0-4d3c-8591-54798454fe4d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1272 microversion: 2.1 time: 0.460817 Aug 29 15:50:45.672606 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2568/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:45 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1272 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:46.208612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:46.209406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:46.218500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.235022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.236077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.240395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.241138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.243819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.347945 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14c13a92-2f2f-4f7f-941b-1ee9c3c22799 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/ips" status: 200 len: 148 microversion: 2.1 time: 0.146549 Aug 29 15:50:46.349846 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2369/4937] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:50:46 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/ips => generated 148 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:46.421960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:46.424745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:46.449138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:46.455584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.456092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.456538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.457259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.457762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.458194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.612175 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55d7d895-eb54-4f59-b9db-df9944d796d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191484 Aug 29 15:50:46.614162 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2569/4938] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:46 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:50:46.693125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:46.693789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:46.707855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.716919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.719534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.721753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.725226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.729418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.626647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:47.630326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:47.651136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:47.651636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:47.652080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.652835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:47.653260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:47.653816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.783731 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92502166-0b39-400f-8d6a-061f5f7b86aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162534 Aug 29 15:50:47.786440 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2570/4939] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:47 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:50:48.130140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:48.147876 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dfb4d952-1432-451b-bd38-b5dde37f222e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1314 microversion: 2.1 time: 1.459243 Aug 29 15:50:48.149948 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2370/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:46 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1314 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:48.799365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:48.803498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:48.823434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.825101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.827596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.828461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.830095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.830554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.913540 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cee63b99-c31e-483d-96aa-60c639264a2d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.120539 Aug 29 15:50:48.915009 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2571/4941] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:48 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:50:48.989139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9e7c7f5e-a179-4b69-889e-5050d9a81421 req-f0c6a507-439b-4e84-8b73-bfaea4d60445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6e279b-a092-4e0b-8740-2ab3cdd3276e", "tag": "433ed27d-6106-4c8c-a89b-b30fdaa6ff16"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:49.021011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e7c7f5e-a179-4b69-889e-5050d9a81421 req-f0c6a507-439b-4e84-8b73-bfaea4d60445 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.023448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e7c7f5e-a179-4b69-889e-5050d9a81421 req-f0c6a507-439b-4e84-8b73-bfaea4d60445 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.026177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e7c7f5e-a179-4b69-889e-5050d9a81421 req-f0c6a507-439b-4e84-8b73-bfaea4d60445 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.071987 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9e7c7f5e-a179-4b69-889e-5050d9a81421 req-f0c6a507-439b-4e84-8b73-bfaea4d60445 service nova] Creating event network-changed:433ed27d-6106-4c8c-a89b-b30fdaa6ff16 for instance af6e279b-a092-4e0b-8740-2ab3cdd3276e on n-h1-854882-3 Aug 29 15:50:49.083946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9e7c7f5e-a179-4b69-889e-5050d9a81421 req-f0c6a507-439b-4e84-8b73-bfaea4d60445 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099237 Aug 29 15:50:49.087000 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2371/4942] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:49.179439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:49.180497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:49.195669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.196565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.197209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.198228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.201201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.204791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.733516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3e40fdd-4a14-463c-b5dd-74313724f212"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:49.744557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:49.767674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.768502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.768968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.771612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.772107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.772550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.864661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:50.380158 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ecec8b09-4f00-4b7d-be5f-553de5577519 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "POST /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652588 Aug 29 15:50:50.389166 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2372/4943] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 15:50:49 2022] POST /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 194 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:50.404014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:50.418744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:50.421778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:50.457228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:50.458943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:50.462468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.463565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:50.464773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:50.468639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.584690 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a3890e95-3a4f-4ceb-bb86-21fdb1fb211f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.193589 Aug 29 15:50:50.599468 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2373/4944] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:50 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:50:50.714797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:50.731147 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5438aca5-3841-4640-8fbb-c967cee7a179 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1314 microversion: 2.1 time: 1.558951 Aug 29 15:50:50.744591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2572/4945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:49 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1314 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:51.596950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:51.599962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:51.617037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.617954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.618625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.619560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.621670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.627439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.752376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:51.753149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:51.756098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2f5615a1-f9a6-4255-ad8e-f89a7322e0d3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162684 Aug 29 15:50:51.757770 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2374/4946] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:51 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:50:51.763121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.776179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.777036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.779905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.780630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.783228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.210011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:52.222984 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0d42c091-18a2-41d7-b33c-3528aa874149 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1314 microversion: 2.1 time: 0.471714 Aug 29 15:50:52.226354 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2573/4947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:51 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:52.769264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:52.774483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:52.784982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:52.788892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:52.816152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.816639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.817084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.828465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.829965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.833547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.953239 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e364fe8d-8634-4885-86c1-377feedd830f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182811 Aug 29 15:50:52.959110 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2375/4948] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:52 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:50:53.250346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:53.252000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:53.258727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:53.275789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.276569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.277292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.278438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.278904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.279339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.984527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:53.996993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:54.019267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.024193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.024887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.026108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.027065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.028069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.092752 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f46ca5a2-a59b-4f6e-9615-7ffa343bb4a8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.128975 Aug 29 15:50:54.095523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2376/4949] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:50:53 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:54.122755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:54.135528 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ee7ade8f-27a3-4a62-b320-e289b8ac8799 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1314 microversion: 2.1 time: 0.889148 Aug 29 15:50:54.139564 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2574/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:53 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:54.229141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:54.230967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:54.250268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.254199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.255219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.256343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.259536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.261122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.348565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:54.645245 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b8f819ea-d5b2-4a1f-80d8-79d3f4dd43e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 204 len: 0 microversion: 2.20 time: 0.420988 Aug 29 15:50:54.649843 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2377/4951] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:50:54 2022] DELETE /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:50:54.658293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:54.659752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:54.680100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.684600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.689216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.692588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.693205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.693875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.159950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:55.162420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:55.186515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.189634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.194232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.195755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.198839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.199779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.224097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:55.236267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:55.241102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:55.244979 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d45cec64-79f8-4191-9592-c9f9d96adc72 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.588916 Aug 29 15:50:55.249162 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2575/4952] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:54 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:50:56.137627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:56.152057 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-000cead1-1711-41f1-bd76-86217c312b9c tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1314 microversion: 2.1 time: 0.999392 Aug 29 15:50:56.158750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2378/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:55 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1314 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:56.269910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:56.271508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:56.286686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.290503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.291348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.292336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.294533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.295984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.077700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:57.090828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:57.094644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:57.096383 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8e21083-22b2-4d00-98db-f25672f2f9a3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 0.831906 Aug 29 15:50:57.097702 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2576/4954] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:56 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:50:57.186031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:57.187556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:57.211908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:57.211908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:57.216890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.219282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:57.221812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:57.222280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.122800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:58.123436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:58.136373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.136873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.137302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.153671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.154436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.161341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.147909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.165650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.167641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.168918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0396795c-68bf-4295-8270-95a8b80e0bd9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 1.050368 Aug 29 15:50:59.169818 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2577/4955] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:50:58 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:50:59.196807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1bd4eb0f-a7e4-4c9b-b469-05f39bf97800 req-356dc6b5-5346-42bf-8408-dee8b051f96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6e279b-a092-4e0b-8740-2ab3cdd3276e", "name": "network-vif-plugged", "status": "completed", "tag": "433ed27d-6106-4c8c-a89b-b30fdaa6ff16"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:59.248654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1bd4eb0f-a7e4-4c9b-b469-05f39bf97800 req-356dc6b5-5346-42bf-8408-dee8b051f96e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.261312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1bd4eb0f-a7e4-4c9b-b469-05f39bf97800 req-356dc6b5-5346-42bf-8408-dee8b051f96e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.264083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1bd4eb0f-a7e4-4c9b-b469-05f39bf97800 req-356dc6b5-5346-42bf-8408-dee8b051f96e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.297454 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1bd4eb0f-a7e4-4c9b-b469-05f39bf97800 req-356dc6b5-5346-42bf-8408-dee8b051f96e service nova] Creating event network-vif-plugged:433ed27d-6106-4c8c-a89b-b30fdaa6ff16 for instance af6e279b-a092-4e0b-8740-2ab3cdd3276e on n-h1-854882-3 Aug 29 15:50:59.308802 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1bd4eb0f-a7e4-4c9b-b469-05f39bf97800 req-356dc6b5-5346-42bf-8408-dee8b051f96e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137741 Aug 29 15:50:59.323567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2578/4956] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:59.683913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.702402 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4ade9fbd-5713-4aa9-8ed4-f1df56756715 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1314 microversion: 2.1 time: 2.522604 Aug 29 15:50:59.730299 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2379/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:57 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1314 bytes in 2553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:00.209470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.210195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.240707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.241221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.241693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.250368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.251617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.252085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.735914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.736519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.794731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.808518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.808962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.809749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.810212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.810643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.449370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.517478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.520981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.530660 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0bbadf35-ff74-44ae-8054-47fd17220c03 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1722 microversion: 2.20 time: 2.336567 Aug 29 15:51:02.565766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.567899 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2579/4958] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:00 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1722 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:51:02.571532 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5352576c-db19-4e1e-a88c-f868749c2f25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1314 microversion: 2.1 time: 1.839355 Aug 29 15:51:02.589339 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2380/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:00 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1314 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:02.608262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fcad8ef2-f0a5-48eb-9425-86420566fa86 req-fd0e2279-2fda-4da0-b09d-0b3a6d3e4eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "name": "network-vif-unplugged", "status": "completed", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:02.643808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fcad8ef2-f0a5-48eb-9425-86420566fa86 req-fd0e2279-2fda-4da0-b09d-0b3a6d3e4eb4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.656448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fcad8ef2-f0a5-48eb-9425-86420566fa86 req-fd0e2279-2fda-4da0-b09d-0b3a6d3e4eb4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.657538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fcad8ef2-f0a5-48eb-9425-86420566fa86 req-fd0e2279-2fda-4da0-b09d-0b3a6d3e4eb4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.709847 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fcad8ef2-f0a5-48eb-9425-86420566fa86 req-fd0e2279-2fda-4da0-b09d-0b3a6d3e4eb4 service nova] Creating event network-vif-unplugged:089534cd-a1fd-4322-a9bd-4aef2c5a4503 for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 on n-h1-854882-3 Aug 29 15:51:02.740079 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fcad8ef2-f0a5-48eb-9425-86420566fa86 req-fd0e2279-2fda-4da0-b09d-0b3a6d3e4eb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169753 Aug 29 15:51:02.741148 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2580/4960] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:03.260661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4fbced57-c5e8-41c9-a81a-e55fb8ce0027 req-487b9512-8269-4840-9e80-e49a07e6bc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a32f1-7b0f-4f11-86c2-ef0f2b561055", "name": "network-vif-deleted", "tag": "089534cd-a1fd-4322-a9bd-4aef2c5a4503"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:03.333306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4fbced57-c5e8-41c9-a81a-e55fb8ce0027 req-487b9512-8269-4840-9e80-e49a07e6bc8c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.345861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4fbced57-c5e8-41c9-a81a-e55fb8ce0027 req-487b9512-8269-4840-9e80-e49a07e6bc8c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.347142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4fbced57-c5e8-41c9-a81a-e55fb8ce0027 req-487b9512-8269-4840-9e80-e49a07e6bc8c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.423352 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4fbced57-c5e8-41c9-a81a-e55fb8ce0027 req-487b9512-8269-4840-9e80-e49a07e6bc8c service nova] Creating event network-vif-deleted:089534cd-a1fd-4322-a9bd-4aef2c5a4503 for instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 on n-h1-854882-3 Aug 29 15:51:03.447980 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4fbced57-c5e8-41c9-a81a-e55fb8ce0027 req-487b9512-8269-4840-9e80-e49a07e6bc8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200829 Aug 29 15:51:03.465251 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2381/4961] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:03.599746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:03.600684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:03.602140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:03.603320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:03.626803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.630128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.631146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.632306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.635063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.636025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.636731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.638914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.644764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.658403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.665896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.666610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.850419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.852840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.853367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.855368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lazy-loading 'fault' on Instance uuid cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:04.612704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.630784 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-61a0427f-5c49-450e-b5ec-dfe9cf24453d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1501 microversion: 2.1 time: 1.038124 Aug 29 15:51:04.637364 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2382/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:03 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1501 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:04.657738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:04.676417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:04.692227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.692784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.693222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.696650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.697145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.697618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.770303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.787026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.792133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.799588 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b5819b3-ca0c-4ccd-9206-b30f1e1b1c5d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 200 len: 1371 microversion: 2.20 time: 1.213457 Aug 29 15:51:04.809173 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2581/4963] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:03 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 1371 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:05.589676 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.network.security_group_api [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Removing security group 037c2794-7ba8-4f18-a560-ec9852b5a7c3 from port 433ed27d-6106-4c8c-a89b-b30fdaa6ff16 Aug 29 15:51:05.857764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:05.858312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:05.879713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.880227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.880735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.881501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.881969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.882402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.929565 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] HTTP exception thrown: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Request method failure captured: Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 HTTP/1.1 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN91lcBNCzBblCXc3866CJSekRHuCrSaAHxk2cKdDYCvk9DRvFj6WNu3HE4PfAD2fEfA9-PK7Zf_f85pU_5awLuKMsfj01cnScMPt8J9Q1SiCFt-2-MJOpczyXr7Q4afG935QqXvo3mrMPrKQWMivvBPEcgYNgGKN7xrxyuHIna91Aw Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da6f1599da704dbc9ec86f3638638bba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}] Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: dc8f7bc05b984ea0a3d96aea8a65d139 Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'cc6a32f1-7b0f-4f11-86c2-ef0f2b561055'} Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:05.931308 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Returning 404 to user: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:05.936818 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-672281d8-35d5-4905-821d-44f391c5c0f6 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 404 len: 111 microversion: 2.20 time: 0.079208 Aug 29 15:51:05.942613 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2582/4964] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:05 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:51:05.957426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8432d322-f7e6-47f2-9c01-aa82c13c2609 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '.version_select at 0x7fb0eb5b9dc0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:05.995336 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8432d322-f7e6-47f2-9c01-aa82c13c2609 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680339133" status: 204 len: 0 microversion: 2.20 time: 0.051435 Aug 29 15:51:05.996271 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2583/4965] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Aug 29 15:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680339133 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:06.775230 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ae20f82a-9763-49da-94cd-abe3aba99a19 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e/action" status: 202 len: 0 microversion: 2.1 time: 2.121597 Aug 29 15:51:06.775866 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2383/4966] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:04 2022] POST /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e/action => generated 0 bytes in 2123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:06.787795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:06.788688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:06.807781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.808782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.811102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.814141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.814823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.815436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.831822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-909486af-0708-4f8a-825e-5298555488d0 req-3fdf7ccd-262f-4e25-a7d3-7da069c55cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6e279b-a092-4e0b-8740-2ab3cdd3276e", "tag": "433ed27d-6106-4c8c-a89b-b30fdaa6ff16"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:06.870460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-909486af-0708-4f8a-825e-5298555488d0 req-3fdf7ccd-262f-4e25-a7d3-7da069c55cac service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.873276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-909486af-0708-4f8a-825e-5298555488d0 req-3fdf7ccd-262f-4e25-a7d3-7da069c55cac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.876015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-909486af-0708-4f8a-825e-5298555488d0 req-3fdf7ccd-262f-4e25-a7d3-7da069c55cac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.926421 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-909486af-0708-4f8a-825e-5298555488d0 req-3fdf7ccd-262f-4e25-a7d3-7da069c55cac service nova] Creating event network-changed:433ed27d-6106-4c8c-a89b-b30fdaa6ff16 for instance af6e279b-a092-4e0b-8740-2ab3cdd3276e on n-h1-854882-3 Aug 29 15:51:06.941327 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-909486af-0708-4f8a-825e-5298555488d0 req-3fdf7ccd-262f-4e25-a7d3-7da069c55cac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113678 Aug 29 15:51:06.943845 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2384/4967] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:07.436788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:07.477678 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c5b4622-42ab-48a5-b0e6-224ee063e968 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1459 microversion: 2.1 time: 0.673889 Aug 29 15:51:07.485806 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2584/4968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:06 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1459 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:07.515456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.516730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:07.549071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.559310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.560168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.561038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.561597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.562035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.554576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3144bc5a-9048-4322-9123-800aaa83232d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'create', calling method: .version_select at 0x7fb0e26f6e50>, body: {"keypair": {"name": "tempest-keypair-662936836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvpRmvy92PJG8F16vdSCOTurKOYfzWNq5nxF2mg1gQ3TuM0IZi6opN+SnCUPbs4qMOJ+H4mwvLdpzhUWZCTpWzd8SB2/WB2WxMG4nHVvLSFBsBF8Z/7z/uJTrhV0MKP9w=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:08.589892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:08.608655 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ed6e5de-56dd-46bc-8e95-234d28c8912a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.097761 Aug 29 15:51:08.614618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3144bc5a-9048-4322-9123-800aaa83232d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for project da6f1599da704dbc9ec86f3638638bba. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:08.616326 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2385/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:08.646390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3144bc5a-9048-4322-9123-800aaa83232d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for user dc8f7bc05b984ea0a3d96aea8a65d139 and project da6f1599da704dbc9ec86f3638638bba. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:08.655273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.656689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:08.669071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.673485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.674154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.675066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.675716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.676322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.713637 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3144bc5a-9048-4322-9123-800aaa83232d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.168011 Aug 29 15:51:08.725621 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2585/4970] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:51:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:51:09.416747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:09.430019 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df26595f-4894-41cf-9e85-de9d3fdb5fa1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.781557 Aug 29 15:51:09.447643 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2386/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:09.465231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.465911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:09.480306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.480840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.481295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.482091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.482549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.482981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.213732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:10.242509 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9bec37b-527a-4b27-a967-9575afa7fe62 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.778046 Aug 29 15:51:10.246210 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2586/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:09 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:10.268901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:10.269796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:10.288939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.290339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.302155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.303747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.304753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.305918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.605652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:10.624756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:10.643754 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d97e9c3a-6e5e-47c3-82d0-31889dbf3d7d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.375287 Aug 29 15:51:10.655034 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2387/4973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:10 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:10.905892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1847611322", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "495c919e-8bb9-4e7e-b31f-e6fe4e50e138"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:11.093647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] validate_networks() for [('495c919e-8bb9-4e7e-b31f-e6fe4e50e138', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:11.255285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:11.257942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:11.292631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.294053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.297587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.298466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.300632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.303806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.492740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lazy-loading 'services' on Instance uuid ddafa5bf-2080-4bd6-b998-c4ee781d6af3 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:11.704757 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a571de1-0452-42cd-9b5b-579215393bb9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments/c3e40fdd-4a14-463c-b5dd-74313724f212" status: 202 len: 0 microversion: 2.1 time: 0.458579 Aug 29 15:51:11.714264 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2388/4974] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 15:51:11 2022] DELETE /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments/c3e40fdd-4a14-463c-b5dd-74313724f212 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:11.731118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:11.733782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:11.755081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.756484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.757118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.758214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.760749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.762505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.904533 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a81fcc9-12e5-405f-b441-26c6c0f4df71 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187811 Aug 29 15:51:11.906342 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2389/4975] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:11 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:12.922767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:12.929742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:12.968773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.978071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.979793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.980869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.981610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.982277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.052579 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-51dca3db-964c-4c9a-a465-b46eb580a24d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136927 Aug 29 15:51:13.054503 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2390/4976] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:12 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:13.738084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-161851600", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "86de6d9b-4157-4912-aa79-99d8b87fc1d1"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:13.812242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] validate_networks() for [('86de6d9b-4157-4912-aa79-99d8b87fc1d1', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:14.548051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:14.548608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:14.549065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:14.549535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:14.549958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:14.579316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.579823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.580263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.580997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.593426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.593898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.696641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:14.719915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Getting quotas for user a68002795ce541338b30129e6dbb0fb6 and project 2c147d42182146409a91f2e0359f2e98. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:14.774263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:14.778060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:14.905586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bd02acbf-ed19-4f25-bfcb-9d078246f63d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.006853 Aug 29 15:51:14.906697 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2587/4977] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:14.912085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:14.922434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:14.936537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.937038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.937509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.940805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.941798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.944703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.026572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5d2ac970-f1bc-42e9-a51e-28751800628a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118198 Aug 29 15:51:15.033467 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2588/4978] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:14 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:15.039460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1916244984", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec5ed8da-bbeb-4b6c-bc3f-bffa573d8e89"}], "security_groups": [{"name": "tempest-securitygroup--1052402505"}], "key_name": "tempest-keypair-662936836", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:15.058301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:15.058899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:15.059580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:15.060003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:15.060422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:15.095988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.097173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.097877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.099980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.101146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.101948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.157488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Getting quotas for project 571cec2b4f7f48a0ac319b4f44319935. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:15.165560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Getting quotas for user 9b302183018f4d44b7cfbd8b1b6c1cc6 and project 571cec2b4f7f48a0ac319b4f44319935. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:15.182630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:15.186138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:15.252933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67873ee6-9ec1-4e0c-8852-fa2ab72a6257 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741570 Aug 29 15:51:15.254692 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2391/4979] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:15.260930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fafd761e-7967-4906-8ce9-92f296dfa4b3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.262143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fafd761e-7967-4906-8ce9-92f296dfa4b3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.581801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fafd761e-7967-4906-8ce9-92f296dfa4b3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.593537 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fafd761e-7967-4906-8ce9-92f296dfa4b3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1215 microversion: 2.1 time: 0.336230 Aug 29 15:51:15.598865 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2392/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:15.638688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] validate_networks() for [('ec5ed8da-bbeb-4b6c-bc3f-bffa573d8e89', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:15.643255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5389177-9ac7-4d95-acd9-79ba1d19ccbf tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.643882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5389177-9ac7-4d95-acd9-79ba1d19ccbf tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.848766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b5389177-9ac7-4d95-acd9-79ba1d19ccbf tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.857317 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5389177-9ac7-4d95-acd9-79ba1d19ccbf tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1224 microversion: 2.1 time: 0.237250 Aug 29 15:51:15.860380 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2393/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1224 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:16.039089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:16.042121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:16.096728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.097467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.097467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.098123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.098582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.098996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.212243 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-23bcef94-3f67-4419-a47e-0158152ce201 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176685 Aug 29 15:51:16.217721 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2394/4982] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:16 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:16.620592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:16.622235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:16.647932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.648592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.649082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.651310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.652083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.653573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.861415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:17.010678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.020115 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be388380-5bfb-4824-af05-a84ebc840ac5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1267 microversion: 2.1 time: 0.404986 Aug 29 15:51:17.026600 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2395/4983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:16 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1267 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:17.045525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:17.046388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:17.091342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.099527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.105672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.114094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.114614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.125229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.722303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:17.722711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:17.723487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:17.724145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:17.724762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:17.746711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.757538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.759369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.760485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.761947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.764388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.805043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:17.850380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for project da6f1599da704dbc9ec86f3638638bba. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:17.867738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Getting quotas for user dc8f7bc05b984ea0a3d96aea8a65d139 and project da6f1599da704dbc9ec86f3638638bba. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:17.899698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.909849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:17.916041 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cafb68e-3592-4f19-958d-68612d3f40f1 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1276 microversion: 2.1 time: 0.878577 Aug 29 15:51:17.917523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2396/4984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:17 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1276 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:17.929923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:17.934843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:17.937173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:17.978546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.997737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.998396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.999163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.999653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.000064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.070375 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c5d0424e-4395-436a-879d-3a635a0c2a21 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.035487 Aug 29 15:51:18.081445 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2589/4985] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:51:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 3047 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:51:18.102200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:18.103255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.128024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.131736 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-46e5aaed-1006-4f0c-baf2-ff329cbdc7b1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202528 Aug 29 15:51:18.136106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.136871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.139053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.140477 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2397/4986] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:17 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:18.142192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.144365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.147725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8abaf5b8-4f87-48e6-83b3-f8ff7d8ffccd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:18.148465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8abaf5b8-4f87-48e6-83b3-f8ff7d8ffccd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.408613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8abaf5b8-4f87-48e6-83b3-f8ff7d8ffccd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:18.417326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8abaf5b8-4f87-48e6-83b3-f8ff7d8ffccd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:18.427460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8abaf5b8-4f87-48e6-83b3-f8ff7d8ffccd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:18.428601 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8abaf5b8-4f87-48e6-83b3-f8ff7d8ffccd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1281 microversion: 2.20 time: 0.287080 Aug 29 15:51:18.447358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:18.455502 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-88749c4c-999c-467a-8b03-f98024f74b07 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1273 microversion: 2.1 time: 0.370661 Aug 29 15:51:18.456541 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2398/4987] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:18 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1281 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:18.465340 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2590/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:18 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:18.946306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:18.947204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.961111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.967232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.967959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.968886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.971164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.971760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.152656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.155431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.206015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.206534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.206980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.207818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.208276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.208729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.324335 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-faed8f12-ff59-476b-8694-6740f8760f2c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176042 Aug 29 15:51:19.324945 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2591/4989] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:19 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:19.466120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.467407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.479042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.482063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.482819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.485510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.487308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.489410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.590148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.611353 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e317bfc9-ad5b-452f-8794-d2a5fade845b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1282 microversion: 2.1 time: 0.662924 Aug 29 15:51:19.612787 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2399/4990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:18 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1282 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:19.618469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.624150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.662420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.663253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.666170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.667282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.671963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.673376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.738940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.762176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.764619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.769731 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4875c9bc-3556-4595-be7c-5ca6009c55c2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1277 microversion: 2.20 time: 0.315091 Aug 29 15:51:19.788710 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2592/4991] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:19 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:19.879359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.906930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f5aabb27-4505-4b6b-a418-69f28b616f02 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1273 microversion: 2.1 time: 0.290756 Aug 29 15:51:19.910790 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2400/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:19 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:20.336507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:20.339372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:20.368794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.370062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.373027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.374052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.379791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.384072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.500983 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-82cd1af1-85d9-47e6-b251-9bd6e1a3fc84 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168108 Aug 29 15:51:20.501624 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2593/4993] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:20 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:20.633152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:20.634860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:20.640127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:20.654188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.658095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.658547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.660971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.666048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.666507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.797069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:20.798302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:20.808974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.809759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.814019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.815075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.815983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.816590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.068805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.080723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.082539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.083822 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08df57b4-0540-43bb-879e-b2b46ec85f4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1339 microversion: 2.20 time: 0.291282 Aug 29 15:51:21.106462 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2594/4994] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:20 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1339 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:51:21.119489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:21.120330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:21.135513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.137283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.143667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.145145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.146891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.147553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.455565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.463478 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-054ca9e2-63e1-4004-986d-855ade49ca48 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1282 microversion: 2.1 time: 0.835084 Aug 29 15:51:21.485821 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2401/4995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:20 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1282 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:21.515126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:21.518208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:21.531115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.532149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.532801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.533750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.538491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.539237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.606472 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef6034bf-0bbe-4042-aa07-e648c52700e2 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097220 Aug 29 15:51:21.613802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2402/4996] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:21 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:21.709507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.723326 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1571f45b-0093-4c60-aaa2-cfcac5223a33 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1273 microversion: 2.1 time: 0.615282 Aug 29 15:51:21.725201 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2595/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:21 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1273 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:22.123793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:22.126036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:22.148202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.148922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.149426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.150190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.150645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.151108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.485371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:22.486871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:22.499276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.510528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.511410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.512289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.512902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.517031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.719998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.733153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.736079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.739138 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d94afbaf-2fdb-4f15-b182-c09925e39603 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1339 microversion: 2.20 time: 0.618999 Aug 29 15:51:22.742819 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2403/4998] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:22 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1339 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:22.753927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:22.758201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:22.767651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.768647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.769365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.770443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.772332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.772950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.829145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d61214a5-6d58-4132-969a-2b3d03111f47 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084370 Aug 29 15:51:22.835546 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2404/4999] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:22 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:22.842301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:22.843200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:22.861621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.862415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.863019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.864587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.865208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.866046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.296644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:23.319913 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6be3b78f-2c06-404b-9e3f-a59abd090748 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1324 microversion: 2.1 time: 0.830623 Aug 29 15:51:23.320740 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2596/5000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:22 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1324 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:23.723411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:23.738830 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-186374e5-10a8-4416-a50c-64b4bbb051cf tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 0.901784 Aug 29 15:51:23.742382 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2405/5001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:22 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:23.766388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.767416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:23.781140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.784455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.785184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.786252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.788314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.789062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.842812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.845848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:23.862283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.865971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.868171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.877520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.887722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.888295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.958824 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6df421aa-da60-4389-8d28-8eb96ad8835b tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120027 Aug 29 15:51:23.970557 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2406/5002] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:23.990347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.004220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.006966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.012446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6a667d36-f39c-4423-b65d-1c2467dca6ea tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1339 microversion: 2.20 time: 0.251608 Aug 29 15:51:24.025887 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2597/5003] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1339 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:24.343403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:24.344674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:24.351588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.352519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.353183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.354114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.354853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.355524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.385684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:24.774661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:24.775981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:24.791646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.792686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.793353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.794678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.795369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.796109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.932026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.948384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-90c141e3-3232-4a42-836b-b06e202bdc8f tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1324 microversion: 2.1 time: 0.608794 Aug 29 15:51:24.950580 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2407/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:24 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1324 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:24.960669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2886805d-59c5-4e0f-a6ae-79f00be4384e req-2334c21c-fdca-45cb-afa1-5d83b2e8bdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb", "tag": "56e6747c-d82e-4b01-b23c-9c1b2cbed055"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:24.978856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2886805d-59c5-4e0f-a6ae-79f00be4384e req-2334c21c-fdca-45cb-afa1-5d83b2e8bdb8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.979648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2886805d-59c5-4e0f-a6ae-79f00be4384e req-2334c21c-fdca-45cb-afa1-5d83b2e8bdb8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.980747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2886805d-59c5-4e0f-a6ae-79f00be4384e req-2334c21c-fdca-45cb-afa1-5d83b2e8bdb8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.997873 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2886805d-59c5-4e0f-a6ae-79f00be4384e req-2334c21c-fdca-45cb-afa1-5d83b2e8bdb8 service nova] Creating event network-changed:56e6747c-d82e-4b01-b23c-9c1b2cbed055 for instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb on n-h2-854882-3 Aug 29 15:51:25.008052 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2886805d-59c5-4e0f-a6ae-79f00be4384e req-2334c21c-fdca-45cb-afa1-5d83b2e8bdb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054464 Aug 29 15:51:25.009963 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2408/5005] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:25.024261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.027223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.054547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.054547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.054547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.054547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.054547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.054547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.118714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:25.128853 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ffaef38a-b88e-4dd6-9fe3-f1576f6cde5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116798 Aug 29 15:51:25.131013 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2409/5006] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:51:25.144216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.145380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.161098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.163975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.165238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.167425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.168138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.169002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.455265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.466082 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bfb5222d-8b9b-422b-822e-eef19d0775f6 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 0.706242 Aug 29 15:51:25.470602 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2598/5007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:24 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:25.475648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.482175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.505767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.506775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.507330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.508171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.508746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.509286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.569972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:25.768336 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eb33058b-98c5-45b2-a20b-e1c46088e5cb tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 204 len: 0 microversion: 2.1 time: 0.296090 Aug 29 15:51:25.769374 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2599/5008] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:25 2022] DELETE /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:25.779247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.780689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.800260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.800805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.801195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.802018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.802582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.816660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.267794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.280734 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6bf07e39-396a-4186-a6f5-1dffa9abd549 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1678 microversion: 2.1 time: 0.506108 Aug 29 15:51:26.298912 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2600/5009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1678 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:26.308414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.309403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.323297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.324059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.324780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.325692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.326310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.332710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.471003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.483666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.486150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.488166 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b1da386f-4a6b-4f8d-b1de-f1bb21863403 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 1.354699 Aug 29 15:51:26.488973 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2410/5010] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:26.518897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.524736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.553345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.554403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.555113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.556302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.557366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.558134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.923885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.934524 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-418462aa-cddb-498b-ace9-01c6c98114d9 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1324 microversion: 2.1 time: 0.633600 Aug 29 15:51:26.937251 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2601/5011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:26 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1324 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:27.142000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-992a7355-8518-457c-9745-a224bee8931e req-6725000d-be0f-491f-9f10-a85ec29e7ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc15443-a874-4743-a4f2-ede41cede91c", "tag": "c1e73542-0832-4ea3-bff9-67b47129aad5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:27.161377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:27.166303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-992a7355-8518-457c-9745-a224bee8931e req-6725000d-be0f-491f-9f10-a85ec29e7ebc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.169245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-992a7355-8518-457c-9745-a224bee8931e req-6725000d-be0f-491f-9f10-a85ec29e7ebc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.169669 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58a4a645-0c64-40ca-a1b1-b0e757062c49 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 0.673767 Aug 29 15:51:27.170268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-992a7355-8518-457c-9745-a224bee8931e req-6725000d-be0f-491f-9f10-a85ec29e7ebc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.172786 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2411/5012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:26 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:27.212159 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-992a7355-8518-457c-9745-a224bee8931e req-6725000d-be0f-491f-9f10-a85ec29e7ebc service nova] Creating event network-changed:c1e73542-0832-4ea3-bff9-67b47129aad5 for instance fbc15443-a874-4743-a4f2-ede41cede91c on n-h2-854882-3 Aug 29 15:51:27.235202 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-992a7355-8518-457c-9745-a224bee8931e req-6725000d-be0f-491f-9f10-a85ec29e7ebc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097351 Aug 29 15:51:27.235834 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2602/5013] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:27.313985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:27.315360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:27.330683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.335007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.335726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.337812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.339597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.340130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.512020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:27.512745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:27.529180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.529688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.530134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.530853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.531837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.532277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.805591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:27.891737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=16 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:28.018232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.028286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3d9dee6b-7bb2-4ad0-b728-36ff75cd1145 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1678 microversion: 2.1 time: 0.722197 Aug 29 15:51:28.049637 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2412/5014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:27 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1678 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:28.063964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.070020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.099053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.099619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.100095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.100852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.101336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.101802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.167361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.200112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.205214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.208927 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8048ef9-1284-48c6-a2a1-5c99d1abb9c5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 0.701129 Aug 29 15:51:28.225322 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2603/5015] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:27 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:51:28.232065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.233019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.249763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.251653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.252606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.254490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.255230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.256675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.416767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=12 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:28.462513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.474292 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eec93d17-0b16-4f17-8424-b8bd1104bf4c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1324 microversion: 2.1 time: 0.423327 Aug 29 15:51:28.496407 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2413/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:29.052786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.053442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.064405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.064891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.065322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.073122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.077353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.077895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.239655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:29.267884 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e42ca882-0c51-4429-adb5-10bafa1b2b0e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 1.030660 Aug 29 15:51:29.269107 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2604/5017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:29.274624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.274949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.288284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.288781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.289321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.290253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.290807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.291373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.324672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:30.081566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.095587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.111301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.115395 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f181afa1-f057-44f9-9415-cbc4ff4abc4c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 0.845042 Aug 29 15:51:30.119614 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2605/5018] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:29 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:30.140262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.140936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.163201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.163333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.163771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.164502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.165176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.165810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.184104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.197841 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-103c7f15-76ed-4153-87bd-e216040a4228 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1678 microversion: 2.1 time: 1.146146 Aug 29 15:51:30.201740 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2414/5019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:29 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1678 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:30.293152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.293958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.306643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.321732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.327901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.330843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.333460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.335162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.847076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.865291 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2dc0c81-ab7a-463d-85eb-5a1b1308f348 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1324 microversion: 2.1 time: 0.740745 Aug 29 15:51:30.878572 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2606/5020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1324 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:30.890393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-19b00310-afba-423c-bc7d-6a8e398e7633 req-a2ab9ba2-684d-4f51-b53e-615136daa70c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:30.907448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.918128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-33df4046-47d1-49d3-a658-5e537a478605 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 0.630136 Aug 29 15:51:30.924264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-19b00310-afba-423c-bc7d-6a8e398e7633 req-a2ab9ba2-684d-4f51-b53e-615136daa70c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.925543 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2415/5021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:30.926767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-19b00310-afba-423c-bc7d-6a8e398e7633 req-a2ab9ba2-684d-4f51-b53e-615136daa70c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.938087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-19b00310-afba-423c-bc7d-6a8e398e7633 req-a2ab9ba2-684d-4f51-b53e-615136daa70c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.973995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-19b00310-afba-423c-bc7d-6a8e398e7633 req-a2ab9ba2-684d-4f51-b53e-615136daa70c service nova] Creating event network-changed:81fb5f09-4b24-46e4-b6cd-b0488f3dfb25 for instance cc738f5e-e78a-4030-9027-b69a1df31032 on n-h1-854882-3 Aug 29 15:51:30.993794 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-19b00310-afba-423c-bc7d-6a8e398e7633 req-a2ab9ba2-684d-4f51-b53e-615136daa70c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113289 Aug 29 15:51:31.005014 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2607/5022] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:31.148992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.149316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.163665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.164694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.166194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.167889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.176860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.177611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.224874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.225897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.246546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.247653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.249537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.251282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.258129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.259699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.390309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.409129 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c72346fc-a5f3-4b48-a861-2fea8c6f0f6c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1611 microversion: 2.1 time: 0.186912 Aug 29 15:51:31.412107 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2608/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1611 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:31.899570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.901730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.921750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.922930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.923666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.924793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.925561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.926264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.133689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:32.164199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:32.183121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:32.189816 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-091a2865-a045-47e7-a865-04b7587ab892 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 1.042639 Aug 29 15:51:32.191376 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2416/5024] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:32.206975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:32.210465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.226634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.228284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.229344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.230421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.231069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.233287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.990116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.001514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.004364 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e317b6b9-b63f-48b2-9e24-fecec8f94a86 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1324 microversion: 2.1 time: 1.107444 Aug 29 15:51:33.005839 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2609/5025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1324 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:33.018605 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d9b2b6c5-54cc-4173-a600-f6126b5a8c26 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 0.820668 Aug 29 15:51:33.031813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2417/5026] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:32 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:33.038100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:33.039347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:33.046045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1b5bca46-57b2-497d-8601-de9c88ddd806 req-e42aeb33-cb2d-4a12-b1be-6bc69b78a01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb", "name": "network-vif-plugged", "status": "completed", "tag": "56e6747c-d82e-4b01-b23c-9c1b2cbed055"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:33.059124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.061539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.062375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.064891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.066751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.067470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.074332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1b5bca46-57b2-497d-8601-de9c88ddd806 req-e42aeb33-cb2d-4a12-b1be-6bc69b78a01f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.074896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1b5bca46-57b2-497d-8601-de9c88ddd806 req-e42aeb33-cb2d-4a12-b1be-6bc69b78a01f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.075338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1b5bca46-57b2-497d-8601-de9c88ddd806 req-e42aeb33-cb2d-4a12-b1be-6bc69b78a01f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.133735 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1b5bca46-57b2-497d-8601-de9c88ddd806 req-e42aeb33-cb2d-4a12-b1be-6bc69b78a01f service nova] Creating event network-vif-plugged:56e6747c-d82e-4b01-b23c-9c1b2cbed055 for instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb on n-h2-854882-3 Aug 29 15:51:33.147904 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1b5bca46-57b2-497d-8601-de9c88ddd806 req-e42aeb33-cb2d-4a12-b1be-6bc69b78a01f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114245 Aug 29 15:51:33.149965 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2418/5027] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:33.226810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:33.227743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:33.237038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.237635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.238132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.238851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.239415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.239831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.451843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.466470 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4d52125-ba06-478b-9f86-8b98e4e0370c tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1611 microversion: 2.1 time: 0.439940 Aug 29 15:51:33.467407 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2610/5028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:33 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1611 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:33.516213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.526100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.527776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.529133 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe983448-e019-46c7-8638-9b30ee3743a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 0.312952 Aug 29 15:51:33.529869 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2419/5029] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:33 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:33.906760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6aee9982-28f0-416a-9a7d-1a009104307c req-ce8875bd-5256-436c-ad5d-d219792e709f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddafa5bf-2080-4bd6-b998-c4ee781d6af3", "name": "network-vif-deleted", "tag": "6b328ae8-a8f9-438a-b39c-7b5cd2a62885"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:33.931400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6aee9982-28f0-416a-9a7d-1a009104307c req-ce8875bd-5256-436c-ad5d-d219792e709f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.932153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6aee9982-28f0-416a-9a7d-1a009104307c req-ce8875bd-5256-436c-ad5d-d219792e709f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.932779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6aee9982-28f0-416a-9a7d-1a009104307c req-ce8875bd-5256-436c-ad5d-d219792e709f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.964984 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6aee9982-28f0-416a-9a7d-1a009104307c req-ce8875bd-5256-436c-ad5d-d219792e709f service nova] Creating event network-vif-deleted:6b328ae8-a8f9-438a-b39c-7b5cd2a62885 for instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 on n-h2-854882-3 Aug 29 15:51:33.976734 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6aee9982-28f0-416a-9a7d-1a009104307c req-ce8875bd-5256-436c-ad5d-d219792e709f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074064 Aug 29 15:51:33.977373 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2611/5030] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:34.026578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.037932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.045266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.050685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.068795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.075237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.082200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.084088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.084799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.088279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.089444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.091010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.091745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.092458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.094261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.094958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.030059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.043437 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85ba8124-3ea2-44fb-a9c7-7cc3e459a939 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 1.010749 Aug 29 15:51:35.050585 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2612/5031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.062256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.070531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.094393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.097287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.097984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.099024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.100037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.101272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.184679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.185349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.186032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.186917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lazy-loading 'fault' on Instance uuid ddafa5bf-2080-4bd6-b998-c4ee781d6af3 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:35.409610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ee130e8e74db88b9b7ffd16ed1bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b20946b0cd4fc3b2289200eb839230', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.427208 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3f71cce-3798-434b-bb64-8b1c35901e5a tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 200 len: 1330 microversion: 2.1 time: 0.375113 Aug 29 15:51:35.432750 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2613/5032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 1330 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.438254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.443653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.461353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.462290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.463255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.464440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.466245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.466934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.691177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.715989 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aaabce11-5673-485f-be27-1b978b8994aa tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1324 microversion: 2.1 time: 1.690807 Aug 29 15:51:35.716650 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2420/5033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1324 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.826323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b2e36d2d-63bb-42a6-92ad-9a49c3dac3c7 req-ae9d7057-4cba-4ffd-a44e-62d9d68284ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc15443-a874-4743-a4f2-ede41cede91c", "name": "network-vif-plugged", "status": "completed", "tag": "c1e73542-0832-4ea3-bff9-67b47129aad5"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:35.846087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.849904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b2e36d2d-63bb-42a6-92ad-9a49c3dac3c7 req-ae9d7057-4cba-4ffd-a44e-62d9d68284ad service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.850897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b2e36d2d-63bb-42a6-92ad-9a49c3dac3c7 req-ae9d7057-4cba-4ffd-a44e-62d9d68284ad service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.852573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b2e36d2d-63bb-42a6-92ad-9a49c3dac3c7 req-ae9d7057-4cba-4ffd-a44e-62d9d68284ad service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.864791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.872602 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b2e36d2d-63bb-42a6-92ad-9a49c3dac3c7 req-ae9d7057-4cba-4ffd-a44e-62d9d68284ad service nova] Creating event network-vif-plugged:c1e73542-0832-4ea3-bff9-67b47129aad5 for instance fbc15443-a874-4743-a4f2-ede41cede91c on n-h2-854882-3 Aug 29 15:51:35.879156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.884422 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1be7770a-8991-4e4b-828a-15a48452a5ba tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 0.449926 Aug 29 15:51:35.891165 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2614/5034] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:35.914389 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b2e36d2d-63bb-42a6-92ad-9a49c3dac3c7 req-ae9d7057-4cba-4ffd-a44e-62d9d68284ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094135 Aug 29 15:51:35.915857 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2421/5035] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:36.078857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.080302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.094477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.096478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.099397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.100571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.101866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.102492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.458983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.460396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.477061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.479531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.480546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.481578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.484049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.487666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.523782 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 HTTP/1.1 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ddafa5bf-2080-4bd6-b998-c4ee781d6af3'} Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:36.533667 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:36.539257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:36.539257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:36.539257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:36.539257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:36.539257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:36.539257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:36.539257 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:36.545523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:36.550034 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-413bbd1f-f58e-46f7-8bfa-4f33f2ea2a5d tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 404 len: 111 microversion: 2.1 time: 0.097965 Aug 29 15:51:36.557379 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2422/5036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:36.573309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-931f678b-3420-41fc-a8fe-e7b714921165 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '.version_select at 0x7fb0e3050670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.668726 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-931f678b-3420-41fc-a8fe-e7b714921165 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630722741" status: 202 len: 0 microversion: 2.1 time: 0.108572 Aug 29 15:51:36.676183 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2423/5037] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:51:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630722741 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:36.738882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.740399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.748631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.750390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.751029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.751907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.752529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.753139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.777198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:36.794857 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b375019f-6433-4d86-aefb-881b29af9260 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1315 microversion: 2.1 time: 0.722579 Aug 29 15:51:36.810021 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2615/5038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:36.917332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.918696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.941316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.943085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.946047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.952719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.954110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.957427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.174618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.182896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8ad31cb-9b15-4c75-adc8-c1ae2d775bee tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1520 microversion: 2.1 time: 0.449052 Aug 29 15:51:37.189218 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2424/5039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:37.213734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.214537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.221566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.230813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.231485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.232451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.233092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.233737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.293240 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] HTTP exception thrown: Instance is not a member of specified network Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Request method failure captured: Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb/ips/invalid HTTP/1.1 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOBxk99azeNp4Z6tU-bMeDT6237pYd5TgG8eLkjb_Dt38BaAK4nlvKpAKVE_s1GWLuRvnrLkKZT4ovDyaHI8M__BorMctm2VeQFH9qU3MVBsGDfvV7L9BZox1xBwsdamowUG0Y8aQOlac60C76Ts1ndHZAngmJnjOPh0iDLyjfCGzp8 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 571cec2b4f7f48a0ac319b4f44319935 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/571cec2b4f7f48a0ac319b4f44319935"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/571cec2b4f7f48a0ac319b4f44319935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_571cec2b4f7f48a0ac319b4f44319935", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/571cec2b4f7f48a0ac319b4f44319935"}]}] Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 571cec2b4f7f48a0ac319b4f44319935 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerAddressesNegativeTestJSON-1087370484-project Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 9b302183018f4d44b7cfbd8b1b6c1cc6 Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1087370484-project Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance is not a member of specified network Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': '4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb', 'id': 'invalid'} Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 29 15:51:37.302182 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.306315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Returning 404 to user: Instance is not a member of specified network {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:37.306315 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-35c873ed-6ff4-47cb-a862-d7b1b04afa1c tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.094195 Aug 29 15:51:37.306315 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2425/5040] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb/ips/invalid => generated 91 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:51:37.331798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd06cd23-1d77-4781-a9fd-1e7883e08b05 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.333918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd06cd23-1d77-4781-a9fd-1e7883e08b05 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Failed to fetch instance by id 999 {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:51:37.336884 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-bd06cd23-1d77-4781-a9fd-1e7883e08b05 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] HTTP exception thrown: Instance 999 could not be found. Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd06cd23-1d77-4781-a9fd-1e7883e08b05 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Request method failure captured: Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOBxk99azeNp4Z6tU-bMeDT6237pYd5TgG8eLkjb_Dt38BaAK4nlvKpAKVE_s1GWLuRvnrLkKZT4ovDyaHI8M__BorMctm2VeQFH9qU3MVBsGDfvV7L9BZox1xBwsdamowUG0Y8aQOlac60C76Ts1ndHZAngmJnjOPh0iDLyjfCGzp8 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 571cec2b4f7f48a0ac319b4f44319935 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/571cec2b4f7f48a0ac319b4f44319935"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/571cec2b4f7f48a0ac319b4f44319935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_571cec2b4f7f48a0ac319b4f44319935", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/571cec2b4f7f48a0ac319b4f44319935"}]}] Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 571cec2b4f7f48a0ac319b4f44319935 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerAddressesNegativeTestJSON-1087370484-project Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 9b302183018f4d44b7cfbd8b1b6c1cc6 Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1087370484-project Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 999 could not be found. Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': '999'} Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 15:51:37.340767 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:37.345989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd06cd23-1d77-4781-a9fd-1e7883e08b05 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Returning 404 to user: Instance 999 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:37.361272 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd06cd23-1d77-4781-a9fd-1e7883e08b05 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.032369 Aug 29 15:51:37.373015 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2426/5041] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:51:37.380988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.381841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.396121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.397404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.399588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.401953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.402654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.404543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.473322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:37.478333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.499758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.510071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.512791 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6c3e0af0-8697-429c-aedb-5ad28ae58758 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 0.600330 Aug 29 15:51:37.537040 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2616/5042] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:37.567630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:37.661857 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36915c78-a78e-4540-8d4a-3e75c0103e46 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 204 len: 0 microversion: 2.1 time: 0.287398 Aug 29 15:51:37.662794 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2427/5043] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:37 2022] DELETE /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:37.675336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.676449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.703861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.706959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.709136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.714019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.715244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.716984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.816385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.817961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.830260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.831043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.831664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.832554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.834253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.834858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.296135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.308612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8158ccbe-70e6-432c-849a-74055012bf29 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1526 microversion: 2.1 time: 0.638511 Aug 29 15:51:38.310083 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2617/5044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1526 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:38.545059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:38.546342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.562969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.563501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.563943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.564657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.565110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.565565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.780495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.794948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ed68d37-4822-4852-a629-84dc6f0525cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1503 microversion: 2.1 time: 0.982471 Aug 29 15:51:38.795796 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2428/5045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1503 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:38.819041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:38.820332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.830957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.831763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.832424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.833348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.846145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.846932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.008684 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f10d3a96-1bb8-4c90-be1f-d6882f220114 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c/action" status: 202 len: 0 microversion: 2.1 time: 0.193197 Aug 29 15:51:39.009735 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2429/5046] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:38 2022] POST /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:51:39.028636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-23e24328-3848-40ff-871c-47acf55845ef req-d937c958-e5d1-4147-b721-a175251a2ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "name": "network-vif-plugged", "status": "completed", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:39.049856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-23e24328-3848-40ff-871c-47acf55845ef req-d937c958-e5d1-4147-b721-a175251a2ec5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.050343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-23e24328-3848-40ff-871c-47acf55845ef req-d937c958-e5d1-4147-b721-a175251a2ec5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.050779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-23e24328-3848-40ff-871c-47acf55845ef req-d937c958-e5d1-4147-b721-a175251a2ec5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.081326 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-23e24328-3848-40ff-871c-47acf55845ef req-d937c958-e5d1-4147-b721-a175251a2ec5 service nova] Creating event network-vif-plugged:81fb5f09-4b24-46e4-b6cd-b0488f3dfb25 for instance cc738f5e-e78a-4030-9027-b69a1df31032 on n-h1-854882-3 Aug 29 15:51:39.108705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-23e24328-3848-40ff-871c-47acf55845ef req-d937c958-e5d1-4147-b721-a175251a2ec5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097477 Aug 29 15:51:39.109921 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2430/5047] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:39.116262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.123636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.124444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:39.129083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.139428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.147942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.149135 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc42677f-163e-48b4-ad5b-380286e6b3e8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 0.609541 Aug 29 15:51:39.154289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.154742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.155486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.155944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.156464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.181492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2618/5048] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:38 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:51:39.332097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.332765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:39.348478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.351629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.358014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.359179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.367388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.368402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.594028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.608869 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e1514a9d-ca2d-4a48-80ba-7c10985e95d0 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1508 microversion: 2.1 time: 0.490999 Aug 29 15:51:39.608869 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2431/5049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:39 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1508 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:40.177250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:40.178006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:40.199608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.200183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.200670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.201703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.202217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.206058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.958047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.966795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.968259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.981872 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58c9de29-3b39-474b-b66e-31d6896a1ad7 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1407 microversion: 2.20 time: 0.798068 Aug 29 15:51:40.982541 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2432/5050] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:40 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1407 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:51:41.011080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:41.014843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:41.039201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.039858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.040578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.041584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.050190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.051061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.627940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.645592 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ce82a25f-1f38-439a-9e8d-fb16c44e34ec tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1488 microversion: 2.1 time: 0.661495 Aug 29 15:51:41.647492 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2433/5051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:40 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1488 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:41.667560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:41.674206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:41.683533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.686771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.690504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.691410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.692575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.692731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.744072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.765037 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e93289a-bf59-4c7b-9c4e-654273ddf628 tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1526 microversion: 2.1 time: 2.438163 Aug 29 15:51:41.772253 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2619/5052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:39 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1526 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:41.772535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lazy-loading 'flavor' on Instance uuid fbc15443-a874-4743-a4f2-ede41cede91c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:42.032770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.036159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.072161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.082202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.082922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.084008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.084642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.085990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.404682 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-760ac0b7-24ae-496c-819c-f3ba021da189 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c/action" status: 202 len: 0 microversion: 2.1 time: 0.740635 Aug 29 15:51:42.409457 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2434/5053] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:41 2022] POST /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:42.433163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.434731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.454190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.457423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.458249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.459235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.461706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.462452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.889380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.912766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.919079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.921842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-512ae516-a6a3-4f2a-a313-d78ed14a528b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1599 microversion: 2.20 time: 0.910643 Aug 29 15:51:42.937536 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2620/5054] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1599 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:42.937536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.937536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.951424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.952284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.954124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.957317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.958053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.959119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.161792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b302183018f4d44b7cfbd8b1b6c1cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571cec2b4f7f48a0ac319b4f44319935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:43.176882 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9063825b-43a3-4dc2-b1f8-29b17440fb2b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 200 len: 1484 microversion: 2.1 time: 0.249288 Aug 29 15:51:43.198249 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2621/5055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 1484 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:43.204156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-50a4557d-c149-4b98-b459-5ee00416c730 req-6df9ed4b-6aa9-494b-a357-21724e600b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb", "name": "network-vif-deleted", "tag": "56e6747c-d82e-4b01-b23c-9c1b2cbed055"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:43.251613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50a4557d-c149-4b98-b459-5ee00416c730 req-6df9ed4b-6aa9-494b-a357-21724e600b57 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.273520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50a4557d-c149-4b98-b459-5ee00416c730 req-6df9ed4b-6aa9-494b-a357-21724e600b57 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.274318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-50a4557d-c149-4b98-b459-5ee00416c730 req-6df9ed4b-6aa9-494b-a357-21724e600b57 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.319463 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-50a4557d-c149-4b98-b459-5ee00416c730 req-6df9ed4b-6aa9-494b-a357-21724e600b57 service nova] Creating event network-vif-deleted:56e6747c-d82e-4b01-b23c-9c1b2cbed055 for instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb on n-h2-854882-3 Aug 29 15:51:43.342872 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-50a4557d-c149-4b98-b459-5ee00416c730 req-6df9ed4b-6aa9-494b-a357-21724e600b57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142951 Aug 29 15:51:43.343530 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2622/5056] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:43.366428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:43.373813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:43.396260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.396771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.397218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.398008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.398471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.398907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.688505 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2e09659b-725e-4d51-848e-0ae551e567de tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.327276 Aug 29 15:51:43.689345 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2623/5057] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:51:43 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-interface => generated 285 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:51:44.200899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.202298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] [instance: 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.229882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.230789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.231446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.238552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.242005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.244623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.302200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:44.302633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.311623 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9067e7d-6ec3-4f51-a1be-c91b8d929a99 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1494 microversion: 2.1 time: 1.897937 Aug 29 15:51:44.317595 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] HTTP exception thrown: Instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb could not be found. Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Request method failure captured: Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb HTTP/1.1 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOBxk99azeNp4Z6tU-bMeDT6237pYd5TgG8eLkjb_Dt38BaAK4nlvKpAKVE_s1GWLuRvnrLkKZT4ovDyaHI8M__BorMctm2VeQFH9qU3MVBsGDfvV7L9BZox1xBwsdamowUG0Y8aQOlac60C76Ts1ndHZAngmJnjOPh0iDLyjfCGzp8 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 571cec2b4f7f48a0ac319b4f44319935 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/571cec2b4f7f48a0ac319b4f44319935"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/571cec2b4f7f48a0ac319b4f44319935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_571cec2b4f7f48a0ac319b4f44319935", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/571cec2b4f7f48a0ac319b4f44319935"}]}] Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 571cec2b4f7f48a0ac319b4f44319935 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1087370484 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerAddressesNegativeTestJSON-1087370484-project Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 9b302183018f4d44b7cfbd8b1b6c1cc6 Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1087370484-project Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb could not be found. Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb'} Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb could not be found. Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb could not be found. Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:44.322357 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb could not be found. Aug 29 15:51:44.327413 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:51:44.327986 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2435/5058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1494 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:44.330481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] Returning 404 to user: Instance 4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:44.331555 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c17cde9e-942a-43f7-9059-9acfd143ef1b tempest-ServerAddressesNegativeTestJSON-1087370484 tempest-ServerAddressesNegativeTestJSON-1087370484-project] 10.222.0.16 "GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb" status: 404 len: 111 microversion: 2.1 time: 0.134700 Aug 29 15:51:44.332877 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2624/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/4c44eaab-f3ec-43e9-addd-8f8a9e8b32fb => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:51:45.335489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.337078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.364484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.365283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.366043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.367248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.367948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.368624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.495020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:46.513427 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3c18ffd-cb49-4c78-ab82-064dca855fab tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.181782 Aug 29 15:51:46.514576 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2436/5060] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:45 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:47.539618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:47.540325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:47.555460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:47.563873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.572845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.576549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.582177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.582837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.583687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.134211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.134876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.143065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.143550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.156299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.157084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.157599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.158028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.233558 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 HTTP/1.1 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ddafa5bf-2080-4bd6-b998-c4ee781d6af3'} Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:48.236332 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.241836 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.251334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:48.253331 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0e1e62c9-4c9d-4571-bbc9-206f3dd89da6 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 404 len: 111 microversion: 2.1 time: 0.123098 Aug 29 15:51:48.259823 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2437/5061] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:48 2022] DELETE /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:48.269910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.275123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: ddafa5bf-2080-4bd6-b998-c4ee781d6af3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.297434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.300283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.300833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.301763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.303433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.304195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.341350 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 HTTP/1.1 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ddafa5bf-2080-4bd6-b998-c4ee781d6af3'} Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.344753 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.351226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.351226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.351226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.351226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:48.351226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:48.351226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. Aug 29 15:51:48.351226 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.360462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance ddafa5bf-2080-4bd6-b998-c4ee781d6af3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:48.361702 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d886747-613a-41b4-99c6-b4b0580cd2c1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3" status: 404 len: 111 microversion: 2.1 time: 0.100205 Aug 29 15:51:48.364835 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2438/5062] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:48 2022] GET /compute/v2.1/servers/ddafa5bf-2080-4bd6-b998-c4ee781d6af3 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:48.655164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:48.673149 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-75728c2b-100b-4e56-b0d6-e6a4c880337e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.131924 Aug 29 15:51:48.676077 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2625/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:47 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:48.936841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-01917c74-5a49-43e4-804b-72b60e098960 req-1f2c6996-e66f-4604-a4d8-f359ace6e591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:48.989643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-01917c74-5a49-43e4-804b-72b60e098960 req-1f2c6996-e66f-4604-a4d8-f359ace6e591 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.991861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-01917c74-5a49-43e4-804b-72b60e098960 req-1f2c6996-e66f-4604-a4d8-f359ace6e591 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.995674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-01917c74-5a49-43e4-804b-72b60e098960 req-1f2c6996-e66f-4604-a4d8-f359ace6e591 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.048608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-01917c74-5a49-43e4-804b-72b60e098960 req-1f2c6996-e66f-4604-a4d8-f359ace6e591 service nova] Creating event network-changed:81fb5f09-4b24-46e4-b6cd-b0488f3dfb25 for instance cc738f5e-e78a-4030-9027-b69a1df31032 on n-h1-854882-3 Aug 29 15:51:49.072530 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-01917c74-5a49-43e4-804b-72b60e098960 req-1f2c6996-e66f-4604-a4d8-f359ace6e591 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140364 Aug 29 15:51:49.079515 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2439/5064] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:49.484494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-94b88cc6-fb11-4ee7-9239-0681bfd3e302 req-d7d33556-c20b-4d9e-b5fa-27b980e4d6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc15443-a874-4743-a4f2-ede41cede91c", "name": "network-vif-plugged", "status": "completed", "tag": "c1e73542-0832-4ea3-bff9-67b47129aad5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:49.517724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-94b88cc6-fb11-4ee7-9239-0681bfd3e302 req-d7d33556-c20b-4d9e-b5fa-27b980e4d6a6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.520072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-94b88cc6-fb11-4ee7-9239-0681bfd3e302 req-d7d33556-c20b-4d9e-b5fa-27b980e4d6a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.521378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-94b88cc6-fb11-4ee7-9239-0681bfd3e302 req-d7d33556-c20b-4d9e-b5fa-27b980e4d6a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.590405 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-94b88cc6-fb11-4ee7-9239-0681bfd3e302 req-d7d33556-c20b-4d9e-b5fa-27b980e4d6a6 service nova] Creating event network-vif-plugged:c1e73542-0832-4ea3-bff9-67b47129aad5 for instance fbc15443-a874-4743-a4f2-ede41cede91c on n-h2-854882-3 Aug 29 15:51:49.618731 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-94b88cc6-fb11-4ee7-9239-0681bfd3e302 req-d7d33556-c20b-4d9e-b5fa-27b980e4d6a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138352 Aug 29 15:51:49.622245 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2626/5065] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:49.702879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:49.705600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:49.740890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.741488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.760967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.761938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.764443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.772613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.666292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.680006 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29b02a9d-1187-42fa-a39f-2c5d44b534ad tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.983434 Aug 29 15:51:51.687603 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2440/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:49 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:52.704625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.705356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.722352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.722857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.723305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.736702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.737218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.737702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.839909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.858144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-891353d0-f8b1-4304-9eb9-54541ed45346 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.157655 Aug 29 15:51:53.872957 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2627/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:54.896325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.897616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.900524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:54.940427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.940928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.971620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.972439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.976921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.977380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.456906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:56.466005 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ad0fb9c-49e9-4de7-b3b8-5ff9e6d5d1d1 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.573573 Aug 29 15:51:56.469792 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2441/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:54 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:57.511665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.513463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.544966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.555645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.556543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.562953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.563960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.565122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.928649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.929166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.954648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.955969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.958234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.961152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.968136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.973375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.051118 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 HTTP/1.1 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3881fe52-0c97-4880-b6f7-43ec6e463e69'} Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:58.059109 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.064632 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.068791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:58.071116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07eb6ca6-dc2a-4d13-8140-9134400888fa tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 404 len: 111 microversion: 2.1 time: 0.147843 Aug 29 15:51:58.074992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2442/5069] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:57 2022] DELETE /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:51:58.095821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:58.098850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3881fe52-0c97-4880-b6f7-43ec6e463e69] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:58.123914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.124452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.133107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.134088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.134584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.135026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.215438 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 HTTP/1.1 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3881fe52-0c97-4880-b6f7-43ec6e463e69'} Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.230519 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance 3881fe52-0c97-4880-b6f7-43ec6e463e69 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:58.236334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b09c021-b0e0-4486-a4ec-47a8104088fd tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69" status: 404 len: 111 microversion: 2.1 time: 0.152770 Aug 29 15:51:58.240409 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2443/5070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:58 2022] GET /compute/v2.1/servers/3881fe52-0c97-4880-b6f7-43ec6e463e69 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:58.250598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:58.251103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:58.301302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.303597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.304054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.310746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.311239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.311683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.381914 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 HTTP/1.1 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3306b415-8c0a-4823-a389-9a48192c7371'} Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:58.383807 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.389323 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.393101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:58.394207 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be98df2b-d4f5-49c0-b52c-054e0be191a9 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 404 len: 111 microversion: 2.1 time: 0.150059 Aug 29 15:51:58.395285 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2444/5071] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:58 2022] DELETE /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:58.405169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:58.414064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: 3306b415-8c0a-4823-a389-9a48192c7371] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:58.448502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.450536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.451179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.458495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.460661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.462806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.531913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:58.551197 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-572cdb05-7b11-4fcf-a537-cd91615224f4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.053365 Aug 29 15:51:58.554704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2628/5072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:57 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:58.588980 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 HTTP/1.1 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3306b415-8c0a-4823-a389-9a48192c7371'} Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:58.594769 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.603529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:58.603529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:58.603529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:58.603529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:58.603529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:58.603529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. Aug 29 15:51:58.603529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:51:58.608573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance 3306b415-8c0a-4823-a389-9a48192c7371 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:58.616374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57e7b843-08fa-4bed-aba8-dde6731e32ff tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371" status: 404 len: 111 microversion: 2.1 time: 0.216513 Aug 29 15:51:58.618427 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2445/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:58 2022] GET /compute/v2.1/servers/3306b415-8c0a-4823-a389-9a48192c7371 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:51:59.586140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:59.586755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:59.595735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.596236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.596677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.597418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.603964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.604420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:00.528471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:00.550067 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f321b5e-6c78-4605-ab73-a5141718e99a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 0.977597 Aug 29 15:52:00.558908 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2629/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:59 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:01.607163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.610087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.626756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.643237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.654385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.663693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.664676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.667471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.722675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:02.573088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.589267 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab9be624-445a-4882-83b8-ce6139eb86aa tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.014364 Aug 29 15:52:02.590594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2446/5075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:01 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:03.614550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:03.616018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:03.635674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.637376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.641628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.644321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.646445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.647652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.435932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:04.454288 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8514868a-f35a-42de-beb0-fb480a9bf619 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 0.846068 Aug 29 15:52:04.455538 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2630/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:03 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:05.477823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:05.480102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:05.520734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.522193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.549360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.550176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.550655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.551092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.014078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:06.026397 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76121889-2f5c-4001-a210-eea14182cc54 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 0.553552 Aug 29 15:52:06.026919 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2447/5077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:05 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:06.813379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:06.814804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:06.827401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.839599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.840385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.845862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.853548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.854008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.910443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 HTTP/1.1 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'e977ea80-1a26-4547-a392-9b56b30f50b3'} Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:06.921638 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:06.926464 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:52:06.971413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:06.972680 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-02d128a9-f368-49a8-ad34-de5669ae9da1 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 404 len: 111 microversion: 2.1 time: 0.163995 Aug 29 15:52:07.000933 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2631/5078] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:06 2022] DELETE /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:07.010708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.011954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] [instance: e977ea80-1a26-4547-a392-9b56b30f50b3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.026827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.027571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.028197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.030272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.032694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.033304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.054909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.055461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.075736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.076394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.080084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.084655 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] HTTP exception thrown: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:07.084880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.085186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Request method failure captured: Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 HTTP/1.1 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7st56msQoNC8AaguBabISbDHFqhWusJc_rcdGTdTSGETq-zxG_-582FqLtmfvJMsfTuTZffi75Qn5nAJucnthx4iQClsOQPFEv-P2BrAtBPeaGPUHxup-Vk-ypFxVjXv575aQTDpnJd03H4B3p-Afc5drV7g9982nzK-uHc2FOPiI Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10b20946b0cd4fc3b2289200eb839230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10b20946b0cd4fc3b2289200eb839230", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10b20946b0cd4fc3b2289200eb839230"}]}] Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 10b20946b0cd4fc3b2289200eb839230 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432413714 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f70ee130e8e74db88b9b7ffd16ed1bd5 Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeNegativeTest-1432413714-project Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'e977ea80-1a26-4547-a392-9b56b30f50b3'} Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:07.086872 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:52:07.093638 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:07.093638 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:07.093638 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:07.093638 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:07.093638 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:07.093638 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. Aug 29 15:52:07.093638 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:52:07.094541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.095988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] Returning 404 to user: Instance e977ea80-1a26-4547-a392-9b56b30f50b3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:07.097056 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb632b4e-b9eb-41d0-b007-dc542afb61c3 tempest-AttachVolumeNegativeTest-1432413714 tempest-AttachVolumeNegativeTest-1432413714-project] 10.222.0.16 "GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3" status: 404 len: 111 microversion: 2.1 time: 0.091479 Aug 29 15:52:07.098175 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2448/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/e977ea80-1a26-4547-a392-9b56b30f50b3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:08.297906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:08.353975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db95a961-a4e9-4bed-852e-566f3e922830 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.304855 Aug 29 15:52:08.355466 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2632/5080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:09.387564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:09.393793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:09.408922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.411221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.413740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.414684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.417980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.418632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.057879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:11.084241 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b59dd887-0032-43f6-9e9f-10d6fe5bd2df tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.705230 Aug 29 15:52:11.086383 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2449/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:09 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:12.122856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:12.124404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:12.143251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.144067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.144839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:12.145801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.146690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.147602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.259515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:13.280798 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1ae3eb37-7c9c-4612-a8dd-6d1fbd9a0abe tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.171909 Aug 29 15:52:13.281426 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2633/5082] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:12 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:14.303732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:14.304385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:14.328482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.330242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.330873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.332032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.335677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.336354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:15.725822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:15.739290 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a588a281-7650-4ce0-babd-d93f45315c75 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.440370 Aug 29 15:52:15.756860 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2450/5083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:14 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:16.776716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:16.778563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:16.799364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:16.801140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:16.801880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:16.802869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:16.806333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:16.808709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:18.579995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:18.584885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=52 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:18.616536 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-524e7ed7-d98c-4592-ba7b-709057be1a21 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.840914 Aug 29 15:52:18.621667 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2634/5084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:16 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:19.648987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:19.649712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:19.667583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=20 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:19.674526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.675589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.676695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.680158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.682576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.683323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.861189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:19.864730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:19.882406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.884451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.887535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.888651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.891543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.894348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.940434 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2dc0112-f43d-4868-a18f-ff035664337c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/ips" status: 200 len: 151 microversion: 2.20 time: 0.543321 Aug 29 15:52:19.941750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2451/5085] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Aug 29 15:52:19 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/ips => generated 151 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:52:21.322139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:21.340513 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d071c2d-f89a-4122-8790-dc7559292c25 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1510 microversion: 2.1 time: 1.703376 Aug 29 15:52:21.357416 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2635/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:19 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1510 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:22.370658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:22.379689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:22.437010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.441636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.445082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.446652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.449788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.450851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.011346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.057749 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96c7203a-7e42-48e3-b9f8-cc8924e1c0cc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1507 microversion: 2.1 time: 0.691091 Aug 29 15:52:23.073702 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2452/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:22 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1507 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:23.237605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-156b82f0-3ebf-4cce-9300-e17f75351fec req-4e466f20-dd40-43b7-bc1a-98333bded053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc15443-a874-4743-a4f2-ede41cede91c", "name": "network-vif-unplugged", "status": "completed", "tag": "c1e73542-0832-4ea3-bff9-67b47129aad5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:23.240355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:23.241072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:23.252323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:23.253351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-156b82f0-3ebf-4cce-9300-e17f75351fec req-4e466f20-dd40-43b7-bc1a-98333bded053 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:23.253875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-156b82f0-3ebf-4cce-9300-e17f75351fec req-4e466f20-dd40-43b7-bc1a-98333bded053 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:23.254322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:23.255155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.258537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:23.259611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:23.260383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.267331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-156b82f0-3ebf-4cce-9300-e17f75351fec req-4e466f20-dd40-43b7-bc1a-98333bded053 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.315858 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-156b82f0-3ebf-4cce-9300-e17f75351fec req-4e466f20-dd40-43b7-bc1a-98333bded053 service nova] Creating event network-vif-unplugged:c1e73542-0832-4ea3-bff9-67b47129aad5 for instance fbc15443-a874-4743-a4f2-ede41cede91c on n-h2-854882-3 Aug 29 15:52:23.359195 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-156b82f0-3ebf-4cce-9300-e17f75351fec req-4e466f20-dd40-43b7-bc1a-98333bded053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.232564 Aug 29 15:52:23.364097 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2636/5088] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:23.373118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lazy-loading 'flavor' on Instance uuid cc738f5e-e78a-4030-9027-b69a1df31032 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:23.718949 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ffbda992-c990-4494-9392-57ab1b6085ca tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/action" status: 202 len: 0 microversion: 2.20 time: 0.485386 Aug 29 15:52:23.732258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:23.734006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:23.740204 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2453/5089] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:52:23 2022] POST /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:52:23.746454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:23.747260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:23.747910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.749327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:23.750584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:23.751199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.081586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:24.082684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:24.100683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.101658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.104387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.105499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.106786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.107431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.500608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.518102 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-54e18f54-82ca-4739-bffd-d62213a8f333 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1507 microversion: 2.1 time: 0.439085 Aug 29 15:52:24.519441 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2454/5090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:24 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:24.742516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.756699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.767757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.774282 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ece86321-31bf-489b-9102-8c3de50ac6dc tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 1.047115 Aug 29 15:52:24.775207 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2637/5091] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:23 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:25.542223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:25.544791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:25.560067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=28 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:25.566300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.568407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.568936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.572411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.573310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.573911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.802520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:25.803946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:25.818150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.819142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.819804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.824885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.825954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.826682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.091542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.106377 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe4ec54d-ff80-4029-bad5-491d6b81896e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1507 microversion: 2.1 time: 0.568552 Aug 29 15:52:26.109113 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2455/5092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:25 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:26.336566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.349819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.356473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.358479 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13217571-15f5-46a8-bd0f-5013a33d5b4b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 0.559964 Aug 29 15:52:26.361732 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2638/5093] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:25 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:26.769934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1596187604", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:26.914829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] validate_networks() for [('adfa223e-9b3e-4da0-b596-969dfbcc8318', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:52:27.129753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.130998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.144628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.148487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.149169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.151495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.152158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.153681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.741154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:27.755649 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cde4735e-0e84-4401-ba1d-7ce6b92c8169 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 200 len: 1450 microversion: 2.1 time: 0.624661 Aug 29 15:52:27.756323 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2639/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 1450 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:27.793276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.796233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.810582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.813742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.814484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.815664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.817989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.818686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.897913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:52:28.898511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:52:28.898992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:52:28.899601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:52:28.900189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:52:28.927272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.930777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.933591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.937410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.938661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.939291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.992840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Getting quotas for project 2e9c174d274442a592b9306e146ff891. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:52:29.008393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Getting quotas for user eaaf3b2473a141efbb1a2904ade04d34 and project 2e9c174d274442a592b9306e146ff891. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:52:29.046415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:52:29.052354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:52:29.176683 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6130eea-f883-4ad7-ab06-75c7bb9e77dd tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.779358 Aug 29 15:52:29.185496 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2456/5095] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:52:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:52:29.190932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.191913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.199481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.200265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.200970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.202563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.203262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.203918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.477616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.491910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.495107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.509214 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf9ecd80-06d5-4ae5-b819-ac0ce79525aa tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 1.731240 Aug 29 15:52:29.511491 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2640/5096] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:29.529039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8e781b14-f8e8-42b1-997e-b3efd15471d6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.529921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8e781b14-f8e8-42b1-997e-b3efd15471d6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.766263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8e781b14-f8e8-42b1-997e-b3efd15471d6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.773346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.778369 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8e781b14-f8e8-42b1-997e-b3efd15471d6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1223 microversion: 2.1 time: 0.265736 Aug 29 15:52:29.780473 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2641/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1223 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:29.792074 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2febe05d-ecae-47ff-8861-3d3a41f2a800 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.605064 Aug 29 15:52:29.793380 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2457/5098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:29.823946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.824695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.833256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.834705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.838525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.839456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.842082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.844829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.537669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:30.538837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:30.553772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.554899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.555035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.556591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.560680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.566849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.567690 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3fc223c6-81a7-42cc-8fbb-9d521364d2d5 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.743609 Aug 29 15:52:30.567963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.568363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2642/5099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:30.590501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:30.591137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:30.616411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.626995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.626995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.626995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.626995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.627457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.100242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.118005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.122098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.126128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a7714a17-09d5-4b1f-abf2-3eca26bc3227 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 0.594748 Aug 29 15:52:31.130191 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2458/5100] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:30 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:31.142292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.143146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.154737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.163052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.166417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.170368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.172418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.173071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.299843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.315320 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24241b85-9f82-4b54-886f-cd5a8e6c6d2b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1227 microversion: 2.1 time: 0.182301 Aug 29 15:52:31.333981 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2459/5101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:31 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1227 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:31.374409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.402521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14524c1b-2b0d-429f-ba89-62ffb446512a tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.802855 Aug 29 15:52:31.402521 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2643/5102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:30 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:31.441232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.442285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.457581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.458344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.462153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.465650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.466413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.467154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.817733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.822537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:31.835905 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83ecf365-3db4-4a36-a789-c1e3aa593857 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.398680 Aug 29 15:52:31.836489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2460/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:31 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:31.857367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a0609de4-a21b-42b4-aac2-0c535a1a1460 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:31.873165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0609de4-a21b-42b4-aac2-0c535a1a1460 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.874277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0609de4-a21b-42b4-aac2-0c535a1a1460 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.875031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0609de4-a21b-42b4-aac2-0c535a1a1460 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.936040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a0609de4-a21b-42b4-aac2-0c535a1a1460 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Going to try to stop instance {{(pid=130002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:52:32.008408 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a0609de4-a21b-42b4-aac2-0c535a1a1460 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.154933 Aug 29 15:52:32.009583 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2644/5104] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:31 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:32.019045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:32.020023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:32.032498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.034791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.036157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.038546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.039248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.040855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.158123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:32.159257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:32.179671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.180653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.181907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.189284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.194917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.195595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.754829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.764253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.765771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.767008 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6e6a5a36-6c45-4051-b06c-e8d32f63325f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 0.614985 Aug 29 15:52:32.767592 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2645/5105] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:32 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:32.787823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:32.789739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:32.800666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.801332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.801927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.805809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.806437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.807167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.924233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.940053 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da257415-7f29-4d35-bf24-c0c1366b523d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 0.925790 Aug 29 15:52:32.940686 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2461/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:32 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:33.021017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.027073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-524fcce4-cafb-4547-b9c6-781ac5586c98 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e32a65e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:33.046864 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b1d9d4f1-1caa-4ec7-9dca-71aa444387c2 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1281 microversion: 2.1 time: 0.269502 Aug 29 15:52:33.057422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2646/5107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:32 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:33.143095 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-524fcce4-cafb-4547-b9c6-781ac5586c98 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0fa81fa7-187b-4054-ac1c-51113b1e893f" status: 200 len: 351 microversion: 2.1 time: 0.119793 Aug 29 15:52:33.153048 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2462/5108] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:33 2022] GET /compute/v2.1/os-volumes/0fa81fa7-187b-4054-ac1c-51113b1e893f => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:33.799628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:33.800657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:33.812333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.835308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.835924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.838166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.838791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.848458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.969225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:33.970884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:33.990548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.992185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.992874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.993953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.994640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.996014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.229151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.238687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.245147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.246524 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3f8cbfba-ec33-4883-9438-cf393cc505bd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 0.451763 Aug 29 15:52:34.250540 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2647/5109] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:33 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:34.255516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:34.258291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:34.285035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.285842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.286466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.287423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.288158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.288824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.488783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.497436 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f54320ad-bfef-4668-9c43-fed807168524 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1281 microversion: 2.1 time: 0.245519 Aug 29 15:52:34.505955 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2648/5110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:34 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:35.272905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:35.274556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:35.284556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.287992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.290170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.291256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.294221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.295307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.362381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.380881 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d822eae-8a47-4fc1-8615-67c9c1622ef2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 1.415518 Aug 29 15:52:35.407062 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2463/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:33 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:35.522163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:35.523100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:35.540900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.544403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.545757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.546728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.548999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.549746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.612144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.622440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.629958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.641310 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-173c230d-c48f-4fa2-b23d-63d29dd067e2 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1744 microversion: 2.20 time: 0.370809 Aug 29 15:52:35.655435 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2649/5112] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:35 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1744 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:36.087446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-57aa95c1-7f5a-4bde-87c1-5ccccdd76b74 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e26f6040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.165115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:36.180790 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73dd689a-c16a-404e-ad24-8533cfda426c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.664733 Aug 29 15:52:36.183359 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2464/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:35 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:36.216386 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-57aa95c1-7f5a-4bde-87c1-5ccccdd76b74 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5b827d9b-2c0d-451d-996e-bceb9f6b5cbd" status: 200 len: 350 microversion: 2.1 time: 0.132717 Aug 29 15:52:36.216987 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2650/5114] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:36 2022] GET /compute/v2.1/os-volumes/5b827d9b-2c0d-451d-996e-bceb9f6b5cbd => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:36.424633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.427723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:36.441547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.443632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.444416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.446759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.447526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.448760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.669150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.671057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:36.685273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.686117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.686762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.689168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.690299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.691975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.223606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:37.241795 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07b0e3b7-ec99-48dc-a1ca-26c1dcca8216 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 0.824314 Aug 29 15:52:37.242492 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2465/5115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:36 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:37.251256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:37.251891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:37.284928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.287566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.288403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.302326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.302839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.303291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.387424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:37.402475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:37.406157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:37.410931 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9bd88b0-5d8c-4ecb-a137-af7c202dadaf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.746025 Aug 29 15:52:37.433510 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2651/5116] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:36 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:38.264721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:38.265256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:38.265689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:38.275604 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c8a875de-c66d-4f37-9682-c6938e16c15c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 1.028476 Aug 29 15:52:38.291463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2466/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:37 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:38.326078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.328438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.328909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.329710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.330208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.348409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.442965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:38.443785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:38.467866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.471472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.472403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.490458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.497339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.517985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.966347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:39.025113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:39.047613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:39.067727 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93d143d8-3476-4778-a897-c19cecfdbed2 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 0.801880 Aug 29 15:52:39.083651 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2652/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:38 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:39.098097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-abb1ffab-b636-4cac-93a1-bae8b0dfa0a6 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0eb723af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.283970 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-abb1ffab-b636-4cac-93a1-bae8b0dfa0a6 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a3fe1d17-4e9f-4127-a269-8347132f4077" status: 200 len: 350 microversion: 2.1 time: 0.195868 Aug 29 15:52:39.285087 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2653/5119] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/os-volumes/a3fe1d17-4e9f-4127-a269-8347132f4077 => generated 350 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:39.299916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ae5fc57-7e18-4c8a-84b3-f85403e0e8f3 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0eb5d2940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.571263 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ae5fc57-7e18-4c8a-84b3-f85403e0e8f3 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.277338 Aug 29 15:52:39.571850 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2654/5120] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:39.590957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.597216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:39.605731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:39.616731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.618433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:39.619184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.620373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.621938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.625165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:39.625794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.626508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.631559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:39.633282 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-338d478f-320d-4581-957b-5fa9012ab3c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 1.196700 Aug 29 15:52:39.633933 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2467/5121] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:38 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:39.654439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-50334c7a-6495-4c33-a49f-702bb43fecce tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e2f39670>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.774675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:39.873111 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-50334c7a-6495-4c33-a49f-702bb43fecce tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.234492 Aug 29 15:52:39.884197 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2468/5122] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:40.326098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c1325196-888d-4afc-8c99-83d5f99364d2 req-dd26d8ab-e39b-488f-b125-bede2c17e8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf4dfad-f241-47c2-afda-b91e0e7e6b67", "tag": "ef4111ba-14bb-4b4d-8376-3a02f4965421"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:40.363296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c1325196-888d-4afc-8c99-83d5f99364d2 req-dd26d8ab-e39b-488f-b125-bede2c17e8d5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.363791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c1325196-888d-4afc-8c99-83d5f99364d2 req-dd26d8ab-e39b-488f-b125-bede2c17e8d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.364222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c1325196-888d-4afc-8c99-83d5f99364d2 req-dd26d8ab-e39b-488f-b125-bede2c17e8d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.397562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:40.408177 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e59926e9-5a61-45d9-96eb-f521886f1294 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.824253 Aug 29 15:52:40.418418 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c1325196-888d-4afc-8c99-83d5f99364d2 req-dd26d8ab-e39b-488f-b125-bede2c17e8d5 service nova] Creating event network-changed:ef4111ba-14bb-4b4d-8376-3a02f4965421 for instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 on n-h1-854882-3 Aug 29 15:52:40.437318 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c1325196-888d-4afc-8c99-83d5f99364d2 req-dd26d8ab-e39b-488f-b125-bede2c17e8d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545473 Aug 29 15:52:40.439193 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2469/5123] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:40.465212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab9ed573-e081-4c4e-89ce-48c9d80d73e5 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e3273430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:40.478891 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2655/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:40.504241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:40.512237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:40.564464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.564975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.565434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.569123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.574557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.581346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.701325 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab9ed573-e081-4c4e-89ce-48c9d80d73e5 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.260893 Aug 29 15:52:40.702472 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2470/5125] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Aug 29 15:52:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:40.710620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:40.711475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:40.737897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.738486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.738930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.800171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.800681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.801140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.748792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:41.764754 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ce207555-c416-482f-a50e-3dbcfd7016e4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1679 microversion: 2.1 time: 1.277130 Aug 29 15:52:41.769270 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2656/5126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:40 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1679 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:41.807657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb5e2e78-aeea-45eb-98cc-e0fbd660dd51 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0eb5b00d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.092906 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb5e2e78-aeea-45eb-98cc-e0fbd660dd51 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.304250 Aug 29 15:52:42.094456 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2657/5127] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:52:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:42.101763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.103033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:42.129871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.130780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.131439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.132439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.134085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.134795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.277369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:42.293476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:42.300404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:42.308302 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30437689-8456-48d1-910c-73a08cfe0770 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 1.602320 Aug 29 15:52:42.328890 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2471/5128] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:40 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:42.334355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-60f07c83-fb9b-4afd-a172-2a16d32875eb tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e28855e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.712822 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-60f07c83-fb9b-4afd-a172-2a16d32875eb tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.382429 Aug 29 15:52:42.713794 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2472/5129] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:42.729740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ce188fe-f842-40c9-a9ab-a02ff7aa8951 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e3268820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.983555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:42.997357 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-01690853-877f-4cd9-8d7e-53849ec76e52 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.898179 Aug 29 15:52:42.998013 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2658/5130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:43.026628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:43.027264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:43.067516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.069159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.071603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.073763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.081101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.093201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ce188fe-f842-40c9-a9ab-a02ff7aa8951 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.366790 Aug 29 15:52:43.094350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.094730 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2473/5131] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:43.109281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-91b792e8-b8b9-40db-8359-727fe47262ef tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e3268310>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:43.353501 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-91b792e8-b8b9-40db-8359-727fe47262ef tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.249371 Aug 29 15:52:43.354220 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2474/5132] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Aug 29 15:52:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:43.360616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:43.361379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:43.389602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.393540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.397039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.399427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.404603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.406872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.775219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:43.793867 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21b7b808-7f50-4c50-b8a4-b74b9c216788 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1656 microversion: 2.1 time: 0.775209 Aug 29 15:52:43.794733 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2659/5133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1656 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:43.838360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83636501-9a01-43f7-be58-81577a8f99b6 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] Calling method '.version_select at 0x7fb0e362e5e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:44.086899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83636501-9a01-43f7-be58-81577a8f99b6 tempest-VolumesTestJSON-1116689311 tempest-VolumesTestJSON-1116689311-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.270711 Aug 29 15:52:44.087748 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2660/5134] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:52:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:44.112565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf4bbfc2-8b43-4da4-ad1a-dc215f94a849 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:44.156965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf4bbfc2-8b43-4da4-ad1a-dc215f94a849 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.161455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf4bbfc2-8b43-4da4-ad1a-dc215f94a849 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.161909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bf4bbfc2-8b43-4da4-ad1a-dc215f94a849 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.232954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bf4bbfc2-8b43-4da4-ad1a-dc215f94a849 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Going to try to start instance {{(pid=130002) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:52:44.313996 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf4bbfc2-8b43-4da4-ad1a-dc215f94a849 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.224111 Aug 29 15:52:44.318102 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2661/5135] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:44 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:44.333737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:44.341615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:44.352429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.370210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.371146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.372117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.372779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.373594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.887918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:44.898453 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f16aaf30-e9b8-4494-b1c8-c0a1b459ca0e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.578749 Aug 29 15:52:44.903575 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2662/5136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:44 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:44.919703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:44.923354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:44.946876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.960217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.964037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.970887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.971565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.973955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:45.316518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:45.329400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:45.337714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:45.339009 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4655a70e-baca-4aca-85cf-c2dc2c92036e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 1.983763 Aug 29 15:52:45.340270 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2475/5137] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:43 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:45.926509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:45.927257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:45.945912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:45.946415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:45.946857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:45.963502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:45.964424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:45.964884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.364366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:46.378304 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6920ff35-01fc-464f-9732-b76eae815389 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1665 microversion: 2.1 time: 1.466159 Aug 29 15:52:46.399015 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2663/5138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:44 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1665 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:46.413036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:46.425277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:46.427786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:46.445071 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0ec2f782-7b6d-4091-b65c-d1d5a53c5acb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.524767 Aug 29 15:52:46.453737 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2476/5139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:45 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:46.480462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.486360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.489596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.493114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.496634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.497826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.988381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8b010ac6-25fa-46bb-9374-2080d072a441 req-549d448e-f924-4e94-965d-2fb14bfec734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "name": "network-vif-plugged", "status": "completed", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:47.019304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8b010ac6-25fa-46bb-9374-2080d072a441 req-549d448e-f924-4e94-965d-2fb14bfec734 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:47.024961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8b010ac6-25fa-46bb-9374-2080d072a441 req-549d448e-f924-4e94-965d-2fb14bfec734 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:47.025773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8b010ac6-25fa-46bb-9374-2080d072a441 req-549d448e-f924-4e94-965d-2fb14bfec734 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:47.078021 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8b010ac6-25fa-46bb-9374-2080d072a441 req-549d448e-f924-4e94-965d-2fb14bfec734 service nova] Creating event network-vif-plugged:81fb5f09-4b24-46e4-b6cd-b0488f3dfb25 for instance cc738f5e-e78a-4030-9027-b69a1df31032 on n-h1-854882-3 Aug 29 15:52:47.095970 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8b010ac6-25fa-46bb-9374-2080d072a441 req-549d448e-f924-4e94-965d-2fb14bfec734 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108382 Aug 29 15:52:47.103425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2477/5140] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:47.418346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:47.419100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:47.440157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:47.441751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:47.441751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:47.441922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:47.442253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:47.445340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:47.897704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:47.919328 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-891054a5-7f55-42a7-828a-87640fc3eeb8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1665 microversion: 2.1 time: 0.507533 Aug 29 15:52:47.943871 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2478/5141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:47 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1665 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:47.949912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:47.950794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:47.972224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:47.975238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:47.976060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:47.980583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:47.981430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:47.982946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:48.530717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:48.551965 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c81660b8-0abf-482a-889f-9d728d9e9648 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.606610 Aug 29 15:52:48.557975 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2479/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:47 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:48.942806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:48.943435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:48.957129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:48.957702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:48.958266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:48.959287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:48.960067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:48.960503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.130517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:49.140068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:49.146502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:49.150830 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3ff3c6d-ed8a-4a4c-aeb2-077b69ceec3e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 2.750411 Aug 29 15:52:49.151422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2664/5143] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 2752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:49.392367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:49.409287 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a638bd1-7465-47aa-8ed8-4a33fa9d0afb tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1665 microversion: 2.1 time: 0.470168 Aug 29 15:52:49.410518 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2480/5144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:48 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1665 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:49.582136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:49.582837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:49.607313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.611526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.614574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.615780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.620444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.624381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:50.091870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:50.104497 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85300519-1135-46c9-8c45-796025659f40 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.522678 Aug 29 15:52:50.121422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2665/5145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:49 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:50.180196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:50.180833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:50.211981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:50.212622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:50.213076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:50.223621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:50.224154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:50.224610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:50.433670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:50.434054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:50.437026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=54 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:50.450014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:50.450524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:50.450958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:50.469174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:50.488510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:50.489755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:50.714105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:50.723465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:50.724957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:50.726284 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c67cdee2-8775-4842-8f89-da9aa9b63edf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.552133 Aug 29 15:52:50.727178 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2481/5146] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:50 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:51.135114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:51.135749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:51.147509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.148267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.148740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:51.149845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.150376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.150816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:51.393937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:51.424593 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3d920c6-caf5-45ff-8dfe-7abc052ef53f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.996039 Aug 29 15:52:51.425931 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2666/5147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:50 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:51.449806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:51.450616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:51.471143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.482490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.487016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:51.488560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.491511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.497545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.066859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:52.080053 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a614bc3a-a12e-43f2-bbd7-7edadbc2860e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.635618 Aug 29 15:52:52.093420 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2667/5148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:51 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:52.100901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.103999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:52.131050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.131562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.132020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.138736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.139962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.140421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.442072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:52.456841 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-70bbec5e-cfd1-4588-9c46-7ec90f51b6b5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 1.321306 Aug 29 15:52:52.461084 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2482/5149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:51 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:52.480101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.483474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:52.512172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.524417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.528234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.532344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.534135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.534765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.759107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:52.769340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:52.786194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:52.787504 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-549121fc-6a50-46b5-8858-239516f01ef5 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.704677 Aug 29 15:52:52.789460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2668/5150] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:52 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:52.896131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:52.909201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-121d2afa-a611-4f56-98ab-82727ac37ea3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.445499 Aug 29 15:52:52.910087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2483/5151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:52 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:52.933267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.933930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:52.949090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.949630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.950085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.950813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.958082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.958548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.480317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:53.480936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:53.493602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.505980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.506883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.508491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.509140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.509982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.757733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:53.767529 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c960f275-cb8d-4062-826c-c27c460ba239 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.838018 Aug 29 15:52:53.777730 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2669/5152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:52 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:53.789077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:53.806430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:53.852455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.854060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.864917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.865849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.868366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:53.869063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.869656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.876111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:53.880151 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-18f8284b-945a-4322-8bc4-84f2d57e1af7 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 0.403767 Aug 29 15:52:53.887595 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2484/5153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:53 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:53.905288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:53.918884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:53.928839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.959092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.961641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.963611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.967096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.970024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.256263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:54.266346 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-be1dd791-ead7-48c4-9265-dc92fc653fc4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.481870 Aug 29 15:52:54.271456 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2670/5154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:53 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:54.278985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7971e251-ab51-4b87-9808-00a3483bb9ae req-7d1bc449-7863-4900-b371-9c0f96e27e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf4dfad-f241-47c2-afda-b91e0e7e6b67", "name": "network-vif-plugged", "status": "completed", "tag": "ef4111ba-14bb-4b4d-8376-3a02f4965421"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:54.308404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7971e251-ab51-4b87-9808-00a3483bb9ae req-7d1bc449-7863-4900-b371-9c0f96e27e96 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.317142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7971e251-ab51-4b87-9808-00a3483bb9ae req-7d1bc449-7863-4900-b371-9c0f96e27e96 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.317880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7971e251-ab51-4b87-9808-00a3483bb9ae req-7d1bc449-7863-4900-b371-9c0f96e27e96 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.353709 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7971e251-ab51-4b87-9808-00a3483bb9ae req-7d1bc449-7863-4900-b371-9c0f96e27e96 service nova] Creating event network-vif-plugged:ef4111ba-14bb-4b4d-8376-3a02f4965421 for instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 on n-h1-854882-3 Aug 29 15:52:54.365925 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7971e251-ab51-4b87-9808-00a3483bb9ae req-7d1bc449-7863-4900-b371-9c0f96e27e96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093009 Aug 29 15:52:54.378375 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2671/5155] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:54.384157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:54.388660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:54.408118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.409970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.410599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.413497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.415789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.416444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.477607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lazy-loading 'flavor' on Instance uuid 5341307c-698b-4787-bc09-6b5d2c2a1824 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:54.579225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:54.593238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:54.594745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:54.596001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4edbfe06-a43d-4eb1-b5fa-623d5dc839c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.697434 Aug 29 15:52:54.596605 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2485/5156] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:53 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:54.637486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:54.696099 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e0b2f07d-5ba7-4068-b258-5bb6799c5fc9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.315949 Aug 29 15:52:54.701173 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2672/5157] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:54 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:54.705631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:54.706335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:54.720036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.720545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.720986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.721726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.722282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.722592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.909900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:54.911282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:54.933677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.935396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.937261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.940819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.943089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.964851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:55.421228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:55.440413 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ec7fa68-a1b3-4772-9940-bdcb7be7445f tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1677 microversion: 2.1 time: 0.738669 Aug 29 15:52:55.464611 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2486/5158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:54 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1677 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:55.619259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:55.621949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:55.645294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:55.647837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:55.651631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:55.652659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:55.654089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:55.656057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:56.170007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:56.189148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:56.197575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:56.213942 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-44fa7630-2c5a-498d-bf00-9d42f9d0e2db tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.585885 Aug 29 15:52:56.217798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2487/5159] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:55 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:56.486631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:56.487510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:56.506557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:56.530608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:56.531812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:56.536515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:56.539100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:56.540623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:56.545817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:56.885820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:56.901427 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-59a57a6f-8c04-43e0-ae92-037698c69cdc tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1323 microversion: 2.1 time: 1.996123 Aug 29 15:52:56.904661 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2673/5160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:54 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1323 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:56.918108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:56.932097 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f98440d4-677d-4240-90a5-873d4637e3a8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1660 microversion: 2.1 time: 0.449208 Aug 29 15:52:56.933213 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2488/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:56 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1660 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:56.958586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:56.959250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:56.969574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:56.978461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:56.979269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:56.980879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:56.983772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:56.984434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:57.244145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:57.244894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:57.260648 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5ef22ff3-34e1-438b-a8c9-efb08c00e40d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action" status: 202 len: 0 microversion: 2.1 time: 0.306726 Aug 29 15:52:57.266496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.267976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.269556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:57.271000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.273820 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2674/5162] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:56 2022] POST /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:57.274746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.281549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:57.299414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:57.300151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:57.326410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.331938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.335809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:57.336822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.339168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.339793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:58.183843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:58.199480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:58.208303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:58.209920 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d6d33722-6c5b-4698-b74e-3c438fc12272 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.970847 Aug 29 15:52:58.241782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2489/5163] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:57 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:58.251986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:58.262275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:58.283922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:58.287364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:58.298296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:58.301084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:58.303178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:58.308087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.040032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:59.054965 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c2331d36-7426-4179-94d5-04f7d24b67d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1517 microversion: 2.1 time: 0.811731 Aug 29 15:52:59.061845 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2490/5164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:58 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1517 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:59.090360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:59.096681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:59.110924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.111718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.113981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.115109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.116465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.118421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.177293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lazy-loading 'flavor' on Instance uuid 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:59.464776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:59.475503 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c4f471f2-222c-4d4f-8197-d3e0ccab444d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action" status: 200 len: 32 microversion: 2.1 time: 0.353771 Aug 29 15:52:59.488094 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2491/5165] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:59 2022] POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action => generated 32 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:52:59.519529 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-06e74e92-e5a9-4e28-9da6-74a9a87f6d97 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1666 microversion: 2.1 time: 2.240021 Aug 29 15:52:59.522205 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2675/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:57 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1666 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:59.528779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:59.531910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:59.552154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:59.565987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:59.600169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.602062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.603628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.605785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.609810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.611656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.617890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.618680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.619376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.620437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.621555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.622197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:00.182894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:00.213271 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d8b2402d-9616-431a-a603-23d4f2cf706e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.672806 Aug 29 15:53:00.219732 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2676/5167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:59 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:00.554485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:00.556646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:00.577343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:00.577971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:00.578843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:00.579641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:00.581268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:00.582992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:01.104239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:01.111107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:01.127943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:01.129433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:01.138355 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec9beec7-cc7c-4e12-812e-31826f7858ee tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1666 microversion: 2.1 time: 0.591788 Aug 29 15:53:01.140844 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2677/5168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:00 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1666 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:01.148916 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-db6624a5-d452-4ed8-9b9c-362829cefc3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 1.650603 Aug 29 15:53:01.150112 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2492/5169] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:59 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:01.247266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:01.247899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:01.273775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:01.274329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:01.274801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:01.276501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:01.276971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:01.277419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.124117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:02.150606 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6cc506be-e79b-423f-9c76-4540f7884c97 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.912182 Aug 29 15:53:02.158750 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2678/5170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:01 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:02.182569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:02.184105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:02.193427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.193933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.194379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.195112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.195571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.196000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.204704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:02.205339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:02.237016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.245610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.246220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.246995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.247483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.256918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.884587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:02.913811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:02.921826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:02.922842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0957766a-0861-4a41-8087-30f18803a30d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.749215 Aug 29 15:53:02.932190 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2679/5171] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:02 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:03.178231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:03.178967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:03.185124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:03.185702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:03.186153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:03.188052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:03.193756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:03.194696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:03.533069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:03.572118 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-262e506a-70c3-45ab-ba27-99e19d02fde4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 1.413284 Aug 29 15:53:03.581446 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2493/5172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:02 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:03.599527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:03.600605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:03.614778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:03.618730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:03.619692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:03.620651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:03.621314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:03.621982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:04.122634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:04.133325 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-963d6bb7-17fa-438d-87eb-54da246e775a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.959179 Aug 29 15:53:04.133962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2680/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:03 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:04.168504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:04.171208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:04.219320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:04.219895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:04.220321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:04.221046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:04.223900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:04.224877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:04.293806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:04.306040 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5dbf48b6-ef3b-41c3-b1c1-a654089a5b3b tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1669 microversion: 2.1 time: 0.711857 Aug 29 15:53:04.322504 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2494/5174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:03 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1669 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:04.343035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:04.343839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:04.350806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:04.351804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:04.352493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:04.353650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:04.354325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:04.354975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:04.393358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:04.411264 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.compute.api [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Working on deleting snapshot a21a40ee-f0bf-4c70-aaa0-2ddd5746b811 from shelved instance... Aug 29 15:53:05.418755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:05.439734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:05.442499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:05.444812 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1374b2e4-af2c-41fc-b390-048c8aeae4dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 1.302216 Aug 29 15:53:05.477881 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2681/5175] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:04 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:05.495729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:05.500316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:05.527743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:05.528644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:05.535385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:05.542582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:05.543853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:05.546147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.373170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:06.382283 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b3e3ec41-bde1-4b26-aa97-e4ccf4cc272b tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.901818 Aug 29 15:53:06.387892 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2682/5176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:05 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:06.471750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:06.473098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:06.480618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Doing local delete in cell f444391f-7036-4697-bac9-7a9b7c940a18(cell1) {{(pid=130001) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 15:53:06.483584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:06.484199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:06.486465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:06.487226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.487899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:06.489855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.490809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:06.491210 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.compute.api [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 15:53:06.493691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:06.494346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.505114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] deallocate_for_instance() {{(pid=130001) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 29 15:53:07.450037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:07.479127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:07.482798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:07.485844 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16f368a2-baae-4e3d-98c1-7f48e426655f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 1.016653 Aug 29 15:53:07.502045 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2683/5177] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:06 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:07.524118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:07.526064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:07.536514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:07.537676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:07.538608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:07.539973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:07.540917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:07.542055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:08.589790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:08.600166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7cdcc297-5cc6-4d02-b25e-ac7be2e1f7b4 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 1.096644 Aug 29 15:53:08.603864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2684/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:07 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:08.613175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:08.617068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:08.638363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:08.641941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:08.644072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:08.649085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:08.650173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:08.650868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:08.784830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Updating instance_info_cache with network_info: [] {{(pid=130001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:53:09.233704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:09.252746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:09.255824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:09.258370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-882b421a-112f-4aca-9247-e2878df4e475 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.653187 Aug 29 15:53:09.260216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2685/5179] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:08 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:09.266772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2d83bc98-550c-40ff-89c6-69f3150ddc7b req-0db7bc1b-5949-4bcf-a094-511a098f8a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc15443-a874-4743-a4f2-ede41cede91c", "name": "network-vif-deleted", "tag": "c1e73542-0832-4ea3-bff9-67b47129aad5"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:09.288272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2d83bc98-550c-40ff-89c6-69f3150ddc7b req-0db7bc1b-5949-4bcf-a094-511a098f8a7f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.289702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2d83bc98-550c-40ff-89c6-69f3150ddc7b req-0db7bc1b-5949-4bcf-a094-511a098f8a7f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.290775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2d83bc98-550c-40ff-89c6-69f3150ddc7b req-0db7bc1b-5949-4bcf-a094-511a098f8a7f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.321247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.server_external_events [req-2d83bc98-550c-40ff-89c6-69f3150ddc7b req-0db7bc1b-5949-4bcf-a094-511a098f8a7f service nova] Unable to find a host for instance fbc15443-a874-4743-a4f2-ede41cede91c. Dropping event network-vif-deleted {{(pid=130002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:53:09.322511 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2d83bc98-550c-40ff-89c6-69f3150ddc7b req-0db7bc1b-5949-4bcf-a094-511a098f8a7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.061088 Aug 29 15:53:09.328052 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2686/5180] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:53:09.363810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:09.695421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d1436c47-902a-4d27-9dc3-d946fa1c0be9 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Action: 'create', calling method: .version_select at 0x7fb0e3d96c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1126589652", "metadata": {"Type": "work"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d1436c47-902a-4d27-9dc3-d946fa1c0be9 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Request method failure captured: Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 122 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDODkZJlurqqsuBFoIyjRCqwrv1_cC8DKafEStjGnUapIlCueYRfxQFgG9Cb__9ykKWeVhF804wVgXSzHqI4BjrSMbHNr0lkXLkSfqoQPKRarmo_i0tJPvsJ-3htr-ZJjgwNQyRiPtLpagPrUGHd67wLvNDr9nYNnbfDGYT17QEqe7r8 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_912759d94bb94f538d9c26344fd358e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}] Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3cff49ac81154056860c4d1e0bb4c5ef Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1126589652", "metadata": {"Type": "work"}}} Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: method: Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1126589652', 'metadata': {'Type': 'work'}}}} Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:53:09.702124 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d1436c47-902a-4d27-9dc3-d946fa1c0be9 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d1436c47-902a-4d27-9dc3-d946fa1c0be9 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.374723 Aug 29 15:53:09.707782 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2687/5181] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:53:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 376 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:53:09.709421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:09.711217 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-299d6679-3dd4-44e0-b89d-4f1bee2117fc tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 204 len: 0 microversion: 2.1 time: 5.382065 Aug 29 15:53:09.714526 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2495/5182] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:04 2022] DELETE /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 0 bytes in 5386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:53:09.721575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-68121ff9-63b3-4438-bf78-ea2c2d3df462 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Action: 'create', calling method: .version_select at 0x7fb0e29704c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-867784536", "metadata": {"Type": "work"}}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:09.730351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-68121ff9-63b3-4438-bf78-ea2c2d3df462 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Request method failure captured: Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 119 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDODkZJlurqqsuBFoIyjRCqwrv1_cC8DKafEStjGnUapIlCueYRfxQFgG9Cb__9ykKWeVhF804wVgXSzHqI4BjrSMbHNr0lkXLkSfqoQPKRarmo_i0tJPvsJ-3htr-ZJjgwNQyRiPtLpagPrUGHd67wLvNDr9nYNnbfDGYT17QEqe7r8 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_912759d94bb94f538d9c26344fd358e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}] Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3cff49ac81154056860c4d1e0bb4c5ef Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-867784536", "metadata": {"Type": "work"}}} Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-867784536', 'metadata': {'Type': 'work'}}}} Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi '0' Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:53:09.735535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:53:09.741554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.756332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-68121ff9-63b3-4438-bf78-ea2c2d3df462 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:09.759188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.759598 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-68121ff9-63b3-4438-bf78-ea2c2d3df462 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.041713 Aug 29 15:53:09.760425 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2496/5183] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:53:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:53:09.766137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.766852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.767858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.768612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.769229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.786743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:09.795696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: fbc15443-a874-4743-a4f2-ede41cede91c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:09.833835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.834736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.835394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.836523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.837215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.837879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.896493 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] HTTP exception thrown: Instance fbc15443-a874-4743-a4f2-ede41cede91c could not be found. Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Request method failure captured: Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c HTTP/1.1 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7gilGWWc6o29gKBNjrobKSdTqLhwFnqSflY2odYo3gGp2Rp54Ukd9KFrzitSKe6QyCWj61U6LPD25i9myJ_STWgTJ2iHrMBfr9pIJzAYvRNmf9W6BST2s-1orSzQrWLqf5-BO88k_4cYDzPD7GzMtvHxV9eEou14q-4QeDxUPNR9A Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c147d42182146409a91f2e0359f2e98", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}] Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a68002795ce541338b30129e6dbb0fb6 Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance fbc15443-a874-4743-a4f2-ede41cede91c could not be found. Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'fbc15443-a874-4743-a4f2-ede41cede91c'} Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc15443-a874-4743-a4f2-ede41cede91c could not be found. Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc15443-a874-4743-a4f2-ede41cede91c could not be found. Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.898921 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.905529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.905529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.905529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.905529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:09.905529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:09.905529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc15443-a874-4743-a4f2-ede41cede91c could not be found. Aug 29 15:53:09.905529 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.915676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Returning 404 to user: Instance fbc15443-a874-4743-a4f2-ede41cede91c could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:09.916946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-495f3de9-b394-4697-a1d8-4a260bf3bc0d tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c" status: 404 len: 111 microversion: 2.1 time: 0.155271 Aug 29 15:53:09.918326 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2497/5184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:09 2022] GET /compute/v2.1/servers/fbc15443-a874-4743-a4f2-ede41cede91c => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:09.924880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88f5d2bf-abe1-44fc-a821-72725f6f1777 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Action: 'create', calling method: .version_select at 0x7fb0e3b5a940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1071874998", "metadata": {"Type": "work"}}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88f5d2bf-abe1-44fc-a821-72725f6f1777 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Request method failure captured: Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 119 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDODkZJlurqqsuBFoIyjRCqwrv1_cC8DKafEStjGnUapIlCueYRfxQFgG9Cb__9ykKWeVhF804wVgXSzHqI4BjrSMbHNr0lkXLkSfqoQPKRarmo_i0tJPvsJ-3htr-ZJjgwNQyRiPtLpagPrUGHd67wLvNDr9nYNnbfDGYT17QEqe7r8 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_912759d94bb94f538d9c26344fd358e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}] Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3cff49ac81154056860c4d1e0bb4c5ef Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1071874998", "metadata": {"Type": "work"}}} Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1071874998', 'metadata': {'Type': 'work'}}}} Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi '' Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:53:09.934466 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:53:09.940370 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:09.954337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88f5d2bf-abe1-44fc-a821-72725f6f1777 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:09.955587 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88f5d2bf-abe1-44fc-a821-72725f6f1777 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035804 Aug 29 15:53:09.956714 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2498/5185] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:53:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:53:09.963931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:09.964786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:09.987781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.988616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.989229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.990355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.991080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.991805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:10.046435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:10.239207 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f843a749-92ca-47ff-8902-e57cf1d53180 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 204 len: 0 microversion: 2.1 time: 0.280386 Aug 29 15:53:10.243535 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2499/5186] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:09 2022] DELETE /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:10.251112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b97aa772-13b2-4362-ba54-6c0943ed71cc tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Calling method '.version_select at 0x7fb0e2632550>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:10.281639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:10.298944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ed4e6ff3-0feb-4c47-82c2-d59fc90d2c6c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.588116 Aug 29 15:53:10.299955 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2688/5187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:09 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:10.307394 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b97aa772-13b2-4362-ba54-6c0943ed71cc tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] HTTP exception thrown: Volume tempest-invalid-1656509357 could not be found. Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b97aa772-13b2-4362-ba54-6c0943ed71cc tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Request method failure captured: Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1656509357 HTTP/1.1 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDODkZJlurqqsuBFoIyjRCqwrv1_cC8DKafEStjGnUapIlCueYRfxQFgG9Cb__9ykKWeVhF804wVgXSzHqI4BjrSMbHNr0lkXLkSfqoQPKRarmo_i0tJPvsJ-3htr-ZJjgwNQyRiPtLpagPrUGHd67wLvNDr9nYNnbfDGYT17QEqe7r8 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_912759d94bb94f538d9c26344fd358e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}] Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3cff49ac81154056860c4d1e0bb4c5ef Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume tempest-invalid-1656509357 could not be found. Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'tempest-invalid-1656509357'} Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1656509357 could not be found. (HTTP 404) (Request-ID: req-197eda2a-4507-4bfc-bf07-456c7d936d98) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:53:10.309554 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1656509357 could not be found. Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1656509357 could not be found. Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1656509357 could not be found. Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b97aa772-13b2-4362-ba54-6c0943ed71cc tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Returning 404 to user: Volume tempest-invalid-1656509357 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:10.315468 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b97aa772-13b2-4362-ba54-6c0943ed71cc tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1656509357" status: 404 len: 99 microversion: 2.1 time: 0.066342 Aug 29 15:53:10.341302 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2500/5188] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:53:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1656509357 => generated 99 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:53:10.364440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:10.373674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:10.403153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:10.403680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:10.404731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:10.405514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:10.405976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:10.406550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:10.446784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-712776129", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "db542865-54c7-46a5-aa11-f7cbffdb0047"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:10.547530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:10.558252 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-257f5760-df2b-4012-b62a-e5caed395c57 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1465 microversion: 2.1 time: 0.215117 Aug 29 15:53:10.561440 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2501/5189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:10 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1465 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:10.579507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:10.580341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:10.592925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] validate_networks() for [('db542865-54c7-46a5-aa11-f7cbffdb0047', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:53:10.604033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:10.605029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:10.605735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:10.606845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:10.607568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:10.608280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.237460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:11.254374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:11.258431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:11.260025 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cfc11c5-90b9-4a07-97a2-62878c578a84 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1739 microversion: 2.20 time: 0.697541 Aug 29 15:53:11.265714 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2502/5190] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:10 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1739 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:11.277159 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b156c1b-a937-4ca7-85c6-b610abe14ef0 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009444 Aug 29 15:53:11.278296 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2503/5191] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Aug 29 15:53:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:53:11.291009 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9aca7fb0-3eee-4f57-b119-1624c113588c tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005814 Aug 29 15:53:11.295736 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2504/5192] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:53:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:53:11.327390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1455b105-b546-48f5-9d21-883f69cedd97 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Calling method '.version_select at 0x7fb0e320a4c0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:11.441755 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-1455b105-b546-48f5-9d21-883f69cedd97 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] HTTP exception thrown: Volume a31bfb34-47a2-478d-99dc-47c11ec26f33 could not be found. Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1455b105-b546-48f5-9d21-883f69cedd97 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Request method failure captured: Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/os-volumes/a31bfb34-47a2-478d-99dc-47c11ec26f33 HTTP/1.1 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDODkZJlurqqsuBFoIyjRCqwrv1_cC8DKafEStjGnUapIlCueYRfxQFgG9Cb__9ykKWeVhF804wVgXSzHqI4BjrSMbHNr0lkXLkSfqoQPKRarmo_i0tJPvsJ-3htr-ZJjgwNQyRiPtLpagPrUGHd67wLvNDr9nYNnbfDGYT17QEqe7r8 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_912759d94bb94f538d9c26344fd358e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}] Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3cff49ac81154056860c4d1e0bb4c5ef Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume a31bfb34-47a2-478d-99dc-47c11ec26f33 could not be found. Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a31bfb34-47a2-478d-99dc-47c11ec26f33'} Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a31bfb34-47a2-478d-99dc-47c11ec26f33 could not be found. (HTTP 404) (Request-ID: req-d94a3e73-da9b-40ed-83b2-62b1a586bae2) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:53:11.444824 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a31bfb34-47a2-478d-99dc-47c11ec26f33 could not be found. Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a31bfb34-47a2-478d-99dc-47c11ec26f33 could not be found. Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a31bfb34-47a2-478d-99dc-47c11ec26f33 could not be found. Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1455b105-b546-48f5-9d21-883f69cedd97 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Returning 404 to user: Volume a31bfb34-47a2-478d-99dc-47c11ec26f33 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1455b105-b546-48f5-9d21-883f69cedd97 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/a31bfb34-47a2-478d-99dc-47c11ec26f33" status: 404 len: 109 microversion: 2.1 time: 0.139542 Aug 29 15:53:11.452335 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2505/5193] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:53:11 2022] DELETE /compute/v2.1/os-volumes/a31bfb34-47a2-478d-99dc-47c11ec26f33 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:11.465874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:11.468068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:11.501545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.502066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.502502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.508444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.508951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.509437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.840376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:11.862407 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fd6f1f1e-53dc-462c-a6c8-49b03ebfe869 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.412116 Aug 29 15:53:11.864732 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2506/5194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:11 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:11.875860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3059fe9c-d6c1-42d4-a9fb-ab98a4727165 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Calling method '.version_select at 0x7fb0e2f39af0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:11.918563 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-3059fe9c-d6c1-42d4-a9fb-ab98a4727165 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] HTTP exception thrown: Volume 088ab678-59f4-48d4-b035-34305bf26dac could not be found. Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3059fe9c-d6c1-42d4-a9fb-ab98a4727165 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Request method failure captured: Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/os-volumes/088ab678-59f4-48d4-b035-34305bf26dac HTTP/1.1 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDODkZJlurqqsuBFoIyjRCqwrv1_cC8DKafEStjGnUapIlCueYRfxQFgG9Cb__9ykKWeVhF804wVgXSzHqI4BjrSMbHNr0lkXLkSfqoQPKRarmo_i0tJPvsJ-3htr-ZJjgwNQyRiPtLpagPrUGHd67wLvNDr9nYNnbfDGYT17QEqe7r8 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/912759d94bb94f538d9c26344fd358e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_912759d94bb94f538d9c26344fd358e5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/912759d94bb94f538d9c26344fd358e5"}]}] Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 912759d94bb94f538d9c26344fd358e5 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesNegativeTest-861399809 Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 3cff49ac81154056860c4d1e0bb4c5ef Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesNegativeTest-861399809-project Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: method: Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: exception: Volume 088ab678-59f4-48d4-b035-34305bf26dac could not be found. Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '088ab678-59f4-48d4-b035-34305bf26dac'} Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 088ab678-59f4-48d4-b035-34305bf26dac could not be found. (HTTP 404) (Request-ID: req-e5719ceb-77cd-419e-82fe-412abaca1003) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:53:11.921759 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 088ab678-59f4-48d4-b035-34305bf26dac could not be found. Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 088ab678-59f4-48d4-b035-34305bf26dac could not be found. Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 088ab678-59f4-48d4-b035-34305bf26dac could not be found. Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:11.927681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3059fe9c-d6c1-42d4-a9fb-ab98a4727165 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] Returning 404 to user: Volume 088ab678-59f4-48d4-b035-34305bf26dac could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:11.932761 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3059fe9c-d6c1-42d4-a9fb-ab98a4727165 tempest-VolumesNegativeTest-861399809 tempest-VolumesNegativeTest-861399809-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/088ab678-59f4-48d4-b035-34305bf26dac" status: 404 len: 109 microversion: 2.1 time: 0.057042 Aug 29 15:53:11.932761 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2507/5195] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:53:11 2022] GET /compute/v2.1/os-volumes/088ab678-59f4-48d4-b035-34305bf26dac => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:11.945001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:11.948782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:11.968718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.973930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.974699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.976946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.977625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.979876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.330796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:12.348580 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b19a7175-90ef-43a5-ba53-3821f1247bd3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1465 microversion: 2.1 time: 0.417946 Aug 29 15:53:12.349959 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2508/5196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:11 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1465 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:12.383380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:12.390576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:12.407116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:53:12.408571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:53:12.408994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.409483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:53:12.410532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:53:12.410666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.411187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.411751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:53:12.412618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.414507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.415460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.443000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.444077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.447490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.452788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.453575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.456786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.484878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:12.507466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Getting quotas for project 40c8dfe3aa504903b706c3fb65a8211e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:12.519047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Getting quotas for user fd4769547d9c4863b66db8c1eff4f8bb and project 40c8dfe3aa504903b706c3fb65a8211e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:12.541432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:53:12.546053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:53:12.647362 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d1d22309-aa79-4da6-80eb-145fe426a757 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321349 Aug 29 15:53:12.648139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2689/5197] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:53:12.660173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-036dcfba-e819-4d4b-a78e-442a07959729 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:12.661127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-036dcfba-e819-4d4b-a78e-442a07959729 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:12.805982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-036dcfba-e819-4d4b-a78e-442a07959729 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:12.825011 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-036dcfba-e819-4d4b-a78e-442a07959729 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1214 microversion: 2.1 time: 0.169070 Aug 29 15:53:12.826733 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2690/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:12 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:12.897832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:12.902180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:12.915643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.921294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.922290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.924356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.925324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.928917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:13.050435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:13.062696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:13.064130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:13.065349 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-60013f5c-f836-47f6-b48e-d53e30b5e3f1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1721 microversion: 2.20 time: 0.711730 Aug 29 15:53:13.073819 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2509/5199] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:12 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1721 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:13.379263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:13.380801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:13.442894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:13.449908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:13.451940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:13.453311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:13.461081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:13.462122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:13.842531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:13.860382 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2594290-faaa-4a35-b9a7-787a7ee79326 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1465 microversion: 2.1 time: 0.489619 Aug 29 15:53:13.862320 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2510/5200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:13 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1465 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:13.877452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:13.878527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:13.896100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:13.897990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:13.898630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:13.900603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:13.902383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:13.904610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.012882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:14.032284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73fbc3f0-7f6c-4f67-96c6-d29201a16160 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 1.150456 Aug 29 15:53:14.033836 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2691/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:12 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:14.070362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:14.083511 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3840e965-9511-4fcf-9b8e-7ef2c8ead0eb tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1266 microversion: 2.1 time: 0.217989 Aug 29 15:53:14.097902 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2511/5202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:13 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:14.102771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:14.104638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:14.119250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:14.121057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:14.121800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.122838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:14.123747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:14.125422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.678759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:14.696944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:14.705592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:14.710299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4996b7fb-8ffd-4083-bd89-e63fcc31747c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1721 microversion: 2.20 time: 0.622944 Aug 29 15:53:14.713738 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2692/5203] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:14 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1721 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:53:14.889987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:14.890956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:14.909063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-626eb873-70a5-488d-9fcd-4cc8df352f23 req-986ad1e4-9ac0-43f3-bce0-1088517fa728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6e279b-a092-4e0b-8740-2ab3cdd3276e", "name": "network-vif-deleted", "tag": "433ed27d-6106-4c8c-a89b-b30fdaa6ff16"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:14.915530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:14.920685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:14.925467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.926693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:14.929755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-626eb873-70a5-488d-9fcd-4cc8df352f23 req-986ad1e4-9ac0-43f3-bce0-1088517fa728 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:14.930500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:14.931139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.934290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-626eb873-70a5-488d-9fcd-4cc8df352f23 req-986ad1e4-9ac0-43f3-bce0-1088517fa728 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:14.939415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-626eb873-70a5-488d-9fcd-4cc8df352f23 req-986ad1e4-9ac0-43f3-bce0-1088517fa728 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.963723 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-626eb873-70a5-488d-9fcd-4cc8df352f23 req-986ad1e4-9ac0-43f3-bce0-1088517fa728 service nova] Creating event network-vif-deleted:433ed27d-6106-4c8c-a89b-b30fdaa6ff16 for instance af6e279b-a092-4e0b-8740-2ab3cdd3276e on n-h1-854882-3 Aug 29 15:53:14.984465 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-626eb873-70a5-488d-9fcd-4cc8df352f23 req-986ad1e4-9ac0-43f3-bce0-1088517fa728 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.405277 Aug 29 15:53:14.986562 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2512/5204] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:15.060280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:15.068841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:15.069755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:15.083517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.084008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.084727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:15.087166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b5a7285-4da1-464a-84cd-a03470296548 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1465 microversion: 2.1 time: 0.206756 Aug 29 15:53:15.087892 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2693/5205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:14 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1465 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:15.088222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.090036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.090509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:15.116844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:15.125330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:15.143556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.144073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.144525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:15.145487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.145995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.146433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:15.273978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:15.291142 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-09c25796-a8b4-487b-a481-3e4509f9ca4d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1274 microversion: 2.1 time: 0.181710 Aug 29 15:53:15.291970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2694/5206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:15 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:15.404365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:15.413013 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-91671817-f92a-4342-ad60-69ae80a0955a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.357033 Aug 29 15:53:15.414039 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2513/5207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:15 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:15.740428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:15.741631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:15.761366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.762711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.763889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:15.765274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.766669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.767755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.121075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:16.128523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:16.175423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.179337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.181678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.183694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.187413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.192242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.493523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.494884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.495909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.497782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lazy-loading 'fault' on Instance uuid af6e279b-a092-4e0b-8740-2ab3cdd3276e {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:16.614884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:16.648363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:16.650965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:16.653367 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-373fd084-e0ae-488c-9a84-4aed4901c7b9 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1721 microversion: 2.20 time: 0.920944 Aug 29 15:53:16.655459 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2695/5208] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:15 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1721 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:53:16.668239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:16.669263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:16.681681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.682449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.684251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.690598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.692266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.692923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.893437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:16.907664 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e8c7f64-2423-4389-87e8-1a2a4fc32fc8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 200 len: 1304 microversion: 2.1 time: 0.801736 Aug 29 15:53:16.911135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:16.913146 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2514/5209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:16 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 1304 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:16.941463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:16.942394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:16.944000 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-902b2d52-3428-4b56-8dda-1be214781c00 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1272 microversion: 2.1 time: 0.286404 Aug 29 15:53:16.956499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.956499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.956499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.956814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.957619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.958706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.960149 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2696/5210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:16 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:16.965748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-972765a8-0677-4b35-a3ce-b57278a48b2a req-7dc5f397-42b3-4a33-abaa-ad99afde6d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "name": "network-vif-unplugged", "status": "completed", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:16.979217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-972765a8-0677-4b35-a3ce-b57278a48b2a req-7dc5f397-42b3-4a33-abaa-ad99afde6d53 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.980255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-972765a8-0677-4b35-a3ce-b57278a48b2a req-7dc5f397-42b3-4a33-abaa-ad99afde6d53 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.980964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-972765a8-0677-4b35-a3ce-b57278a48b2a req-7dc5f397-42b3-4a33-abaa-ad99afde6d53 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:17.007356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.compute.server_external_events [req-972765a8-0677-4b35-a3ce-b57278a48b2a req-7dc5f397-42b3-4a33-abaa-ad99afde6d53 service nova] Unable to find a host for instance cc738f5e-e78a-4030-9027-b69a1df31032. Dropping event network-vif-unplugged {{(pid=130002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:53:17.017525 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-972765a8-0677-4b35-a3ce-b57278a48b2a req-7dc5f397-42b3-4a33-abaa-ad99afde6d53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055688 Aug 29 15:53:17.019631 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2697/5211] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:53:17.237435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:17.245762 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76f4d1e0-32fb-4715-a220-e6a1158ab66d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.331355 Aug 29 15:53:17.248499 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2515/5212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:16 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:17.678852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:17.680150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:17.688492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:17.689361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:17.690164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:17.691119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:17.691784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:17.695951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:17.940362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:17.941117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: af6e279b-a092-4e0b-8740-2ab3cdd3276e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:17.952603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:17.953112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:17.953642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:17.954900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:17.955786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:17.956435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:17.985924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:17.987723 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] HTTP exception thrown: Instance af6e279b-a092-4e0b-8740-2ab3cdd3276e could not be found. Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Request method failure captured: Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e HTTP/1.1 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7gilGWWc6o29gKBNjrobKSdTqLhwFnqSflY2odYo3gGp2Rp54Ukd9KFrzitSKe6QyCWj61U6LPD25i9myJ_STWgTJ2iHrMBfr9pIJzAYvRNmf9W6BST2s-1orSzQrWLqf5-BO88k_4cYDzPD7GzMtvHxV9eEou14q-4QeDxUPNR9A Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c147d42182146409a91f2e0359f2e98", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}] Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a68002795ce541338b30129e6dbb0fb6 Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance af6e279b-a092-4e0b-8740-2ab3cdd3276e could not be found. Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'af6e279b-a092-4e0b-8740-2ab3cdd3276e'} Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6e279b-a092-4e0b-8740-2ab3cdd3276e could not be found. Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6e279b-a092-4e0b-8740-2ab3cdd3276e could not be found. Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:17.997461 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:18.002050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:18.002050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:18.002050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:18.002050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:18.002050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:18.002050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6e279b-a092-4e0b-8740-2ab3cdd3276e could not be found. Aug 29 15:53:18.002050 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:18.009682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Returning 404 to user: Instance af6e279b-a092-4e0b-8740-2ab3cdd3276e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:18.011287 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9ace238-041f-4989-98e4-35a70c447029 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e" status: 404 len: 111 microversion: 2.1 time: 0.075182 Aug 29 15:53:18.016154 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2516/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:17 2022] GET /compute/v2.1/servers/af6e279b-a092-4e0b-8740-2ab3cdd3276e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:53:18.024118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:18.024778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:18.033065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.033602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.034049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.034804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.035286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.035714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.200997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:18.220535 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-15661b85-995b-46b3-a903-4c0b614fc066 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1272 microversion: 2.1 time: 0.201792 Aug 29 15:53:18.237342 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2517/5214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:18 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:18.245518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:18.247217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:18.254456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.255281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.256012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.258151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.259194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.259871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.312596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:18.399737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:18.413268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:18.420726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:18.422097 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0fa7d463-ee6c-4752-a9d5-0b7bd9796638 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1664 microversion: 2.20 time: 0.747213 Aug 29 15:53:18.422677 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2698/5215] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:17 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1664 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:18.435658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:18.437558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:18.445485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.446318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.446756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.447729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.448396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.448832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.493557 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-906232b9-fc9c-489b-82c4-d1cc7c564ac4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 204 len: 0 microversion: 2.1 time: 0.253861 Aug 29 15:53:18.494670 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2518/5216] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:18 2022] DELETE /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:18.508916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15becdaf-a728-4dc9-81ff-6df3e4abb271"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:18.513858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:18.520716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.522410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.523116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.524158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:18.524854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:18.525582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:18.992238 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5f2e164e-1571-4ba8-b83a-b89ba9228dad tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.495557 Aug 29 15:53:19.000337 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2519/5217] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Aug 29 15:53:18 2022] POST /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-volume_attachments => generated 188 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:53:19.012888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:19.015847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:19.031165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.032081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.035307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:19.036261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.038527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.039164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:19.184348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:19.198455 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8fddb353-eae3-4106-a1a7-ff4c97629a1a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.766225 Aug 29 15:53:19.202263 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2699/5218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:18 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:19.242853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:19.243647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:19.252749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.253249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.253725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:19.254447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.254912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.255345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:19.582426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:19.597543 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d9bedde2-d3b6-4030-a2c5-35e8a1608846 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1508 microversion: 2.1 time: 0.594579 Aug 29 15:53:19.598722 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2520/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:19 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1508 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:19.608689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:19.609458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:19.634688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.636845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.637456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:19.641163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.643491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.645029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:19.836760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:19.850446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-094b3ab1-fbaf-484e-814f-0f5268e29944 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1314 microversion: 2.1 time: 0.611771 Aug 29 15:53:19.851696 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2700/5220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:19 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:20.116105 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d518cb1-26dd-4775-afb3-afdb109ab4f3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-volume_attachments/15becdaf-a728-4dc9-81ff-6df3e4abb271" status: 202 len: 0 microversion: 2.20 time: 0.514855 Aug 29 15:53:20.117201 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2521/5221] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Aug 29 15:53:19 2022] DELETE /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-volume_attachments/15becdaf-a728-4dc9-81ff-6df3e4abb271 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:20.212009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:20.212845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:20.223617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:20.224318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:20.229594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.230600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.235462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.236415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.238053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.238730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.239654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.242011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.242655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.249191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.249948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.250487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.487384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:20.491338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130002) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 15:53:20.587544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:20.607885 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-64f2988c-e135-46e2-b4f6-bde07fa21f13 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.388632 Aug 29 15:53:20.614464 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2522/5222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:20 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:20.631458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:20.632572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:20.644271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.652246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.652725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.656133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.656878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.657645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.661115 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6628c986-1f8a-4e36-ae8f-9a2ed6f78b5e tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "POST /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/action" status: 202 len: 0 microversion: 2.20 time: 0.452197 Aug 29 15:53:20.661915 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2701/5223] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Aug 29 15:53:20 2022] POST /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:20.677225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:20.679172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:20.696047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.696631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.698352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.700202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.701756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.703947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.962515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:20.979224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4611c172-b5d8-42f4-9b53-16dcb6dacc63 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1508 microversion: 2.1 time: 0.352099 Aug 29 15:53:20.981178 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2523/5224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:20 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:21.007091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:21.007728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:21.020009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.020513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.020958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.021964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.022423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.028468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.346948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.355647 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-03239666-5c4f-4f2b-aea6-e4da235d8920 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1314 microversion: 2.1 time: 0.372565 Aug 29 15:53:21.356333 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2524/5225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:20 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:21.389138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.398311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.400215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.401467 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b011ae3-c088-45fe-8212-c9fee8e8bccb tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1672 microversion: 2.20 time: 0.734664 Aug 29 15:53:21.402051 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2702/5226] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:20 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1672 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:21.637893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:21.640153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:21.657506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.659337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.660222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.664915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.666853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.667564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.006048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.007055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.021030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.023611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.024286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.028007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.030206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.030840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.192190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:22.203848 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1216e8d4-aef4-4982-8d7d-d8fe76633f3c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1523 microversion: 2.1 time: 0.572846 Aug 29 15:53:22.206844 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2525/5227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:21 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:22.308730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:22.322384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-56ab184d-67d7-4e8b-92f2-88ba978fabee req-6425cb58-75a9-4fd9-99ba-3012be05ed05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e438716-de97-482f-842e-ebdb75a24e6b", "name": "network-vif-deleted", "tag": "e2089e44-0270-4f41-a47a-1693edd7b379"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:22.331768 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ca0b098-207f-4a0d-8fee-2175670bf19e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 200 len: 1466 microversion: 2.1 time: 0.330739 Aug 29 15:53:22.352941 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2703/5228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:21 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 1466 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:22.361236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-56ab184d-67d7-4e8b-92f2-88ba978fabee req-6425cb58-75a9-4fd9-99ba-3012be05ed05 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.362330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-56ab184d-67d7-4e8b-92f2-88ba978fabee req-6425cb58-75a9-4fd9-99ba-3012be05ed05 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.363103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-56ab184d-67d7-4e8b-92f2-88ba978fabee req-6425cb58-75a9-4fd9-99ba-3012be05ed05 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.380261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.380906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.405262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.405948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.406223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.407008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.407369 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-56ab184d-67d7-4e8b-92f2-88ba978fabee req-6425cb58-75a9-4fd9-99ba-3012be05ed05 service nova] Creating event network-vif-deleted:e2089e44-0270-4f41-a47a-1693edd7b379 for instance 4e438716-de97-482f-842e-ebdb75a24e6b on n-h2-854882-3 Aug 29 15:53:22.407497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.407883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.418517 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-56ab184d-67d7-4e8b-92f2-88ba978fabee req-6425cb58-75a9-4fd9-99ba-3012be05ed05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100456 Aug 29 15:53:22.430998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2526/5229] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:22.437470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.447693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.480822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.483375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.486226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:22.487607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.489334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.490338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.492254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.497631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:22.817309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:22.864287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:22.875624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa0372a3-e4b8-4005-8e92-7086197e2b7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1314 microversion: 2.1 time: 0.500963 Aug 29 15:53:22.876225 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2704/5230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:22 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:23.104260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:23.121595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:23.123905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:23.128823 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b944e9c7-c384-4d11-8603-5639acbe9da0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1672 microversion: 2.20 time: 0.692812 Aug 29 15:53:23.129485 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2527/5231] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:22 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1672 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:23.226622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:23.227253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:23.246733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.256873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.257644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.258635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.259309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.259909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.366825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:23.367869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 4e438716-de97-482f-842e-ebdb75a24e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:23.389043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.391223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.392060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.395074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.395805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.402579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.423536 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] HTTP exception thrown: Instance 4e438716-de97-482f-842e-ebdb75a24e6b could not be found. Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Request method failure captured: Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b HTTP/1.1 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7gilGWWc6o29gKBNjrobKSdTqLhwFnqSflY2odYo3gGp2Rp54Ukd9KFrzitSKe6QyCWj61U6LPD25i9myJ_STWgTJ2iHrMBfr9pIJzAYvRNmf9W6BST2s-1orSzQrWLqf5-BO88k_4cYDzPD7GzMtvHxV9eEou14q-4QeDxUPNR9A Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c147d42182146409a91f2e0359f2e98", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}] Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a68002795ce541338b30129e6dbb0fb6 Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 4e438716-de97-482f-842e-ebdb75a24e6b could not be found. Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '4e438716-de97-482f-842e-ebdb75a24e6b'} Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e438716-de97-482f-842e-ebdb75a24e6b could not be found. Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e438716-de97-482f-842e-ebdb75a24e6b could not be found. Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:23.425884 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.430723 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:23.430723 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:23.430723 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:23.430723 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:23.430723 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:23.430723 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e438716-de97-482f-842e-ebdb75a24e6b could not be found. Aug 29 15:53:23.430723 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.434328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Returning 404 to user: Instance 4e438716-de97-482f-842e-ebdb75a24e6b could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:23.435689 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dcd3ce9b-9d1f-438f-aa19-cc64d05030d4 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b" status: 404 len: 111 microversion: 2.1 time: 0.073637 Aug 29 15:53:23.436834 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2528/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:23 2022] GET /compute/v2.1/servers/4e438716-de97-482f-842e-ebdb75a24e6b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:23.446590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:23.447610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:23.477681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.478513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.479364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.480467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.481430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.483323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.546847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:23.714030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:23.726924 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-411ebbb0-a3f8-44d2-9695-c278576159df tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1503 microversion: 2.1 time: 0.504098 Aug 29 15:53:23.727880 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2705/5233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:23 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1503 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:23.746674 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-160f1915-c963-4306-9876-56cc34af5f6e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 204 len: 0 microversion: 2.1 time: 0.303577 Aug 29 15:53:23.748173 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2529/5234] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:23 2022] DELETE /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:23.757349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-89cde915-8358-4fde-a177-c3f02fde1f9c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'create', calling method: .version_select at 0x7fb0e2693280>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-836255142", "description": "tempest-description-874315672"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:23.757595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:23.758539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:23.780291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.780767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.781208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.781945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.782637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.783554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.194556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-89cde915-8358-4fde-a177-c3f02fde1f9c tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.447598 Aug 29 15:53:24.195413 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2706/5235] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Aug 29 15:53:23 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:24.208233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:24.208845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:24.223333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.223939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.224462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.226808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.227376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.227921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.511690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:24.516464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:24.521016 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee17fa3a-8297-4e94-9630-f3cb2778e2b9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1495 microversion: 2.1 time: 0.768734 Aug 29 15:53:24.521918 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2530/5236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:23 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1495 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:24.526815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:24.527703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:24.529912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:24.536625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.537357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.538046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.538826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.539328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.539807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.541504 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba48e7f8-4ed7-4f50-8a48-9dda80098444 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1314 microversion: 2.1 time: 0.337132 Aug 29 15:53:24.553932 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2707/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:24 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:24.561398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-836255142"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:24.562246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:24.569234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.570094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.570719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.571645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.572282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.572938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.576792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:24.883498 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.network.security_group_api [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Adding security group 8113c3e9-d104-42d9-b6de-f2009968ac54 to port ef4111ba-14bb-4b4d-8376-3a02f4965421 Aug 29 15:53:25.149952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:25.158902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:25.160358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:25.161607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b564f52-ae71-4d7c-ac62-542413daa0c1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.638410 Aug 29 15:53:25.162182 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2531/5238] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:24 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:25.182530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-fb65f9f3-88d8-4ba4-ab1d-23172c84fca4 req-39712a01-3b51-49a4-aee6-80c3da5efffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bc6bf6-c4e3-4d67-8bb8-9db4592afeba", "tag": "cb97d959-d59b-4fc6-a460-0529e80b91c1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:25.200393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fb65f9f3-88d8-4ba4-ab1d-23172c84fca4 req-39712a01-3b51-49a4-aee6-80c3da5efffe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.201743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fb65f9f3-88d8-4ba4-ab1d-23172c84fca4 req-39712a01-3b51-49a4-aee6-80c3da5efffe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.202370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fb65f9f3-88d8-4ba4-ab1d-23172c84fca4 req-39712a01-3b51-49a4-aee6-80c3da5efffe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.224285 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fb65f9f3-88d8-4ba4-ab1d-23172c84fca4 req-39712a01-3b51-49a4-aee6-80c3da5efffe service nova] Creating event network-changed:cb97d959-d59b-4fc6-a460-0529e80b91c1 for instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba on n-h1-854882-3 Aug 29 15:53:25.234107 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-fb65f9f3-88d8-4ba4-ab1d-23172c84fca4 req-39712a01-3b51-49a4-aee6-80c3da5efffe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070252 Aug 29 15:53:25.235274 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2532/5239] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:25.555406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:25.571301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:25.619903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.621774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.627026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.630413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.636508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.637360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.618920 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f0dd530-3589-4d16-b9b3-dcc06036ac01 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action" status: 202 len: 0 microversion: 2.1 time: 2.063751 Aug 29 15:53:26.620498 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2708/5240] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:24 2022] POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action => generated 0 bytes in 2066 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:26.627055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:26.628411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:26.645107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.651601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.652321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.653188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.653823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.654530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.805866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:26.821946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b345dc29-d232-4661-a40b-9ed2ea301129 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 200 len: 1495 microversion: 2.1 time: 1.273458 Aug 29 15:53:26.842222 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2533/5241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:25 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 1495 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:26.842222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:26.842222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:26.856554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.856554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.856554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.856554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.856554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.856554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.266588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:27.311453 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-50f00fcc-9be2-4375-9bde-b39394a04f6c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1314 microversion: 2.1 time: 0.656384 Aug 29 15:53:27.315408 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2709/5242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:26 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:27.344202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-836255142"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:27.345667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:27.376545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.386878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.387552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.388905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.389687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.398976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.519802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:27.557548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:27.559749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:27.561304 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65055e5b-c56a-4344-8b79-fdb0ad80f502 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.733458 Aug 29 15:53:27.562083 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2534/5243] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:26 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:27.569591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3edbcce6-b654-49cf-9208-fb16b36a46c8 req-0658c8fa-c97e-4657-b8fa-6e217a0e1f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb9a407-82b4-40c2-ba1e-ef58bfd63187", "name": "network-vif-deleted", "tag": "71729a0b-5c0f-4a43-a173-b074572cc882"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:27.599335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3edbcce6-b654-49cf-9208-fb16b36a46c8 req-0658c8fa-c97e-4657-b8fa-6e217a0e1f9a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.599900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3edbcce6-b654-49cf-9208-fb16b36a46c8 req-0658c8fa-c97e-4657-b8fa-6e217a0e1f9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.604990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3edbcce6-b654-49cf-9208-fb16b36a46c8 req-0658c8fa-c97e-4657-b8fa-6e217a0e1f9a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.635914 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3edbcce6-b654-49cf-9208-fb16b36a46c8 req-0658c8fa-c97e-4657-b8fa-6e217a0e1f9a service nova] Creating event network-vif-deleted:71729a0b-5c0f-4a43-a173-b074572cc882 for instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 on n-h2-854882-3 Aug 29 15:53:27.651774 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3edbcce6-b654-49cf-9208-fb16b36a46c8 req-0658c8fa-c97e-4657-b8fa-6e217a0e1f9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088229 Aug 29 15:53:27.652773 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2535/5244] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:27.659328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-75248670-15ce-493a-97ca-3545c5559dde req-caf9b49d-2693-4e54-b009-2a80fc338166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}, {"name": "network-changed", "server_uuid": "1bf4dfad-f241-47c2-afda-b91e0e7e6b67", "tag": "ef4111ba-14bb-4b4d-8376-3a02f4965421"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:27.681911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-75248670-15ce-493a-97ca-3545c5559dde req-caf9b49d-2693-4e54-b009-2a80fc338166 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.694632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-75248670-15ce-493a-97ca-3545c5559dde req-caf9b49d-2693-4e54-b009-2a80fc338166 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.695349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-75248670-15ce-493a-97ca-3545c5559dde req-caf9b49d-2693-4e54-b009-2a80fc338166 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.712958 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-75248670-15ce-493a-97ca-3545c5559dde req-caf9b49d-2693-4e54-b009-2a80fc338166 service nova] Creating event network-changed:81fb5f09-4b24-46e4-b6cd-b0488f3dfb25 for instance cc738f5e-e78a-4030-9027-b69a1df31032 on n-h2-854882-3 Aug 29 15:53:27.713820 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-75248670-15ce-493a-97ca-3545c5559dde req-caf9b49d-2693-4e54-b009-2a80fc338166 service nova] Creating event network-changed:ef4111ba-14bb-4b4d-8376-3a02f4965421 for instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 on n-h1-854882-3 Aug 29 15:53:27.723096 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-75248670-15ce-493a-97ca-3545c5559dde req-caf9b49d-2693-4e54-b009-2a80fc338166 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068010 Aug 29 15:53:27.724329 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2536/5245] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:27.796886 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.network.security_group_api [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Removing security group 8113c3e9-d104-42d9-b6de-f2009968ac54 from port ef4111ba-14bb-4b4d-8376-3a02f4965421 Aug 29 15:53:27.866551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:27.867488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 7cb9a407-82b4-40c2-ba1e-ef58bfd63187] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:27.882358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.883032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.894034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.896209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.898415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.900460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.950963 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] HTTP exception thrown: Instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 could not be found. Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Request method failure captured: Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 HTTP/1.1 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7gilGWWc6o29gKBNjrobKSdTqLhwFnqSflY2odYo3gGp2Rp54Ukd9KFrzitSKe6QyCWj61U6LPD25i9myJ_STWgTJ2iHrMBfr9pIJzAYvRNmf9W6BST2s-1orSzQrWLqf5-BO88k_4cYDzPD7GzMtvHxV9eEou14q-4QeDxUPNR9A Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c147d42182146409a91f2e0359f2e98", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}] Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a68002795ce541338b30129e6dbb0fb6 Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 could not be found. Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '7cb9a407-82b4-40c2-ba1e-ef58bfd63187'} Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 could not be found. Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 could not be found. Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:27.955026 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:27.960535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:27.960535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:27.960535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:27.960535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:27.960535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:27.960535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 could not be found. Aug 29 15:53:27.960535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:27.964762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Returning 404 to user: Instance 7cb9a407-82b4-40c2-ba1e-ef58bfd63187 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:27.965819 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-becdaa9c-a2f6-4df4-8ed4-49d55182272e tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187" status: 404 len: 111 microversion: 2.1 time: 0.105111 Aug 29 15:53:27.968402 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2537/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:27 2022] GET /compute/v2.1/servers/7cb9a407-82b4-40c2-ba1e-ef58bfd63187 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:53:27.986131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:27.990230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:28.006407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.010182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.011056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.012882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.014643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.016658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.098400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:28.329018 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a87bd041-a15c-4e7d-9fbf-4ad6fbabdbd9 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 204 len: 0 microversion: 2.1 time: 0.353654 Aug 29 15:53:28.335820 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2538/5247] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:27 2022] DELETE /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:28.393680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:28.396363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:28.415057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.416082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.416768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.418370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.419300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.420207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.848943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:28.867998 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a50e3e6c-f782-466b-928f-4fd64e00c236 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1675 microversion: 2.1 time: 0.523787 Aug 29 15:53:28.870907 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2539/5248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:28 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1675 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:28.885292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:28.889872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:28.906043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.906941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.907616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.908546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.909253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.909927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.042988 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8009d8ed-1324-47b8-873b-40068636f055 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action" status: 202 len: 0 microversion: 2.1 time: 1.708174 Aug 29 15:53:29.047696 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2710/5249] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:27 2022] POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action => generated 0 bytes in 1713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:29.058124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:29.060564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:29.074709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.079211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.084848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.086091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.092491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.097996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.437048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:29.446197 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-15df7e43-26e7-4570-b79c-26b3747d9c51 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1314 microversion: 2.1 time: 0.572793 Aug 29 15:53:29.453883 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2540/5250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:28 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:29.463006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1131198b-3751-46cf-a586-b57b3329d1d5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'create', calling method: .version_select at 0x7fb0e260f280>, body: {"pool": null} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:30.000853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.019701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.021398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.025100 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6efb330-bd6c-4b4c-b37f-83f8be3449c3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.975877 Aug 29 15:53:30.026853 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2711/5251] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:29 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:30.042835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-70160e35-c805-4b9a-a6c3-cb7d2756ad8d req-c3e4080e-608a-41e2-9e5f-c7116fe96daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf4dfad-f241-47c2-afda-b91e0e7e6b67", "tag": "ef4111ba-14bb-4b4d-8376-3a02f4965421"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:30.054086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-70160e35-c805-4b9a-a6c3-cb7d2756ad8d req-c3e4080e-608a-41e2-9e5f-c7116fe96daf service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.055595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-70160e35-c805-4b9a-a6c3-cb7d2756ad8d req-c3e4080e-608a-41e2-9e5f-c7116fe96daf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.056245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-70160e35-c805-4b9a-a6c3-cb7d2756ad8d req-c3e4080e-608a-41e2-9e5f-c7116fe96daf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.070353 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-70160e35-c805-4b9a-a6c3-cb7d2756ad8d req-c3e4080e-608a-41e2-9e5f-c7116fe96daf service nova] Creating event network-changed:ef4111ba-14bb-4b4d-8376-3a02f4965421 for instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 on n-h1-854882-3 Aug 29 15:53:30.079605 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-70160e35-c805-4b9a-a6c3-cb7d2756ad8d req-c3e4080e-608a-41e2-9e5f-c7116fe96daf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043891 Aug 29 15:53:30.081017 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2712/5252] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:30.089759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:30.090798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:30.098662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.099476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.100145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.101646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.102850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.103761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.906067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.936114 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-33daba55-1da6-4f36-8cc7-d9ea2951c6e3 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1675 microversion: 2.1 time: 0.852762 Aug 29 15:53:30.954968 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2713/5253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:30 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1675 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:30.969359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:30.972852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:30.998621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.999164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.999668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.000515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.001121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.001622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.464115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:31.478817 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d9c9eb42-1307-4aba-8418-83d03a4b4b3c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1314 microversion: 2.1 time: 0.518439 Aug 29 15:53:31.479619 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2714/5254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:30 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:31.492247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d46b515f-9fa5-4447-80ec-51271c0b0c26 req-2d9288a6-8a73-4169-9f61-d08acbb708cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bc6bf6-c4e3-4d67-8bb8-9db4592afeba", "name": "network-vif-plugged", "status": "completed", "tag": "cb97d959-d59b-4fc6-a460-0529e80b91c1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:31.524745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d46b515f-9fa5-4447-80ec-51271c0b0c26 req-2d9288a6-8a73-4169-9f61-d08acbb708cb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.529451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d46b515f-9fa5-4447-80ec-51271c0b0c26 req-2d9288a6-8a73-4169-9f61-d08acbb708cb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.531408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d46b515f-9fa5-4447-80ec-51271c0b0c26 req-2d9288a6-8a73-4169-9f61-d08acbb708cb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.582935 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d46b515f-9fa5-4447-80ec-51271c0b0c26 req-2d9288a6-8a73-4169-9f61-d08acbb708cb service nova] Creating event network-vif-plugged:cb97d959-d59b-4fc6-a460-0529e80b91c1 for instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba on n-h1-854882-3 Aug 29 15:53:31.599889 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d46b515f-9fa5-4447-80ec-51271c0b0c26 req-2d9288a6-8a73-4169-9f61-d08acbb708cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113663 Aug 29 15:53:31.603248 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2715/5255] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:31.618669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:31.619455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:31.636714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.639325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.640151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.641082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.642729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.645350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.950035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:32.968888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:32.971149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:32.984915 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1687e08a-2380-4420-ab84-64f3de53f107 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 1.374962 Aug 29 15:53:32.985829 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2716/5256] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:31 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:32.998623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8c1a8289-c182-4015-ad82-9927ca57d7e8 req-8e71ff6d-3219-41ed-a119-0f82e0f2a3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5341307c-698b-4787-bc09-6b5d2c2a1824", "name": "network-vif-deleted", "tag": "56835bc8-aa8c-4a8a-9b22-967e3b09909d"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:33.043200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8c1a8289-c182-4015-ad82-9927ca57d7e8 req-8e71ff6d-3219-41ed-a119-0f82e0f2a3a2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.043876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8c1a8289-c182-4015-ad82-9927ca57d7e8 req-8e71ff6d-3219-41ed-a119-0f82e0f2a3a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.044562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8c1a8289-c182-4015-ad82-9927ca57d7e8 req-8e71ff6d-3219-41ed-a119-0f82e0f2a3a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.080388 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8c1a8289-c182-4015-ad82-9927ca57d7e8 req-8e71ff6d-3219-41ed-a119-0f82e0f2a3a2 service nova] Creating event network-vif-deleted:56835bc8-aa8c-4a8a-9b22-967e3b09909d for instance 5341307c-698b-4787-bc09-6b5d2c2a1824 on n-h2-854882-3 Aug 29 15:53:33.103265 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8c1a8289-c182-4015-ad82-9927ca57d7e8 req-8e71ff6d-3219-41ed-a119-0f82e0f2a3a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115833 Aug 29 15:53:33.104530 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2717/5257] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:33.110114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:33.116379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:33.142041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.142651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.143124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.143969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.144441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.144959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.227431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.227925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.228365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.228830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lazy-loading 'fault' on Instance uuid 5341307c-698b-4787-bc09-6b5d2c2a1824 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:33.635234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a68002795ce541338b30129e6dbb0fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c147d42182146409a91f2e0359f2e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:33.643492 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24e9f7fc-7299-4e66-a86a-20c82657cc65 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 200 len: 1329 microversion: 2.1 time: 0.537459 Aug 29 15:53:33.661634 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2718/5258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:33 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 1329 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:33.682184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:33.682952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:33.690336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.690836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.691308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.698413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.698916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.699365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.070471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1131198b-3751-46cf-a586-b57b3329d1d5 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.615315 Aug 29 15:53:34.072751 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2541/5259] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Aug 29 15:53:29 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:34.084753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:34.086100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:34.099038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.100946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.104302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.105054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.113777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.114483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.437806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:34.449328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-595fcb78-3931-4cdd-baf9-b2dbfa68304d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1501 microversion: 2.1 time: 0.785832 Aug 29 15:53:34.454151 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2719/5260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:33 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1501 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:34.467112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.7"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:34.480829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:34.493490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.494455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.497953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.498957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.499611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.501425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.569263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "refresh_cache-1bf4dfad-f241-47c2-afda-b91e0e7e6b67" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:53:34.579931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquired lock "refresh_cache-1bf4dfad-f241-47c2-afda-b91e0e7e6b67" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:53:34.735717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:34.756500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:34.759216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:34.760729 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e76a65b3-dc58-44a0-9d8a-b39a8e559941 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.686548 Aug 29 15:53:34.782461 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2542/5261] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:34 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:34.804823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:34.806241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:34.815510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.816885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.818479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.820036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.820728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.821756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.353834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:35.388386 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b49d5627-52d2-4bc7-8bee-f407c50a4da9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1501 microversion: 2.1 time: 0.604492 Aug 29 15:53:35.407179 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2543/5262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:34 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1501 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:35.423420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.424252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] [instance: 5341307c-698b-4787-bc09-6b5d2c2a1824] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.447013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.447771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.448378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.449273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.452528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.453195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.471555 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] HTTP exception thrown: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 could not be found. Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Request method failure captured: Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 HTTP/1.1 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN7gilGWWc6o29gKBNjrobKSdTqLhwFnqSflY2odYo3gGp2Rp54Ukd9KFrzitSKe6QyCWj61U6LPD25i9myJ_STWgTJ2iHrMBfr9pIJzAYvRNmf9W6BST2s-1orSzQrWLqf5-BO88k_4cYDzPD7GzMtvHxV9eEou14q-4QeDxUPNR9A Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c147d42182146409a91f2e0359f2e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c147d42182146409a91f2e0359f2e98", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c147d42182146409a91f2e0359f2e98"}]}] Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 2c147d42182146409a91f2e0359f2e98 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1690089586 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: a68002795ce541338b30129e6dbb0fb6 Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-1690089586-project Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 could not be found. Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5341307c-698b-4787-bc09-6b5d2c2a1824'} Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 could not be found. Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 could not be found. Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:35.473703 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:35.479779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:35.479779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:35.479779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:35.479779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:35.479779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:35.479779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 could not be found. Aug 29 15:53:35.479779 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:35.482365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Returning 404 to user: Instance 5341307c-698b-4787-bc09-6b5d2c2a1824 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:35.484271 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fdd8a6a2-1fa7-41c7-a626-80e193b943b8 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824" status: 404 len: 111 microversion: 2.1 time: 0.074563 Aug 29 15:53:35.489940 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2544/5263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/5341307c-698b-4787-bc09-6b5d2c2a1824 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:35.496973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:35.505950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.514216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.515035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.516707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.517933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.518657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.519410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.557938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:35.568763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lazy-loading 'flavor' on Instance uuid 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:35.686011 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-32a21069-a53a-47e8-98c3-f625a638cd44 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action" status: 202 len: 0 microversion: 2.1 time: 0.193660 Aug 29 15:53:35.687326 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2545/5264] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:35 2022] POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:35.695252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa3311c3-baf6-4121-b25b-1adb5eb6b331 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] Calling method '.version_select at 0x7fb0e260f700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.733282 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa3311c3-baf6-4121-b25b-1adb5eb6b331 tempest-ServerActionsTestJSON-1690089586 tempest-ServerActionsTestJSON-1690089586-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973218798" status: 202 len: 0 microversion: 2.1 time: 0.041833 Aug 29 15:53:35.739278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2546/5265] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973218798 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:35.752877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.754169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.764661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.765550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.766914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.769793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.771002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.771731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.342134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:36.359599 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a113f848-70ba-4615-a24b-fb4bd3396e0d tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1509 microversion: 2.1 time: 0.618426 Aug 29 15:53:36.370310 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2547/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1509 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:36.376596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:36.376596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:36.395493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.395998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.396445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.398227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.399759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.400212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.351246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:37.359857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:37.366506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:37.367838 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f9df8b6c-b135-4ce3-8bf5-0f761159e4cf tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 1.004576 Aug 29 15:53:37.373467 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2548/5267] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:36 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:37.393599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:37.394611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:37.411737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.412499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.413229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.414222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.415155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.415807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.157076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Building network info cache for instance {{(pid=130002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:53:39.282682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:39.300049 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-70a825c9-c3a7-4a90-9fb9-1e001018209f tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1492 microversion: 2.1 time: 1.904132 Aug 29 15:53:39.318854 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2549/5268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:37 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1492 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:39.335890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:39.340015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:39.356934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.357438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.357875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.358569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.359017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.359428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.005255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:40.018758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:40.027857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:40.034642 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7a17ef3-86bf-4044-bf28-0a98ed502e3d tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.714684 Aug 29 15:53:40.035435 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2550/5269] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:39 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:40.066181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-69298d32-0ffb-4c56-a907-d1c028c171d3 req-bf8bff7d-1bc1-43d6-96c2-08b2deb23d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf4dfad-f241-47c2-afda-b91e0e7e6b67", "tag": "ef4111ba-14bb-4b4d-8376-3a02f4965421"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:40.115449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-69298d32-0ffb-4c56-a907-d1c028c171d3 req-bf8bff7d-1bc1-43d6-96c2-08b2deb23d28 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.118013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-69298d32-0ffb-4c56-a907-d1c028c171d3 req-bf8bff7d-1bc1-43d6-96c2-08b2deb23d28 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.120077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-69298d32-0ffb-4c56-a907-d1c028c171d3 req-bf8bff7d-1bc1-43d6-96c2-08b2deb23d28 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.162165 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-69298d32-0ffb-4c56-a907-d1c028c171d3 req-bf8bff7d-1bc1-43d6-96c2-08b2deb23d28 service nova] Creating event network-changed:ef4111ba-14bb-4b4d-8376-3a02f4965421 for instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 on n-h1-854882-3 Aug 29 15:53:40.183304 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-69298d32-0ffb-4c56-a907-d1c028c171d3 req-bf8bff7d-1bc1-43d6-96c2-08b2deb23d28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135874 Aug 29 15:53:40.187096 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2551/5270] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:40.210932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:40.217969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:40.242629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.244610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.246259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.252915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.254037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.256387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.483586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-90424e4b-96f2-4127-b67a-d1a6f854158e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action" status: 202 len: 0 microversion: 2.1 time: 0.294666 Aug 29 15:53:40.488065 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2552/5271] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:40 2022] POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:40.511462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:40.515831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:40.535523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.550302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.552085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.553108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.554594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.555313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.223660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Updating instance_info_cache with network_info: [{"id": "ef4111ba-14bb-4b4d-8376-3a02f4965421", "address": "fa:16:3e:96:99:20", "network": {"id": "adfa223e-9b3e-4da0-b596-969dfbcc8318", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-689600269-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2e9c174d274442a592b9306e146ff891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapef4111ba-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:53:41.243850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Releasing lock "refresh_cache-1bf4dfad-f241-47c2-afda-b91e0e7e6b67" {{(pid=130002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:53:41.247872 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e30cc980-f0eb-45aa-9900-a5b8f8b016cb tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action" status: 202 len: 0 microversion: 2.1 time: 6.785886 Aug 29 15:53:41.252930 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2720/5272] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:34 2022] POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action => generated 0 bytes in 6795 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:53:41.274942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:41.279849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.316536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.318868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.319740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.321682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.335598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.338793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.456009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:41.472634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f5483e52-8b08-410a-8443-3842704c73a3 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1498 microversion: 2.1 time: 0.983119 Aug 29 15:53:41.475287 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2553/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:40 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1498 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:41.486292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.7"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:41.932711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.940969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.941787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.942924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.945159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.946003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.947866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.793199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:42.806525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:42.815011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:42.823956 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-08bafe71-9d3a-4107-909e-0c5a2010b5f8 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 1.566011 Aug 29 15:53:42.828508 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2721/5274] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:41 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:42.838475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:42.839357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:42.869264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.875825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.876515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.877676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.881957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.885685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.350802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "refresh_cache-1bf4dfad-f241-47c2-afda-b91e0e7e6b67" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:53:43.352100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquired lock "refresh_cache-1bf4dfad-f241-47c2-afda-b91e0e7e6b67" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:53:43.993254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:44.033283 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-58ba1404-f733-439c-95eb-abea72f7b3b2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1498 microversion: 2.1 time: 1.183854 Aug 29 15:53:44.037284 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2722/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:42 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1498 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:44.067170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:44.072325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:44.108432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:44.118269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:44.120868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:44.131037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:44.132248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:44.133342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:44.700899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:44.726122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:44.729550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:44.732852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-050d62ba-0058-43dc-9b9e-5cbe5a26d5b3 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.690169 Aug 29 15:53:44.753505 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2723/5276] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:44 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:45.063809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:45.064491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:45.079213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.082123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.082790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.085771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.086247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.088925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.474243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:45.486623 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a966190-6efd-4d2c-848e-d3acad6928f2 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1501 microversion: 2.1 time: 0.427757 Aug 29 15:53:45.487249 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2724/5277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:45 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1501 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:45.519762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:45.520319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:45.529781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Building network info cache for instance {{(pid=130001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:53:45.535581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.536079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.536518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.538399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.540351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.541004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.577429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lazy-loading 'flavor' on Instance uuid 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:45.607294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:45.784008 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-719ea2d9-0191-4408-89f8-a9688ca05220 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action" status: 202 len: 0 microversion: 2.1 time: 0.274406 Aug 29 15:53:45.790130 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2725/5278] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:45 2022] POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:45.798093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6e856789-8333-4af3-9366-5c1560f1a2f1 req-d378dc8a-3e0c-4fe0-8bef-2e1dce35b093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf4dfad-f241-47c2-afda-b91e0e7e6b67", "tag": "ef4111ba-14bb-4b4d-8376-3a02f4965421"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:45.827070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6e856789-8333-4af3-9366-5c1560f1a2f1 req-d378dc8a-3e0c-4fe0-8bef-2e1dce35b093 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.827633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6e856789-8333-4af3-9366-5c1560f1a2f1 req-d378dc8a-3e0c-4fe0-8bef-2e1dce35b093 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.828874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6e856789-8333-4af3-9366-5c1560f1a2f1 req-d378dc8a-3e0c-4fe0-8bef-2e1dce35b093 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.855888 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6e856789-8333-4af3-9366-5c1560f1a2f1 req-d378dc8a-3e0c-4fe0-8bef-2e1dce35b093 service nova] Creating event network-changed:ef4111ba-14bb-4b4d-8376-3a02f4965421 for instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 on n-h1-854882-3 Aug 29 15:53:45.863870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6e856789-8333-4af3-9366-5c1560f1a2f1 req-d378dc8a-3e0c-4fe0-8bef-2e1dce35b093 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071730 Aug 29 15:53:45.865203 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2726/5279] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:45.871935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:45.873157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:45.901541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.902517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.902972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.904230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.904696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.905530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.310055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:46.318891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:46.328760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:46.330002 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77a96818-c778-439d-948a-def11fcda567 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.463278 Aug 29 15:53:46.330572 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2727/5280] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:45 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:46.335353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.339686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.352747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.355320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.355911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.357775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.361616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.362202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.624327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:46.636577 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2cca15d8-cdf9-496f-9db3-af4b097e9348 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1492 microversion: 2.1 time: 0.304694 Aug 29 15:53:46.639123 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2728/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:46 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1492 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:46.665207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:46.666074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.677332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.677945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.678362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.679209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.679868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.680198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.780195 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6dccf20-ebc0-404e-aea7-180823091993 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action" status: 202 len: 0 microversion: 2.1 time: 0.123228 Aug 29 15:53:46.781485 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2729/5282] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:46 2022] POST /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:46.803675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.805062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.830112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.832120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.832652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.834205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.836218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.837595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.931287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Updating instance_info_cache with network_info: [{"id": "ef4111ba-14bb-4b4d-8376-3a02f4965421", "address": "fa:16:3e:96:99:20", "network": {"id": "adfa223e-9b3e-4da0-b596-969dfbcc8318", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-689600269-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2e9c174d274442a592b9306e146ff891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapef4111ba-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:53:47.947101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Releasing lock "refresh_cache-1bf4dfad-f241-47c2-afda-b91e0e7e6b67" {{(pid=130001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:53:47.948449 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bff684f8-839d-442b-bc36-7eed21af39e3 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action" status: 202 len: 0 microversion: 2.1 time: 6.471870 Aug 29 15:53:47.952988 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2554/5283] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:41 2022] POST /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67/action => generated 0 bytes in 6477 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:53:47.965282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:47.967430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:47.969052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:47.979219 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a6413e0-5e2f-48e3-a08b-46b6eae11cea tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1498 microversion: 2.1 time: 1.183647 Aug 29 15:53:47.987237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.988102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.988654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.991337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.995001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.995716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.996779 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2730/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:46 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1498 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:48.008492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa6dc6aa-c5b5-41e5-84c3-ea3034f5942d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '.version_select at 0x7fb0e36355e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:48.745935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:48.761151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:48.763469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:48.766950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-836af001-1c25-4d22-8930-586fa76c23a0 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.812350 Aug 29 15:53:48.767787 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2555/5285] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:47 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:49.003555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:49.004260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:49.014368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.015902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.017521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.018330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.020510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.022289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.336635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:49.344310 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-758297b2-b384-4685-a5b6-69120c28a6ff tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1498 microversion: 2.1 time: 0.344893 Aug 29 15:53:49.353376 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2556/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:48 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1498 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:49.441435 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa6dc6aa-c5b5-41e5-84c3-ea3034f5942d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d3de8938-40a5-4cee-b0e2-9045aff7e986" status: 202 len: 0 microversion: 2.1 time: 1.443357 Aug 29 15:53:49.442144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2731/5287] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:53:47 2022] DELETE /compute/v2.1/os-floating-ips/d3de8938-40a5-4cee-b0e2-9045aff7e986 => generated 0 bytes in 1445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:49.453660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb3d0c24-8d70-4b52-93b9-60528cf725d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '.version_select at 0x7fb0e30e3c10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:49.801927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:49.803517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:49.837599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.839262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.840368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.843153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.843813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.846217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.143601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:50.156264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:50.157924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:50.160691 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96149ae1-8a85-408f-838c-d81a6c8842dd tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.373017 Aug 29 15:53:50.162002 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2732/5288] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:49 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:50.210143 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb3d0c24-8d70-4b52-93b9-60528cf725d9 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8113c3e9-d104-42d9-b6de-f2009968ac54" status: 202 len: 0 microversion: 2.1 time: 0.761662 Aug 29 15:53:50.210741 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2557/5289] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 15:53:49 2022] DELETE /compute/v2.1/os-security-groups/8113c3e9-d104-42d9-b6de-f2009968ac54 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:50.219797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:50.223888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:50.233448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.234210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.234876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.235690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.236248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.236779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.266716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:50.377002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:50.377650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:50.395742 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f089deed-7e57-4408-8efd-3115f0f36400 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 204 len: 0 microversion: 2.1 time: 0.180226 Aug 29 15:53:50.396989 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2733/5290] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:50 2022] DELETE /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:50.401583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.402081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.402520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.403270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.403722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.404304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.407246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:50.408173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:50.415352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.415986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.416708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.417842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.418509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.419641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.747768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:50.758649 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-49ca5a4d-7dbd-4c94-97ab-8098fc3e1e1e tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1509 microversion: 2.1 time: 0.356571 Aug 29 15:53:50.772528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:50.773412 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2734/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:50 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:50.785930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3ece5bb-9fa9-4679-8891-bd7b042d2981 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1501 microversion: 2.1 time: 0.409796 Aug 29 15:53:50.786742 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2558/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:50 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1501 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:50.810361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:50.811109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:50.813866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:50.828428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.829213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.829680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.830403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.830857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.834801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.894404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:51.078846 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ad2d4a8-eaee-4cbc-9019-54cc560d4798 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 204 len: 0 microversion: 2.1 time: 0.272873 Aug 29 15:53:51.079409 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2735/5293] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:50 2022] DELETE /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:51.090366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:51.092055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:51.101775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.103390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.104130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.105193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.105995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.107332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.184836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:51.186188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:51.199190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.200358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.200610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.201326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.201809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.202273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.652285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:51.666482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:51.669151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:51.671381 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7cc2d311-9367-45da-90c6-bdff0d58a58f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.490538 Aug 29 15:53:51.672211 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2736/5294] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:51 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:53:51.705158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4d47bdcc-2375-4854-b049-f99acdbacaf2 req-99958239-ace5-49f9-b392-4eaeeab3fb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "name": "network-vif-plugged", "status": "completed", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:51.728524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d47bdcc-2375-4854-b049-f99acdbacaf2 req-99958239-ace5-49f9-b392-4eaeeab3fb02 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.730345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d47bdcc-2375-4854-b049-f99acdbacaf2 req-99958239-ace5-49f9-b392-4eaeeab3fb02 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.731060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4d47bdcc-2375-4854-b049-f99acdbacaf2 req-99958239-ace5-49f9-b392-4eaeeab3fb02 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.762450 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4d47bdcc-2375-4854-b049-f99acdbacaf2 req-99958239-ace5-49f9-b392-4eaeeab3fb02 service nova] Creating event network-vif-plugged:81fb5f09-4b24-46e4-b6cd-b0488f3dfb25 for instance cc738f5e-e78a-4030-9027-b69a1df31032 on n-h2-854882-3 Aug 29 15:53:51.770895 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4d47bdcc-2375-4854-b049-f99acdbacaf2 req-99958239-ace5-49f9-b392-4eaeeab3fb02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079483 Aug 29 15:53:51.771878 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2737/5295] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:51.783805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:51.784726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:51.788700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:51.807118 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ec08686-4b22-4a45-9095-273a31308b2c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1507 microversion: 2.1 time: 0.722878 Aug 29 15:53:51.807805 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2559/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:51 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1507 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:51.808857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.810426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.814260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.815234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.819138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.819864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.306545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:52.326221 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd36aaf8-9a45-4dce-8f46-e2d3f830eebf tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1509 microversion: 2.1 time: 0.548272 Aug 29 15:53:52.329140 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2738/5297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:51 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:52.696401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:52.697489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:52.710779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.711976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.712812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.713783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.714427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.716742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.831500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:52.832775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:52.840787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.841693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.842459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.843803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.844625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.845178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.854894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:53.147757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:53.161287 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-653cf605-9dd6-47a5-b9a0-84f41c9fe7c9 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1507 microversion: 2.1 time: 0.335587 Aug 29 15:53:53.175827 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2739/5298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:52 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:53.330309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:53.344862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:53.346335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:53.349954 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65d2cfee-60fe-494e-a2f1-05eb188b8172 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 0.658726 Aug 29 15:53:53.350842 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2560/5299] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:52 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:53:53.364039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:53.366968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:53.376918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.377793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.378958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.380422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.382191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.383129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.824361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:53.857696 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63e02f0b-319a-4804-8022-6d766e8da0a6 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1509 microversion: 2.1 time: 0.501381 Aug 29 15:53:53.859098 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2740/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:53 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:54.184216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:54.185610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:54.199087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.199586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.200671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.201422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.206433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.207055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.240589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:54.378821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:54.379853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:54.412037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.418442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.423519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.425863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.426367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.426820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.609289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:54.621602 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9f9c9f7d-4f40-4a64-8b2c-bf4628dbf669 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1507 microversion: 2.1 time: 0.440392 Aug 29 15:53:54.623478 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2561/5301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:54 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:54.880111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:54.881141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:54.884906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:54.910833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.911326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.911758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.912464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.912913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.913333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.526768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:55.554054 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75c44e18-e8aa-4f2a-aee0-223d68ae9f4d tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1509 microversion: 2.1 time: 0.676319 Aug 29 15:53:55.555032 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2562/5302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:54 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1509 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:55.593188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:55.615622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:55.625309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:55.626897 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f48f59e6-430f-43c3-b367-b071411e5709 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1730 microversion: 2.20 time: 1.252903 Aug 29 15:53:55.649848 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2741/5303] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:54 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1730 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:55.650825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:55.651707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.669511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.671891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.685575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.690727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.691415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.696283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.643492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:56.659506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b47b94f4-daff-48fd-ac24-61b25068c37c tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1507 microversion: 2.1 time: 1.013059 Aug 29 15:53:56.669884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2563/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:55 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1507 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:56.682598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e8070de7-d81c-4ff3-a137-9271dc1cb2ae req-4577ad8e-c65b-4b09-a036-d5614309d57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bc6bf6-c4e3-4d67-8bb8-9db4592afeba", "name": "network-vif-deleted", "tag": "cb97d959-d59b-4fc6-a460-0529e80b91c1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:56.716226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e8070de7-d81c-4ff3-a137-9271dc1cb2ae req-4577ad8e-c65b-4b09-a036-d5614309d57d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.717523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e8070de7-d81c-4ff3-a137-9271dc1cb2ae req-4577ad8e-c65b-4b09-a036-d5614309d57d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.718770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e8070de7-d81c-4ff3-a137-9271dc1cb2ae req-4577ad8e-c65b-4b09-a036-d5614309d57d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.750900 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e8070de7-d81c-4ff3-a137-9271dc1cb2ae req-4577ad8e-c65b-4b09-a036-d5614309d57d service nova] Creating event network-vif-deleted:cb97d959-d59b-4fc6-a460-0529e80b91c1 for instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba on n-h1-854882-3 Aug 29 15:53:56.761065 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e8070de7-d81c-4ff3-a137-9271dc1cb2ae req-4577ad8e-c65b-4b09-a036-d5614309d57d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087458 Aug 29 15:53:56.764700 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2564/5305] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:56.776980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:56.779153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:56.786673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1451427053", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": "none"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:56.798880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.799683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.800265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.803841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.805903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.806580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.891871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.894144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.895793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.897604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lazy-loading 'fault' on Instance uuid 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:56.939711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:53:56.940702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:53:56.941195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:53:56.941961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:53:56.942388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:53:56.964098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.968343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.969051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.970073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.970767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.972398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.987495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.002755 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c95de0c7-f2d5-480a-b69d-a9395f738554 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1313 microversion: 2.1 time: 0.236761 Aug 29 15:53:57.006384 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2565/5306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:56 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:57.021507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d8222b1f-4ded-4d3c-b48b-91b893475d6a req-b965dd12-f68d-4685-9f29-a1a2396ee410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf4dfad-f241-47c2-afda-b91e0e7e6b67", "name": "network-vif-deleted", "tag": "ef4111ba-14bb-4b4d-8376-3a02f4965421"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:57.039979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d8222b1f-4ded-4d3c-b48b-91b893475d6a req-b965dd12-f68d-4685-9f29-a1a2396ee410 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.040952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d8222b1f-4ded-4d3c-b48b-91b893475d6a req-b965dd12-f68d-4685-9f29-a1a2396ee410 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.042719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d8222b1f-4ded-4d3c-b48b-91b893475d6a req-b965dd12-f68d-4685-9f29-a1a2396ee410 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.048884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Getting quotas for project 1000fe730f2e4cce8f941050ea854b34. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:57.058454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Getting quotas for user bdbaa320cf0e46b79579f858aac51192 and project 1000fe730f2e4cce8f941050ea854b34. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:57.073254 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d8222b1f-4ded-4d3c-b48b-91b893475d6a req-b965dd12-f68d-4685-9f29-a1a2396ee410 service nova] Creating event network-vif-deleted:ef4111ba-14bb-4b4d-8376-3a02f4965421 for instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 on n-h1-854882-3 Aug 29 15:53:57.077145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:53:57.079853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:53:57.087270 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d8222b1f-4ded-4d3c-b48b-91b893475d6a req-b965dd12-f68d-4685-9f29-a1a2396ee410 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076347 Aug 29 15:53:57.091760 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2566/5307] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:57.108933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:57.114630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:57.130096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.130853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.133008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.135177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.135838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.136567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.185277 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-caa5efd8-2018-426e-a31c-5b0bfc691c9f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.027836 Aug 29 15:53:57.199819 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2742/5308] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Aug 29 15:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:53:57.218830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f496aaa-3db5-434e-9c8a-22873c234840 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:57.219663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f496aaa-3db5-434e-9c8a-22873c234840 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:57.436142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f496aaa-3db5-434e-9c8a-22873c234840 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.465699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f496aaa-3db5-434e-9c8a-22873c234840 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.470705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f496aaa-3db5-434e-9c8a-22873c234840 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.478372 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f496aaa-3db5-434e-9c8a-22873c234840 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1278 microversion: 2.54 time: 0.276172 Aug 29 15:53:57.478976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2743/5309] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:57 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:57.601776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.612780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.616577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.617855 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e01ea17-33c6-4e81-b3bb-11101d671073 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1717 microversion: 2.20 time: 0.523680 Aug 29 15:53:57.618437 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2567/5310] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:57 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1717 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:53:57.685988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:57.686767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:57.697956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.699688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.701080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.703643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.704298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.705150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.796052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.797615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.798073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.801184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lazy-loading 'fault' on Instance uuid 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:58.040296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:58.042697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:58.061746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.064170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.064829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.067842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.069866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.071909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.147735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.149714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.150483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.151578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lazy-loading 'fault' on Instance uuid 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:58.219898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf3b2473a141efbb1a2904ade04d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9c174d274442a592b9306e146ff891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.247890 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d927f28e-e96d-43fa-9bd7-65c2530c905a tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 200 len: 1313 microversion: 2.1 time: 0.219970 Aug 29 15:53:58.251641 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2568/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:58 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:58.492456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4769547d9c4863b66db8c1eff4f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c8dfe3aa504903b706c3fb65a8211e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.502917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:58.503545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:58.514646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e12960f7-4cbe-489f-a06c-070cff6ebed8 tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 200 len: 1304 microversion: 2.1 time: 0.835176 Aug 29 15:53:58.514999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.515679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.518039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.518467 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2744/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:57 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 1304 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:58.519375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.522547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.523318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.644940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.657081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.660813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.662494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef027baa-8bbe-42a4-890d-4863af0bc6b0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1282 microversion: 2.54 time: 0.164021 Aug 29 15:53:58.663258 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2569/5313] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:58 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:53:59.276054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:59.277720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] [instance: 1bf4dfad-f241-47c2-afda-b91e0e7e6b67] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:59.299029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.300853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.304413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.305825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.310730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.311318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.376941 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] HTTP exception thrown: Instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 could not be found. Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Request method failure captured: Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 HTTP/1.1 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOC6NmHqECXi2ZmV-E8EUu1rYB4bHhFEwTp7uOG8R7YFQ9XLhZquQ3dQkEIytyyVFtCLA8lhSYBW7ToLLxmpdIyRL0MLR8xhYpMMJHIkFXvsmZiQXpopt3cj_JgKR2Njzn-qwUZDWfWDLMf4LLvN5zNq7wqmWDES7wZNUfTG5PnWKK4 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 2e9c174d274442a592b9306e146ff891 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1766800466 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e9c174d274442a592b9306e146ff891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e9c174d274442a592b9306e146ff891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e9c174d274442a592b9306e146ff891", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e9c174d274442a592b9306e146ff891"}]}] Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1766800466 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 2e9c174d274442a592b9306e146ff891 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1766800466 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerRescueTestJSONUnderV235-1766800466-project Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: eaaf3b2473a141efbb1a2904ade04d34 Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1766800466-project Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 could not be found. Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '1bf4dfad-f241-47c2-afda-b91e0e7e6b67'} Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 could not be found. Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 could not be found. Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.384800 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 could not be found. Aug 29 15:53:59.390144 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.405473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] Returning 404 to user: Instance 1bf4dfad-f241-47c2-afda-b91e0e7e6b67 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:59.407364 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8f7b986-a45c-4df6-8dd8-1237b3757391 tempest-ServerRescueTestJSONUnderV235-1766800466 tempest-ServerRescueTestJSONUnderV235-1766800466-project] 10.222.0.16 "GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67" status: 404 len: 111 microversion: 2.1 time: 0.138701 Aug 29 15:53:59.421744 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2745/5314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:59 2022] GET /compute/v2.1/servers/1bf4dfad-f241-47c2-afda-b91e0e7e6b67 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:59.545655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:59.547055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] [instance: 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:59.565172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.565865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.566481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.567428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.571914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.572493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.590008 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] HTTP exception thrown: Instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba could not be found. Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Request method failure captured: Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba HTTP/1.1 Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDODh22ep2S-CTIGbz8Gnzb1lRtod4BTXHe1ff5Mb71GsK3YNo94Tt9Mq37mR68387c8Yjl5TF-3FCuXCCM9K0SKqdweTl2OoeYLy7DMsG6_Q7WKD7uE6lQJ9iQX2BdPz3fibdMUrvS7Gg5L1xNUQYtXtKw3EbOMRSM3xunU5MbaeZEU Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 40c8dfe3aa504903b706c3fb65a8211e Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestServerAdvancedOps-370235879 Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40c8dfe3aa504903b706c3fb65a8211e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40c8dfe3aa504903b706c3fb65a8211e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40c8dfe3aa504903b706c3fb65a8211e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40c8dfe3aa504903b706c3fb65a8211e"}]}] Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestServerAdvancedOps-370235879 Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 40c8dfe3aa504903b706c3fb65a8211e Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestServerAdvancedOps-370235879 Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestServerAdvancedOps-370235879-project Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: fd4769547d9c4863b66db8c1eff4f8bb Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestServerAdvancedOps-370235879-project Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba could not be found. Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '21bc6bf6-c4e3-4d67-8bb8-9db4592afeba'} Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba could not be found. Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba could not be found. Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:59.593081 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.596531 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:59.596531 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:59.596531 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:59.596531 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:59.596531 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:59.596531 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba could not be found. Aug 29 15:53:59.596531 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:53:59.598470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] Returning 404 to user: Instance 21bc6bf6-c4e3-4d67-8bb8-9db4592afeba could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:59.600117 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b1e1dfe-60af-4588-9ee9-10360dce9a7e tempest-TestServerAdvancedOps-370235879 tempest-TestServerAdvancedOps-370235879-project] 10.222.0.16 "GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba" status: 404 len: 111 microversion: 2.1 time: 0.059328 Aug 29 15:53:59.601582 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2570/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:59 2022] GET /compute/v2.1/servers/21bc6bf6-c4e3-4d67-8bb8-9db4592afeba => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:59.689189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:59.690294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:59.711934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.712446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.717183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.718083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.718576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.719022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:00.024401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:00.038986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:00.083607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:00.085412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-11771991-8dee-4fff-99b7-4c06b1fdef4d tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1330 microversion: 2.54 time: 0.401650 Aug 29 15:54:00.093881 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2746/5316] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:59 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1330 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:01.117124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:01.118469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:01.141281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.150453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.150916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.151666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.152128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.152550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.339642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:01.349656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:01.358288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:01.362544 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-852a7545-9b40-487a-8785-ea3f885a9cd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1336 microversion: 2.54 time: 0.251202 Aug 29 15:54:01.367737 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2571/5317] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:01 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1336 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:02.391980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:02.393027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:02.399906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.400418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.400872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.401642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.402114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.402555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.525950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:02.538274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:02.561506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:02.563784 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-962a6f69-4958-429b-9728-6d972077ad5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1357 microversion: 2.54 time: 0.175729 Aug 29 15:54:02.578672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2747/5318] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:02 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:02.604881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f7bfdda6-6344-4fb7-894b-11b83dbad550 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Action: 'create', calling method: .version_select at 0x7fb0eb573790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-884751449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIcSzRUEQ4kSbgVQTd5Hs5yjzOoX19jcZRZgPpVSrFa1tDuy6kGEO2cqwRVPX7U2OZkPQj7EphpXEtkpbXJoddEpscdGAgpjFCSdX89UacCKfV8PgOymyOyNIJis9Jhpg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:02.645276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f7bfdda6-6344-4fb7-894b-11b83dbad550 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Getting quotas for project 1000fe730f2e4cce8f941050ea854b34. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:02.657184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f7bfdda6-6344-4fb7-894b-11b83dbad550 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Getting quotas for user bdbaa320cf0e46b79579f858aac51192 and project 1000fe730f2e4cce8f941050ea854b34. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:02.727353 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f7bfdda6-6344-4fb7-894b-11b83dbad550 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.128850 Aug 29 15:54:02.728694 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2572/5319] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Aug 29 15:54:02 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:54:02.740050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-884751449", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:02.743449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:02.755299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.757193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.759332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.765785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.766527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.767335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.005195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:03.006940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:03.010427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:03.011779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:03.012525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:03.161013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:03.176041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.178183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.180128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.184480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.185119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.185753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.315359 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70b53814-510b-413a-a704-c7de3d853a10 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "POST /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3/action" status: 202 len: 1139 microversion: 2.54 time: 0.576086 Aug 29 15:54:03.317737 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2748/5320] 10.222.0.16 () {62 vars in 1320 bytes} [Mon Aug 29 15:54:02 2022] POST /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3/action => generated 1139 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:54:03.336724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:03.337555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:03.347233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.351780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.353360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.354206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.359107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.359681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.624224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.639034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.643788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.647391 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e19796d-2cd4-484a-8cf0-8bf6d6a859a8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.312692 Aug 29 15:54:03.660376 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2573/5321] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:03 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:04.680248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:04.680895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:04.699329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:04.700862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:04.701667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:04.703410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:04.706450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:04.707131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.005010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.021951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.024829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.027294 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-246560cc-b00a-4deb-ba74-ca8a94e12941 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.353992 Aug 29 15:54:05.081188 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2749/5322] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:04 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:06.085888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:06.086676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:06.100062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.100881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.102296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.103432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.105325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.109508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.261730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.277192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.279095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.281195 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2fe9fc9e-9ae0-4801-ae5a-cd83d80a171c tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.203527 Aug 29 15:54:06.283588 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2574/5323] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:06 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:07.310890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:07.311511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:07.328746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:07.337778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.338305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.338765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.339524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.339992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.342606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.479423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:07.780286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.799215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.800968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.802252 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b6db2414-05fd-482c-8bc9-51d4c8ac5884 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.497645 Aug 29 15:54:07.806817 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2750/5324] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:07 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:08.832472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.834300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.848713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.849514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.851681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.852584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.853260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.855102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:09.064866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:09.076311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:09.078759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:09.082282 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-587aa036-6416-44e0-9d18-892d465be8fd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.254328 Aug 29 15:54:09.100952 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2575/5325] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:08 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:10.112032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:10.112032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:10.119868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.120426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.121496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.123022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.123801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.124625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.305959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.322651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.325358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.327523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12f20d98-6138-4311-9724-caab140633a6 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.223283 Aug 29 15:54:10.328611 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2751/5326] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:10 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:11.353769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:11.355207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:11.362992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.363719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.364302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.365147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.365881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.371988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.475623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.485380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.487159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.488616 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0175a5f-a14b-44a9-a1ba-dac1277097f9 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.140276 Aug 29 15:54:11.504904 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2576/5327] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:11 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:12.514449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:12.515089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:12.530891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.533032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.536212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.537634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.540512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.541199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.706241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.722504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.723953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.725888 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-122bb2e3-ed0c-441f-b60e-f5915ea1be5a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.217182 Aug 29 15:54:12.726950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2752/5328] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:12 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:13.749547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:13.750742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:13.765160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:13.767142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.771871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.772477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.773362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.773990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.774657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.969376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.985819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.988737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.990383 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e6f84a0-7e42-4682-857a-03f13dcd8a89 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.245349 Aug 29 15:54:14.007816 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2577/5329] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:13 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:15.021628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:15.022904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:15.026602 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 15:54:15.027417 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 15:54:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 (ip 10.222.0.16) !!! Aug 29 15:54:15.049432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.050160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.050783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.051498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.052111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.052539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.217908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.234682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.236394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.237848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b04c66ba-75e0-4622-9e3d-1a5c9107feb5 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.223373 Aug 29 15:54:15.238768 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2753/5330] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:15 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:16.271788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:16.273872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:16.300418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.304656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.306536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.316189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.317901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.319002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.496540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:16.510189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:16.515644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:16.518653 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-602bc00e-207c-4a6f-8009-0ef7c5034552 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.254059 Aug 29 15:54:16.521474 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2578/5331] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:16 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:17.555241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:17.556006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:17.570045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.572861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.577661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.578498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.578983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.579432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.815111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.844277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.846386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.848219 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ca101a2-28d9-43ab-9c7e-410a68b03ea8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.297026 Aug 29 15:54:17.857295 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2754/5332] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:17 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:18.878073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:18.879074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:18.889567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.890247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.890898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.891764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.892355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.892919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.459168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:19.475777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:19.477642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:19.479053 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a474c987-ac1b-4f5d-83e8-19d47b485614 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.607651 Aug 29 15:54:19.480732 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2579/5333] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:20.507477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:20.507477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:20.525335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.525873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.526321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.527055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.528170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.528604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.576499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:20.685975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.699329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.702639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.704192 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-16e71491-82fe-4dae-8d57-affe80792470 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.203315 Aug 29 15:54:20.705021 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2755/5334] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:20 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:21.729380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:21.730049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:21.742645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.744090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.744888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.747640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.748112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.748947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.783963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:21.894976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.908002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.912238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.914288 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a73204be-4384-4c3b-ba62-303cd5564fa8 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.190369 Aug 29 15:54:21.919547 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2580/5335] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:21 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:22.946182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:22.947385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.951393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:22.963733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.964242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.964710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.973796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.974506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.975111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.119850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:23.135872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:23.142513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:23.143757 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-465d7d99-b961-4426-838d-a31c29ac487a tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.202783 Aug 29 15:54:23.147435 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2756/5336] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:22 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:24.169087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:24.170932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:24.205044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.210783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.211349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.214157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.225960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.228333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.477144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.500600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.507392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.522421 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a15dab31-a282-4501-af93-c83924cb249e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.358601 Aug 29 15:54:24.528158 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2581/5337] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:24 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:25.144395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-10272788", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "d3efd83b-bcf4-4a62-bc28-cb42a750ecc3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:25.551914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:25.554063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:25.558071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:25.580199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.582105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.585966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.594217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.595139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.596226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.790481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:25.807462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.821107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.823563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.829830 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-493fe5f7-3e54-465e-a182-4c7ad6e68979 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.278417 Aug 29 15:54:25.833855 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2582/5338] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:25 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:26.522894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:26.523883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:26.524514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:26.525096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:26.525756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:26.557430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.560420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.561033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.564834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.565484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.566138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.610138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:26.624628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:26.648760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:26.651747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:26.735789 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a50f5f98-3332-4bbb-8bf9-229b07017026 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.852248 Aug 29 15:54:26.737833 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2757/5339] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:54:26.758390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-64dcfce7-9ae8-4193-9510-42490632ff48 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:26.759017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-64dcfce7-9ae8-4193-9510-42490632ff48 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:26.858365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:26.859270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:26.872538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.875720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.881619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.884063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.889987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.890760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.989806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-64dcfce7-9ae8-4193-9510-42490632ff48 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.997068 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-64dcfce7-9ae8-4193-9510-42490632ff48 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1191 microversion: 2.1 time: 0.252129 Aug 29 15:54:27.008256 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2583/5340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:26 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1191 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:27.053086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.066096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.067575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.071540 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b88438a6-aa11-4b3d-9951-26d41659b01e tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.218372 Aug 29 15:54:27.076636 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2758/5341] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:26 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:27.726654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:27.731939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:27.763407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.764036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.769362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.772278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.776729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.776729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.846277 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e58d4067-3767-4697-be94-46d6025df58c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.130483 Aug 29 15:54:27.847395 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2584/5342] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Aug 29 15:54:27 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:28.014188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.014608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.028832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.030066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.034533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.035975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.036588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.038442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.040163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.041506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.042139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.043621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.045460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.047472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.062216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.068447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.140923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:28.349662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9763a814-a4d7-4f0a-ba4b-f166924b8c30 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 204 len: 0 microversion: 2.20 time: 0.341043 Aug 29 15:54:28.353764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2759/5343] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:54:28 2022] DELETE /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:54:28.361861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.362989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.374172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.375158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.375751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.377171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.378116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.378708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.438408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.450724 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83dec9f6-d955-4d17-bb84-05b08779fba3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1243 microversion: 2.1 time: 0.426539 Aug 29 15:54:28.457470 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2585/5344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:28 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1243 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:28.486011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.487384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.498737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.499468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.500658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.502126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.502840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.503589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.755602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.774080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.782076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.783496 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8191d79-5e96-4852-b14e-665401307fb3 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.426889 Aug 29 15:54:28.785190 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2760/5345] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:28 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:28.945544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.978523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.983104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.985115 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53615839-30bf-47c5-83fc-0f04a4dcc55f tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 0.526611 Aug 29 15:54:28.986013 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2586/5346] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:28 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:29.478923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:29.479763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:29.493685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.496698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.500566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.501710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.532031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.533432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.673968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.689188 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d2bd64e-8bc8-4773-9104-e07c1ff8100f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1243 microversion: 2.1 time: 0.214751 Aug 29 15:54:29.692693 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2761/5347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:29 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1243 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:29.811028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:29.811659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:29.829325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.829962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.833620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.834602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.835969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.839585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.998986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.013673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:30.014723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:30.018355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.021035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.024191 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-440bb94d-8137-4af0-83e6-867cd1f07c7b tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1408 microversion: 2.54 time: 0.218378 Aug 29 15:54:30.025024 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2587/5348] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:29 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:30.029562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.029562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.029562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.030168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.030951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.033319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.424102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.439426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.441334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.445194 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0efea86-e894-4f20-acad-d712facd66e1 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1723 microversion: 2.20 time: 0.436854 Aug 29 15:54:30.447814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2762/5349] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:30 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:30.719566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:30.720181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:30.727534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.727534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.728258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.729247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.730167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.730797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.801211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.809785 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-377fd847-423c-4fe2-90cc-a8d133c8ade2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1249 microversion: 2.1 time: 0.100538 Aug 29 15:54:30.815708 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2588/5350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:30 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:31.050876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:31.052133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:31.063100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.064102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.065156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.066337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.069181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.069912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.204560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.220470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.223299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.228928 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e240b603-6447-4226-88dd-6d948ed1bea2 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1414 microversion: 2.54 time: 0.183517 Aug 29 15:54:31.232716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4579d1fa-074f-4550-9e40-1ad0369af2bb req-6462deb3-4caf-4601-91ee-e933944754c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc738f5e-e78a-4030-9027-b69a1df31032", "name": "network-vif-deleted", "tag": "81fb5f09-4b24-46e4-b6cd-b0488f3dfb25"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:31.253823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2763/5351] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:31 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1414 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:31.267709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4579d1fa-074f-4550-9e40-1ad0369af2bb req-6462deb3-4caf-4601-91ee-e933944754c1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.268202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4579d1fa-074f-4550-9e40-1ad0369af2bb req-6462deb3-4caf-4601-91ee-e933944754c1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.268639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4579d1fa-074f-4550-9e40-1ad0369af2bb req-6462deb3-4caf-4601-91ee-e933944754c1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.302548 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4579d1fa-074f-4550-9e40-1ad0369af2bb req-6462deb3-4caf-4601-91ee-e933944754c1 service nova] Creating event network-vif-deleted:81fb5f09-4b24-46e4-b6cd-b0488f3dfb25 for instance cc738f5e-e78a-4030-9027-b69a1df31032 on n-h2-854882-3 Aug 29 15:54:31.330525 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4579d1fa-074f-4550-9e40-1ad0369af2bb req-6462deb3-4caf-4601-91ee-e933944754c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089904 Aug 29 15:54:31.331763 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2589/5352] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:31.473157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:31.475324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:31.488364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.491192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.492321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.493312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.494264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.495338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.565145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.565681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.566128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.566591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lazy-loading 'fault' on Instance uuid cc738f5e-e78a-4030-9027-b69a1df31032 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:54:31.647478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.661106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.662640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc8f7bc05b984ea0a3d96aea8a65d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6f1599da704dbc9ec86f3638638bba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.663848 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-328469cf-71aa-42be-b0c2-a7632f1ce468 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 200 len: 1371 microversion: 2.20 time: 0.199536 Aug 29 15:54:31.664421 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2764/5353] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:31 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:31.832351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:31.833068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:31.858493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.859407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.860069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.860958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.874877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.876439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.178350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.187281 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-01243cf5-a2a3-4e8f-bc12-ccedb328f6a8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1291 microversion: 2.1 time: 0.359802 Aug 29 15:54:32.201456 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2590/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:31 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1291 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:32.260670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:32.261310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:32.273055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.274038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.275027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.276476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.277134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.277926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.436282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.451220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.453093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.454557 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-953e6211-665d-4a6e-8933-7fb1c93be3dd tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1414 microversion: 2.54 time: 0.198069 Aug 29 15:54:32.456779 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2765/5355] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:32 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1414 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:32.691396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:32.692239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:32.704197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.706910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.710575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.712176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.713143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.716043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.745566 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] HTTP exception thrown: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Request method failure captured: Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 HTTP/1.1 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN91lcBNCzBblCXc3866CJSekRHuCrSaAHxk2cKdDYCvk9DRvFj6WNu3HE4PfAD2fEfA9-PK7Zf_f85pU_5awLuKMsfj01cnScMPt8J9Q1SiCFt-2-MJOpczyXr7Q4afG935QqXvo3mrMPrKQWMivvBPEcgYNgGKN7xrxyuHIna91Aw Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da6f1599da704dbc9ec86f3638638bba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}] Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: dc8f7bc05b984ea0a3d96aea8a65d139 Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'cc738f5e-e78a-4030-9027-b69a1df31032'} Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:32.748448 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Returning 404 to user: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-844ddb4d-74ff-4b42-b05d-35b62329a55c tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 404 len: 111 microversion: 2.20 time: 0.063373 Aug 29 15:54:32.753230 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2591/5356] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:32 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:54:32.761163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a90ce66f-1bd2-428e-851f-338f52e01e05 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '.version_select at 0x7fb0e27073a0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:32.803830 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a90ce66f-1bd2-428e-851f-338f52e01e05 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662936836" status: 204 len: 0 microversion: 2.20 time: 0.046682 Aug 29 15:54:32.807816 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2766/5357] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Aug 29 15:54:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662936836 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:54:33.210754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:33.211388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:33.219161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.229266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.230184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.231364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.231837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.232523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.368719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7a87b9ca-d7ea-4082-8a07-08cf081abe32 req-58eecd30-6364-406f-a02b-53e21fabf579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd489ea3-174a-4523-8070-9ce6dba90247", "tag": "d76df2d0-a03d-4480-aec9-faf05da4036f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:33.410952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7a87b9ca-d7ea-4082-8a07-08cf081abe32 req-58eecd30-6364-406f-a02b-53e21fabf579 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.411440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7a87b9ca-d7ea-4082-8a07-08cf081abe32 req-58eecd30-6364-406f-a02b-53e21fabf579 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.411885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7a87b9ca-d7ea-4082-8a07-08cf081abe32 req-58eecd30-6364-406f-a02b-53e21fabf579 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.432413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7a87b9ca-d7ea-4082-8a07-08cf081abe32 req-58eecd30-6364-406f-a02b-53e21fabf579 service nova] Creating event network-changed:d76df2d0-a03d-4480-aec9-faf05da4036f for instance bd489ea3-174a-4523-8070-9ce6dba90247 on n-h2-854882-3 Aug 29 15:54:33.462553 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7a87b9ca-d7ea-4082-8a07-08cf081abe32 req-58eecd30-6364-406f-a02b-53e21fabf579 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098997 Aug 29 15:54:33.463258 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2767/5358] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:33.482579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:33.483300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:33.490263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.490768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.491213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.491931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.492392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.492824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.634659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.648587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.657355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.659407 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d873173f-0ac0-4b16-a29e-8fc4b85f8493 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1399 microversion: 2.54 time: 0.183948 Aug 29 15:54:33.660527 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2768/5359] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:33 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1399 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:33.686733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cebf0654-b5bc-4d9d-bfa2-37a24af984d1 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '.version_select at 0x7fb0e26b2c10>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:33.722772 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cebf0654-b5bc-4d9d-bfa2-37a24af984d1 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-884751449" status: 204 len: 0 microversion: 2.54 time: 0.043509 Aug 29 15:54:33.723915 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2769/5360] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Aug 29 15:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-884751449 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:54:33.743284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:33.744067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:33.751835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.752662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.753270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.754388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.755123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.755708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.786922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.798412 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-892542e5-a361-4239-8346-c520d3b1ab9e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1291 microversion: 2.1 time: 0.591636 Aug 29 15:54:33.809420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:33.810094 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2592/5361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:33 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1291 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:33.981574 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-44bbd0af-a154-41f9-9fb5-f2577c48e539 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "DELETE /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 204 len: 0 microversion: 2.54 time: 0.241295 Aug 29 15:54:33.984958 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2770/5362] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:54:33 2022] DELETE /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:54:33.994663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:33.995621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:34.006801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.009942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.010867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:34.014411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.014411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.014411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:34.167403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:34.176281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:34.177764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:34.178984 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d92dd38b-ffd9-452f-9e71-cd5004c6577f tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1405 microversion: 2.54 time: 0.188521 Aug 29 15:54:34.179527 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2593/5363] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:33 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:34.833260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:34.833753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:34.841684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.842412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.843010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:34.843870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.844482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.845102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.104364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.108354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:35.129663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-408ded88-bbf5-47b3-b9f7-6edd9a6d9458 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1291 microversion: 2.1 time: 0.312951 Aug 29 15:54:35.130542 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2771/5364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:34 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1291 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:35.205544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:35.206408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:35.215373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:35.216249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:35.216832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.217787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:35.218385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:35.218968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.299774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.318010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.320325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.322053 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f5e280c-fa3f-4644-8cc0-ed72792a4296 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1405 microversion: 2.54 time: 0.121528 Aug 29 15:54:35.323122 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2594/5365] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:35 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:36.155553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:36.156922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:36.168953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.169954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.171630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:36.173254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.174004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.174728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:36.357651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:36.358259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:36.382922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.390167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.391075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:36.394367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.397568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.398265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:36.495668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.497144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.498244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:36.498880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lazy-loading 'fault' on Instance uuid 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:54:36.587102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:36.594079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:36.607640 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c050e3ef-8029-4317-8cab-017cc7acfb1d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1291 microversion: 2.1 time: 0.460369 Aug 29 15:54:36.610853 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2772/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:36 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1291 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:36.850823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:36.864841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:36.867192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdbaa320cf0e46b79579f858aac51192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1000fe730f2e4cce8f941050ea854b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:36.868915 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4c2e0b6-f1d1-4000-8b59-19f89d414dd0 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 200 len: 1410 microversion: 2.54 time: 0.516380 Aug 29 15:54:36.870210 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2595/5367] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:36 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 1410 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:37.631945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:37.632566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:37.637973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:37.643729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.645314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.647947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.649174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.650683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.651375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.826779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.835054 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-10a9ffdd-51a9-45ce-8c24-3f3a3de62f0a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1291 microversion: 2.1 time: 0.206814 Aug 29 15:54:37.849835 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2773/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:37 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1291 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:37.898709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:37.900459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] [instance: 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:37.903784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:37.909434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.909913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.910537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.911363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.911764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.912336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.928553 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] HTTP exception thrown: Instance 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 could not be found. Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Request method failure captured: Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 HTTP/1.1 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEToH7BwbjveT5_m-lX0lIaNGqmyH0-Vj-eUL3iK5WL8S6RNJS8zGM10UrCm-50D0JTg5mGn90Y0pyBpySM46mqszA_aCNG37fq8T3FTPIqo2P-HFnnsl6c_sUxBYIzd_QlbQn-S0ym6M2LI0FAepxyJkfk9D8lkgRKtErxjxdK-aY Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.54 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 1000fe730f2e4cce8f941050ea854b34 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerShowV254Test-122975173 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1000fe730f2e4cce8f941050ea854b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1000fe730f2e4cce8f941050ea854b34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1000fe730f2e4cce8f941050ea854b34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1000fe730f2e4cce8f941050ea854b34"}]}] Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerShowV254Test-122975173 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 1000fe730f2e4cce8f941050ea854b34 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerShowV254Test-122975173 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerShowV254Test-122975173-project Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: bdbaa320cf0e46b79579f858aac51192 Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerShowV254Test-122975173-project Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 could not be found. Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '01a16aaa-51fb-4ec1-a732-38c9ace0f4f3'} Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 could not be found. Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 could not be found. Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:37.930184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 could not be found. Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] Returning 404 to user: Instance 01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f12fd147-f06e-411e-bc0e-da6bd4a04772 tempest-ServerShowV254Test-122975173 tempest-ServerShowV254Test-122975173-project] 10.222.0.16 "GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3" status: 404 len: 111 microversion: 2.54 time: 0.038084 Aug 29 15:54:37.934917 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2596/5369] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:37 2022] GET /compute/v2.1/servers/01a16aaa-51fb-4ec1-a732-38c9ace0f4f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:54:38.069333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:38.070074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:38.085989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.086692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.087835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.088949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.091189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.092981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.133944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] HTTP exception thrown: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Request method failure captured: Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 HTTP/1.1 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN91lcBNCzBblCXc3866CJSekRHuCrSaAHxk2cKdDYCvk9DRvFj6WNu3HE4PfAD2fEfA9-PK7Zf_f85pU_5awLuKMsfj01cnScMPt8J9Q1SiCFt-2-MJOpczyXr7Q4afG935QqXvo3mrMPrKQWMivvBPEcgYNgGKN7xrxyuHIna91Aw Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da6f1599da704dbc9ec86f3638638bba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}] Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: dc8f7bc05b984ea0a3d96aea8a65d139 Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'cc738f5e-e78a-4030-9027-b69a1df31032'} Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:38.137851 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Returning 404 to user: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc0654f1-4596-4823-83bb-acf076c52c07 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 404 len: 111 microversion: 2.20 time: 0.075288 Aug 29 15:54:38.141356 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2774/5370] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:54:38 2022] DELETE /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:54:38.149589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:38.151216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc738f5e-e78a-4030-9027-b69a1df31032] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:38.159238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.160056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.161041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.162260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.162918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.163544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.182722 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] HTTP exception thrown: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Request method failure captured: Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 HTTP/1.1 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDN91lcBNCzBblCXc3866CJSekRHuCrSaAHxk2cKdDYCvk9DRvFj6WNu3HE4PfAD2fEfA9-PK7Zf_f85pU_5awLuKMsfj01cnScMPt8J9Q1SiCFt-2-MJOpczyXr7Q4afG935QqXvo3mrMPrKQWMivvBPEcgYNgGKN7xrxyuHIna91Aw Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da6f1599da704dbc9ec86f3638638bba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}] Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: dc8f7bc05b984ea0a3d96aea8a65d139 Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'cc738f5e-e78a-4030-9027-b69a1df31032'} Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.185835 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. Aug 29 15:54:38.189259 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:38.191556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Returning 404 to user: Instance cc738f5e-e78a-4030-9027-b69a1df31032 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:38.192923 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df6c7394-580f-4a6e-a897-cf07b58134b4 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032" status: 404 len: 111 microversion: 2.20 time: 0.048630 Aug 29 15:54:38.197716 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2597/5371] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:38 2022] GET /compute/v2.1/servers/cc738f5e-e78a-4030-9027-b69a1df31032 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:54:38.860390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:38.861159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:38.878337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.880682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.881280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.882182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.882986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.884848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.126728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d2da4236-6e1c-4c5c-80d9-2ecfcd8b9b69 req-4a56beb7-0798-4f06-be1f-c5dbb173841d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd489ea3-174a-4523-8070-9ce6dba90247", "name": "network-vif-plugged", "status": "completed", "tag": "d76df2d0-a03d-4480-aec9-faf05da4036f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:39.146077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d2da4236-6e1c-4c5c-80d9-2ecfcd8b9b69 req-4a56beb7-0798-4f06-be1f-c5dbb173841d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:39.148816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d2da4236-6e1c-4c5c-80d9-2ecfcd8b9b69 req-4a56beb7-0798-4f06-be1f-c5dbb173841d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:39.151205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d2da4236-6e1c-4c5c-80d9-2ecfcd8b9b69 req-4a56beb7-0798-4f06-be1f-c5dbb173841d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.175992 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d2da4236-6e1c-4c5c-80d9-2ecfcd8b9b69 req-4a56beb7-0798-4f06-be1f-c5dbb173841d service nova] Creating event network-vif-plugged:d76df2d0-a03d-4480-aec9-faf05da4036f for instance bd489ea3-174a-4523-8070-9ce6dba90247 on n-h2-854882-3 Aug 29 15:54:39.184465 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d2da4236-6e1c-4c5c-80d9-2ecfcd8b9b69 req-4a56beb7-0798-4f06-be1f-c5dbb173841d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060944 Aug 29 15:54:39.186142 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2598/5372] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:39.254835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.266135 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6a2b7ce7-68e1-4687-be62-2cbccb10aac1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1291 microversion: 2.1 time: 0.413014 Aug 29 15:54:39.266737 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2775/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:38 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1291 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:40.288895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:40.289762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:40.302931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.304052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.306117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.307424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.307990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.321976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.583732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.610095 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31bc5485-216a-451e-81a2-3e1747d41e55 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1291 microversion: 2.1 time: 0.325395 Aug 29 15:54:40.621656 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2599/5374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1291 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:41.076044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1cc05a7-0c3f-4370-99e1-602b63cb6d2c tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Calling method '.version_select at 0x7fb0e3635160>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.352929 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1cc05a7-0c3f-4370-99e1-602b63cb6d2c tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550/defaults" status: 200 len: 371 microversion: 2.1 time: 0.442487 Aug 29 15:54:41.357746 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2776/5375] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550/defaults => generated 371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:41.366453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f683d9e-fc6a-4738-8d11-288d5c2ff71a tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Calling method '.version_select at 0x7fb0e338eaf0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.472881 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f683d9e-fc6a-4738-8d11-288d5c2ff71a tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550" status: 200 len: 371 microversion: 2.1 time: 0.111050 Aug 29 15:54:41.473800 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2600/5376] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550 => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:41.490790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8807391a-d3a6-454c-9f74-15c8dcb90885 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Calling method '.version_select at 0x7fb0e2de81f0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.571140 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8807391a-d3a6-454c-9f74-15c8dcb90885 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550/defaults" status: 200 len: 371 microversion: 2.1 time: 0.084425 Aug 29 15:54:41.572005 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2777/5377] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550/defaults => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:41.585753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c00ad2ef-2d67-4599-bd52-5cf5e4f1f966 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Calling method '.version_select at 0x7fb0e29b0940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.634690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.635394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:41.646219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.646219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.646219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.646219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.646219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.646219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.682695 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c00ad2ef-2d67-4599-bd52-5cf5e4f1f966 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550" status: 200 len: 371 microversion: 2.1 time: 0.100681 Aug 29 15:54:41.683307 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2601/5378] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550 => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:41.694646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f912a519-4e1a-4d49-824b-c42a79026af6 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Calling method '.version_select at 0x7fb0e264de50>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.787438 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f912a519-4e1a-4d49-824b-c42a79026af6 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550?user_id=f6ab6003ed7b4061931f76b6946e0597" status: 200 len: 371 microversion: 2.1 time: 0.096542 Aug 29 15:54:41.788296 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2602/5379] 10.222.0.16 () {58 vars in 1323 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/os-quota-sets/c2739a008e5d459c8357e7d4682ba550?user_id=f6ab6003ed7b4061931f76b6946e0597 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:41.828122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:41.838828 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d551343d-f242-47d3-a3f3-671aba7891ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1472 microversion: 2.1 time: 0.208139 Aug 29 15:54:41.839615 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2778/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:42.007971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1031297121", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:42.078616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:42.696178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:42.696689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:42.707981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.708485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.708924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.715052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.715553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.716005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.752907 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] HTTP exception thrown: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Request method failure captured: Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 HTTP/1.1 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN91lcBNCzBblCXc3866CJSekRHuCrSaAHxk2cKdDYCvk9DRvFj6WNu3HE4PfAD2fEfA9-PK7Zf_f85pU_5awLuKMsfj01cnScMPt8J9Q1SiCFt-2-MJOpczyXr7Q4afG935QqXvo3mrMPrKQWMivvBPEcgYNgGKN7xrxyuHIna91Aw Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da6f1599da704dbc9ec86f3638638bba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}] Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: dc8f7bc05b984ea0a3d96aea8a65d139 Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'cc6a32f1-7b0f-4f11-86c2-ef0f2b561055'} Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:42.754882 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.758333 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.763293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Returning 404 to user: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:42.764398 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d7dd144-0386-4d37-aba1-1b61cc16a910 tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 404 len: 111 microversion: 2.20 time: 0.072151 Aug 29 15:54:42.765994 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2779/5381] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Aug 29 15:54:42 2022] DELETE /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:54:42.774591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:42.775534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] [instance: cc6a32f1-7b0f-4f11-86c2-ef0f2b561055] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:42.790386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.793683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.795462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.797426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.800155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.801794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.850703 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] HTTP exception thrown: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Request method failure captured: Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 HTTP/1.1 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDN91lcBNCzBblCXc3866CJSekRHuCrSaAHxk2cKdDYCvk9DRvFj6WNu3HE4PfAD2fEfA9-PK7Zf_f85pU_5awLuKMsfj01cnScMPt8J9Q1SiCFt-2-MJOpczyXr7Q4afG935QqXvo3mrMPrKQWMivvBPEcgYNgGKN7xrxyuHIna91Aw Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da6f1599da704dbc9ec86f3638638bba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da6f1599da704dbc9ec86f3638638bba", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da6f1599da704dbc9ec86f3638638bba"}]}] Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da6f1599da704dbc9ec86f3638638bba Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2058795153 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: dc8f7bc05b984ea0a3d96aea8a65d139 Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2058795153-project Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'cc6a32f1-7b0f-4f11-86c2-ef0f2b561055'} Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.852335 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:54:42.855865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] Returning 404 to user: Instance cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:42.859009 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dde37f9b-5126-468c-85d3-4b263312db5b tempest-AttachVolumeShelveTestJSON-2058795153 tempest-AttachVolumeShelveTestJSON-2058795153-project] 10.222.0.16 "GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055" status: 404 len: 111 microversion: 2.20 time: 0.083537 Aug 29 15:54:42.859610 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2780/5382] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:42 2022] GET /compute/v2.1/servers/cc6a32f1-7b0f-4f11-86c2-ef0f2b561055 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:54:42.873537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:42.874052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:42.874433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:42.874951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:42.876329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:42.893034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.893755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.894517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.896940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.897901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.898948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.926678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:42.932501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:42.948391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:42.952515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: de51c98b-cbfb-4fad-87b8-14f169926bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:43.010200 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39560159-90f9-4031-9474-363ee5507920 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005950 Aug 29 15:54:43.011322 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2603/5383] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:54:43.023711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a979b2b7-3b21-4303-a4e1-b89ca3ab011b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:43.024336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a979b2b7-3b21-4303-a4e1-b89ca3ab011b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: de51c98b-cbfb-4fad-87b8-14f169926bf6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:43.051587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a979b2b7-3b21-4303-a4e1-b89ca3ab011b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: de51c98b-cbfb-4fad-87b8-14f169926bf6] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:43.510523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.scheduler.client.report [None req-a979b2b7-3b21-4303-a4e1-b89ca3ab011b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Deleted allocations for instance de51c98b-cbfb-4fad-87b8-14f169926bf6 Aug 29 15:54:43.517677 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-a979b2b7-3b21-4303-a4e1-b89ca3ab011b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: de51c98b-cbfb-4fad-87b8-14f169926bf6] Instance Mapping does not exist while attempting local delete cleanup. Aug 29 15:54:43.518586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a979b2b7-3b21-4303-a4e1-b89ca3ab011b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6" status: 204 len: 0 microversion: 2.1 time: 0.498904 Aug 29 15:54:43.519223 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2781/5384] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:54:43 2022] DELETE /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:43.531229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce4b90a5-3cf9-4093-bdce-221465275665 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:43.532206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ce4b90a5-3cf9-4093-bdce-221465275665 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: de51c98b-cbfb-4fad-87b8-14f169926bf6] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:43.539816 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-ce4b90a5-3cf9-4093-bdce-221465275665 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce4b90a5-3cf9-4093-bdce-221465275665 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6 HTTP/1.1 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'de51c98b-cbfb-4fad-87b8-14f169926bf6'} Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:43.542443 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:43.547049 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:43.547049 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:43.547049 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:54:43.547049 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:54:43.548842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce4b90a5-3cf9-4093-bdce-221465275665 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:43.549931 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ce4b90a5-3cf9-4093-bdce-221465275665 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6" status: 404 len: 111 microversion: 2.1 time: 0.023460 Aug 29 15:54:43.550498 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2604/5385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:43 2022] GET /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:54:43.811272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-711008529", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "d3efd83b-bcf4-4a62-bc28-cb42a750ecc3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:43.906427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:44.821501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:44.822563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:44.824984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:44.824984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:44.824984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:44.846372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.849213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.849914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.850837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.851495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.862205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.899735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:44.906835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:44.919568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:44.955568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:44.960261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:45.084313 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b5cf1d2-642e-438c-bd20-95aa8b1134b3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278027 Aug 29 15:54:45.084634 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2782/5386] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:54:45.095952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce487649-a0b5-49a7-b72b-b0965efc10d9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:45.097137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ce487649-a0b5-49a7-b72b-b0965efc10d9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:45.241418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ce487649-a0b5-49a7-b72b-b0965efc10d9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.270080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ce487649-a0b5-49a7-b72b-b0965efc10d9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1220 microversion: 2.1 time: 0.177492 Aug 29 15:54:45.271388 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2605/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:45 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:45.515852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59a54cc0-a3c7-431f-b123-3e2c009969bc tempest-ComputeTenantNetworksTest-775789827 tempest-ComputeTenantNetworksTest-775789827-project] Calling method '.version_select at 0x7fb0e2ce4040>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:45.864981 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-59a54cc0-a3c7-431f-b123-3e2c009969bc tempest-ComputeTenantNetworksTest-775789827 tempest-ComputeTenantNetworksTest-775789827-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.677651 Aug 29 15:54:45.865636 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2783/5388] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:54:45 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:45.880603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8be71694-dd8f-4171-bf4b-60a44a26f35d tempest-ComputeTenantNetworksTest-775789827 tempest-ComputeTenantNetworksTest-775789827-project] Calling method '.version_select at 0x7fb0eb55fc10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:45.990948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8be71694-dd8f-4171-bf4b-60a44a26f35d tempest-ComputeTenantNetworksTest-775789827 tempest-ComputeTenantNetworksTest-775789827-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/da4144ea-6d3a-4043-a8b2-cb35ce20ac39" status: 200 len: 139 microversion: 2.1 time: 0.117414 Aug 29 15:54:45.991716 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2606/5389] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:54:45 2022] GET /compute/v2.1/os-tenant-networks/da4144ea-6d3a-4043-a8b2-cb35ce20ac39 => generated 139 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:46.292241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:46.293257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:46.308566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.310004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.313845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.314787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.315410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.316146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.472432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.481995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-15fb55bf-8114-424c-9486-f53d1eed081f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1272 microversion: 2.1 time: 0.193979 Aug 29 15:54:46.506303 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2784/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:46 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:47.508122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:47.508965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:47.525559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.527387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.528428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.529459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.532483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.537769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.899361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:47.903312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:47.955828 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d55418cc-c580-42db-94e6-f2d0fe097f99 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1278 microversion: 2.1 time: 0.452362 Aug 29 15:54:47.957244 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2607/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:47 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1278 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:48.978704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:48.979982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:48.992552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.997035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.999034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.002729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.004466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.005071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.313662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.325788 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-84b7f7a2-f753-4ca8-ae09-40817bc3f76b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.351008 Aug 29 15:54:49.341719 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2785/5392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:48 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:50.039090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-72747041-5260-4283-94f8-c5daed17000d req-79dd2cfc-be65-4371-9a90-7b2874fc88c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d618a90f-ee4d-43ea-83b5-278ee6064a51", "tag": "7c3f30b4-27a7-4b03-acc0-6cbe609ff5b8"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:50.070168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-72747041-5260-4283-94f8-c5daed17000d req-79dd2cfc-be65-4371-9a90-7b2874fc88c9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.077323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-72747041-5260-4283-94f8-c5daed17000d req-79dd2cfc-be65-4371-9a90-7b2874fc88c9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.078024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-72747041-5260-4283-94f8-c5daed17000d req-79dd2cfc-be65-4371-9a90-7b2874fc88c9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.091208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-72747041-5260-4283-94f8-c5daed17000d req-79dd2cfc-be65-4371-9a90-7b2874fc88c9 service nova] Creating event network-changed:7c3f30b4-27a7-4b03-acc0-6cbe609ff5b8 for instance d618a90f-ee4d-43ea-83b5-278ee6064a51 on n-h1-854882-3 Aug 29 15:54:50.097715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-72747041-5260-4283-94f8-c5daed17000d req-79dd2cfc-be65-4371-9a90-7b2874fc88c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063475 Aug 29 15:54:50.099046 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2608/5393] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:50.348281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:50.348905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:50.360039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.365506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.366141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.367041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.372043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.372605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.651289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:50.666522 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-686c4648-a6aa-4468-b720-fb2f116335bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.321932 Aug 29 15:54:50.669504 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2786/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:50 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:51.695528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:51.696815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:51.712306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.713702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.715262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.716414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.718893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.720553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.157414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.168694 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-01353924-d11a-41d4-bafa-36e73575f266 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.479237 Aug 29 15:54:52.174685 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2609/5395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:51 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:53.195596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:53.196374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:53.212106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.212661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.213115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.213905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.214407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.214847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.425911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.438440 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3568eec1-ab3c-4503-b31f-fb0922f8ea97 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.247358 Aug 29 15:54:53.443266 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2787/5396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:53 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:54.460908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:54.461638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:54.466053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:54.477564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.478183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.478633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.481874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.483205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.484388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.693576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:54.707485 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e6fc6199-b9e8-422a-9989-459ae1c3ead1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.252117 Aug 29 15:54:54.708320 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2610/5397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:54 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:55.734427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:55.735659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:55.739899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:55.740805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:55.747790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.748598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.749301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.750296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.750955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.756083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.056262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.065704 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a0201d1c-3b27-4e86-838b-c2d59d1f5a17 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.335438 Aug 29 15:54:56.082294 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2788/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:55 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:57.013140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1b072e12-10f5-476e-8ef1-80d0c171a272 req-ce260a14-afff-4886-9656-465de16a1fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d618a90f-ee4d-43ea-83b5-278ee6064a51", "name": "network-vif-plugged", "status": "completed", "tag": "7c3f30b4-27a7-4b03-acc0-6cbe609ff5b8"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:57.020420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:57.026240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:57.043111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1b072e12-10f5-476e-8ef1-80d0c171a272 req-ce260a14-afff-4886-9656-465de16a1fc7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.044092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1b072e12-10f5-476e-8ef1-80d0c171a272 req-ce260a14-afff-4886-9656-465de16a1fc7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.044678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1b072e12-10f5-476e-8ef1-80d0c171a272 req-ce260a14-afff-4886-9656-465de16a1fc7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.057261 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1b072e12-10f5-476e-8ef1-80d0c171a272 req-ce260a14-afff-4886-9656-465de16a1fc7 service nova] Creating event network-vif-plugged:7c3f30b4-27a7-4b03-acc0-6cbe609ff5b8 for instance d618a90f-ee4d-43ea-83b5-278ee6064a51 on n-h1-854882-3 Aug 29 15:54:57.064653 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1b072e12-10f5-476e-8ef1-80d0c171a272 req-ce260a14-afff-4886-9656-465de16a1fc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056500 Aug 29 15:54:57.065792 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2611/5399] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:57.093188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:57.093859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:57.103439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.104014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.104568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.106599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.107389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.107985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.399821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.410413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-029cb196-4ab3-4e6e-8c2d-54979d694785 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.321178 Aug 29 15:54:57.411585 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2789/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:57 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:58.434685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:58.436106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:58.453195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.454019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.454652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.455517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.456135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.456706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.735314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:58.745662 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-12ed20db-dd1e-4803-8419-fc5af28450b2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1320 microversion: 2.1 time: 0.315547 Aug 29 15:54:58.747571 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2612/5401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:58 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:59.768276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:59.768890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:59.782602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.783449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.785130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.793546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.794661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.795147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.998381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.008668 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a2abaa3c-7a0f-480d-a580-58ab761015e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1500 microversion: 2.1 time: 0.245479 Aug 29 15:55:00.009665 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2790/5402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:59 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:00.031018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.031623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.041833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.042847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.043547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.044699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.045424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.046007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.245471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.259316 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-327d302d-9bcf-4509-adaf-df8ec24e871a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1500 microversion: 2.1 time: 0.233007 Aug 29 15:55:00.262676 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2613/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1500 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:00.282442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.283150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.289832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.290769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.291359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.293303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.293945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.294547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.336439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:00.446176 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9b1da91-7572-48c2-873d-5f4a83573ffe tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 204 len: 0 microversion: 2.1 time: 0.167651 Aug 29 15:55:00.446962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2791/5404] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:00 2022] DELETE /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:55:00.456950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.457990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.466428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.467677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.468289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.469456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.470011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.470762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.682302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.692329 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d51c1b42-4869-4271-abfd-706ce1cc9420 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1506 microversion: 2.1 time: 0.239748 Aug 29 15:55:00.692926 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2614/5405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:01.717433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:01.718933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:01.744604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.748371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.750128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.754981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.755639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.757548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.979845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.995000 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52437c99-cf2a-47f1-b5a9-ccf68ba8612b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1506 microversion: 2.1 time: 0.284334 Aug 29 15:55:01.998249 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2792/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:01 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:02.711641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b9d9e6eb-d3b3-4b54-be5a-952306c4f45a req-2b9b5ff8-e1df-4fe4-8c34-83aec8a45087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d618a90f-ee4d-43ea-83b5-278ee6064a51", "name": "network-vif-deleted", "tag": "7c3f30b4-27a7-4b03-acc0-6cbe609ff5b8"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:02.742441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b9d9e6eb-d3b3-4b54-be5a-952306c4f45a req-2b9b5ff8-e1df-4fe4-8c34-83aec8a45087 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.745499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b9d9e6eb-d3b3-4b54-be5a-952306c4f45a req-2b9b5ff8-e1df-4fe4-8c34-83aec8a45087 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.746037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b9d9e6eb-d3b3-4b54-be5a-952306c4f45a req-2b9b5ff8-e1df-4fe4-8c34-83aec8a45087 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.792320 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b9d9e6eb-d3b3-4b54-be5a-952306c4f45a req-2b9b5ff8-e1df-4fe4-8c34-83aec8a45087 service nova] Creating event network-vif-deleted:7c3f30b4-27a7-4b03-acc0-6cbe609ff5b8 for instance d618a90f-ee4d-43ea-83b5-278ee6064a51 on n-h1-854882-3 Aug 29 15:55:02.806683 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b9d9e6eb-d3b3-4b54-be5a-952306c4f45a req-2b9b5ff8-e1df-4fe4-8c34-83aec8a45087 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104772 Aug 29 15:55:02.814088 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2615/5407] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 15:55:03.045511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:03.049485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:03.071695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.072197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.072735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.073337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.074440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.074775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.176824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:03.244549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.246461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.246916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.248942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lazy-loading 'fault' on Instance uuid d618a90f-ee4d-43ea-83b5-278ee6064a51 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:03.316616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.329741 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b12dd8a7-bf8e-48aa-8839-565653abd896 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 200 len: 1310 microversion: 2.1 time: 0.313325 Aug 29 15:55:03.344496 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2793/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:03 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 1310 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:04.361896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:04.365188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:04.385216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.388506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.389612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.390793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.393319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.394014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.434120 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 HTTP/1.1 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd618a90f-ee4d-43ea-83b5-278ee6064a51'} Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:55:04.439648 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:04.443477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:04.443477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:04.443477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:04.443477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:04.443477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:55:04.443477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:55:04.445958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:04.447165 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97e7447a-64d7-4f63-ac6a-2b252b532c30 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 404 len: 111 microversion: 2.1 time: 0.098970 Aug 29 15:55:04.457619 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2616/5409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:04 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:04.462034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9247b6f4-c238-4b75-a2d7-63971231ca3b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: .version_select at 0x7fb0e3d96c10>, body: {"keypair": {"name": "tempest-key-443901249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCzcY09wKflUkDc5mzbnSohOh2EqhS4/GQw6K4gfG1xFtsp08txJSqyFjnImMPogw3qs/hhSpDxJOe38KK4jZkswvatRuzNDOaAbMyptYo+OiQgj3ahX8CkvoLOWWiDlw=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:04.497214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9247b6f4-c238-4b75-a2d7-63971231ca3b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:04.515992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9247b6f4-c238-4b75-a2d7-63971231ca3b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:04.556619 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9247b6f4-c238-4b75-a2d7-63971231ca3b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.098718 Aug 29 15:55:04.558624 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2794/5410] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:55:04 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:55:04.568886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ecd64d3-c807-45aa-a30f-9d29c4704c5d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '.version_select at 0x7fb0e308a160>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:04.575236 n-d-854882-3 devstack@n-api.service[130001]: WARNING oslo_db.sqlalchemy.utils [None req-5ecd64d3-c807-45aa-a30f-9d29c4704c5d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:55:04.590510 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ecd64d3-c807-45aa-a30f-9d29c4704c5d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.025513 Aug 29 15:55:04.592999 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2617/5411] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 15:55:04 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:55:04.760443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1195136327", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-key-443901249", "networks": [{"uuid": "d3efd83b-bcf4-4a62-bc28-cb42a750ecc3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:04.851393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:55:05.946310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:55:05.947882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:55:05.949126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:55:05.950343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:55:05.950974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:55:05.967557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.968462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.968620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.969605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.970130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.970747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.003207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:06.010070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:06.027058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:55:06.030269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:55:06.135466 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91c0c82c-4a17-455e-8987-b2fe6079e8c0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380024 Aug 29 15:55:06.136908 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2795/5412] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:55:06.147815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cd293c09-f8a4-445e-a633-66c15993aa85 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:06.148419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cd293c09-f8a4-445e-a633-66c15993aa85 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:06.489421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cd293c09-f8a4-445e-a633-66c15993aa85 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.499499 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cd293c09-f8a4-445e-a633-66c15993aa85 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1228 microversion: 2.1 time: 0.355780 Aug 29 15:55:06.516614 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2618/5413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:06 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1228 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:07.522246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.523279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.542096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.543589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.544889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.545903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.546834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.547475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.664728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:07.678552 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3a92aedd-faf4-499a-a91d-f4b4ce43c4a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1280 microversion: 2.1 time: 0.161944 Aug 29 15:55:07.693450 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2796/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:08.701211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:08.702496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:08.714318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.716616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.717997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.719085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.720979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.721445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.845489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.860040 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-513541ce-55ff-4771-8470-97b7ed5e0d19 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1286 microversion: 2.1 time: 0.163671 Aug 29 15:55:08.860707 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2619/5415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:08 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:09.885312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:09.886671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:09.897984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.898901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.899537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.900470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.901084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.902601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.238838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:10.271618 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db608b3e-299c-4af4-99e4-4fe03ec246ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1328 microversion: 2.1 time: 0.389963 Aug 29 15:55:10.275686 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2797/5416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:09 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1328 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:11.220579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-853e2f74-891c-405d-b095-dcc58e57a000 req-d9ae3527-74cd-40f8-88ae-afe15fe6ac01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f742f3a-45a4-4953-aaf0-6c7db659558c", "tag": "5ceb1af1-236f-4a62-aa47-9bb44bc11ed9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:11.251605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-853e2f74-891c-405d-b095-dcc58e57a000 req-d9ae3527-74cd-40f8-88ae-afe15fe6ac01 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:11.252289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-853e2f74-891c-405d-b095-dcc58e57a000 req-d9ae3527-74cd-40f8-88ae-afe15fe6ac01 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:11.252913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-853e2f74-891c-405d-b095-dcc58e57a000 req-d9ae3527-74cd-40f8-88ae-afe15fe6ac01 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.275857 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-853e2f74-891c-405d-b095-dcc58e57a000 req-d9ae3527-74cd-40f8-88ae-afe15fe6ac01 service nova] Creating event network-changed:5ceb1af1-236f-4a62-aa47-9bb44bc11ed9 for instance 2f742f3a-45a4-4953-aaf0-6c7db659558c on n-h1-854882-3 Aug 29 15:55:11.284862 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-853e2f74-891c-405d-b095-dcc58e57a000 req-d9ae3527-74cd-40f8-88ae-afe15fe6ac01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072630 Aug 29 15:55:11.285958 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2620/5417] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:11.301550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:11.303937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:11.331519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:11.331519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:11.331519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.332180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:11.333664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:11.335522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.639580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:11.656849 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd5fa9c8-4631-4193-a551-74befeafa38b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1328 microversion: 2.1 time: 0.362529 Aug 29 15:55:11.658575 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2798/5418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:11 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:12.681424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:12.683098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:12.703035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.703529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.703973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.704685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.705332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.705871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.965780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.976016 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-78d7516a-c8e3-439e-a702-c4f19ef7b5ac tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1328 microversion: 2.1 time: 0.300596 Aug 29 15:55:12.977039 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2621/5419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:12 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1328 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:14.000370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:14.000999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:14.009381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:14.009970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:14.010414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.011701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:14.012157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:14.012587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.295846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.307432 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a60851b7-1d77-4fa7-ac74-39e278edaccb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1328 microversion: 2.1 time: 0.312733 Aug 29 15:55:14.308313 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2799/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1328 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:15.335132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:15.335969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:15.350778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.351329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.351856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.352657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.353204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.353768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.730044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:15.744247 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13f9946a-8889-4281-b08c-a0c1fbb55453 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1328 microversion: 2.1 time: 0.412793 Aug 29 15:55:15.758866 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2622/5421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:15 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1328 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:16.768471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.770733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.781612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:16.783209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=10 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:16.786605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:16.806342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.812830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.814285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.815924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.820191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.825076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.146841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:17.160556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b451a7fa-84ca-4dbf-967a-3e3c12c4168c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1328 microversion: 2.1 time: 0.395590 Aug 29 15:55:17.163817 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2800/5422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:16 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:17.752132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a3c0a0f6-7412-41db-ba56-ca8ffb214bdf req-8b6d2ee0-2f8b-4f94-af91-75ab77913d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f742f3a-45a4-4953-aaf0-6c7db659558c", "name": "network-vif-plugged", "status": "completed", "tag": "5ceb1af1-236f-4a62-aa47-9bb44bc11ed9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:17.781113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:17.804218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a3c0a0f6-7412-41db-ba56-ca8ffb214bdf req-8b6d2ee0-2f8b-4f94-af91-75ab77913d82 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.807249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a3c0a0f6-7412-41db-ba56-ca8ffb214bdf req-8b6d2ee0-2f8b-4f94-af91-75ab77913d82 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.809082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a3c0a0f6-7412-41db-ba56-ca8ffb214bdf req-8b6d2ee0-2f8b-4f94-af91-75ab77913d82 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.848297 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a3c0a0f6-7412-41db-ba56-ca8ffb214bdf req-8b6d2ee0-2f8b-4f94-af91-75ab77913d82 service nova] Creating event network-vif-plugged:5ceb1af1-236f-4a62-aa47-9bb44bc11ed9 for instance 2f742f3a-45a4-4953-aaf0-6c7db659558c on n-h1-854882-3 Aug 29 15:55:17.862070 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a3c0a0f6-7412-41db-ba56-ca8ffb214bdf req-8b6d2ee0-2f8b-4f94-af91-75ab77913d82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112929 Aug 29 15:55:17.865199 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2623/5423] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:18.192392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.194738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:18.235828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.236461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.237101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.247675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.266572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.269207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.668724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:18.688314 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63db0e8e-3c55-4616-aa26-48e8440f06c4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1328 microversion: 2.1 time: 0.505385 Aug 29 15:55:18.690546 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2801/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:18 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1328 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:19.714207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:19.714930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:19.731404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.732164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.732626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.733612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.734698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.736569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.974806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:19.984188 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-724cf456-c9f4-45b4-8946-66bff81930bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1509 microversion: 2.1 time: 0.275176 Aug 29 15:55:19.985229 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2624/5425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:19 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:20.010022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:20.011411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:20.024055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.024814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.025438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.027220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.028497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.029349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.374826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:20.384381 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-180e36b6-01c5-4b45-8bef-2cb7d5752fc3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1509 microversion: 2.1 time: 0.379826 Aug 29 15:55:20.402209 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2802/5426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:20 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:20.408236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:20.409014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:20.420236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.420675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.423126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.424876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.427098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.427988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.443653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=68 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:20.512461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:20.836296 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73f1fc38-e6d7-4162-bf03-41a0e64736bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 204 len: 0 microversion: 2.1 time: 0.429116 Aug 29 15:55:20.837659 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2625/5427] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:20 2022] DELETE /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:55:20.856254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:20.861574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:20.890760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.892722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.897951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.902319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.903794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.909056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.285659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:21.303142 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2462fdad-f481-4db9-995d-13f57666b53c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1515 microversion: 2.1 time: 0.456866 Aug 29 15:55:21.304236 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2803/5428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:20 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:22.341816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:22.343723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:22.354351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.357233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.358775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.360220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.360220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.360888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.691421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.708282 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80355ebb-ca2a-4228-8470-1a110e14ef23 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1515 microversion: 2.1 time: 0.372549 Aug 29 15:55:22.709498 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2626/5429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:22 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:23.024267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4c1fa84e-5424-48a7-9cb0-c077a01054c9 req-795b0fdb-84ac-41e1-83b5-11efb91b9ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f742f3a-45a4-4953-aaf0-6c7db659558c", "name": "network-vif-deleted", "tag": "5ceb1af1-236f-4a62-aa47-9bb44bc11ed9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:23.050599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c1fa84e-5424-48a7-9cb0-c077a01054c9 req-795b0fdb-84ac-41e1-83b5-11efb91b9ed2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.051386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c1fa84e-5424-48a7-9cb0-c077a01054c9 req-795b0fdb-84ac-41e1-83b5-11efb91b9ed2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.051845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c1fa84e-5424-48a7-9cb0-c077a01054c9 req-795b0fdb-84ac-41e1-83b5-11efb91b9ed2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.101265 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4c1fa84e-5424-48a7-9cb0-c077a01054c9 req-795b0fdb-84ac-41e1-83b5-11efb91b9ed2 service nova] Creating event network-vif-deleted:5ceb1af1-236f-4a62-aa47-9bb44bc11ed9 for instance 2f742f3a-45a4-4953-aaf0-6c7db659558c on n-h1-854882-3 Aug 29 15:55:23.111229 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4c1fa84e-5424-48a7-9cb0-c077a01054c9 req-795b0fdb-84ac-41e1-83b5-11efb91b9ed2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091532 Aug 29 15:55:23.112426 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2804/5430] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:23.730152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:23.730765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:23.745545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.746063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.746500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.755925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.756418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.757854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.831670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.834435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.834882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.835343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lazy-loading 'fault' on Instance uuid 2f742f3a-45a4-4953-aaf0-6c7db659558c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:23.969728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:23.979928 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ead6f897-922b-4f1b-8d00-9dfa6128d1bf tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 200 len: 1318 microversion: 2.1 time: 0.253079 Aug 29 15:55:23.981223 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2627/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:23 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:25.005696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:25.006663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:25.023768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.024805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.026540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.027639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.030099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.030648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.071710 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c HTTP/1.1 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '2f742f3a-45a4-4953-aaf0-6c7db659558c'} Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.078837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.082628 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:25.082628 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:25.082628 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:25.082628 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:25.082628 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:55:25.082628 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.084105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:25.086636 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4f23f924-e91d-439a-b068-1f32d37d0a8f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 404 len: 111 microversion: 2.1 time: 0.087725 Aug 29 15:55:25.093122 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2805/5432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:24 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:25.097661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f1884ad-e844-400a-839c-ba58d9e1bdf4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '.version_select at 0x7fb0e308a700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:25.139387 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f1884ad-e844-400a-839c-ba58d9e1bdf4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-443901249" status: 202 len: 0 microversion: 2.1 time: 0.045781 Aug 29 15:55:25.140404 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2628/5433] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:55:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-443901249 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:55:25.435561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1279199951", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "d3efd83b-bcf4-4a62-bc28-cb42a750ecc3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:25.536364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:55:27.018669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:55:27.020466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:55:27.030906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:55:27.032100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:55:27.033350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:55:27.054754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.055776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.060599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.062409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.065268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.066360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.121048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:27.127893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:27.142349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:55:27.144765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:55:27.200355 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f50907c-ad9a-4697-a8fa-6017d458561e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.769232 Aug 29 15:55:27.201671 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2806/5434] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:55:27.215027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66e94afc-ec14-498a-b9b2-b827812b30db tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:27.215890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-66e94afc-ec14-498a-b9b2-b827812b30db tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:27.222536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:27.349855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-66e94afc-ec14-498a-b9b2-b827812b30db tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.356167 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-66e94afc-ec14-498a-b9b2-b827812b30db tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1209 microversion: 2.1 time: 0.147539 Aug 29 15:55:27.356757 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2629/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:27 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1209 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:28.380122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:28.381952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:28.401958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.405706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.407192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.410855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.412699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.413764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.611221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:28.644424 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b1b0c1b-a6e7-4732-80a2-1c31618f9a02 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1261 microversion: 2.1 time: 0.270730 Aug 29 15:55:28.657523 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2807/5436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:28 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:29.670234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:29.671059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:29.685739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.687076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.687670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.688535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.689147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.690420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.884017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:29.905056 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f624b77f-0c55-4017-8f87-e2ca8c087f98 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1267 microversion: 2.1 time: 0.237516 Aug 29 15:55:29.923313 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2630/5437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:29 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:30.934876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:30.935521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:30.950443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:30.951359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:30.952143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:30.953090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:30.953919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:30.954586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:31.146352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:31.156464 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6e150ee3-07d1-498e-84c4-a8dd7d40b14e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 0.230005 Aug 29 15:55:31.170478 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2808/5438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:30 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:32.183706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:32.184822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:32.202209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:32.203432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:32.204429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:32.206017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:32.207622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:32.209145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:32.258722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9e379ef6-68ba-4ce2-bcdf-e4eec4b5c7ee req-f5264102-3ba8-46bd-adbd-190512a9f6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "381cd196-fc69-44fb-815d-d70f7580b7a0", "tag": "0ef5856d-fea1-468e-bad6-8687518e5588"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:32.280952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9e379ef6-68ba-4ce2-bcdf-e4eec4b5c7ee req-f5264102-3ba8-46bd-adbd-190512a9f6dd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:32.281478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9e379ef6-68ba-4ce2-bcdf-e4eec4b5c7ee req-f5264102-3ba8-46bd-adbd-190512a9f6dd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:32.281931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9e379ef6-68ba-4ce2-bcdf-e4eec4b5c7ee req-f5264102-3ba8-46bd-adbd-190512a9f6dd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:32.316609 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9e379ef6-68ba-4ce2-bcdf-e4eec4b5c7ee req-f5264102-3ba8-46bd-adbd-190512a9f6dd service nova] Creating event network-changed:0ef5856d-fea1-468e-bad6-8687518e5588 for instance 381cd196-fc69-44fb-815d-d70f7580b7a0 on n-h1-854882-3 Aug 29 15:55:32.329463 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9e379ef6-68ba-4ce2-bcdf-e4eec4b5c7ee req-f5264102-3ba8-46bd-adbd-190512a9f6dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076119 Aug 29 15:55:32.330132 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2809/5439] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:32.600227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:32.609610 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27efb84b-5c9f-4e41-a85b-d01a5bcb0918 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 0.434525 Aug 29 15:55:32.610984 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2631/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:32 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:33.632608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:33.633403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:33.652247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.653164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.653655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.654400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.654874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.655301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.714646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=75 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:33.944549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:33.958505 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9f49e442-5180-4f81-9668-c564280791d5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 0.331236 Aug 29 15:55:33.976096 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2810/5441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:33 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:34.984255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:34.985150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:34.997605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:34.998868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:34.999226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.001129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:35.002973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:35.003862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.337837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:35.349710 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0b11fd02-9a5e-4f23-aba8-19473644c213 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 0.367200 Aug 29 15:55:35.352530 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2632/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:34 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:36.372580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:36.373241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:36.393247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.393784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.394225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.394951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.395401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.407431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.893869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:36.907670 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a39fe88-7f5e-466f-924b-536cfe62a90f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 0.539028 Aug 29 15:55:36.921574 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2811/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:36 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:37.931446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:37.932172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:37.937160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:37.955722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:37.955722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:37.955722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:37.961085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:37.961606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:37.962046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.475262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:38.484738 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-895c62b1-e33d-4d92-bd97-434ff7d3b62b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 0.558058 Aug 29 15:55:38.485333 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2633/5444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:37 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:39.212822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:39.213899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:39.515744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:39.537101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Calling method '.version_select at 0x7fb0e28c39d0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:39.547202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:39.556674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.557998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.559956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.577888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.579662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.581204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.585111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.585818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.589954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.629963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.630321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.634516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.691592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.692104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.692553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.722488 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18ae4410-134b-431c-a229-fef014072bca tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889 tempest-PortsAdminExtendedAttrsIpV6TestJSON-293483889-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.517004 Aug 29 15:55:39.724372 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2812/5445] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:55:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:39.732628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6516290d-c1bc-43d7-897b-eaa47206f62a req-827a7048-ade4-4032-843d-303c701a4ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381cd196-fc69-44fb-815d-d70f7580b7a0", "name": "network-vif-plugged", "status": "completed", "tag": "0ef5856d-fea1-468e-bad6-8687518e5588"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:39.746840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6516290d-c1bc-43d7-897b-eaa47206f62a req-827a7048-ade4-4032-843d-303c701a4ede service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.747685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6516290d-c1bc-43d7-897b-eaa47206f62a req-827a7048-ade4-4032-843d-303c701a4ede service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.748345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6516290d-c1bc-43d7-897b-eaa47206f62a req-827a7048-ade4-4032-843d-303c701a4ede service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.761260 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6516290d-c1bc-43d7-897b-eaa47206f62a req-827a7048-ade4-4032-843d-303c701a4ede service nova] Creating event network-vif-plugged:0ef5856d-fea1-468e-bad6-8687518e5588 for instance 381cd196-fc69-44fb-815d-d70f7580b7a0 on n-h1-854882-3 Aug 29 15:55:39.767782 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6516290d-c1bc-43d7-897b-eaa47206f62a req-827a7048-ade4-4032-843d-303c701a4ede service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041219 Aug 29 15:55:39.768907 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2813/5446] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:40.492023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:40.505837 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ec44bf96-4e0f-4087-9f35-e4840c38a3fb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 1.002919 Aug 29 15:55:40.510705 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2634/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:39 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:41.533136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:41.533947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:41.561349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:41.561913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:41.563310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:41.564197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:41.567191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:41.567856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.368575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:42.381687 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8e8aa0a-4776-4cdf-ba51-958ab60d746d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1309 microversion: 2.1 time: 0.853902 Aug 29 15:55:42.382293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2814/5448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:41 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1309 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:43.411645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:43.413063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:43.451364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:43.451872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:43.452313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:43.459097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:43.459739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:43.460194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:43.978679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:43.993949 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fadaf0ad-8cc4-4a22-80ac-eff66b153554 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1490 microversion: 2.1 time: 0.588534 Aug 29 15:55:43.995102 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2635/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:43 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1490 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:44.250598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1279199951", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "d3efd83b-bcf4-4a62-bc28-cb42a750ecc3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:44.434350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:55:45.828371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:55:45.829561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:55:45.830623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:55:45.831264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:55:45.831952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:55:45.841663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:45.842456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:45.843086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:45.844022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:45.844748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:45.845233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:45.872204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:45.878668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:45.894008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:55:45.897074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:55:45.975784 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d27941d2-2b62-4f78-89fd-451cd758bdae tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.740537 Aug 29 15:55:45.986020 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2815/5450] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:55:45.988611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13549cd1-130f-4d8b-836a-7e38a1f81a6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:45.989225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-13549cd1-130f-4d8b-836a-7e38a1f81a6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:46.177284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-13549cd1-130f-4d8b-836a-7e38a1f81a6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:46.188135 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13549cd1-130f-4d8b-836a-7e38a1f81a6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1209 microversion: 2.1 time: 0.202736 Aug 29 15:55:46.205262 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2636/5451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:45 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1209 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:47.211500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:47.212290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:47.216387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:47.224373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:47.231167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:47.231975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:47.232948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:47.240276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:47.241485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:47.370856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:47.379064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95f5a63e-4acb-43f1-bbf4-5d410948617d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1261 microversion: 2.1 time: 0.174709 Aug 29 15:55:47.383941 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2816/5452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:47 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:48.408936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:48.410870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:48.423963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:48.425307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:48.426435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:48.427380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:48.427989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:48.428597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:48.591790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:48.615192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d578a222-56b3-4dfe-bd56-6dbeedf9e01f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1267 microversion: 2.1 time: 0.212039 Aug 29 15:55:48.616036 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2637/5453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:48 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:49.636906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.638314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:49.652646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.653328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.654411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.656097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.661043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.664617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:50.081068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:50.097193 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d4fc789-9e9d-42eb-87ab-d49bfa56c9bd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 0.464327 Aug 29 15:55:50.098734 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2817/5454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:51.123346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:51.124269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:51.148459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.148459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.148459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.150216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.152503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.152980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.192124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:51.437514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1fe9177d-3890-4880-b3d0-8a772bd88484 req-acdf9596-25c4-472d-a3c6-7d242cbb18c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcf0f26-ca48-447b-92a2-199a082dbfd2", "tag": "6de9a670-f77b-4f27-ba2d-b2b9b1dae6b8"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:51.451196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1fe9177d-3890-4880-b3d0-8a772bd88484 req-acdf9596-25c4-472d-a3c6-7d242cbb18c0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.451875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1fe9177d-3890-4880-b3d0-8a772bd88484 req-acdf9596-25c4-472d-a3c6-7d242cbb18c0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.452472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1fe9177d-3890-4880-b3d0-8a772bd88484 req-acdf9596-25c4-472d-a3c6-7d242cbb18c0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.474464 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1fe9177d-3890-4880-b3d0-8a772bd88484 req-acdf9596-25c4-472d-a3c6-7d242cbb18c0 service nova] Creating event network-changed:6de9a670-f77b-4f27-ba2d-b2b9b1dae6b8 for instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 on n-h2-854882-3 Aug 29 15:55:51.480841 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1fe9177d-3890-4880-b3d0-8a772bd88484 req-acdf9596-25c4-472d-a3c6-7d242cbb18c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047400 Aug 29 15:55:51.482014 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2818/5455] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:51.585257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:51.598286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7187752e-31f2-4f51-ae81-2f900828162e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 0.477839 Aug 29 15:55:51.598286 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2638/5456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:51 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:52.623820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:52.624619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:52.646156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.649033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.651406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.656450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.657079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.658271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.299296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:53.308911 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-feeec16f-d3c4-4acb-a3c0-922753d3e4e9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 0.689986 Aug 29 15:55:53.310072 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2819/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:52 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:54.332258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:54.332946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:54.367208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.367709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.370402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.371280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.371851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.372426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.967278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:54.975630 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ce2a9df-d67e-4519-adf2-b1aefce1b02b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 0.647887 Aug 29 15:55:54.989333 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2639/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:54 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:55.997171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:55.998710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:56.007830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:56.008538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:56.016775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:56.017278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:56.017755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:56.018483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:56.018951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:56.019396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:56.328378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:56.336410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-adc8d841-99f4-481f-8892-0da6127dc992 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 0.344466 Aug 29 15:55:56.337074 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2820/5459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:55 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:57.357694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:57.358312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:57.371680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:57.377181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=26 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:57.378759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.379304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.379729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.380441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.380901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.381328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.752185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:57.762494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c17a0b36-1ceb-420e-ba39-aaebdbeed8a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 0.408682 Aug 29 15:55:57.776796 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2640/5460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:57 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:58.784884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:58.786085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:58.800504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.801285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.802091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:58.803024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.803652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.809345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.160724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:59.177458 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2c0d22c8-680e-4e63-8791-1bb68b90b98a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 0.396732 Aug 29 15:55:59.193843 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2821/5461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:58 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:00.206784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a93dda15-6a21-4935-8661-908817c3669d req-bd44fc30-74f1-4189-bdc9-fbe642aee8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcf0f26-ca48-447b-92a2-199a082dbfd2", "name": "network-vif-plugged", "status": "completed", "tag": "6de9a670-f77b-4f27-ba2d-b2b9b1dae6b8"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:00.209319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:00.210854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:00.242000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.243070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.245442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.246223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a93dda15-6a21-4935-8661-908817c3669d req-bd44fc30-74f1-4189-bdc9-fbe642aee8ab service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.247365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.249534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a93dda15-6a21-4935-8661-908817c3669d req-bd44fc30-74f1-4189-bdc9-fbe642aee8ab service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.252998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a93dda15-6a21-4935-8661-908817c3669d req-bd44fc30-74f1-4189-bdc9-fbe642aee8ab service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.253619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.254361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.306200 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a93dda15-6a21-4935-8661-908817c3669d req-bd44fc30-74f1-4189-bdc9-fbe642aee8ab service nova] Creating event network-vif-plugged:6de9a670-f77b-4f27-ba2d-b2b9b1dae6b8 for instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 on n-h2-854882-3 Aug 29 15:56:00.319507 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a93dda15-6a21-4935-8661-908817c3669d req-bd44fc30-74f1-4189-bdc9-fbe642aee8ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116361 Aug 29 15:56:00.320381 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2822/5462] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:01.617309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:01.635750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4461220b-f211-4ff0-9f4a-a1c3bd216352 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1309 microversion: 2.1 time: 1.440285 Aug 29 15:56:01.636640 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2641/5463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:00 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1309 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:02.659806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:02.661030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:02.679162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.684008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.684008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.684008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.685520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.688183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.449366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:03.463893 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-696d5822-2ee5-41c5-bc4e-a33050a14337 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1489 microversion: 2.1 time: 0.810001 Aug 29 15:56:03.486747 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2823/5464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:02 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1489 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:03.493355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:03.494600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:03.518197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.519921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.521104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.523789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.524757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.526492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:04.112629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:04.128408 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7b4a752b-1faa-4a2d-ba6b-aada8fefc146 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1490 microversion: 2.1 time: 0.639882 Aug 29 15:56:04.129034 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2642/5465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:03 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1490 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:04.148705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:04.149327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:04.165116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:04.185467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:04.186160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:04.188065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:04.188065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:04.188065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:04.203412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=68 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:04.958575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:04.974392 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-075385a2-6b3a-4ff5-a51a-9d02a8a74e40 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1489 microversion: 2.1 time: 0.829437 Aug 29 15:56:04.975035 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2824/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:04 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1489 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:05.004707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:05.005209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:05.036354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.039697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.040311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.041818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.043603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.045148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.172395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:56:05.466624 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80f39431-df8f-48b0-97ad-9c8c7b4a1390 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 204 len: 0 microversion: 2.1 time: 0.469471 Aug 29 15:56:05.474631 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2643/5467] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:04 2022] DELETE /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:56:05.478307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:05.479985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:05.493624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.494480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.507293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.508417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.508785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.516979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:06.054381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:06.070768 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-526d3030-df07-413a-995e-7267dbc533e8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1495 microversion: 2.1 time: 0.596127 Aug 29 15:56:06.071904 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2825/5468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:05 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1495 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:07.093118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:07.093896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:07.104524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.110617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.111079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:07.112026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.112491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.112922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:08.008427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5679db4a-e2ab-4921-848f-cab144ced808 req-0e000e3b-3560-49d9-9c4d-c9ea0e98b689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcf0f26-ca48-447b-92a2-199a082dbfd2", "name": "network-vif-deleted", "tag": "6de9a670-f77b-4f27-ba2d-b2b9b1dae6b8"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:08.066141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5679db4a-e2ab-4921-848f-cab144ced808 req-0e000e3b-3560-49d9-9c4d-c9ea0e98b689 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:08.066634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5679db4a-e2ab-4921-848f-cab144ced808 req-0e000e3b-3560-49d9-9c4d-c9ea0e98b689 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:08.074942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5679db4a-e2ab-4921-848f-cab144ced808 req-0e000e3b-3560-49d9-9c4d-c9ea0e98b689 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:08.125190 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5679db4a-e2ab-4921-848f-cab144ced808 req-0e000e3b-3560-49d9-9c4d-c9ea0e98b689 service nova] Creating event network-vif-deleted:6de9a670-f77b-4f27-ba2d-b2b9b1dae6b8 for instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 on n-h2-854882-3 Aug 29 15:56:08.136690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:08.158858 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5679db4a-e2ab-4921-848f-cab144ced808 req-0e000e3b-3560-49d9-9c4d-c9ea0e98b689 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154911 Aug 29 15:56:08.160510 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2edddcfb-4932-497e-8d06-38c7eb04729c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 200 len: 1453 microversion: 2.1 time: 1.071555 Aug 29 15:56:08.175841 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2826/5469] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:08.179045 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2644/5470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:07 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 1453 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:09.189596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:09.192592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:09.235975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:09.237490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:09.239673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:09.243701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:09.246829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:09.248105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:09.322728 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 HTTP/1.1 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fcf0f26-ca48-447b-92a2-199a082dbfd2'} Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:09.324556 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:09.328573 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:09.328573 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:09.328573 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:09.328573 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:09.328573 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:56:09.328573 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:09.349613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:09.352665 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ced5d89d-fe6e-4767-97ad-6c35ee1be961 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 404 len: 111 microversion: 2.1 time: 0.168527 Aug 29 15:56:09.355318 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2827/5471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:09 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:09.364763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:09.366046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:09.391649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:09.392781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:09.395126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:09.400168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:09.403929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:09.404682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:09.498457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:56:09.708625 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9385dc4-3f8a-4f21-8346-f176c1a51e2a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 204 len: 0 microversion: 2.1 time: 0.348074 Aug 29 15:56:09.709854 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2645/5472] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:09 2022] DELETE /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:56:09.718841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:09.720132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:09.743213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:09.746417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:09.747167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:09.748142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:09.751062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:09.751789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:10.262126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:10.271849 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0315bf63-157a-4036-80f5-12f97d91f447 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1496 microversion: 2.1 time: 0.557700 Aug 29 15:56:10.277896 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2828/5473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:09 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1496 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:11.300348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:11.301068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:11.317898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:11.318463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:11.318939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:11.319680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:11.320162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:11.320636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:12.219886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:12.240200 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-41ccc597-7ad8-4281-92ff-a3cccb92359e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1496 microversion: 2.1 time: 0.945549 Aug 29 15:56:12.254560 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2646/5474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:11 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1496 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:12.455911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1a8fa9e4-8b96-48cf-b781-38299e2fd2a1 req-91e780f6-665e-4a66-8d23-1a13092e0213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381cd196-fc69-44fb-815d-d70f7580b7a0", "name": "network-vif-deleted", "tag": "0ef5856d-fea1-468e-bad6-8687518e5588"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:12.472968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1a8fa9e4-8b96-48cf-b781-38299e2fd2a1 req-91e780f6-665e-4a66-8d23-1a13092e0213 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:12.473220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1a8fa9e4-8b96-48cf-b781-38299e2fd2a1 req-91e780f6-665e-4a66-8d23-1a13092e0213 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:12.478954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1a8fa9e4-8b96-48cf-b781-38299e2fd2a1 req-91e780f6-665e-4a66-8d23-1a13092e0213 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:12.524984 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1a8fa9e4-8b96-48cf-b781-38299e2fd2a1 req-91e780f6-665e-4a66-8d23-1a13092e0213 service nova] Creating event network-vif-deleted:0ef5856d-fea1-468e-bad6-8687518e5588 for instance 381cd196-fc69-44fb-815d-d70f7580b7a0 on n-h1-854882-3 Aug 29 15:56:12.540827 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1a8fa9e4-8b96-48cf-b781-38299e2fd2a1 req-91e780f6-665e-4a66-8d23-1a13092e0213 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089387 Aug 29 15:56:12.546478 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2829/5475] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:13.276974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:13.277649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:13.288194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:13.292177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:13.293067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:13.296480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:13.297128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:13.298657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:13.385430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:13.386177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:13.386972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:13.388519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lazy-loading 'fault' on Instance uuid 381cd196-fc69-44fb-815d-d70f7580b7a0 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:56:13.839055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:13.850099 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f91a03d3-2741-4ff1-82ab-104aa8577e6d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 200 len: 1299 microversion: 2.1 time: 0.577792 Aug 29 15:56:13.850909 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2647/5476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:13 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 1299 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:14.874787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:14.876294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:14.890348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:14.891052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:14.891684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:14.892592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:14.893211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:14.894954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:14.939931 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 HTTP/1.1 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '381cd196-fc69-44fb-815d-d70f7580b7a0'} Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:14.942624 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:14.947890 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:14.947890 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:14.947890 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:14.947890 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:14.947890 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:56:14.947890 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:14.948647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:14.950088 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-888dee07-d1b1-4669-9f10-7accf3905392 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 404 len: 111 microversion: 2.1 time: 0.081632 Aug 29 15:56:14.954793 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2830/5477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:14 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:15.206919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1956357475", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "d3efd83b-bcf4-4a62-bc28-cb42a750ecc3"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:15.305771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:56:16.091208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:56:16.091834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:56:16.092677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:56:16.093311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:56:16.093888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:56:16.110024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:16.117080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:16.117967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:16.119609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:16.120215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:16.120828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:16.168691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:56:16.185477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:56:16.219232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:56:16.226980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:56:16.385080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a213b3c5-1aee-4b9f-8feb-3d040e5fbaa5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182590 Aug 29 15:56:16.385778 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2648/5478] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:56:16.399108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c048a5f-c1a3-4b29-bd8a-d6c5851b48bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:16.402607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c048a5f-c1a3-4b29-bd8a-d6c5851b48bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:16.601401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c048a5f-c1a3-4b29-bd8a-d6c5851b48bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:16.615117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c048a5f-c1a3-4b29-bd8a-d6c5851b48bc tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1209 microversion: 2.1 time: 0.221918 Aug 29 15:56:16.616095 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2831/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:16 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1209 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:17.640322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:17.640935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:17.665330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:17.670771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:17.671303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:17.675370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:17.677693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:17.678146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:18.140618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:18.151849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa5fb9af-2a10-4602-92b3-bb073c7a1c05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1205 microversion: 2.1 time: 0.519359 Aug 29 15:56:18.174386 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2649/5480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:17 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1205 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:19.186512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:19.187168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:19.204027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=34 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:19.213080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:19.214553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:19.215106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:19.215941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:19.217948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:19.220161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:19.555765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:19.573716 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-389e709a-9b09-4e94-bd00-e6f549a26e88 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1267 microversion: 2.1 time: 0.384883 Aug 29 15:56:19.574546 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2832/5481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:19 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1267 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:20.601430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:20.610428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:20.633221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:20.633972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:20.638548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:20.639451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:20.640746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:20.642077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:20.968717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:20.979537 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5fffea09-9bcf-4990-a525-01796ab06ac8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1267 microversion: 2.1 time: 0.387175 Aug 29 15:56:20.983508 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2650/5482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:20 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1267 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:22.003547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:22.004259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:22.038556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:22.039063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:22.043493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:22.044327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:22.044760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:22.045203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:22.988360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:23.001166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2197106a-da38-4663-b142-eb0ac8b9a0a5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1309 microversion: 2.1 time: 1.002194 Aug 29 15:56:23.002386 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2833/5483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:21 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1309 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:23.371015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-cad190af-76bb-42e0-8ce6-24a27d1b9441 req-e7a3f560-92a7-49ac-afd1-aed578cd2da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143349fc-fcfb-4f3e-900c-374dbb3ada76", "tag": "2b4ee7de-867e-4fc0-b9f0-99ee822dab18"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:23.384974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cad190af-76bb-42e0-8ce6-24a27d1b9441 req-e7a3f560-92a7-49ac-afd1-aed578cd2da0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:23.386070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cad190af-76bb-42e0-8ce6-24a27d1b9441 req-e7a3f560-92a7-49ac-afd1-aed578cd2da0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:23.386752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-cad190af-76bb-42e0-8ce6-24a27d1b9441 req-e7a3f560-92a7-49ac-afd1-aed578cd2da0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:23.399191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:23.402098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-cad190af-76bb-42e0-8ce6-24a27d1b9441 req-e7a3f560-92a7-49ac-afd1-aed578cd2da0 service nova] Creating event network-changed:2b4ee7de-867e-4fc0-b9f0-99ee822dab18 for instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 on n-h1-854882-3 Aug 29 15:56:23.411298 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-cad190af-76bb-42e0-8ce6-24a27d1b9441 req-e7a3f560-92a7-49ac-afd1-aed578cd2da0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045412 Aug 29 15:56:23.412957 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2651/5484] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:24.024366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:24.026897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:24.050282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:24.050805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:24.051408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:24.052280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:24.052741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:24.053169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:24.540085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:24.554086 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-79a0f77e-e9b3-4bd7-a6dd-1c4e109453e3 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1309 microversion: 2.1 time: 0.535607 Aug 29 15:56:24.555462 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2834/5485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:24 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1309 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:25.582634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:25.583357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:25.597431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:25.599826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:25.600448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:25.602746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:25.603559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:25.604205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:25.835999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:25.849411 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c628cd0a-da13-4288-847f-f49bf6f85a63 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1309 microversion: 2.1 time: 0.275840 Aug 29 15:56:25.851471 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2652/5486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:25 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:26.873922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:26.875161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:26.883089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:26.885929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:26.886969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:26.887762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:26.888781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:26.890368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:26.892227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:27.426308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:27.446462 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4822243a-be39-4acf-a484-ed2f0c9eb6ee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1309 microversion: 2.1 time: 0.573812 Aug 29 15:56:27.463184 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2835/5487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:26 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1309 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:28.472408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:28.473033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:28.478829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:28.492742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:28.498604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:28.504005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:28.504506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:28.508722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:28.509632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:28.510109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:28.512798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:28.733275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:28.743438 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c6c63e95-2418-4004-b63c-f72f556e3303 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1309 microversion: 2.1 time: 0.275032 Aug 29 15:56:28.747092 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2653/5488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:28 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:29.545620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-cef3bb68-bb73-4353-9e79-adf0a75d11e4 req-9a602657-e7f4-487b-838f-b4c3f3a592f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143349fc-fcfb-4f3e-900c-374dbb3ada76", "name": "network-vif-plugged", "status": "completed", "tag": "2b4ee7de-867e-4fc0-b9f0-99ee822dab18"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:29.570201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cef3bb68-bb73-4353-9e79-adf0a75d11e4 req-9a602657-e7f4-487b-838f-b4c3f3a592f6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:29.570729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cef3bb68-bb73-4353-9e79-adf0a75d11e4 req-9a602657-e7f4-487b-838f-b4c3f3a592f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:29.571406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cef3bb68-bb73-4353-9e79-adf0a75d11e4 req-9a602657-e7f4-487b-838f-b4c3f3a592f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:29.614762 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-cef3bb68-bb73-4353-9e79-adf0a75d11e4 req-9a602657-e7f4-487b-838f-b4c3f3a592f6 service nova] Creating event network-vif-plugged:2b4ee7de-867e-4fc0-b9f0-99ee822dab18 for instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 on n-h1-854882-3 Aug 29 15:56:29.631947 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-cef3bb68-bb73-4353-9e79-adf0a75d11e4 req-9a602657-e7f4-487b-838f-b4c3f3a592f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093779 Aug 29 15:56:29.633816 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2836/5489] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:56:29.771346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:29.772387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:29.815793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:29.817606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:29.828067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:29.829764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:29.831062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:29.835104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:30.233918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:30.242737 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-43852dbc-bce4-4902-a09b-68c26b42b252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1309 microversion: 2.1 time: 0.479390 Aug 29 15:56:30.246511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2654/5490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:29 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1309 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:31.268116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:31.270435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:31.304271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:31.304770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:31.309080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:31.312013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:31.312586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:31.315931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:31.644652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:31.653907 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b9f3f983-db9a-4386-bac3-ea04db3b7bce tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1309 microversion: 2.1 time: 0.391438 Aug 29 15:56:31.669560 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2837/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:31 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:32.680363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:32.681874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:32.704569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:32.705818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:32.707478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:32.708441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:32.709073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:32.711539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:33.201228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:33.229586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aec155a2-857a-48c3-bba5-26d1efad9432 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1490 microversion: 2.1 time: 0.555095 Aug 29 15:56:33.247303 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2655/5492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:32 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1490 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:33.251490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:33.255660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:33.269732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:33.270579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:33.270783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:33.271852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:33.273055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:33.274110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:33.404061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-993293df-249a-4a01-89e5-11c559013db0 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "PUT /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1085 microversion: 2.1 time: 0.155953 Aug 29 15:56:33.409286 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2838/5493] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:56:33 2022] PUT /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1085 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:33.425455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:33.426405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:33.436499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:33.438759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:33.439472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:33.442025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:33.443679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:33.446176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:33.764838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:33.776326 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c0315a20-7922-4639-8a9d-09f3d0fb489a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1511 microversion: 2.1 time: 0.352131 Aug 29 15:56:33.793273 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2656/5494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:33 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:33.798883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:33.808841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:33.825160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:33.825705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:33.826163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:33.826888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:33.827356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:33.827788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:34.218514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:34.230025 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1bbb5cd7-53a8-42a9-8a1a-e6cc4df92667 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1511 microversion: 2.1 time: 0.435337 Aug 29 15:56:34.230978 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2839/5495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:33 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:34.255484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:34.256269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:34.264345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:34.265100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:34.266688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:34.267613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:34.268622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:34.269643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:34.305324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:56:34.463901 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-abd61c0a-dbd5-41ed-aa2a-c7aafb2bfcad tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 204 len: 0 microversion: 2.1 time: 0.212628 Aug 29 15:56:34.466893 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2657/5496] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:34 2022] DELETE /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:56:34.475206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:34.475825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:34.489314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:34.489966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:34.490578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:34.491451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:34.494284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:34.494937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:34.507691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:35.118828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:35.166443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85f533f6-48f9-4705-967b-52b2d793aef4 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1517 microversion: 2.1 time: 0.694950 Aug 29 15:56:35.188341 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2840/5497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:34 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1517 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:36.204520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:36.206333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:36.265190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:36.266888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:36.266888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:36.275596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:36.275987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:36.276604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:37.054105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:37.067157 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e17bb0fd-3685-4494-ae67-694c373f4261 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1517 microversion: 2.1 time: 0.867954 Aug 29 15:56:37.078229 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2658/5498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:36 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1517 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:37.931568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c9ab689a-56aa-4aa8-b3b0-d24eee931c94 req-2f55da9f-e6ce-4ac7-8b68-ffc17c8e730c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143349fc-fcfb-4f3e-900c-374dbb3ada76", "name": "network-vif-deleted", "tag": "2b4ee7de-867e-4fc0-b9f0-99ee822dab18"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:37.990865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c9ab689a-56aa-4aa8-b3b0-d24eee931c94 req-2f55da9f-e6ce-4ac7-8b68-ffc17c8e730c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:37.991410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c9ab689a-56aa-4aa8-b3b0-d24eee931c94 req-2f55da9f-e6ce-4ac7-8b68-ffc17c8e730c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:37.992809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c9ab689a-56aa-4aa8-b3b0-d24eee931c94 req-2f55da9f-e6ce-4ac7-8b68-ffc17c8e730c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:38.046381 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c9ab689a-56aa-4aa8-b3b0-d24eee931c94 req-2f55da9f-e6ce-4ac7-8b68-ffc17c8e730c service nova] Creating event network-vif-deleted:2b4ee7de-867e-4fc0-b9f0-99ee822dab18 for instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 on n-h1-854882-3 Aug 29 15:56:38.063790 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c9ab689a-56aa-4aa8-b3b0-d24eee931c94 req-2f55da9f-e6ce-4ac7-8b68-ffc17c8e730c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135180 Aug 29 15:56:38.065682 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2841/5499] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:38.121970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:38.122854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:38.138383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:38.138872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:38.142168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:38.146536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:38.147920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:38.149996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:38.234591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:38.235843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:38.238958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:38.239706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lazy-loading 'fault' on Instance uuid 143349fc-fcfb-4f3e-900c-374dbb3ada76 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:56:38.303361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:38.314475 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-60c9210a-49ae-4b03-be70-af34eeec602f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 200 len: 1320 microversion: 2.1 time: 0.205456 Aug 29 15:56:38.317664 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2659/5500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:38 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:39.338569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:39.339288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:39.353475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:39.353985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:39.354709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:39.355743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:39.356211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:39.356710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:39.381010 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 HTTP/1.1 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '143349fc-fcfb-4f3e-900c-374dbb3ada76'} Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:39.388008 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:39.393912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:39.393912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:39.393912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:39.393912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:39.393912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:56:39.393912 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:56:39.396355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:39.397612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-39c31a9a-e563-40eb-a093-e501918fe7bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 404 len: 111 microversion: 2.1 time: 0.063904 Aug 29 15:56:39.408898 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2842/5501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:39 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:39.631437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-667127564", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "d3efd83b-bcf4-4a62-bc28-cb42a750ecc3"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:39.786068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] validate_networks() for [('d3efd83b-bcf4-4a62-bc28-cb42a750ecc3', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:56:41.310221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:56:41.311342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:56:41.312108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:56:41.312525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:56:41.312950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:56:41.329203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.332180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.334790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:41.335995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.336465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.337617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:41.398277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:56:41.418995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Getting quotas for user 74602998065943c4a49a96d23ec0ce43 and project da746b18bda24573a98f42a731b9fd27. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:56:41.441252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:56:41.445009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:56:41.519699 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6410d67d-8918-46f1-a9e9-cbffb27b6051 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.893031 Aug 29 15:56:41.521257 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2660/5502] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:56:41.533712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26e498be-9650-4817-b793-3fee15c512d2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:41.535164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26e498be-9650-4817-b793-3fee15c512d2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:41.749930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-26e498be-9650-4817-b793-3fee15c512d2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:41.775982 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26e498be-9650-4817-b793-3fee15c512d2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1208 microversion: 2.1 time: 0.247512 Aug 29 15:56:41.780879 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2843/5503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:41 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1208 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:42.801542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:42.803072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:42.825611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:42.845088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:42.845930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:42.846622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:42.851045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:42.851705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:43.004994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:43.016589 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c89bf0d4-88a5-423e-b02f-d4adb1860252 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1212 microversion: 2.1 time: 0.220317 Aug 29 15:56:43.023645 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2661/5504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:42 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1212 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:44.048234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:44.048902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:44.064270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:44.073084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:44.073972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:44.075631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:44.075631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:44.075631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:44.394505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:44.407410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3b2d3744-0713-4782-b2bf-2430ca9ecff7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1268 microversion: 2.1 time: 0.364216 Aug 29 15:56:44.408434 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2844/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:44 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1268 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:45.437979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:45.439187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:45.449783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:45.450267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:45.450694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:45.460268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:45.460771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:45.461211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:45.787286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:45.803240 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cecce793-8477-4ebe-8913-357c944a13ca tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1266 microversion: 2.1 time: 0.369844 Aug 29 15:56:45.824588 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2662/5506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:45 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:46.830782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:46.832367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:46.865162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:46.865714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:46.866169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:46.866917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:46.867386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:46.867823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.258485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:47.269944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-adf5279a-6952-4f1e-b7d2-de40d65c467b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.444859 Aug 29 15:56:47.288906 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2845/5507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:46 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:48.292278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:48.292908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:48.306074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.306575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.307017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.307735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.308193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.308624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.795475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:48.805460 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39eac1d3-0912-4ce3-b62b-fcf2586d7496 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.517666 Aug 29 15:56:48.816797 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2663/5508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:48 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:49.181609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-aab04b98-37ab-469e-882c-931dcdec7650 req-99a90319-1534-4c8f-9853-65e3c4ffda66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e413401-b841-4c7c-a328-acadbf906f96", "tag": "e4edc8d6-1ba1-461b-9fdc-c70f91f7f4ff"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:49.205888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aab04b98-37ab-469e-882c-931dcdec7650 req-99a90319-1534-4c8f-9853-65e3c4ffda66 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.206379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aab04b98-37ab-469e-882c-931dcdec7650 req-99a90319-1534-4c8f-9853-65e3c4ffda66 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.206843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aab04b98-37ab-469e-882c-931dcdec7650 req-99a90319-1534-4c8f-9853-65e3c4ffda66 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.258637 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-aab04b98-37ab-469e-882c-931dcdec7650 req-99a90319-1534-4c8f-9853-65e3c4ffda66 service nova] Creating event network-changed:e4edc8d6-1ba1-461b-9fdc-c70f91f7f4ff for instance 4e413401-b841-4c7c-a328-acadbf906f96 on n-h1-854882-3 Aug 29 15:56:49.280806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-aab04b98-37ab-469e-882c-931dcdec7650 req-99a90319-1534-4c8f-9853-65e3c4ffda66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103648 Aug 29 15:56:49.282404 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2846/5509] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:49.843684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:49.844956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:49.857411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.871935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.884967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.890181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.903156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.903627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:50.679820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:50.688262 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-04d02bc0-feac-4e15-922d-c5b64de3cca2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.849996 Aug 29 15:56:50.692075 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2664/5510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:49 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:51.711176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:51.712409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:51.731265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=32 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:51.734930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.737736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.739544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:51.741690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.743505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.744295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:51.792405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:52.022780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:52.038606 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0c88734c-1264-4c1a-a488-3ff66d52425b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.324935 Aug 29 15:56:52.040915 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2847/5511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:51 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:52.589415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:52.590329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:52.882417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98c8d462-d6f4-4bcb-99bd-50cc903a6c2c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Action: 'create', calling method: .version_select at 0x7fb0e20d1a60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1023277388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8rG3VoAqhGHg3iDYTVnWHuh8JHRIahi+o7kWbed7AjFvy1RCy6APDRHjeq3/pf+nrmMhv3gbPSOO2/8v23ZRx17e6PIENUlxN6eotQmGOYz4dwaQazfKdtDSmBFnIPPg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:52.922326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-98c8d462-d6f4-4bcb-99bd-50cc903a6c2c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Getting quotas for project 7686f5f846414b3b9706ae0a9f89ba6f. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:56:52.934732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-98c8d462-d6f4-4bcb-99bd-50cc903a6c2c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Getting quotas for user 9b95cef51ea04d9b886a7c29791ec255 and project 7686f5f846414b3b9706ae0a9f89ba6f. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:56:52.979274 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-98c8d462-d6f4-4bcb-99bd-50cc903a6c2c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.395802 Aug 29 15:56:52.981340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2665/5512] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 15:56:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:53.060897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:53.061574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:53.077357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:53.077914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:53.078379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:53.080170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:53.080884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:53.081542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:53.834873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:53.850100 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f9fcc9f-6e62-434a-9d00-16bf41191a0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.793524 Aug 29 15:56:53.851562 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2848/5513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:53 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:54.876593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:54.878895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:54.891034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.892363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.893598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:54.895247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.896421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.897658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:55.180251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:55.228679 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4eca9d9b-82b7-403c-b113-436e14baa737 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.359294 Aug 29 15:56:55.232523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2666/5514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:54 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:55.615596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-df0e3b83-911a-4358-92bd-7c61dfce7772 req-319be98e-885c-49d9-813e-85186916a307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e413401-b841-4c7c-a328-acadbf906f96", "name": "network-vif-plugged", "status": "completed", "tag": "e4edc8d6-1ba1-461b-9fdc-c70f91f7f4ff"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:55.650334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df0e3b83-911a-4358-92bd-7c61dfce7772 req-319be98e-885c-49d9-813e-85186916a307 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:55.653167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df0e3b83-911a-4358-92bd-7c61dfce7772 req-319be98e-885c-49d9-813e-85186916a307 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:55.658091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-df0e3b83-911a-4358-92bd-7c61dfce7772 req-319be98e-885c-49d9-813e-85186916a307 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:55.703328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-df0e3b83-911a-4358-92bd-7c61dfce7772 req-319be98e-885c-49d9-813e-85186916a307 service nova] Creating event network-vif-plugged:e4edc8d6-1ba1-461b-9fdc-c70f91f7f4ff for instance 4e413401-b841-4c7c-a328-acadbf906f96 on n-h1-854882-3 Aug 29 15:56:55.722343 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-df0e3b83-911a-4358-92bd-7c61dfce7772 req-319be98e-885c-49d9-813e-85186916a307 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112477 Aug 29 15:56:55.729487 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2849/5515] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 15:56:56.251260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:56.252298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:56.271261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:56.271878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:56.272585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:56.274690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:56.277251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:56.277850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:56.291379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:56.673533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:56.692098 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c873b67c-2f78-4cd9-9485-c49b20102784 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.445429 Aug 29 15:56:56.701257 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2667/5516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:56 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:57.715666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:57.716407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:57.741463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:57.741999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:57.742482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:57.743832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:57.744323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:57.751983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:58.221174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:58.237887 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-361c5ab8-381d-402b-9956-9ef274473710 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1308 microversion: 2.1 time: 0.528748 Aug 29 15:56:58.238499 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2850/5517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:57 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:59.265263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:59.265983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:59.269769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:59.311894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.317349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.320136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.323855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.340825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.348726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.631463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:59.644995 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e2a8220-86ea-4809-a89a-31db138c978b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1488 microversion: 2.1 time: 0.383740 Aug 29 15:56:59.645937 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2668/5518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:59 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1488 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:59.669043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1480065421"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:59.672162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:59.679828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.680603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.681244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.681987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.682615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.683208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.778925 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1e05ea04-ef3c-4e8f-a54d-06bd65da96be tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "PUT /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1074 microversion: 2.1 time: 0.113813 Aug 29 15:56:59.781851 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2851/5519] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:56:59 2022] PUT /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1074 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:59.797953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:59.798950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:59.805329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.806087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.806704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.807631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.808228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.808898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:00.228397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:00.236769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f1d2ec5-9099-4848-8712-fda9a8090a3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1500 microversion: 2.1 time: 0.443042 Aug 29 15:57:00.258175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:00.259729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:00.261101 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2669/5520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:59 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:00.278276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.278892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.280037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:00.284529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.286086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.287247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.134856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:01.144091 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c809a82d-73ac-42da-afbb-28188e83420c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1500 microversion: 2.1 time: 0.890436 Aug 29 15:57:01.169621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a2a1115e-2af0-4012-a87f-c856420bce05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:01.176523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2a1115e-2af0-4012-a87f-c856420bce05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:01.177005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2a1115e-2af0-4012-a87f-c856420bce05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:01.189461 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2852/5521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:00 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1500 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:01.190217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a2a1115e-2af0-4012-a87f-c856420bce05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.236756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a2a1115e-2af0-4012-a87f-c856420bce05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Going to try to stop instance {{(pid=130001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:57:01.317059 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a2a1115e-2af0-4012-a87f-c856420bce05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "POST /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96/action" status: 202 len: 0 microversion: 2.1 time: 0.151160 Aug 29 15:57:01.318521 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2670/5522] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:01 2022] POST /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:57:01.327280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:01.327918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:01.336541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:01.348978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:01.349323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.358399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:01.358964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:01.359360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.759826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:01.775981 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f962362f-6141-47b9-9876-2629fbdfd423 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.451971 Aug 29 15:57:01.777168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2853/5523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:01 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:02.813479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:02.814949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:02.824386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:02.826009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:02.827201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:02.828182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:02.833352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:02.836149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:02.956867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:03.816214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:03.826158 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd62a242-8f55-42f2-8692-c14e86b84bdd tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 1.028772 Aug 29 15:57:03.826754 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2671/5524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:02 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:04.848120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:04.848743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:04.869869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.870373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.870810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.871538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.872004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.872436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.875573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:05.961528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:05.971907 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-660bfba4-3bf4-4e95-92e7-7b49c46ab0ec tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 1.127944 Aug 29 15:57:05.973247 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2854/5525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:04 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:06.999787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:07.000411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:07.027498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:07.030424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:07.039326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:07.040818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:07.047495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:07.049883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:07.868915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:07.879497 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-475ffb3d-0c06-4d60-ab95-8877c1d46f6e tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.884049 Aug 29 15:57:07.886387 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2672/5526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:06 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:08.909422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:08.910166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:08.924904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.929284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.929880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.931730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.932225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.932670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:09.074558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1169671910-access_point-1295824898", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "36f72d83-efa6-4435-a151-b13ebde05921"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1023277388", "security_groups": [{"name": "tempest-secgroup_access--157234368"}, {"name": "tempest-secgroup_general--2031815327"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:09.239490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:09.249561 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-04fca599-4449-42d8-8050-fc292febe399 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.344798 Aug 29 15:57:09.257422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2855/5527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:08 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:10.085115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] validate_networks() for [('36f72d83-efa6-4435-a151-b13ebde05921', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:57:10.273418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:10.276045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:10.284678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.285709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.286519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.287564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.288278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.288970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.659719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:10.681690 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf8bba26-b910-4a26-845b-1e68bcc199c9 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.412887 Aug 29 15:57:10.682319 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2856/5528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:10 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:11.707657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:11.709363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:11.725647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:11.726212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:11.727042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:11.728275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:11.728856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:11.731237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:11.915510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:57:11.915936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:57:11.916534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:57:11.916953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:57:11.917369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:57:11.937164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:11.937746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:11.938368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:11.938990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:11.939451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:11.940000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:11.987588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Getting quotas for project 7686f5f846414b3b9706ae0a9f89ba6f. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:11.993900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Getting quotas for user 9b95cef51ea04d9b886a7c29791ec255 and project 7686f5f846414b3b9706ae0a9f89ba6f. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:12.021303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:12.025845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:57:12.028167 n-d-854882-3 devstack@n-api.service[130001]: WARNING nova.utils [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1169671910-access_point-1295824898 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1169671910-ac Aug 29 15:57:12.034396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:57:12.038396 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4b83b7d8-81ec-4135-9944-f507ce2f7246 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.335553 Aug 29 15:57:12.041658 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2857/5529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:11 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:12.101803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c8175287-d483-437d-95b8-9f131e5b7476 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 3.030993 Aug 29 15:57:12.102477 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2673/5530] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:57:09 2022] POST /compute/v2.1/servers => generated 457 bytes in 3032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:57:12.115173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e0abcfc-5a58-4e6f-ab64-0a859dbf7d60 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:12.115948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e0abcfc-5a58-4e6f-ab64-0a859dbf7d60 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:12.317448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e0abcfc-5a58-4e6f-ab64-0a859dbf7d60 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:12.336193 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e0abcfc-5a58-4e6f-ab64-0a859dbf7d60 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1295 microversion: 2.1 time: 0.225796 Aug 29 15:57:12.341405 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2858/5531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:12 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1295 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:13.064263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:13.065120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:13.090849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.092971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.093872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.095032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.095498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.095923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.370651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:13.372535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:13.383883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.385157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.386181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.390389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.391250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.392810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.425309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.435723 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dd2d80b8-f838-4321-a5cc-2617abff78d1 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.375367 Aug 29 15:57:13.442084 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2674/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:13 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:13.711267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.737661 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7593875c-2240-44d0-90dd-824e40a4b48a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1291 microversion: 2.1 time: 0.377249 Aug 29 15:57:13.760510 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2859/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:13 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1291 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:14.464192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:14.464891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:14.477088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.482145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.483583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.485787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.490411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.491789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.766826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:14.767466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:14.782549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.783370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.784053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.784876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.785432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.785884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.942933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:14.951020 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c9411c5d-bc4a-40d7-97ae-d79eed02a47d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1353 microversion: 2.1 time: 0.188203 Aug 29 15:57:14.960038 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2860/5534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:14 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1353 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:15.172083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:15.189420 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a800867-68cc-4793-bc84-799173df244a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.729822 Aug 29 15:57:15.190359 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2675/5535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:14 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:15.983076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:15.983761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:16.007887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.009022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.012092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.013063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.025087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.026702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.184320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:16.197124 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4eae3f0e-c2cd-4d51-96d0-9ab2a8cf9e09 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1353 microversion: 2.1 time: 0.219426 Aug 29 15:57:16.198851 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2861/5536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:15 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:16.217220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:16.218949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:16.235236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.238087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.239003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.240263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.240961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.241701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.676506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:16.684934 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5441fb5e-45d3-4a41-941f-cbe732a76880 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.473663 Aug 29 15:57:16.685563 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2676/5537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:16 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:17.225068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:17.226700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:17.239212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:17.241277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:17.244007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:17.245562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:17.247068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:17.247937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:17.477206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-03fb943a-3f11-474f-a0da-e7d388f64123 req-0755f1a6-2649-4130-a52e-98babcedffec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3a6146-5746-4a30-b8b9-ccccf36d0e6b", "tag": "30b1ea9a-cf03-4d26-a219-8b37c5f4f872"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:17.511245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03fb943a-3f11-474f-a0da-e7d388f64123 req-0755f1a6-2649-4130-a52e-98babcedffec service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:17.511751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03fb943a-3f11-474f-a0da-e7d388f64123 req-0755f1a6-2649-4130-a52e-98babcedffec service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:17.515061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03fb943a-3f11-474f-a0da-e7d388f64123 req-0755f1a6-2649-4130-a52e-98babcedffec service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:17.538675 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-03fb943a-3f11-474f-a0da-e7d388f64123 req-0755f1a6-2649-4130-a52e-98babcedffec service nova] Creating event network-changed:30b1ea9a-cf03-4d26-a219-8b37c5f4f872 for instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b on n-h1-854882-3 Aug 29 15:57:17.565330 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-03fb943a-3f11-474f-a0da-e7d388f64123 req-0755f1a6-2649-4130-a52e-98babcedffec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089433 Aug 29 15:57:17.566281 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2677/5538] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:17.709110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:17.710225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:17.730352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:17.731227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:17.731885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:17.732856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:17.733434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:17.733966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:17.950762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:17.968330 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fa2167ee-5676-4cc9-9326-887b89a0fb27 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.260283 Aug 29 15:57:17.983149 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2678/5539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:17 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:18.086259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:18.102603 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5cfd4480-90b3-4ea1-a309-7e1a73f1ba52 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1472 microversion: 2.1 time: 0.882497 Aug 29 15:57:18.103865 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2862/5540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:17 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1472 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:18.999554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:19.000879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:19.028095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:19.029030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:19.030680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:19.031659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:19.033855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:19.034917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:19.123550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:19.125500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:19.143712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:19.144604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:19.145267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:19.146301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:19.147012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:19.147639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:19.406602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:19.423425 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dcfaa5d9-3f7f-452a-adfc-62ae75489205 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1472 microversion: 2.1 time: 0.303697 Aug 29 15:57:19.425204 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2863/5541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:19 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:19.611158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:19.629373 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-95198fd7-0d02-4dc4-8747-e5a15c81dc79 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.640598 Aug 29 15:57:19.629944 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2679/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:18 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:20.447289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:20.448876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:20.457338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.458008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.458562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.459369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.459899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.460392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.652410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:20.653027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:20.662377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.665840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.666827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.667732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.668468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.669103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.696752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:20.707280 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6224eba-47ec-4434-811d-b6d932393c9c tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1472 microversion: 2.1 time: 0.263670 Aug 29 15:57:20.713582 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2864/5543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:20 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1472 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:21.167589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:21.178678 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-249f7e6e-7e79-4461-b9b0-25d164bd250c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.530893 Aug 29 15:57:21.198044 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2680/5544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:20 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:21.731053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:21.732287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:21.751751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.755619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.756377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.760068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.760744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.763536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:22.056117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:22.072077 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-48677693-4e32-4351-bb1a-8e0f4d92f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1472 microversion: 2.1 time: 0.347558 Aug 29 15:57:22.078194 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2865/5545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:21 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:22.203309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:22.204026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:22.206878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:22.207627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:22.218957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:22.224682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:22.227503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:22.228519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:22.233371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:22.236157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:22.719556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:22.734720 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8584c11-1963-4ce7-9da1-921677fd665f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.535718 Aug 29 15:57:22.749242 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2681/5546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:22 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:23.103739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:23.109625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:23.112344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:23.116155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=40 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:23.134833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.135966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.136716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:23.137937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.141963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.143013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:23.451975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:23.471469 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-baf0e74c-af1d-438a-af0e-1e07f29b2aba tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1472 microversion: 2.1 time: 0.375357 Aug 29 15:57:23.474163 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2866/5547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:23 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:23.755614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:23.756213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:23.778310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.783017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.783706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:23.786389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.792325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.793730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.175037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:24.184315 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-507f1f66-2830-4693-a1ef-99d2f8d5342f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.432517 Aug 29 15:57:24.187456 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2682/5548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:23 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:24.402528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-dc69cd7d-ed22-4186-9655-124ac5038ce2 req-d1bc2ff3-1155-4f60-b374-b904c15649d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3a6146-5746-4a30-b8b9-ccccf36d0e6b", "name": "network-vif-plugged", "status": "completed", "tag": "30b1ea9a-cf03-4d26-a219-8b37c5f4f872"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:24.435427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dc69cd7d-ed22-4186-9655-124ac5038ce2 req-d1bc2ff3-1155-4f60-b374-b904c15649d4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.437494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dc69cd7d-ed22-4186-9655-124ac5038ce2 req-d1bc2ff3-1155-4f60-b374-b904c15649d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.440140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dc69cd7d-ed22-4186-9655-124ac5038ce2 req-d1bc2ff3-1155-4f60-b374-b904c15649d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.472595 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-dc69cd7d-ed22-4186-9655-124ac5038ce2 req-d1bc2ff3-1155-4f60-b374-b904c15649d4 service nova] Creating event network-vif-plugged:30b1ea9a-cf03-4d26-a219-8b37c5f4f872 for instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b on n-h1-854882-3 Aug 29 15:57:24.494496 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-dc69cd7d-ed22-4186-9655-124ac5038ce2 req-d1bc2ff3-1155-4f60-b374-b904c15649d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440449 Aug 29 15:57:24.495447 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2867/5549] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:57:24.497357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:24.498121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:24.510865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.515791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.516573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.518044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.521035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.522945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.208838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:25.209819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:25.219098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.219951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.220657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.222536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.223181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.223800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.526042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.561505 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-955dcde6-9f5f-4109-a321-0a6f6a874a05 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.346661 Aug 29 15:57:25.561505 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2868/5550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:25 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:25.896430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.905821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-37d536df-b189-4dee-b30f-e56f44e752b5 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1472 microversion: 2.1 time: 1.412829 Aug 29 15:57:25.918332 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2683/5551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:24 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1472 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:26.575760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:26.576374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:26.599437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.600371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.601005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.602738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.603360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.605001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.928363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:26.928947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:26.966328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.966825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.969927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.970908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.974320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.984443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.987449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.994312 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa58f4cb-90ba-46dc-910b-aff9c3e6ab9a tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1510 microversion: 2.1 time: 0.425084 Aug 29 15:57:26.999173 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2869/5552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:26 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:27.000499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:27.310021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:27.321279 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3432337-d2ad-4e5c-ad06-081307c7b7b3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1472 microversion: 2.1 time: 0.396060 Aug 29 15:57:27.321841 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2684/5553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:26 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:28.019769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:28.020395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:28.029120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.033736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.034429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.035343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.038004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.038650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.347834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.352372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:28.352996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:28.365908 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-69f8f76f-c4d6-4ae1-80f7-45f91dd397c7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1487 microversion: 2.1 time: 0.350153 Aug 29 15:57:28.368622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.369129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.369673 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2870/5554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:28 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1487 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:28.385774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.386639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.387123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.387558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.391853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-589575338"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:28.402820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:28.427442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.427950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.428408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.429156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.429652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.430671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.591847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:28.609366 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1554a8f9-bf17-46cf-a617-8d5daaf6c819 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "PUT /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1059 microversion: 2.1 time: 0.221564 Aug 29 15:57:28.612793 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2871/5555] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:57:28 2022] PUT /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1059 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:28.629002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:28.629718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:28.645667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.646188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.646641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.649658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.650143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.650585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.778333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.786465 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0ec66395-a14f-4524-907b-4272f41ce206 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1645 microversion: 2.1 time: 0.444650 Aug 29 15:57:28.787070 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2685/5556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:28 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1645 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:28.811593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:28.812213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:28.825224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.825743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.826194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.826890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.827341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.827757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.068500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:29.085296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77e574ce-a0aa-46cc-a9b5-2abbf34ec827 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1486 microversion: 2.1 time: 0.458562 Aug 29 15:57:29.088016 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2872/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:28 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1486 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:29.119049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:29.119852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:29.136031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.136840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.137977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.143801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.144628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.145242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.495306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:29.509263 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe98646d-d75a-4dd1-9dec-16551d80b2e9 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1645 microversion: 2.1 time: 0.700579 Aug 29 15:57:29.511056 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2686/5558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:28 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1645 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:29.544293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:29.557436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:29.558106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:29.574605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:29.577458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.578755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.580840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.582070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.583275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.584061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.587133 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-924c6011-c975-416d-b56e-3329da2e1786 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1486 microversion: 2.1 time: 0.475775 Aug 29 15:57:29.587725 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2873/5559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:29 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1486 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:29.612320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:29.615694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:29.642091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.644599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.646218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.647181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.655361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.657886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.732909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:57:29.969901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a616947-e5c9-423d-a5c8-1c26096d6196 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 204 len: 0 microversion: 2.1 time: 0.363085 Aug 29 15:57:29.976135 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2874/5560] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:29 2022] DELETE /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:57:29.984696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:29.985890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:29.996450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.997418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.998630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.999835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:30.000557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:30.002008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.330377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.354438 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c0211cd-0f9e-474c-8a1f-c9d5070877a6 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1492 microversion: 2.1 time: 0.375097 Aug 29 15:57:30.355426 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2875/5561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:29 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1492 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:30.385620 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-552dee85-fa57-43b8-91a4-63867ed55398 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1796 microversion: 2.1 time: 0.858387 Aug 29 15:57:30.386219 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2687/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:29 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1796 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:31.377361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:31.378673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:31.394214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.395848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.396505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.397700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.399982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.400595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.163104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:32.183987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2fa5e72b-2668-43ad-9001-9f54d630ad3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1492 microversion: 2.1 time: 0.811376 Aug 29 15:57:32.185943 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2876/5563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:31 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1492 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:33.205610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:33.206242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:33.218266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.218813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.219251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.219950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.220408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.220830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.873051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-80350b25-427e-4d6c-991f-a02598081536 req-15b45826-e68c-4591-80bb-cf17ebe0e1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e413401-b841-4c7c-a328-acadbf906f96", "name": "network-vif-deleted", "tag": "e4edc8d6-1ba1-461b-9fdc-c70f91f7f4ff"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:33.897601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80350b25-427e-4d6c-991f-a02598081536 req-15b45826-e68c-4591-80bb-cf17ebe0e1b8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.898096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80350b25-427e-4d6c-991f-a02598081536 req-15b45826-e68c-4591-80bb-cf17ebe0e1b8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.898556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-80350b25-427e-4d6c-991f-a02598081536 req-15b45826-e68c-4591-80bb-cf17ebe0e1b8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.930489 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-80350b25-427e-4d6c-991f-a02598081536 req-15b45826-e68c-4591-80bb-cf17ebe0e1b8 service nova] Creating event network-vif-deleted:e4edc8d6-1ba1-461b-9fdc-c70f91f7f4ff for instance 4e413401-b841-4c7c-a328-acadbf906f96 on n-h1-854882-3 Aug 29 15:57:33.937854 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-80350b25-427e-4d6c-991f-a02598081536 req-15b45826-e68c-4591-80bb-cf17ebe0e1b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070058 Aug 29 15:57:33.939422 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2877/5564] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:57:34.028813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:34.042764 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-779292fd-4894-4262-b061-a0a6e4ba80c8 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 200 len: 1492 microversion: 2.1 time: 0.839132 Aug 29 15:57:34.045728 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2688/5565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:33 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 1492 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:35.076311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.080167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.105679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.108338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.112103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.113414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.129669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.130469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.191965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 HTTP/1.1 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '4e413401-b841-4c7c-a328-acadbf906f96'} Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.201439 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.206092 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.206092 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.206092 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.206092 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.206092 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.206092 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.207323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.214329 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d7f6cec3-b680-4a65-ab4b-417960c40187 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 404 len: 111 microversion: 2.1 time: 0.145873 Aug 29 15:57:35.217671 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2878/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.238467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.239132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.252092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.255037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.255564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.259617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.260085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.261613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.314803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 HTTP/1.1 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '4e413401-b841-4c7c-a328-acadbf906f96'} Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.328504 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.332390 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a3d21e89-5413-45a7-b828-7295b6adf5d7 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 404 len: 111 microversion: 2.1 time: 0.098679 Aug 29 15:57:35.333655 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2689/5567] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:35 2022] DELETE /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.341945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.343381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 4e413401-b841-4c7c-a328-acadbf906f96] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.362700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.363594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.364479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.366776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.368161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.381305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.402399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 HTTP/1.1 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '4e413401-b841-4c7c-a328-acadbf906f96'} Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.404378 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.408649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.408649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.408649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.408649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.408649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. Aug 29 15:57:35.408649 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.411417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 4e413401-b841-4c7c-a328-acadbf906f96 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.412837 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d781046-5524-412f-9312-a69ea04a2d77 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96" status: 404 len: 111 microversion: 2.1 time: 0.075961 Aug 29 15:57:35.414734 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2879/5568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/4e413401-b841-4c7c-a328-acadbf906f96 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:57:35.423830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.424329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.433731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.434343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.434875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.435794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.436351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.436877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.457309 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 HTTP/1.1 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '143349fc-fcfb-4f3e-900c-374dbb3ada76'} Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.459290 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.464785 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.467373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.469117 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3492b293-b1ed-4d49-8263-ec6ba882901b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 404 len: 111 microversion: 2.1 time: 0.049490 Aug 29 15:57:35.469972 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2690/5569] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:35 2022] DELETE /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.478818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.479499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 143349fc-fcfb-4f3e-900c-374dbb3ada76] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.491841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.493952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.498497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.499512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.500132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.506079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.540279 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 HTTP/1.1 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '143349fc-fcfb-4f3e-900c-374dbb3ada76'} Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.544809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.549937 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.549937 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.549937 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.549937 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.549937 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. Aug 29 15:57:35.549937 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.552439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 143349fc-fcfb-4f3e-900c-374dbb3ada76 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.554488 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0c4ec870-0f2a-4c9f-98c1-8803a3fbbc3f tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76" status: 404 len: 111 microversion: 2.1 time: 0.080152 Aug 29 15:57:35.556800 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2880/5570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/143349fc-fcfb-4f3e-900c-374dbb3ada76 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.563966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.564667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.572913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.573825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.574679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.575629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.576291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.577324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.593768 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 HTTP/1.1 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '6fcf0f26-ca48-447b-92a2-199a082dbfd2'} Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.595735 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.599589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.602400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.603694 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c202aa93-17cc-4017-af2c-79a04ab78d78 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 404 len: 111 microversion: 2.1 time: 0.043636 Aug 29 15:57:35.605362 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2691/5571] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:35 2022] DELETE /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.614528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.615178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 6fcf0f26-ca48-447b-92a2-199a082dbfd2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.625158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.625888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.626530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.627831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.629217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.629920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.659556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 HTTP/1.1 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6fcf0f26-ca48-447b-92a2-199a082dbfd2'} Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.662599 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.666945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.666945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.666945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.666945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.666945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. Aug 29 15:57:35.666945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.666945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 6fcf0f26-ca48-447b-92a2-199a082dbfd2 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.669944 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-10c1f90f-68d2-4141-b68f-8df8cf712719 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2" status: 404 len: 111 microversion: 2.1 time: 0.060445 Aug 29 15:57:35.678438 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2881/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/6fcf0f26-ca48-447b-92a2-199a082dbfd2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.681052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.682127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.693092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.693629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.694079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.694808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.695266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.696232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.733461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 HTTP/1.1 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '381cd196-fc69-44fb-815d-d70f7580b7a0'} Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.737272 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.741191 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7fb2bf93-c938-4444-b69a-c788de1a1a11 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 404 len: 111 microversion: 2.1 time: 0.062438 Aug 29 15:57:35.748526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.749163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 381cd196-fc69-44fb-815d-d70f7580b7a0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.757248 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2692/5573] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:35 2022] DELETE /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:57:35.761477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.762780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.763237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.764424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.764895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.765335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.801443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 HTTP/1.1 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '381cd196-fc69-44fb-815d-d70f7580b7a0'} Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.806100 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 381cd196-fc69-44fb-815d-d70f7580b7a0 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.810066 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63a247e8-e170-4ace-abb3-22a41e15a4a2 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0" status: 404 len: 111 microversion: 2.1 time: 0.064693 Aug 29 15:57:35.819808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.820320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.824682 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2882/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/381cd196-fc69-44fb-815d-d70f7580b7a0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.837482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.838067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.838507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.841572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.841906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.842350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.872647 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c HTTP/1.1 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2f742f3a-45a4-4953-aaf0-6c7db659558c'} Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.877046 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb03efe5-0ecd-4df1-ba54-cd26aeb8f50b tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 404 len: 111 microversion: 2.1 time: 0.064108 Aug 29 15:57:35.881228 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2693/5575] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:35 2022] DELETE /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:57:35.893707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.896133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: 2f742f3a-45a4-4953-aaf0-6c7db659558c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.905322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.906049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.906536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.911863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.917759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.919173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.958140 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c HTTP/1.1 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '2f742f3a-45a4-4953-aaf0-6c7db659558c'} Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.959767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:35.964328 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:35.964328 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:35.964328 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:35.964328 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:35.964328 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. Aug 29 15:57:35.964328 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:35.964328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance 2f742f3a-45a4-4953-aaf0-6c7db659558c could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:35.965668 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eb05c442-74a2-4c45-9a02-da7a3bfc4c9d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c" status: 404 len: 111 microversion: 2.1 time: 0.073133 Aug 29 15:57:35.976424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.978219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.983153 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2883/5576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/2f742f3a-45a4-4953-aaf0-6c7db659558c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:35.991500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.995447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.005982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.007618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.008257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.008950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.030575 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 HTTP/1.1 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd618a90f-ee4d-43ea-83b5-278ee6064a51'} Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:36.032714 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.038110 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.040849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:36.041552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-27b68730-7a72-4c8b-b447-77dd100d9202 req-42ce1838-c22a-4191-bf21-ad0faf9c9c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3a6146-5746-4a30-b8b9-ccccf36d0e6b", "tag": "30b1ea9a-cf03-4d26-a219-8b37c5f4f872"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:36.042228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f0d3e1d4-ecab-4d27-8412-5fab67496839 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 404 len: 111 microversion: 2.1 time: 0.070465 Aug 29 15:57:36.046228 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2694/5577] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:35 2022] DELETE /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:36.052974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.053898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: d618a90f-ee4d-43ea-83b5-278ee6064a51] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.058204 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 15:57:36.058373 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 15:57:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Aug 29 15:57:36.062528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.063499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.063692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-27b68730-7a72-4c8b-b447-77dd100d9202 req-42ce1838-c22a-4191-bf21-ad0faf9c9c5d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.064277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.065103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.065697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.065820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-27b68730-7a72-4c8b-b447-77dd100d9202 req-42ce1838-c22a-4191-bf21-ad0faf9c9c5d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.066267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-27b68730-7a72-4c8b-b447-77dd100d9202 req-42ce1838-c22a-4191-bf21-ad0faf9c9c5d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.066677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.084521 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 HTTP/1.1 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd618a90f-ee4d-43ea-83b5-278ee6064a51'} Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.086589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.090559 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.090559 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.090559 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:36.090559 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:36.090559 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. Aug 29 15:57:36.090559 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.093005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance d618a90f-ee4d-43ea-83b5-278ee6064a51 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:36.094155 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fec7f86a-d55c-4e4e-b97f-ea87e969ae89 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51" status: 404 len: 111 microversion: 2.1 time: 0.046683 Aug 29 15:57:36.095785 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2695/5578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:36 2022] GET /compute/v2.1/servers/d618a90f-ee4d-43ea-83b5-278ee6064a51 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:36.099616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-27b68730-7a72-4c8b-b447-77dd100d9202 req-42ce1838-c22a-4191-bf21-ad0faf9c9c5d service nova] Creating event network-changed:30b1ea9a-cf03-4d26-a219-8b37c5f4f872 for instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b on n-h1-854882-3 Aug 29 15:57:36.105868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-927726c0-15e2-421f-aa9a-a2e1167aedee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.106712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-927726c0-15e2-421f-aa9a-a2e1167aedee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: de51c98b-cbfb-4fad-87b8-14f169926bf6] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.116275 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-27b68730-7a72-4c8b-b447-77dd100d9202 req-42ce1838-c22a-4191-bf21-ad0faf9c9c5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079226 Aug 29 15:57:36.119594 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2884/5579] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:57:36.125781 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-927726c0-15e2-421f-aa9a-a2e1167aedee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-927726c0-15e2-421f-aa9a-a2e1167aedee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6 HTTP/1.1 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'de51c98b-cbfb-4fad-87b8-14f169926bf6'} Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.129850 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-927726c0-15e2-421f-aa9a-a2e1167aedee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-927726c0-15e2-421f-aa9a-a2e1167aedee tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6" status: 404 len: 111 microversion: 2.1 time: 0.032967 Aug 29 15:57:36.138451 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2696/5580] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:36 2022] DELETE /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:36.144911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7aa04cd8-711f-4ec8-a9a6-bf65c86cb26c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.145669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7aa04cd8-711f-4ec8-a9a6-bf65c86cb26c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: de51c98b-cbfb-4fad-87b8-14f169926bf6] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.156698 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-7aa04cd8-711f-4ec8-a9a6-bf65c86cb26c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7aa04cd8-711f-4ec8-a9a6-bf65c86cb26c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6 HTTP/1.1 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'de51c98b-cbfb-4fad-87b8-14f169926bf6'} Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:36.158412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:36.163866 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:36.163866 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:36.163866 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. Aug 29 15:57:36.163866 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:36.165604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7aa04cd8-711f-4ec8-a9a6-bf65c86cb26c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance de51c98b-cbfb-4fad-87b8-14f169926bf6 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:36.166725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7aa04cd8-711f-4ec8-a9a6-bf65c86cb26c tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6" status: 404 len: 111 microversion: 2.1 time: 0.027457 Aug 29 15:57:36.168134 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2885/5581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:36 2022] GET /compute/v2.1/servers/de51c98b-cbfb-4fad-87b8-14f169926bf6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:36.177177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.178097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.186772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.187602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.188179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.188755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.189505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.190268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.219462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:57:36.319354 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ad3621f0-b5e9-4049-9497-9d0afddecea5 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 204 len: 0 microversion: 2.1 time: 0.146713 Aug 29 15:57:36.320223 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2697/5582] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:57:36 2022] DELETE /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:57:36.331028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.332465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.343804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.344553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.345161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.346094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.346710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.347340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.564033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:36.606965 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12957e18-6e97-47ae-b26e-865c33bb36da tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1478 microversion: 2.1 time: 0.281434 Aug 29 15:57:36.607907 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2886/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:36 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1478 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:37.632385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:37.634728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:37.655632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:37.656366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:37.656961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:37.657891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:37.658503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:37.659079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.045581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:38.056099 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d94eff0-0ec4-4e61-9e8d-5e43e36fed0d tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1478 microversion: 2.1 time: 0.428655 Aug 29 15:57:38.058000 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2698/5584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:37 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1478 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:39.086854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:39.087500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:39.097298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.097998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.098517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.100779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.101283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.107318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.369894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74602998065943c4a49a96d23ec0ce43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da746b18bda24573a98f42a731b9fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:39.385837 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-42b21a19-37ac-4064-9361-c1702ccc14bb tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 200 len: 1436 microversion: 2.1 time: 0.308735 Aug 29 15:57:39.387709 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2887/5585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:39 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 1436 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:39.431594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-30bc8c77-552c-4581-903b-ee94f9e463bb req-50e9bd68-fc92-4f45-88e9-c1ed5e153956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd489ea3-174a-4523-8070-9ce6dba90247", "name": "network-vif-deleted", "tag": "d76df2d0-a03d-4480-aec9-faf05da4036f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:39.452530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-30bc8c77-552c-4581-903b-ee94f9e463bb req-50e9bd68-fc92-4f45-88e9-c1ed5e153956 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.453020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-30bc8c77-552c-4581-903b-ee94f9e463bb req-50e9bd68-fc92-4f45-88e9-c1ed5e153956 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.453477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-30bc8c77-552c-4581-903b-ee94f9e463bb req-50e9bd68-fc92-4f45-88e9-c1ed5e153956 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.494064 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-30bc8c77-552c-4581-903b-ee94f9e463bb req-50e9bd68-fc92-4f45-88e9-c1ed5e153956 service nova] Creating event network-vif-deleted:d76df2d0-a03d-4480-aec9-faf05da4036f for instance bd489ea3-174a-4523-8070-9ce6dba90247 on n-h2-854882-3 Aug 29 15:57:39.501453 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-30bc8c77-552c-4581-903b-ee94f9e463bb req-50e9bd68-fc92-4f45-88e9-c1ed5e153956 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073533 Aug 29 15:57:39.502290 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2699/5586] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:57:40.410454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:40.411294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] [instance: bd489ea3-174a-4523-8070-9ce6dba90247] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:40.422779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.424219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.424913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.425992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.426719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.428321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.446544 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] HTTP exception thrown: Instance bd489ea3-174a-4523-8070-9ce6dba90247 could not be found. Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Request method failure captured: Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 HTTP/1.1 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOEwPpTkMesUwP4UqV3lxbz-3TFdQlb0itSISdgBEVpl_jHyr3Ybo5LRYa-GuWt78mgXUMYvs86zlJxqCKNggOuFdpbQuMCjPufKLLdjGxmfkRt6z8K2fORNbnMUbjqh9-ApkphMNdEhYhQvfoB-0LDqN1OKQ6bW08mXSKJXK2Lyaa8 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da746b18bda24573a98f42a731b9fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da746b18bda24573a98f42a731b9fd27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da746b18bda24573a98f42a731b9fd27"}]}] Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersTestJSON-189190805 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: da746b18bda24573a98f42a731b9fd27 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersTestJSON-189190805 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersTestJSON-189190805-project Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 74602998065943c4a49a96d23ec0ce43 Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersTestJSON-189190805-project Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance bd489ea3-174a-4523-8070-9ce6dba90247 could not be found. Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'bd489ea3-174a-4523-8070-9ce6dba90247'} Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd489ea3-174a-4523-8070-9ce6dba90247 could not be found. Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd489ea3-174a-4523-8070-9ce6dba90247 could not be found. Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:40.449204 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:40.453419 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:40.453419 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:40.453419 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:40.453419 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:40.453419 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd489ea3-174a-4523-8070-9ce6dba90247 could not be found. Aug 29 15:57:40.453419 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:57:40.455350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] Returning 404 to user: Instance bd489ea3-174a-4523-8070-9ce6dba90247 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:40.456468 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f874b18a-7918-429d-99b2-a6db5ac28973 tempest-ServersTestJSON-189190805 tempest-ServersTestJSON-189190805-project] 10.222.0.16 "GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247" status: 404 len: 111 microversion: 2.1 time: 0.051597 Aug 29 15:57:40.457635 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2888/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:40 2022] GET /compute/v2.1/servers/bd489ea3-174a-4523-8070-9ce6dba90247 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:13.092222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:13.094095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:13.302551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-695570309", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "b52e427a-8823-455e-ab73-97781a4871f8"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:13.419485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] validate_networks() for [('b52e427a-8823-455e-ab73-97781a4871f8', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:58:15.535780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:15.536894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:15.537707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:15.538533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:15.539119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:15.582516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.586463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.588065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.589660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.590538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.591250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.627860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Getting quotas for project 7fae5ca512c248a7923f618d7809910d. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:15.642389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Getting quotas for user 84c0b2f7cc2a4fc59f1235450797425a and project 7fae5ca512c248a7923f618d7809910d. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:15.665850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:58:15.670964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:58:15.768205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-89483d76-bbfb-451b-a86c-a7bd359ad58a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.678563 Aug 29 15:58:15.777511 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2700/5588] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:58:15.780696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8afb141-b82e-46be-bede-2064a3de9394 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:15.781967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c8afb141-b82e-46be-bede-2064a3de9394 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:15.784768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:15.785750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:16.267796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8afb141-b82e-46be-bede-2064a3de9394 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.287494 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8afb141-b82e-46be-bede-2064a3de9394 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1227 microversion: 2.1 time: 0.504237 Aug 29 15:58:16.288178 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2889/5589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:15 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1227 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:17.309725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:17.310520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:17.331331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.332875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.335943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.340646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.344996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.349050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.489369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:17.499504 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-61ba6af8-c96f-44e7-9184-2522e389f506 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1223 microversion: 2.1 time: 0.194587 Aug 29 15:58:17.515310 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2701/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:17 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1223 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:18.529803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:18.530506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:18.561823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.569501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.570777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.572293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.579810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.580663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:19.218825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:19.230725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dbaefe96-a4cd-44d2-bae6-630afa435658 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1285 microversion: 2.1 time: 0.705627 Aug 29 15:58:19.237272 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2890/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:18 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1285 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:20.258042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:20.259470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:20.273573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.276691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.277207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:20.278357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.280129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.281664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:20.950418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:20.964939 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-459e04f8-5259-4bcb-8d02-9d1eaf816519 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 0.711082 Aug 29 15:58:20.968365 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2702/5592] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:20 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:21.912276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-feff0fae-099c-490a-9b84-7b48cfd32ffb req-2197769e-751c-4c64-8ee0-235e63e08b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f8f497-f20d-430a-81fd-d01a926489a2", "tag": "80ef10d3-b4bb-47ac-b2d9-839238068559"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:21.936445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-feff0fae-099c-490a-9b84-7b48cfd32ffb req-2197769e-751c-4c64-8ee0-235e63e08b4f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:21.936943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-feff0fae-099c-490a-9b84-7b48cfd32ffb req-2197769e-751c-4c64-8ee0-235e63e08b4f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:21.937430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-feff0fae-099c-490a-9b84-7b48cfd32ffb req-2197769e-751c-4c64-8ee0-235e63e08b4f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:21.951250 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-feff0fae-099c-490a-9b84-7b48cfd32ffb req-2197769e-751c-4c64-8ee0-235e63e08b4f service nova] Creating event network-changed:80ef10d3-b4bb-47ac-b2d9-839238068559 for instance 01f8f497-f20d-430a-81fd-d01a926489a2 on n-h2-854882-3 Aug 29 15:58:21.958445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-feff0fae-099c-490a-9b84-7b48cfd32ffb req-2197769e-751c-4c64-8ee0-235e63e08b4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.316378 Aug 29 15:58:21.959357 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2891/5593] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:21.999154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:21.999770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:22.014987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:22.015471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:22.015917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:22.016633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:22.017143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:22.017521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:22.562934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:22.571788 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39d8fd79-f575-45d7-87bc-eb9a642fe4fc tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 0.578495 Aug 29 15:58:22.572369 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2703/5594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:21 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:23.593293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:23.594421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:23.602368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.603004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.603675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.604490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.605058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.605626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.917869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:23.927597 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5d821bdb-0b32-46d6-a514-09da2768257e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 0.338788 Aug 29 15:58:23.928187 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2892/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:23 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:24.949350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:24.950016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:24.966345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.966842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.967303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.968097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.968457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.972263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.977688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1422307643", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "acee3f44-77ea-43ab-a079-5d3b348eaa65"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1023277388", "security_groups": []}, "os:scheduler_hints": {"different_host": ["eb3a6146-5746-4a30-b8b9-ccccf36d0e6b"]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:25.072217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] validate_networks() for [('acee3f44-77ea-43ab-a079-5d3b348eaa65', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:58:25.416851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:25.427529 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-530e0a14-be9f-446b-aae6-464f178731fd tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 0.483166 Aug 29 15:58:25.433778 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2704/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:24 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:25.888472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:25.889005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:25.889596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:25.890359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:25.891016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:25.903683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.905526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.906227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:25.907291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.908265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.908925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:25.941706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Getting quotas for project 7686f5f846414b3b9706ae0a9f89ba6f. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:25.951872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Getting quotas for user 9b95cef51ea04d9b886a7c29791ec255 and project 7686f5f846414b3b9706ae0a9f89ba6f. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:25.985519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:58:25.988862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:58:26.131094 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5c1691c3-a287-4fe4-8148-3eb9725ac80d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.158047 Aug 29 15:58:26.131771 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2893/5597] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:58:24 2022] POST /compute/v2.1/servers => generated 361 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:58:26.146282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c89bb4c-813f-4a3b-8cc0-a71ddf79f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:26.147288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c89bb4c-813f-4a3b-8cc0-a71ddf79f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:26.150526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:26.166290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:26.448271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:26.448912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:26.467461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:26.468322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:26.469107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:26.470315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:26.471144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:26.471892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:26.598359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c89bb4c-813f-4a3b-8cc0-a71ddf79f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:26.624127 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c89bb4c-813f-4a3b-8cc0-a71ddf79f5c7 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1242 microversion: 2.1 time: 0.483204 Aug 29 15:58:26.633261 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2705/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:26 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1242 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:26.834370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:26.846970 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1ee7375f-ee61-4c2c-9057-1dcb39c92ca6 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 0.402539 Aug 29 15:58:26.851532 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2894/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:26 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:27.649129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.649959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.676055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.680190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.680933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.683404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.684071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.686019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.871318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.873167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.888527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.889076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.889558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.894695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.895433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.896063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:28.029209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:28.045113 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d7a2c170-6f77-464f-aa2d-dca4a9936871 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1294 microversion: 2.1 time: 0.400145 Aug 29 15:58:28.057998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2706/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:27 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1294 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:28.872473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:28.884061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8372e050-6214-48d5-b60e-74f9924295e0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 1.017709 Aug 29 15:58:28.899814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2895/5601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:27 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:29.080090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:29.082256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.098627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.112266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.116096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.121067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.121905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.122770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.277838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:29.296118 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4f44648e-8673-4ca9-be83-8f641229e51e tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.223024 Aug 29 15:58:29.316054 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2707/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:29 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:29.909260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:29.909260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.924141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.924838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.927080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.932484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.933159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.933823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.336356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:30.337399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:30.383878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.396031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.397026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.398520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.404682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.405794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.605375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:30.651705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8f9ea4f3-ca19-41b8-9c40-3e45890e4179 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.330332 Aug 29 15:58:30.658036 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2708/5603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:30 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:30.794974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:30.830443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-845e3b41-e712-4f88-83a4-a0a51a0de37a tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 0.926100 Aug 29 15:58:30.831406 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2896/5604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:29 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:30.962829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c9daf9c7-5f8d-44dd-9a7c-a1c16918b22e req-e25d8efc-ca07-480f-90a5-ea85f3b1e36f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f8f497-f20d-430a-81fd-d01a926489a2", "name": "network-vif-plugged", "status": "completed", "tag": "80ef10d3-b4bb-47ac-b2d9-839238068559"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:30.985103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c9daf9c7-5f8d-44dd-9a7c-a1c16918b22e req-e25d8efc-ca07-480f-90a5-ea85f3b1e36f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.986017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c9daf9c7-5f8d-44dd-9a7c-a1c16918b22e req-e25d8efc-ca07-480f-90a5-ea85f3b1e36f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.990450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c9daf9c7-5f8d-44dd-9a7c-a1c16918b22e req-e25d8efc-ca07-480f-90a5-ea85f3b1e36f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.019392 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c9daf9c7-5f8d-44dd-9a7c-a1c16918b22e req-e25d8efc-ca07-480f-90a5-ea85f3b1e36f service nova] Creating event network-vif-plugged:80ef10d3-b4bb-47ac-b2d9-839238068559 for instance 01f8f497-f20d-430a-81fd-d01a926489a2 on n-h2-854882-3 Aug 29 15:58:31.035219 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c9daf9c7-5f8d-44dd-9a7c-a1c16918b22e req-e25d8efc-ca07-480f-90a5-ea85f3b1e36f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077715 Aug 29 15:58:31.037766 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2709/5605] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:31.693233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:31.693881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.713096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.713628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.714070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.714781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.715235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.715661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.855212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:31.856059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.864806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.865863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.867395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.868437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.869133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.869860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.045846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:32.058995 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-362bf673-040e-45bd-88da-c67eee4c994d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.366822 Aug 29 15:58:32.059715 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2897/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:31 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:32.200887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-320282888", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "482d5999-3d3c-49a6-b1ca-7006e339f2d3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:32.221302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:32.231975 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0fb60d09-5e10-478a-9415-d552ad13ed8e tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1327 microversion: 2.1 time: 0.383981 Aug 29 15:58:32.233087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2710/5607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:31 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1327 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:32.276936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] validate_networks() for [('482d5999-3d3c-49a6-b1ca-7006e339f2d3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:58:32.458269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5ea06c7b-996f-40da-a6a2-7f85b503702f req-3cdc3961-15d8-4c42-88a2-a614d967c247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daac574b-1fcf-4398-8310-7aa28779f0b9", "tag": "351fb729-ac56-4bd1-9287-46ebb4c61bc2"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:32.469357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ea06c7b-996f-40da-a6a2-7f85b503702f req-3cdc3961-15d8-4c42-88a2-a614d967c247 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.470415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ea06c7b-996f-40da-a6a2-7f85b503702f req-3cdc3961-15d8-4c42-88a2-a614d967c247 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.471183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ea06c7b-996f-40da-a6a2-7f85b503702f req-3cdc3961-15d8-4c42-88a2-a614d967c247 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.485295 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5ea06c7b-996f-40da-a6a2-7f85b503702f req-3cdc3961-15d8-4c42-88a2-a614d967c247 service nova] Creating event network-changed:351fb729-ac56-4bd1-9287-46ebb4c61bc2 for instance daac574b-1fcf-4398-8310-7aa28779f0b9 on n-h2-854882-3 Aug 29 15:58:32.493847 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5ea06c7b-996f-40da-a6a2-7f85b503702f req-3cdc3961-15d8-4c42-88a2-a614d967c247 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040749 Aug 29 15:58:32.495184 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2711/5608] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:33.081673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:33.082446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:33.099067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.100165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.100872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.101731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.102301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.102826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.298787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:33.308011 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3cfd7380-31c4-4989-850f-c353f186123d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.231530 Aug 29 15:58:33.308884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2712/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:33 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:33.314044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:33.314933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:33.322252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.323911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.324548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.325427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.325956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.326572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.354968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:33.355505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:33.355880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:33.356469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:33.356899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:33.367454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.368226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.368856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.369796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.370435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.371030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.391494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Getting quotas for project 60a19cab0721487b9dada0e3ad35381e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:33.396994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Getting quotas for user 9a121acf89554c7a9650c6461082fbc6 and project 60a19cab0721487b9dada0e3ad35381e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:33.410344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:58:33.412545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:58:33.478229 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55d5013e-4396-45e9-9f91-28fa31511699 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283184 Aug 29 15:58:33.483411 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2898/5610] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:58:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:58:33.506882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9ea17911-f601-4142-bcb2-d2343bd32f89 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:33.508384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9ea17911-f601-4142-bcb2-d2343bd32f89 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:33.626626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:33.641765 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4e94d1fd-171e-49d5-9f89-8bb5af0c7b95 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1526 microversion: 2.1 time: 0.330984 Aug 29 15:58:33.642393 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2713/5611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:33 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1526 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:33.662484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:33.663379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:33.681242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.682536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.683469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.684963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.685805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.686206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.922990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:33.933352 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c418b60-d797-4288-9019-2c045ff07645 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1526 microversion: 2.1 time: 0.274619 Aug 29 15:58:33.940618 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2714/5612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:33 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1526 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:33.962500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9ea17911-f601-4142-bcb2-d2343bd32f89 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:33.976244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9ea17911-f601-4142-bcb2-d2343bd32f89 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1213 microversion: 2.1 time: 0.481532 Aug 29 15:58:33.976684 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2899/5613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:33 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1213 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:34.252169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:34.253352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:34.270867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.272045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.273338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.274240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.274846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.275443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.291917 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] HTTP exception thrown: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Request method failure captured: Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 HTTP/1.1 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOIUGPYm1-IQ2k1eqAqkraWPVuRqdTQt_JHlot1z5SWyLSAUp_hy1WNLUEwISI2QNPnBmxQS0ZOtNKf3-iN5eNVCQVJxr9Ld8YgHen1jSoQCpBPwvMbIw3J_TZAIrfjdnOoROzq6iAu4Y62DRQNaxTUU-A2sRCs3KTisxgl1AJLTMlE Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7a2e9a8f2891451c9199528a3aae2594 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1007934435 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a2e9a8f2891451c9199528a3aae2594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a2e9a8f2891451c9199528a3aae2594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a2e9a8f2891451c9199528a3aae2594", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a2e9a8f2891451c9199528a3aae2594"}]}] Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1007934435 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7a2e9a8f2891451c9199528a3aae2594 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1007934435 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1007934435-project Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c66a6fe93b604459ad298f7dd211e467 Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1007934435-project Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '01f8f497-f20d-430a-81fd-d01a926489a2'} Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:34.294292 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.299310 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.301453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Returning 404 to user: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:34.302464 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4144481-c406-4edc-8822-29286ccfa0f7 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] 10.222.0.16 "DELETE /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 404 len: 111 microversion: 2.1 time: 0.347284 Aug 29 15:58:34.309532 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2715/5614] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:33 2022] DELETE /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 111 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:58:34.314649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:34.317048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:34.329417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.330783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:34.331705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:34.333233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.333998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.337041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.339459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.341232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.352058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.352820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.353554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.356210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.356848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.357452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.681247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:34.692219 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f0efd645-c569-4290-8e6a-f97b68ead51d tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.366987 Aug 29 15:58:34.692822 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2716/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:34 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:34.771019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:34.782290 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-319eae9c-2069-4968-ae23-8fb84176bdb0 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1526 microversion: 2.1 time: 0.471450 Aug 29 15:58:34.783764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2900/5616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:34 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1526 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:34.813249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Action: 'update', calling method: >, body: {"server": {"name": "01f8f497-f20d-430a-81fd-d01a926489a2_new"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:34.815838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:34.830923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.831866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.833748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.837619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.838431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.839009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.857738 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] HTTP exception thrown: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Request method failure captured: Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: request: PUT /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 HTTP/1.1 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 64 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOIUGPYm1-IQ2k1eqAqkraWPVuRqdTQt_JHlot1z5SWyLSAUp_hy1WNLUEwISI2QNPnBmxQS0ZOtNKf3-iN5eNVCQVJxr9Ld8YgHen1jSoQCpBPwvMbIw3J_TZAIrfjdnOoROzq6iAu4Y62DRQNaxTUU-A2sRCs3KTisxgl1AJLTMlE Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7a2e9a8f2891451c9199528a3aae2594 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1007934435 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a2e9a8f2891451c9199528a3aae2594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a2e9a8f2891451c9199528a3aae2594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a2e9a8f2891451c9199528a3aae2594", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a2e9a8f2891451c9199528a3aae2594"}]}] Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1007934435 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7a2e9a8f2891451c9199528a3aae2594 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1007934435 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1007934435-project Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c66a6fe93b604459ad298f7dd211e467 Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1007934435-project Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: {"server": {"name": "01f8f497-f20d-430a-81fd-d01a926489a2_new"}} Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '01f8f497-f20d-430a-81fd-d01a926489a2', 'body': {'server': {'name': '01f8f497-f20d-430a-81fd-d01a926489a2_new'}}} Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:34.859392 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] Returning 404 to user: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:34.864477 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-251cb29d-7343-4d7d-91bb-0e611e2e41d6 tempest-ServersNegativeTestMultiTenantJSON-1007934435 tempest-ServersNegativeTestMultiTenantJSON-1007934435-project] 10.222.0.16 "PUT /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 404 len: 111 microversion: 2.1 time: 0.062517 Aug 29 15:58:34.875084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:34.875597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:34.877738 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2717/5617] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:58:34 2022] PUT /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:34.891761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.894428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.895212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.896159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.898207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.899298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.953306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:58:34.996749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:34.997698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:35.025887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.026405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.026849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.028921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.030793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.031220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.146897 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b08941c7-3666-4840-bd5e-399920b5cba3 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "DELETE /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 204 len: 0 microversion: 2.1 time: 0.276910 Aug 29 15:58:35.148135 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2901/5618] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:34 2022] DELETE /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:58:35.157330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:35.158352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:35.166603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.167316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.167929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.168838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.169736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:35.170092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.170800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.184798 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ceec23ee-b6b3-408d-9f29-fe5fb65f3a30 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1273 microversion: 2.1 time: 0.192627 Aug 29 15:58:35.197844 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2718/5619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:34 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:35.557087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:35.567189 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13e6221f-b039-4de7-aa16-b90ec785aaed tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1532 microversion: 2.1 time: 0.414587 Aug 29 15:58:35.570116 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2902/5620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:35 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1532 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:35.717221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:35.717885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:35.724477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.725692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.726125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.726823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.727269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.727863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.870851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:35.887911 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-afcba6aa-f4dc-465a-aaca-2a2bba5a5cbe tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.174923 Aug 29 15:58:35.890640 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2719/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:35 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:36.209872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:36.211477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:36.237963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.239471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.240379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.244533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.245287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.245887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.590597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:36.593582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:36.605224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.606135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.607162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.608056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.609241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.609875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.615210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:36.641564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:36.656844 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a200d1c6-8a30-486f-9732-43f4db99313f tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1313 microversion: 2.1 time: 0.451793 Aug 29 15:58:36.670780 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2903/5622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:36 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:36.911154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:36.912030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:36.929661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.930393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.930609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.931497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.932136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.932852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.953650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:36.966491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:36.983404 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fa2b1a8e-d4ba-47e8-a6a4-df14b95b439b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1532 microversion: 2.1 time: 0.392896 Aug 29 15:58:36.986853 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2720/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:36 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1532 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:37.181566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:37.195863 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e880d54-9558-4c88-950c-7782b14e8f67 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.286143 Aug 29 15:58:37.203927 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2904/5624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:36 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:37.445503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8d95d75d-eac6-493c-b8a2-e6585cf588c6 req-28a20a00-dfd2-472b-8655-76f8058a19a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f49289-5b53-4614-b14b-7c9f83976a54", "tag": "4ffafdf1-2cbf-4457-9df5-da8b797c92c7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:37.457165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d95d75d-eac6-493c-b8a2-e6585cf588c6 req-28a20a00-dfd2-472b-8655-76f8058a19a3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.457965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d95d75d-eac6-493c-b8a2-e6585cf588c6 req-28a20a00-dfd2-472b-8655-76f8058a19a3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.458553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d95d75d-eac6-493c-b8a2-e6585cf588c6 req-28a20a00-dfd2-472b-8655-76f8058a19a3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.473932 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8d95d75d-eac6-493c-b8a2-e6585cf588c6 req-28a20a00-dfd2-472b-8655-76f8058a19a3 service nova] Creating event network-changed:4ffafdf1-2cbf-4457-9df5-da8b797c92c7 for instance 60f49289-5b53-4614-b14b-7c9f83976a54 on n-h1-854882-3 Aug 29 15:58:37.484357 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8d95d75d-eac6-493c-b8a2-e6585cf588c6 req-28a20a00-dfd2-472b-8655-76f8058a19a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.333206 Aug 29 15:58:37.485714 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2721/5625] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:37.681069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:37.682334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:37.690247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.690742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.691180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.691888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.692334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.701584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.999246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:38.008367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:38.009072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:38.014821 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3270acff-8ae0-4e2c-a444-16db168b48f1 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1313 microversion: 2.1 time: 0.338175 Aug 29 15:58:38.017204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.017566 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2905/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:37 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:38.018907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.019517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.020388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.030489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.031745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.228622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:38.236680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:38.244937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:38.265179 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c0661cb-3943-47fb-9aa8-97ebc48db371 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1532 microversion: 2.1 time: 0.261057 Aug 29 15:58:38.294565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.295396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.304597 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2722/5627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:38 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1532 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:38.308834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.310306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.318796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.320619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.595970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:38.607173 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6e372a0b-b34c-4f4d-800c-9ade1f76241b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.384542 Aug 29 15:58:38.617193 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2906/5628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:38 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:38.811105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c2725fcb-cfe3-430d-b079-928df729a381 req-7d907d55-dd2c-4cf2-9ac4-66fbefe0eb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f8f497-f20d-430a-81fd-d01a926489a2", "name": "network-vif-deleted", "tag": "80ef10d3-b4bb-47ac-b2d9-839238068559"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:38.831665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c2725fcb-cfe3-430d-b079-928df729a381 req-7d907d55-dd2c-4cf2-9ac4-66fbefe0eb24 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.832630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c2725fcb-cfe3-430d-b079-928df729a381 req-7d907d55-dd2c-4cf2-9ac4-66fbefe0eb24 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.833068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c2725fcb-cfe3-430d-b079-928df729a381 req-7d907d55-dd2c-4cf2-9ac4-66fbefe0eb24 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.854110 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c2725fcb-cfe3-430d-b079-928df729a381 req-7d907d55-dd2c-4cf2-9ac4-66fbefe0eb24 service nova] Creating event network-vif-deleted:80ef10d3-b4bb-47ac-b2d9-839238068559 for instance 01f8f497-f20d-430a-81fd-d01a926489a2 on n-h2-854882-3 Aug 29 15:58:38.889708 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c2725fcb-cfe3-430d-b079-928df729a381 req-7d907d55-dd2c-4cf2-9ac4-66fbefe0eb24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083397 Aug 29 15:58:38.890463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2723/5629] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:39.044214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:39.044997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:39.067767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.068441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.068982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.070515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.074197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.075599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.286385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:39.290381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:39.297423 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e59a99f-b640-45a3-af42-435ff07283cd tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1313 microversion: 2.1 time: 0.257740 Aug 29 15:58:39.306728 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2907/5630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:39 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:39.314754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:39.315463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:39.331845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.332820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.334005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.335658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.336323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.337240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.386037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.386801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.387448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.405004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lazy-loading 'fault' on Instance uuid 01f8f497-f20d-430a-81fd-d01a926489a2 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:39.534741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c0b2f7cc2a4fc59f1235450797425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5ca512c248a7923f618d7809910d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:39.542569 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5273474b-121b-43b8-9f97-66b87f0dd68b tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 200 len: 1317 microversion: 2.1 time: 0.234759 Aug 29 15:58:39.554537 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2724/5631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:39 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:39.638689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:39.639571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:39.652838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.656034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.656656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.657574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.659100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.660739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.834661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:39.851688 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a7c31c24-4900-4448-a6f8-0f603bd0c5ff tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.217439 Aug 29 15:58:39.852314 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2908/5632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:39 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:40.322564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:40.326103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:40.341300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.342240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.342676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.343381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.343836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.344261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.500506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:40.513106 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a156d8e1-6550-4e5c-a885-7a4041718d55 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1313 microversion: 2.1 time: 0.195505 Aug 29 15:58:40.513841 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2725/5633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:40 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:40.569665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:40.570767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] [instance: 01f8f497-f20d-430a-81fd-d01a926489a2] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:40.581728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.582321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.583102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.584112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.584854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.585314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.606705 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] HTTP exception thrown: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Request method failure captured: Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 HTTP/1.1 Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOIIRJJnEeVqkojtkSmZe4trLnGoLFco3OM5zDxUSbKmt5CpqK9NHPe4grB_X-2VNOkXR5QaCCikOmm03sBP6czb96oc6S1jhutEBrT6GAMBbskKl4zGuxB8eIT66bzXRpxwrzEmN9SpB4CzFmKlcUpq9DMZ95A_ZUpcafoqrSgk7Uo Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7fae5ca512c248a7923f618d7809910d Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-833468822 Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7fae5ca512c248a7923f618d7809910d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7fae5ca512c248a7923f618d7809910d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7fae5ca512c248a7923f618d7809910d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7fae5ca512c248a7923f618d7809910d"}]}] Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-833468822 Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7fae5ca512c248a7923f618d7809910d Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-833468822 Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestMultiTenantJSON-833468822-project Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 84c0b2f7cc2a4fc59f1235450797425a Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-833468822-project Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '01f8f497-f20d-430a-81fd-d01a926489a2'} Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:40.608975 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] Returning 404 to user: Instance 01f8f497-f20d-430a-81fd-d01a926489a2 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:40.613088 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-961433ce-a46d-44c3-b0bf-8258434da731 tempest-ServersNegativeTestMultiTenantJSON-833468822 tempest-ServersNegativeTestMultiTenantJSON-833468822-project] 10.222.0.16 "GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2" status: 404 len: 111 microversion: 2.1 time: 0.047537 Aug 29 15:58:40.616867 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2909/5634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:40 2022] GET /compute/v2.1/servers/01f8f497-f20d-430a-81fd-d01a926489a2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:58:40.685005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1dc9be32-40c7-4d00-96ae-cb0bb1c28480 req-ab9ad47f-77e8-41d8-94f7-f8f64694135e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daac574b-1fcf-4398-8310-7aa28779f0b9", "name": "network-vif-plugged", "status": "completed", "tag": "351fb729-ac56-4bd1-9287-46ebb4c61bc2"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:40.701029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1dc9be32-40c7-4d00-96ae-cb0bb1c28480 req-ab9ad47f-77e8-41d8-94f7-f8f64694135e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.701946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1dc9be32-40c7-4d00-96ae-cb0bb1c28480 req-ab9ad47f-77e8-41d8-94f7-f8f64694135e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.702560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1dc9be32-40c7-4d00-96ae-cb0bb1c28480 req-ab9ad47f-77e8-41d8-94f7-f8f64694135e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.716169 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1dc9be32-40c7-4d00-96ae-cb0bb1c28480 req-ab9ad47f-77e8-41d8-94f7-f8f64694135e service nova] Creating event network-vif-plugged:351fb729-ac56-4bd1-9287-46ebb4c61bc2 for instance daac574b-1fcf-4398-8310-7aa28779f0b9 on n-h2-854882-3 Aug 29 15:58:40.727476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1dc9be32-40c7-4d00-96ae-cb0bb1c28480 req-ab9ad47f-77e8-41d8-94f7-f8f64694135e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045324 Aug 29 15:58:40.729023 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2726/5635] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:40.874118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:40.874757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:40.888745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.889566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.890225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.891721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.894520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.895190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.047025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:41.064128 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-726d0324-1a55-4030-ad30-a610ed594e2a tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1300 microversion: 2.1 time: 0.195631 Aug 29 15:58:41.065946 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2910/5636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:40 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:41.543906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.545938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:41.564418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.568459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.569590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.571698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.572686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.573490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.972957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:41.988534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63b12aff-fc2c-4a85-81b5-9998b8e0c398 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1313 microversion: 2.1 time: 0.453851 Aug 29 15:58:42.002053 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2727/5637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:42.089737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:42.091398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:42.112691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.113627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.114273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.115227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.119718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.121139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.288556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:42.299231 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae70647a-3e21-4b73-b955-84cf23ac13a4 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1472 microversion: 2.1 time: 0.216577 Aug 29 15:58:42.304837 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2911/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:42 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:42.332489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:42.334163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:42.343076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.343914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.344786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.345867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.346531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.355472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.593797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:42.615418 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f39ad41a-527e-484a-9ad0-4f6c8f610da8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1472 microversion: 2.1 time: 0.293764 Aug 29 15:58:42.616187 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2728/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:42 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:42.637105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:42.637998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:42.651220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.661499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.661880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.662649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.663684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.664122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.748305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-10261bf2-d91d-4885-9dac-4c30abd08234 req-ec8a4784-9c26-4680-aec3-5a93211a926b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f49289-5b53-4614-b14b-7c9f83976a54", "name": "network-vif-plugged", "status": "completed", "tag": "4ffafdf1-2cbf-4457-9df5-da8b797c92c7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:42.785248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10261bf2-d91d-4885-9dac-4c30abd08234 req-ec8a4784-9c26-4680-aec3-5a93211a926b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.786020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10261bf2-d91d-4885-9dac-4c30abd08234 req-ec8a4784-9c26-4680-aec3-5a93211a926b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.786744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-10261bf2-d91d-4885-9dac-4c30abd08234 req-ec8a4784-9c26-4680-aec3-5a93211a926b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.812855 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-10261bf2-d91d-4885-9dac-4c30abd08234 req-ec8a4784-9c26-4680-aec3-5a93211a926b service nova] Creating event network-vif-plugged:4ffafdf1-2cbf-4457-9df5-da8b797c92c7 for instance 60f49289-5b53-4614-b14b-7c9f83976a54 on n-h1-854882-3 Aug 29 15:58:42.861379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-10261bf2-d91d-4885-9dac-4c30abd08234 req-ec8a4784-9c26-4680-aec3-5a93211a926b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116565 Aug 29 15:58:42.877665 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2729/5640] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:42.877926 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-87b2236c-c42e-4bfe-8682-37886ab50676 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1623 microversion: 2.1 time: 0.242920 Aug 29 15:58:42.896080 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2912/5641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:42 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1623 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:42.906006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:42.907440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:42.916471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.917192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.917843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.919977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.920813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.922750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.014835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.015665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:43.029808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.030503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.031163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.032186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.033974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.035681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.304948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:43.334114 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c914e17e-adbe-4d08-a888-2b8f1a7dc491 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1313 microversion: 2.1 time: 0.324540 Aug 29 15:58:43.337429 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2913/5642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:43.414531 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cf21d60-fb39-43ff-a436-8a003af11f56 tempest-TestSecurityGroupsBasicOps-742098015 tempest-TestSecurityGroupsBasicOps-742098015-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1915 microversion: 2.1 time: 0.513072 Aug 29 15:58:43.416478 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2730/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:42 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1915 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:43.518983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.519750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:43.531718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:43.535523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.536695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.542500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.543362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.544097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.544611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.583038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:58:43.672714 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4944a1af-cecb-4638-b768-0150fab471a1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 204 len: 0 microversion: 2.1 time: 0.157917 Aug 29 15:58:43.673258 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2914/5644] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:43 2022] DELETE /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:58:43.684775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.686074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:43.693160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:43.695475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.696125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.697125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.698029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.699829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.700274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.227983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:44.247765 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4525110f-10dc-44ee-84ae-8225eed57deb tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1478 microversion: 2.1 time: 0.568615 Aug 29 15:58:44.249743 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2731/5645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1478 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:44.362238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:44.362993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:44.376483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=16 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:44.387903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:44.427486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.433889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.434700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.435463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.436221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.436361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.762324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:44.785902 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-54749b94-4df6-41b9-89bf-b4ad86a030c0 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1498 microversion: 2.1 time: 0.424958 Aug 29 15:58:44.801905 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2915/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:44 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1498 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:45.274918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:45.276053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:45.285619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.286302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.286898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.288319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.288938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.289741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.316413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:45.317349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:45.323951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.324700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.325306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.326348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.326976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.327572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.355872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:58:45.437705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:45.445633 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a225ea9-ed88-4f88-a9da-9eda3ee668f3 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1478 microversion: 2.1 time: 0.178417 Aug 29 15:58:45.446218 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2732/5647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:45 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1478 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:45.476681 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-085e9dcc-aa05-443e-afea-931d8c3d569c tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 204 len: 0 microversion: 2.1 time: 0.163297 Aug 29 15:58:45.477328 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2916/5648] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:45 2022] DELETE /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:58:45.485415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:45.486039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:45.492077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.492774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.493370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.494846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.495470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.496085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.816129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:45.826335 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65a2df3e-2b73-4b3e-a4a1-7fe804ee2dd6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1504 microversion: 2.1 time: 0.344674 Aug 29 15:58:45.838473 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2733/5649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:45 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:46.158334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-bc3eaffe-4f3f-44ad-a728-a1a7bab0aa7b req-b6978ea7-7a56-4002-acc7-d36f351bb481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daac574b-1fcf-4398-8310-7aa28779f0b9", "name": "network-vif-deleted", "tag": "351fb729-ac56-4bd1-9287-46ebb4c61bc2"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:46.177546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bc3eaffe-4f3f-44ad-a728-a1a7bab0aa7b req-b6978ea7-7a56-4002-acc7-d36f351bb481 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.178041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bc3eaffe-4f3f-44ad-a728-a1a7bab0aa7b req-b6978ea7-7a56-4002-acc7-d36f351bb481 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.179012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bc3eaffe-4f3f-44ad-a728-a1a7bab0aa7b req-b6978ea7-7a56-4002-acc7-d36f351bb481 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.205110 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bc3eaffe-4f3f-44ad-a728-a1a7bab0aa7b req-b6978ea7-7a56-4002-acc7-d36f351bb481 service nova] Creating event network-vif-deleted:351fb729-ac56-4bd1-9287-46ebb4c61bc2 for instance daac574b-1fcf-4398-8310-7aa28779f0b9 on n-h2-854882-3 Aug 29 15:58:46.221946 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-bc3eaffe-4f3f-44ad-a728-a1a7bab0aa7b req-b6978ea7-7a56-4002-acc7-d36f351bb481 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068120 Aug 29 15:58:46.227540 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2917/5650] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:46.466969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:46.467590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:46.474814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.475360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.476348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.476991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.477466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.477893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.518720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.524779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.524779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.524779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lazy-loading 'fault' on Instance uuid daac574b-1fcf-4398-8310-7aa28779f0b9 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:46.610274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:46.643878 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0bbd28e5-12c5-4c82-863b-72b144e5ddca tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 200 len: 1332 microversion: 2.1 time: 0.179365 Aug 29 15:58:46.654587 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2734/5651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:46 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:46.851286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:46.852196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:46.863220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.863992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.864554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.865378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.866263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.866797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.441554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:47.460985 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1d90bba4-6dc1-44e7-901c-7971c04e5b5a tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 200 len: 1504 microversion: 2.1 time: 0.614517 Aug 29 15:58:47.462072 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2918/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:46 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 1504 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:47.542839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1abae11e-8208-4f73-ba18-08f9a9ed360e req-69d6984a-a221-48c0-a80f-4294a59195d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f49289-5b53-4614-b14b-7c9f83976a54", "name": "network-vif-deleted", "tag": "4ffafdf1-2cbf-4457-9df5-da8b797c92c7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:47.559290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1abae11e-8208-4f73-ba18-08f9a9ed360e req-69d6984a-a221-48c0-a80f-4294a59195d2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:47.560749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1abae11e-8208-4f73-ba18-08f9a9ed360e req-69d6984a-a221-48c0-a80f-4294a59195d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:47.561368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1abae11e-8208-4f73-ba18-08f9a9ed360e req-69d6984a-a221-48c0-a80f-4294a59195d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.575679 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1abae11e-8208-4f73-ba18-08f9a9ed360e req-69d6984a-a221-48c0-a80f-4294a59195d2 service nova] Creating event network-vif-deleted:4ffafdf1-2cbf-4457-9df5-da8b797c92c7 for instance 60f49289-5b53-4614-b14b-7c9f83976a54 on n-h1-854882-3 Aug 29 15:58:47.581883 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1abae11e-8208-4f73-ba18-08f9a9ed360e req-69d6984a-a221-48c0-a80f-4294a59195d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043232 Aug 29 15:58:47.582489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2735/5653] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:47.669430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:47.670363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: daac574b-1fcf-4398-8310-7aa28779f0b9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:47.682330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:47.683160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:47.683862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.684873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:47.686689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:47.688861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.714304 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] HTTP exception thrown: Instance daac574b-1fcf-4398-8310-7aa28779f0b9 could not be found. Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Request method failure captured: Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 HTTP/1.1 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOHCAUQbN4WI88XNsdMGYvP27LvYFBP2pXlNNTMrXoIRNj4Zf7fJc_O6F0ksx2S4sCwZRtDwAlSfkxTljKkFs4uJj4wpMU72SMmGe1rt5uzMp4fQsGL1HdywZpF2hSHTHp3E7imTqf09aRu15K_wBcFp5JDFLQIKMsEDZjYESluoc2I Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 7686f5f846414b3b9706ae0a9f89ba6f Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1169671910 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7686f5f846414b3b9706ae0a9f89ba6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7686f5f846414b3b9706ae0a9f89ba6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7686f5f846414b3b9706ae0a9f89ba6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7686f5f846414b3b9706ae0a9f89ba6f"}]}] Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1169671910 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 7686f5f846414b3b9706ae0a9f89ba6f Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1169671910 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestSecurityGroupsBasicOps-1169671910-project Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 9b95cef51ea04d9b886a7c29791ec255 Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1169671910-project Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance daac574b-1fcf-4398-8310-7aa28779f0b9 could not be found. Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'daac574b-1fcf-4398-8310-7aa28779f0b9'} Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daac574b-1fcf-4398-8310-7aa28779f0b9 could not be found. Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daac574b-1fcf-4398-8310-7aa28779f0b9 could not be found. Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:47.716214 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daac574b-1fcf-4398-8310-7aa28779f0b9 could not be found. Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:58:47.722073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Returning 404 to user: Instance daac574b-1fcf-4398-8310-7aa28779f0b9 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:47.724067 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4035601-8a5f-4d3a-8f53-bd8add160fea tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9" status: 404 len: 111 microversion: 2.1 time: 0.058585 Aug 29 15:58:47.725243 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2919/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:47 2022] GET /compute/v2.1/servers/daac574b-1fcf-4398-8310-7aa28779f0b9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:48.483494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:48.484247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 60f49289-5b53-4614-b14b-7c9f83976a54] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:48.494138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.495920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.496760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.497868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.498557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.501053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.571244 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] HTTP exception thrown: Instance 60f49289-5b53-4614-b14b-7c9f83976a54 could not be found. Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Request method failure captured: Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 HTTP/1.1 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOIlRiF7nthWLL5ER13RLlCHZdbHQF7jRei7WnKxnUSzg2DyZwxzrNRgxt430Ils7D3Snds3pzvTVW9mZnvg8uOzNX_gHVQ0JFwNsCErth0EWkMTLcqkquEineRwXvbyWvq8nnlhCuFMoc0AVGuxusGYC6MioJzfhh6PAC85Iz28FkQ Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 60a19cab0721487b9dada0e3ad35381e Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesActionsTest-1368141008 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60a19cab0721487b9dada0e3ad35381e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60a19cab0721487b9dada0e3ad35381e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60a19cab0721487b9dada0e3ad35381e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60a19cab0721487b9dada0e3ad35381e"}]}] Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesActionsTest-1368141008 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 60a19cab0721487b9dada0e3ad35381e Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesActionsTest-1368141008 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesActionsTest-1368141008-project Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 9a121acf89554c7a9650c6461082fbc6 Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesActionsTest-1368141008-project Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 60f49289-5b53-4614-b14b-7c9f83976a54 could not be found. Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '60f49289-5b53-4614-b14b-7c9f83976a54'} Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f49289-5b53-4614-b14b-7c9f83976a54 could not be found. Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f49289-5b53-4614-b14b-7c9f83976a54 could not be found. Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:48.578031 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f49289-5b53-4614-b14b-7c9f83976a54 could not be found. Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Returning 404 to user: Instance 60f49289-5b53-4614-b14b-7c9f83976a54 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:48.585460 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c6b95d97-717a-4bf8-a059-36798a934a10 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54" status: 404 len: 111 microversion: 2.1 time: 0.102927 Aug 29 15:58:48.589430 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2736/5655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:48 2022] GET /compute/v2.1/servers/60f49289-5b53-4614-b14b-7c9f83976a54 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:48.782711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-834847847", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "482d5999-3d3c-49a6-b1ca-7006e339f2d3"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:48.878460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] validate_networks() for [('482d5999-3d3c-49a6-b1ca-7006e339f2d3', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:58:50.462295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:50.466049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:50.467874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:50.468479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:50.469153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:50.489946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.490695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.491784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:50.492706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.493334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.493980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:50.523231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Getting quotas for project 60a19cab0721487b9dada0e3ad35381e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:50.529804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Getting quotas for user 9a121acf89554c7a9650c6461082fbc6 and project 60a19cab0721487b9dada0e3ad35381e. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:50.595005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:58:50.603334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:58:50.695729 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-684ae4c1-530f-46c9-9830-9b800745e1de tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918426 Aug 29 15:58:50.696966 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2920/5656] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:58:50.707509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcc35568-f3d9-41e1-b43e-72ee5f102b40 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.708750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dcc35568-f3d9-41e1-b43e-72ee5f102b40 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:50.832930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dcc35568-f3d9-41e1-b43e-72ee5f102b40 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:50.848712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dcc35568-f3d9-41e1-b43e-72ee5f102b40 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1213 microversion: 2.1 time: 0.144409 Aug 29 15:58:50.849667 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2737/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:50 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:51.875516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:51.876744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:51.893587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:51.894093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:51.894728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:51.895450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:51.895912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:51.896345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:52.010837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.024478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b98737da-094b-4a80-8432-88efe578587b tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1265 microversion: 2.1 time: 0.153434 Aug 29 15:58:52.026302 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2921/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:51 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:53.055414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:53.056050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:53.073137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.073863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.074291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.075305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.075918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.076501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.548650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.559898 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-41379e25-cf2d-4a00-bfac-de80002da0c5 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1271 microversion: 2.1 time: 0.508413 Aug 29 15:58:53.560761 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2738/5659] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:53 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1271 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:54.581565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:54.583421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:54.598874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.601935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.602653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:54.603418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.603890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.608306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:55.150019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:55.161224 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18b6ffce-dc70-42c5-afae-5cc118bdf582 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1313 microversion: 2.1 time: 0.583493 Aug 29 15:58:55.161868 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2922/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:54 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:56.183284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:56.185013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:56.193578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:56.194374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:56.195250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.196159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:56.196800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:56.197452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.719307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.735699 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58dd3820-692d-4793-9323-ffde5e921ba6 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1313 microversion: 2.1 time: 0.555543 Aug 29 15:58:56.736720 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2739/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:56 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:56.829871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-05b55c38-1dd5-46c2-b594-1b8e4e907133 req-5da814df-9113-4abd-8280-3a6488df63b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466f38e2-50f4-4751-9354-50bd6fe9a2e5", "tag": "4b1fe9e2-352c-49df-bd49-82696c164ec2"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:56.850887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-05b55c38-1dd5-46c2-b594-1b8e4e907133 req-5da814df-9113-4abd-8280-3a6488df63b6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:56.852075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-05b55c38-1dd5-46c2-b594-1b8e4e907133 req-5da814df-9113-4abd-8280-3a6488df63b6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:56.853481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-05b55c38-1dd5-46c2-b594-1b8e4e907133 req-5da814df-9113-4abd-8280-3a6488df63b6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.898675 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-05b55c38-1dd5-46c2-b594-1b8e4e907133 req-5da814df-9113-4abd-8280-3a6488df63b6 service nova] Creating event network-changed:4b1fe9e2-352c-49df-bd49-82696c164ec2 for instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 on n-h2-854882-3 Aug 29 15:58:56.906753 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-05b55c38-1dd5-46c2-b594-1b8e4e907133 req-5da814df-9113-4abd-8280-3a6488df63b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094350 Aug 29 15:58:56.907378 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2923/5662] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:57.756826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:57.758094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:57.765604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.766430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.767024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:57.767916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.768534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.769121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:58.524350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:58.532659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-48aabf8b-e7e4-42c3-b036-e23d01e27346 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1313 microversion: 2.1 time: 0.780404 Aug 29 15:58:58.535528 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2740/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:57 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:58.943211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:58.944470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:58.947629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-13733e06-c839-4073-b95e-c20e99f2309e req-60802cf3-da94-48fd-b55a-1f1efdefc574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3a6146-5746-4a30-b8b9-ccccf36d0e6b", "tag": "30b1ea9a-cf03-4d26-a219-8b37c5f4f872"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:58.953259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:58.954071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:58.954831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:58.955885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:58.956555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:58.957143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:58.979152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:58.990875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:58:58.991969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-13733e06-c839-4073-b95e-c20e99f2309e req-60802cf3-da94-48fd-b55a-1f1efdefc574 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:58.992569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-13733e06-c839-4073-b95e-c20e99f2309e req-60802cf3-da94-48fd-b55a-1f1efdefc574 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:58.993089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-13733e06-c839-4073-b95e-c20e99f2309e req-60802cf3-da94-48fd-b55a-1f1efdefc574 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.019115 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-13733e06-c839-4073-b95e-c20e99f2309e req-60802cf3-da94-48fd-b55a-1f1efdefc574 service nova] Creating event network-changed:30b1ea9a-cf03-4d26-a219-8b37c5f4f872 for instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b on n-h1-854882-3 Aug 29 15:58:59.027423 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-13733e06-c839-4073-b95e-c20e99f2309e req-60802cf3-da94-48fd-b55a-1f1efdefc574 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085269 Aug 29 15:58:59.028670 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2741/5664] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:59.163528 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3301c259-def4-4d99-a54f-84d821c99fe1 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 204 len: 0 microversion: 2.1 time: 0.223422 Aug 29 15:58:59.164143 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2924/5665] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:58 2022] DELETE /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:58:59.184750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:59.186951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:59.193560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.195468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.196093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.197078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.197731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.198314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.223247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:59.455269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.464353 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e4380043-42bd-4fd1-aa10-5f43337f69b8 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1770 microversion: 2.1 time: 0.285271 Aug 29 15:58:59.469748 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2742/5666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:59 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1770 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:59.556685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:59.557916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:59.565284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.566003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.566618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.567725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.568365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.569666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.805254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.817718 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f10baaef-d071-484e-9b76-90dcb9b8dedf tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1313 microversion: 2.1 time: 0.264652 Aug 29 15:58:59.821112 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2925/5667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:59 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:00.490459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:00.492163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:00.505986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.507078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.509599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:00.510382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.513985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.514773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:00.839301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:00.841614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:00.845906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:00.847277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:00.848464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:00.858913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.859421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.859877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:00.868890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.877037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.877850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.060209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.075449 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a3021e2-ec16-43f3-a447-89d52476ca7b tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1770 microversion: 2.1 time: 0.585047 Aug 29 15:59:01.076475 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2743/5668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:00 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1770 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:01.185735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.196474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-68a319c6-3a28-450b-9b11-4c4bde347293 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1313 microversion: 2.1 time: 0.360802 Aug 29 15:59:01.197697 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2926/5669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:00 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:01.532815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e76caec8-1743-46aa-8796-0fa4bcf7d89a req-9c2c82d2-4f05-4d64-8778-4695bc0e81f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3a6146-5746-4a30-b8b9-ccccf36d0e6b", "name": "network-vif-deleted", "tag": "30b1ea9a-cf03-4d26-a219-8b37c5f4f872"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:01.544297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e76caec8-1743-46aa-8796-0fa4bcf7d89a req-9c2c82d2-4f05-4d64-8778-4695bc0e81f3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.544986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e76caec8-1743-46aa-8796-0fa4bcf7d89a req-9c2c82d2-4f05-4d64-8778-4695bc0e81f3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.545641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e76caec8-1743-46aa-8796-0fa4bcf7d89a req-9c2c82d2-4f05-4d64-8778-4695bc0e81f3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.561321 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e76caec8-1743-46aa-8796-0fa4bcf7d89a req-9c2c82d2-4f05-4d64-8778-4695bc0e81f3 service nova] Creating event network-vif-deleted:30b1ea9a-cf03-4d26-a219-8b37c5f4f872 for instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b on n-h1-854882-3 Aug 29 15:59:01.569235 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e76caec8-1743-46aa-8796-0fa4bcf7d89a req-9c2c82d2-4f05-4d64-8778-4695bc0e81f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039387 Aug 29 15:59:01.574989 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2744/5670] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:02.098366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:02.098978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:02.111909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.113828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.114531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.117969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.119814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.120337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.191596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.192307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.194393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.195016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lazy-loading 'fault' on Instance uuid eb3a6146-5746-4a30-b8b9-ccccf36d0e6b {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:02.220837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:02.221741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:02.234254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.237168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.237886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.238717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.239283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.241666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.332338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b95cef51ea04d9b886a7c29791ec255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7686f5f846414b3b9706ae0a9f89ba6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.391810 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea7501da-c58e-4026-a873-4e4949b110aa tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 200 len: 1385 microversion: 2.1 time: 0.288660 Aug 29 15:59:02.393315 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2927/5671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:02 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 1385 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:02.610090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.628061 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d5886980-5914-4a89-a788-6ef4ec8997fe tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1313 microversion: 2.1 time: 0.410148 Aug 29 15:59:02.630980 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2745/5672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:02 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:02.841540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-efe7f52a-7c81-45fb-8279-df449aa3528f req-5447790f-aeb0-441b-bffe-1ae2271578b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466f38e2-50f4-4751-9354-50bd6fe9a2e5", "name": "network-vif-plugged", "status": "completed", "tag": "4b1fe9e2-352c-49df-bd49-82696c164ec2"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:02.875783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-efe7f52a-7c81-45fb-8279-df449aa3528f req-5447790f-aeb0-441b-bffe-1ae2271578b2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.876284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-efe7f52a-7c81-45fb-8279-df449aa3528f req-5447790f-aeb0-441b-bffe-1ae2271578b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.882069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-efe7f52a-7c81-45fb-8279-df449aa3528f req-5447790f-aeb0-441b-bffe-1ae2271578b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.911019 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-efe7f52a-7c81-45fb-8279-df449aa3528f req-5447790f-aeb0-441b-bffe-1ae2271578b2 service nova] Creating event network-vif-plugged:4b1fe9e2-352c-49df-bd49-82696c164ec2 for instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 on n-h2-854882-3 Aug 29 15:59:02.918315 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-efe7f52a-7c81-45fb-8279-df449aa3528f req-5447790f-aeb0-441b-bffe-1ae2271578b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080320 Aug 29 15:59:02.918934 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2928/5673] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:03.423566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:03.424759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] [instance: eb3a6146-5746-4a30-b8b9-ccccf36d0e6b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:03.436164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.436889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.437204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.438787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.439249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.452990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.481757 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] HTTP exception thrown: Instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b could not be found. Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Request method failure captured: Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b HTTP/1.1 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOHCAUQbN4WI88XNsdMGYvP27LvYFBP2pXlNNTMrXoIRNj4Zf7fJc_O6F0ksx2S4sCwZRtDwAlSfkxTljKkFs4uJj4wpMU72SMmGe1rt5uzMp4fQsGL1HdywZpF2hSHTHp3E7imTqf09aRu15K_wBcFp5JDFLQIKMsEDZjYESluoc2I Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 7686f5f846414b3b9706ae0a9f89ba6f Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1169671910 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7686f5f846414b3b9706ae0a9f89ba6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7686f5f846414b3b9706ae0a9f89ba6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7686f5f846414b3b9706ae0a9f89ba6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7686f5f846414b3b9706ae0a9f89ba6f"}]}] Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1169671910 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 7686f5f846414b3b9706ae0a9f89ba6f Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1169671910 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestSecurityGroupsBasicOps-1169671910-project Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 9b95cef51ea04d9b886a7c29791ec255 Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1169671910-project Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b could not be found. Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'eb3a6146-5746-4a30-b8b9-ccccf36d0e6b'} Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b could not be found. Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b could not be found. Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:59:03.483747 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b could not be found. Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Returning 404 to user: Instance eb3a6146-5746-4a30-b8b9-ccccf36d0e6b could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59d40ec2-ff15-41f7-ae42-8023f1688515 tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b" status: 404 len: 111 microversion: 2.1 time: 0.070914 Aug 29 15:59:03.488412 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2746/5674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:03 2022] GET /compute/v2.1/servers/eb3a6146-5746-4a30-b8b9-ccccf36d0e6b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:03.655056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:03.655782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:03.676735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.677519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.677696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.678448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.678908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.679332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.933010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:03.944185 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-469943b4-247d-42c8-8311-edd6b2704107 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1313 microversion: 2.1 time: 0.295824 Aug 29 15:59:03.944779 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2929/5675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:03 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:04.964886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:04.965688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:04.978420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.979304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.980010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.980957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.981666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.998141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.367556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.380165 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-315c4c4b-18eb-4e2e-bf65-1e661144ff3d tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1497 microversion: 2.1 time: 0.418558 Aug 29 15:59:05.394565 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2747/5676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:04 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1497 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:06.444631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:06.446841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:06.466273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.468061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.471159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.472113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.473011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.476017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.545223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:06.721538 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d16e5f83-7c81-4b0a-8c0b-9d7306411145 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "DELETE /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 204 len: 0 microversion: 2.1 time: 0.287386 Aug 29 15:59:06.724466 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2930/5677] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:06 2022] DELETE /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:06.734140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:06.735603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:06.784488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.786129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.788262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.789013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.789600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.790172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:07.160424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.178921 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-304b4cff-1fae-4457-b41f-4fcfab66e590 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1503 microversion: 2.1 time: 0.449689 Aug 29 15:59:07.192657 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2748/5678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:06 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:08.200559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.201285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:08.218584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.219090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.219711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.220610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.221268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.221894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:09.077001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3b3434a0-87f4-407a-8778-f3ae85110c66 req-e022f272-0923-4c9b-97a5-e6dd6f2d2c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466f38e2-50f4-4751-9354-50bd6fe9a2e5", "name": "network-vif-deleted", "tag": "4b1fe9e2-352c-49df-bd49-82696c164ec2"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:09.097583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3b3434a0-87f4-407a-8778-f3ae85110c66 req-e022f272-0923-4c9b-97a5-e6dd6f2d2c98 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:09.098079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3b3434a0-87f4-407a-8778-f3ae85110c66 req-e022f272-0923-4c9b-97a5-e6dd6f2d2c98 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:09.098521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3b3434a0-87f4-407a-8778-f3ae85110c66 req-e022f272-0923-4c9b-97a5-e6dd6f2d2c98 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:09.128297 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3b3434a0-87f4-407a-8778-f3ae85110c66 req-e022f272-0923-4c9b-97a5-e6dd6f2d2c98 service nova] Creating event network-vif-deleted:4b1fe9e2-352c-49df-bd49-82696c164ec2 for instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 on n-h2-854882-3 Aug 29 15:59:09.133526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:09.142822 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5b80956c-13a8-4631-acad-dd0ec31c7c60 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1503 microversion: 2.1 time: 0.946449 Aug 29 15:59:09.150244 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2931/5679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:08 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1503 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:09.165000 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3b3434a0-87f4-407a-8778-f3ae85110c66 req-e022f272-0923-4c9b-97a5-e6dd6f2d2c98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091601 Aug 29 15:59:09.168718 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2749/5680] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:10.167654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:10.168403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:10.184392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.185094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.187783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.192331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.193213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.194585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.264826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.265763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.266432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.267152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lazy-loading 'fault' on Instance uuid 466f38e2-50f4-4751-9354-50bd6fe9a2e5 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:10.342919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a121acf89554c7a9650c6461082fbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a19cab0721487b9dada0e3ad35381e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:10.354381 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-991bb1cf-081c-41c6-8239-faa01f1ae9fa tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 200 len: 1303 microversion: 2.1 time: 0.193474 Aug 29 15:59:10.355208 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2932/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:10 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 1303 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:10.791551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24e851ee-aeee-43e2-bd0a-a4fe7768e82f tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] Calling method '.version_select at 0x7fb0e2069f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:10.842248 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24e851ee-aeee-43e2-bd0a-a4fe7768e82f tempest-TestSecurityGroupsBasicOps-1169671910 tempest-TestSecurityGroupsBasicOps-1169671910-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1023277388" status: 202 len: 0 microversion: 2.1 time: 0.059402 Aug 29 15:59:10.844167 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2750/5682] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 15:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1023277388 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:59:11.381724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:11.383236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] [instance: 466f38e2-50f4-4751-9354-50bd6fe9a2e5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:11.393423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.394112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.394636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.395535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.396268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.397014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.427418 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] HTTP exception thrown: Instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 could not be found. Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Request method failure captured: Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 HTTP/1.1 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOIlRiF7nthWLL5ER13RLlCHZdbHQF7jRei7WnKxnUSzg2DyZwxzrNRgxt430Ils7D3Snds3pzvTVW9mZnvg8uOzNX_gHVQ0JFwNsCErth0EWkMTLcqkquEineRwXvbyWvq8nnlhCuFMoc0AVGuxusGYC6MioJzfhh6PAC85Iz28FkQ Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 60a19cab0721487b9dada0e3ad35381e Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-VolumesActionsTest-1368141008 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60a19cab0721487b9dada0e3ad35381e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60a19cab0721487b9dada0e3ad35381e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60a19cab0721487b9dada0e3ad35381e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60a19cab0721487b9dada0e3ad35381e"}]}] Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-VolumesActionsTest-1368141008 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 60a19cab0721487b9dada0e3ad35381e Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-VolumesActionsTest-1368141008 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-VolumesActionsTest-1368141008-project Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 9a121acf89554c7a9650c6461082fbc6 Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-VolumesActionsTest-1368141008-project Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 could not be found. Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '466f38e2-50f4-4751-9354-50bd6fe9a2e5'} Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 could not be found. Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 could not be found. Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:11.429901 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 could not be found. Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:11.434193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] Returning 404 to user: Instance 466f38e2-50f4-4751-9354-50bd6fe9a2e5 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:11.435416 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-59d9e524-a6ee-44b4-bb68-971c27f444b9 tempest-VolumesActionsTest-1368141008 tempest-VolumesActionsTest-1368141008-project] 10.222.0.16 "GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5" status: 404 len: 111 microversion: 2.1 time: 0.056035 Aug 29 15:59:11.435824 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2933/5683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:11 2022] GET /compute/v2.1/servers/466f38e2-50f4-4751-9354-50bd6fe9a2e5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:28.435332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=32 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:28.436131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:28.778239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-298551980", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "b90c68b6-c404-4f9a-8b6a-782f12459a56"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:28.882959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] validate_networks() for [('b90c68b6-c404-4f9a-8b6a-782f12459a56', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:59:30.128030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:59:30.128629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:59:30.131013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:59:30.131726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:59:30.133040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:59:30.157088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.165433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.168360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.171242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.180807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.188207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.258787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Getting quotas for project 100ca676a92148a78c3de75e9a3bfa55. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:30.280649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Getting quotas for user 4ba6354796c546649f20d0dbe3cb3706 and project 100ca676a92148a78c3de75e9a3bfa55. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:30.305715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:59:30.309324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:59:30.384455 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9f3e9325-450b-4977-9ee1-668fae45fa1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958397 Aug 29 15:59:30.392359 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2751/5684] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:59:30.397657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-25f76d19-eec6-4e16-bedf-4f3b3be41623 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:30.398641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-25f76d19-eec6-4e16-bedf-4f3b3be41623 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:30.402267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:30.406893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:30.545242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-25f76d19-eec6-4e16-bedf-4f3b3be41623 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:30.556860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-25f76d19-eec6-4e16-bedf-4f3b3be41623 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1213 microversion: 2.1 time: 0.162473 Aug 29 15:59:30.558083 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2934/5685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:30 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:31.579121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:31.580347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:31.603195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.603976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.604436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.605161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.611035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.611781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.911849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:31.920762 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4d911b87-0ecc-40b3-9ad4-8c579ddb3d1f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1209 microversion: 2.1 time: 0.347059 Aug 29 15:59:31.928604 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2752/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:31 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1209 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:32.950125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:32.951096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:32.972755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.976385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.978894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:32.980580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.982561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.984716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:33.202903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:33.221380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3fd2bea-a7cb-4ebd-8dc7-65a15866d110 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1271 microversion: 2.1 time: 0.274419 Aug 29 15:59:33.223752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2935/5687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:32 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:34.245281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:34.246649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:34.270201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:34.274996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:34.279447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:34.282348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:34.283838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:34.288972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:34.833493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:34.850116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-44c60b4b-11b8-40f2-af3b-21d27cfdc2bb tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 0.608288 Aug 29 15:59:34.885058 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2753/5688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:34 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:35.885305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:35.894962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:35.935646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.937049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.939262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.943687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.949471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.950201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.712563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:36.766762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d1ca79fe-87e8-46eb-a7bf-bc5048b115c4 req-00464dd0-aee5-48ce-a162-62c0812d4b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5ce70f-9d93-4486-8222-f426280d2b41", "tag": "b580b403-1353-44a0-ac8e-de507ab4c0f3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:36.769993 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f98538c-1c4a-46ef-8922-ab391c5ee148 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 0.884672 Aug 29 15:59:36.779871 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2936/5689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:35 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:36.793783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d1ca79fe-87e8-46eb-a7bf-bc5048b115c4 req-00464dd0-aee5-48ce-a162-62c0812d4b90 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.794244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d1ca79fe-87e8-46eb-a7bf-bc5048b115c4 req-00464dd0-aee5-48ce-a162-62c0812d4b90 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.794682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d1ca79fe-87e8-46eb-a7bf-bc5048b115c4 req-00464dd0-aee5-48ce-a162-62c0812d4b90 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.850166 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d1ca79fe-87e8-46eb-a7bf-bc5048b115c4 req-00464dd0-aee5-48ce-a162-62c0812d4b90 service nova] Creating event network-changed:b580b403-1353-44a0-ac8e-de507ab4c0f3 for instance 6a5ce70f-9d93-4486-8222-f426280d2b41 on n-h1-854882-3 Aug 29 15:59:36.888100 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d1ca79fe-87e8-46eb-a7bf-bc5048b115c4 req-00464dd0-aee5-48ce-a162-62c0812d4b90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121421 Aug 29 15:59:36.891638 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2754/5690] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:37.800414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:37.801857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:37.829915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.833293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.836913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.839783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.843158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.845188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.446087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:38.456820 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-156c6587-3a96-4c96-9dfa-8e38813e65ca tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 0.663346 Aug 29 15:59:38.457443 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2937/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:37 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:39.483967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:39.485281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:39.512295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.515184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.521814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.527756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.533105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.542842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.213766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:40.299411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:40.753358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:40.774778 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9a3f203c-8bda-4974-afa4-811e52813a2f tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 1.295242 Aug 29 15:59:40.797549 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2755/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:39 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:41.810220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.810993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:41.814679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:41.834228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.835594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.837565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.838579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.841554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.844083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:42.511676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:42.523861 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b8da2493-1721-484e-b074-c4837afae6a2 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 0.718152 Aug 29 15:59:42.533528 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2938/5693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:41 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:43.560144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:43.561508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:43.579647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.581501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.582124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.583070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.584223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.585936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:44.060560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:44.073464 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed71b216-6b96-4103-94de-bfbedf0b2656 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 0.517933 Aug 29 15:59:44.080118 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2756/5694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:43 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:45.100688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:45.102002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:45.115017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.116194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.120367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.121361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.122087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.122729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.590211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-fca3d28c-e360-43e9-9f8a-1676fa411847 req-8a28523e-327c-4847-ab28-93f9d28f8093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ce70f-9d93-4486-8222-f426280d2b41", "name": "network-vif-plugged", "status": "completed", "tag": "b580b403-1353-44a0-ac8e-de507ab4c0f3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:45.609651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fca3d28c-e360-43e9-9f8a-1676fa411847 req-8a28523e-327c-4847-ab28-93f9d28f8093 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.610926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fca3d28c-e360-43e9-9f8a-1676fa411847 req-8a28523e-327c-4847-ab28-93f9d28f8093 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.611952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fca3d28c-e360-43e9-9f8a-1676fa411847 req-8a28523e-327c-4847-ab28-93f9d28f8093 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.626738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:45.649372 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-78d4fbac-12d7-4eea-94f1-cbb45815abcd tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 0.551187 Aug 29 15:59:45.650824 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2939/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:45 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:45.665663 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fca3d28c-e360-43e9-9f8a-1676fa411847 req-8a28523e-327c-4847-ab28-93f9d28f8093 service nova] Creating event network-vif-plugged:b580b403-1353-44a0-ac8e-de507ab4c0f3 for instance 6a5ce70f-9d93-4486-8222-f426280d2b41 on n-h1-854882-3 Aug 29 15:59:45.680856 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-fca3d28c-e360-43e9-9f8a-1676fa411847 req-8a28523e-327c-4847-ab28-93f9d28f8093 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094768 Aug 29 15:59:45.685231 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2757/5696] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:46.150779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-127097237", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "010f2007-eeeb-47fc-aecf-3eb07da2a1eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:46.412638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:59:46.675080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.675961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:46.697680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.698781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.699446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.700771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.701542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.702263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.052886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:47.065799 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-164f294b-9a58-42d9-b211-dd4cc95c1278 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1313 microversion: 2.1 time: 0.396061 Aug 29 15:59:47.066666 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2758/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:46 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:47.445690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:59:47.447686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:59:47.448202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:59:47.448993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:59:47.449706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:59:47.480681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.481866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.482317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.483099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.492648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.493218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.546567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:47.564868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:47.694554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:59:47.696598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='010f2007-eeeb-47fc-aecf-3eb07da2a1eb',volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:59:47.980779 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-390c846e-53f7-4524-89dd-7ff8d8af832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827941 Aug 29 15:59:47.984926 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2940/5698] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:59:47.992770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5736e73-f233-4880-be9e-0f99ace1b84f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:47.993427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5736e73-f233-4880-be9e-0f99ace1b84f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:48.080081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5736e73-f233-4880-be9e-0f99ace1b84f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:48.088897 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5736e73-f233-4880-be9e-0f99ace1b84f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1056 microversion: 2.1 time: 0.099971 Aug 29 15:59:48.091031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:48.091733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:48.092556 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2759/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:47 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1056 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:48.109671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:48.110298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:48.110763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:48.114288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:48.114816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:48.116564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:48.539382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:48.595478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec8abf0c-594c-4e08-a3d7-37a7c7fb2f66 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1497 microversion: 2.1 time: 0.508045 Aug 29 15:59:48.596566 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2941/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:48 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1497 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:49.113536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:49.114339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:49.142950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.143798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.144437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:49.145372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.147167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.147610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:49.261725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:49.280260 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-791f5b2b-70de-4825-90c2-02f31abb8950 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1106 microversion: 2.1 time: 0.161951 Aug 29 15:59:49.282621 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2760/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:49 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1106 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:50.324735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:50.334700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:50.386832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:50.390148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:50.392399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:50.395151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:50.401091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:50.405891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:50.724605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:50.792039 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18550a7e-34da-437d-86a4-77d8f4773008 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1162 microversion: 2.1 time: 0.465666 Aug 29 15:59:50.795051 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2942/5702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:50 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1162 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:51.836630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:51.837774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:51.850172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:51.856869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:51.858902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:51.860983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:51.863954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:51.866759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:52.054177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:52.068566 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79fcc215-effd-4e5d-9afc-4f28ce9b1565 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1172 microversion: 2.1 time: 0.234140 Aug 29 15:59:52.081434 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2761/5703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:51 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1172 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:53.108327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:53.109859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:53.125282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:53.129626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:53.133807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:53.134819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:53.135452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:53.136648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:53.849666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:53.891020 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc5f3138-227c-4b6d-8a68-66d952235b64 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1214 microversion: 2.1 time: 0.801099 Aug 29 15:59:53.892429 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2943/5704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:53 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1214 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:54.342776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-34b55af9-1d47-412b-87fe-152228e021f2 req-9b68c613-7d3b-4086-baf7-df69f03b6c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba00677-c08f-4f7b-8e53-2b27ba13c4ba", "tag": "638c9bb7-d123-41a0-a8d7-9fea974fb0b0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:54.367339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-34b55af9-1d47-412b-87fe-152228e021f2 req-9b68c613-7d3b-4086-baf7-df69f03b6c97 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.368261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-34b55af9-1d47-412b-87fe-152228e021f2 req-9b68c613-7d3b-4086-baf7-df69f03b6c97 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.372369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-34b55af9-1d47-412b-87fe-152228e021f2 req-9b68c613-7d3b-4086-baf7-df69f03b6c97 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.399375 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-34b55af9-1d47-412b-87fe-152228e021f2 req-9b68c613-7d3b-4086-baf7-df69f03b6c97 service nova] Creating event network-changed:638c9bb7-d123-41a0-a8d7-9fea974fb0b0 for instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba on n-h2-854882-3 Aug 29 15:59:54.409571 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-34b55af9-1d47-412b-87fe-152228e021f2 req-9b68c613-7d3b-4086-baf7-df69f03b6c97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070416 Aug 29 15:59:54.410437 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2762/5705] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:54.914231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.914852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:54.931671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.932360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.933460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.934365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.935075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.935719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.029117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:55.031563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:55.043588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.044470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.045343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.046331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.047124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.047802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.079766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:55.215012 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4369ce2c-758c-47c6-b6aa-c04f5504c48d tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 204 len: 0 microversion: 2.1 time: 0.189667 Aug 29 15:59:55.216323 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2763/5706] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:55 2022] DELETE /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:59:55.228483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:55.230550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:55.242048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.243409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.243798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.245200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.245867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.246591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.331038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:55.362890 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f06c491a-ee60-439d-b5ce-c9bbd85ecd1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1214 microversion: 2.1 time: 0.450357 Aug 29 15:59:55.373442 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2944/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:54 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1214 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:55.456279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:55.467291 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e994747d-77db-4a9b-9443-ae2cd39bb2da tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1503 microversion: 2.1 time: 0.245967 Aug 29 15:59:55.468368 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2764/5708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:55 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:56.397611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:56.399412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:56.407808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.408923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.411199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.412680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.413364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.414054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.493913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:56.495406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:56.504950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.505840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.506511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.507472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.508133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.508785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.776855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:56.787168 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dcb0b8bf-c071-4d1f-8483-db6a5939f060 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1503 microversion: 2.1 time: 0.299758 Aug 29 15:59:56.801557 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2765/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:56 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:56.950097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:56.960611 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fdd0b611-c39c-4047-9f99-9d06df952dea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1214 microversion: 2.1 time: 0.573701 Aug 29 15:59:56.964223 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2945/5710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:56 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1214 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:57.554249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3e9b8e79-b1c7-4978-b3a5-355c632621eb req-93d89958-2a28-4e8c-b558-02f4eeb03096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ce70f-9d93-4486-8222-f426280d2b41", "name": "network-vif-deleted", "tag": "b580b403-1353-44a0-ac8e-de507ab4c0f3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:57.571768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3e9b8e79-b1c7-4978-b3a5-355c632621eb req-93d89958-2a28-4e8c-b558-02f4eeb03096 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.572908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3e9b8e79-b1c7-4978-b3a5-355c632621eb req-93d89958-2a28-4e8c-b558-02f4eeb03096 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.573715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3e9b8e79-b1c7-4978-b3a5-355c632621eb req-93d89958-2a28-4e8c-b558-02f4eeb03096 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.600363 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3e9b8e79-b1c7-4978-b3a5-355c632621eb req-93d89958-2a28-4e8c-b558-02f4eeb03096 service nova] Creating event network-vif-deleted:b580b403-1353-44a0-ac8e-de507ab4c0f3 for instance 6a5ce70f-9d93-4486-8222-f426280d2b41 on n-h1-854882-3 Aug 29 15:59:57.606904 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3e9b8e79-b1c7-4978-b3a5-355c632621eb req-93d89958-2a28-4e8c-b558-02f4eeb03096 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057618 Aug 29 15:59:57.612009 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2766/5711] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:57.813276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:57.815584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:57.826890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:57.831339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:57.833517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.834061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.835137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.835957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.836437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.841629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.926383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.927625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.928439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.928937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lazy-loading 'fault' on Instance uuid 6a5ce70f-9d93-4486-8222-f426280d2b41 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:57.984782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:57.985740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:57.993444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.994003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba6354796c546649f20d0dbe3cb3706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100ca676a92148a78c3de75e9a3bfa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:58.002874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:58.003494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:58.004521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:58.005162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:58.005759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:58.008699 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2d988481-17ab-431f-951c-38b105ecb397 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 200 len: 1303 microversion: 2.1 time: 0.200125 Aug 29 15:59:58.009338 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2946/5712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:57 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:58.089536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:58.291744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:58.303926 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c7d397b8-21f6-421a-9e20-9c16d7a39b78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1214 microversion: 2.1 time: 0.321048 Aug 29 15:59:58.309017 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2767/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:57 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:59.039441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:59.041163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] [instance: 6a5ce70f-9d93-4486-8222-f426280d2b41] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:59.049687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.050753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.051451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.053730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.054410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.055068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.072549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] HTTP exception thrown: Instance 6a5ce70f-9d93-4486-8222-f426280d2b41 could not be found. Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Request method failure captured: Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 HTTP/1.1 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJbn6hgjZTscen39fbK_2u8aW-bNF7MXHSQ-asJCirw5H_vNIkmF1lFScrIzw0lMycggkymgh_y6OXeavIvwCISJbFP-WjJHiM6v2XLqFPzUI7PK1KbaQ5sehb-mo7GnyYKuLrPmuoguYGTU7GxNF3D3_yhKJzJDTYtC6qbMXWMMxQ Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 100ca676a92148a78c3de75e9a3bfa55 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-VolumesActionsTest-1956261684 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/100ca676a92148a78c3de75e9a3bfa55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/100ca676a92148a78c3de75e9a3bfa55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_100ca676a92148a78c3de75e9a3bfa55", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/100ca676a92148a78c3de75e9a3bfa55"}]}] Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-VolumesActionsTest-1956261684 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 100ca676a92148a78c3de75e9a3bfa55 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-VolumesActionsTest-1956261684 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-VolumesActionsTest-1956261684-project Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 4ba6354796c546649f20d0dbe3cb3706 Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-VolumesActionsTest-1956261684-project Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 6a5ce70f-9d93-4486-8222-f426280d2b41 could not be found. Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6a5ce70f-9d93-4486-8222-f426280d2b41'} Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5ce70f-9d93-4486-8222-f426280d2b41 could not be found. Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5ce70f-9d93-4486-8222-f426280d2b41 could not be found. Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:59.074693 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:59.079056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:59.079056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:59.079056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:59.079056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:59.079056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:59.079056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5ce70f-9d93-4486-8222-f426280d2b41 could not be found. Aug 29 15:59:59.079056 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 15:59:59.080846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] Returning 404 to user: Instance 6a5ce70f-9d93-4486-8222-f426280d2b41 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:59.081820 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4f850700-06df-4ce7-b6d5-a85f77cb6c92 tempest-VolumesActionsTest-1956261684 tempest-VolumesActionsTest-1956261684-project] 10.222.0.16 "GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41" status: 404 len: 111 microversion: 2.1 time: 0.047696 Aug 29 15:59:59.082526 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2947/5714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:59 2022] GET /compute/v2.1/servers/6a5ce70f-9d93-4486-8222-f426280d2b41 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:59.328221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:59.329763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:59.340678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.342810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.346075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.346884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.347625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.348352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.348476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.353100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.662565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:59.671556 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83e35bc7-80bc-4ac6-bfd1-dfd0bc84e51d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.348022 Aug 29 15:59:59.671919 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2768/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:59 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:00.695556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:00.696301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:00.704798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:00.708732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:00.710855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:00.711314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:00.712923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:00.716336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:00.717584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:00.725532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=73 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:00.927105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:00.940792 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e21ef5c1-9447-46dd-956d-eb26ab1880b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.251026 Aug 29 16:00:00.944032 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2948/5716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:00 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:01.962568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:01.964841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:01.978503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.979000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.979447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:01.982608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.983584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.984302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:02.183400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:02.192262 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0bc756b0-3912-4075-a60b-95b7022a66e4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.233746 Aug 29 16:00:02.192919 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2769/5717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:01 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:03.214179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:03.214970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:03.226604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:03.227106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:03.227550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:03.231288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:03.232738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:03.234661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:03.459531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:03.469987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-90d7c89c-2f06-44eb-9f93-549044472d8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.261294 Aug 29 16:00:03.470999 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2949/5718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:03 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:04.493096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:04.494543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:04.503842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:04.504715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:04.505934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:04.506908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:04.507621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:04.508333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:04.677794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:04.688829 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-00826484-5989-4b9d-aac9-1714dce7d418 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.201508 Aug 29 16:00:04.690081 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2770/5719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:04 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:05.713956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:05.714977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:05.731517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:05.733072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:05.733562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:05.736578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:05.738617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:05.739566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:06.026244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:06.037430 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a72833c-5055-4fbd-9950-bdb3ac43ed37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.329044 Aug 29 16:00:06.040913 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2950/5720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:05 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:07.070605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:07.073599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:07.089204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:07.090073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:07.090831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:07.091907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:07.092585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:07.093164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:07.354718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:07.413532 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7f378ae8-9ff5-4dc1-a788-a0a141e98a6f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.349033 Aug 29 16:00:07.418703 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2771/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:07 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:08.435656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:08.436294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:08.444368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:08.445064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:08.445735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:08.446881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:08.447523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:08.448111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:08.707867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:08.719374 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4ce9933-a2a2-464f-a337-fc1d722a0c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.287026 Aug 29 16:00:08.720481 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2951/5722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:08 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:09.741431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:09.742053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:09.752916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:09.753441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:09.753865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:09.758919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:09.759603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:09.766718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:10.045379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:10.053929 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d877de36-0e7c-4d2d-9499-6c4d46af214f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.317599 Aug 29 16:00:10.054540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2772/5723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:09 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:10.963553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5ac812be-a911-48e8-859b-18fe279089c4 req-31d408e2-fe6e-4eae-bab8-29f1347ab02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba00677-c08f-4f7b-8e53-2b27ba13c4ba", "name": "network-vif-plugged", "status": "completed", "tag": "638c9bb7-d123-41a0-a8d7-9fea974fb0b0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:10.998264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ac812be-a911-48e8-859b-18fe279089c4 req-31d408e2-fe6e-4eae-bab8-29f1347ab02e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:11.001567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ac812be-a911-48e8-859b-18fe279089c4 req-31d408e2-fe6e-4eae-bab8-29f1347ab02e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:11.002373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5ac812be-a911-48e8-859b-18fe279089c4 req-31d408e2-fe6e-4eae-bab8-29f1347ab02e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:11.033047 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5ac812be-a911-48e8-859b-18fe279089c4 req-31d408e2-fe6e-4eae-bab8-29f1347ab02e service nova] Creating event network-vif-plugged:638c9bb7-d123-41a0-a8d7-9fea974fb0b0 for instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba on n-h2-854882-3 Aug 29 16:00:11.040245 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5ac812be-a911-48e8-859b-18fe279089c4 req-31d408e2-fe6e-4eae-bab8-29f1347ab02e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080922 Aug 29 16:00:11.043093 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2952/5724] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:11.075800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:11.076603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:11.086018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:11.089773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:11.092321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:11.093337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:11.094886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:11.095585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:11.280638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:11.289733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2c36abca-9ec9-4854-9a48-70ab5fc34166 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.217702 Aug 29 16:00:11.301648 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2773/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:11 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:12.326725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:12.328199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:12.340541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:12.346867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:12.347674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:12.348801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:12.349501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:12.350694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:12.825804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:12.842097 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca3dd6fc-bed8-42d7-90cb-6d5433aee9a3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1202 microversion: 2.1 time: 0.521038 Aug 29 16:00:12.844854 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2953/5726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:12 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1202 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:13.869971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:13.871226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:13.888874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:13.889699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:13.890304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:13.891236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:13.891860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:13.892435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:14.182205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:14.206918 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1ca16486-a05d-41ef-82bb-52497e53bd1d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1389 microversion: 2.1 time: 0.336792 Aug 29 16:00:14.210703 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2774/5727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:13 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1389 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:14.231892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:14.233088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:14.256095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:14.257034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:14.257874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:14.259205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:14.260062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:14.260875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:14.612306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:14.623550 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4e68538-ba03-442f-bdef-86bc2d9ce515 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1389 microversion: 2.1 time: 0.395691 Aug 29 16:00:14.640739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2954/5728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:14 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1389 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:14.649843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:14.650798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:14.662743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:14.663475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:14.664315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:14.665211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:14.667253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:14.669301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.178705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:15.195162 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-62cdbca1-21d1-4b9c-afc9-18f16ddcece9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1389 microversion: 2.1 time: 0.549434 Aug 29 16:00:15.200618 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2775/5729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:14 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1389 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:15.275951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:15.277187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:15.296572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.297488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.301729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.306439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.307199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.307880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.362605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:00:15.476329 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a25463f-49ee-4c6b-9361-e68b06c565fc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 204 len: 0 microversion: 2.1 time: 0.205246 Aug 29 16:00:15.477730 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2955/5730] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:00:15 2022] DELETE /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:15.502109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:15.503176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:15.521997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.523468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.523595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.524206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.524888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.525550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.861697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:15.873014 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-66171203-a0a7-4513-96fc-fcadb91bf7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1395 microversion: 2.1 time: 0.383465 Aug 29 16:00:15.874293 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2776/5731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:15 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1395 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:16.914956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:16.920204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:16.953765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:16.959050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:16.963838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:16.968563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:16.969371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:16.973765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:17.913896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:17.923827 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7d63b397-c4e0-49fe-b2ff-e4b2be8ccc37 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1395 microversion: 2.1 time: 1.016080 Aug 29 16:00:17.925464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2956/5732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:16 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1395 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:18.956607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:18.957488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:18.971633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:18.972664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:18.973336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:18.976035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:18.979311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:18.980025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:19.078411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9a65f243-e625-45af-a5c3-ee6eedfe30fc req-44d0f9a7-bd2e-4991-aa28-16c7db315b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba00677-c08f-4f7b-8e53-2b27ba13c4ba", "name": "network-vif-deleted", "tag": "638c9bb7-d123-41a0-a8d7-9fea974fb0b0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:19.104210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9a65f243-e625-45af-a5c3-ee6eedfe30fc req-44d0f9a7-bd2e-4991-aa28-16c7db315b4c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:19.118353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9a65f243-e625-45af-a5c3-ee6eedfe30fc req-44d0f9a7-bd2e-4991-aa28-16c7db315b4c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:19.118888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9a65f243-e625-45af-a5c3-ee6eedfe30fc req-44d0f9a7-bd2e-4991-aa28-16c7db315b4c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:19.140221 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9a65f243-e625-45af-a5c3-ee6eedfe30fc req-44d0f9a7-bd2e-4991-aa28-16c7db315b4c service nova] Creating event network-vif-deleted:638c9bb7-d123-41a0-a8d7-9fea974fb0b0 for instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba on n-h2-854882-3 Aug 29 16:00:19.146201 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9a65f243-e625-45af-a5c3-ee6eedfe30fc req-44d0f9a7-bd2e-4991-aa28-16c7db315b4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075370 Aug 29 16:00:19.147372 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2957/5733] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:19.290511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:19.300953 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83ae3253-6d73-449b-9391-e377379bf989 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1353 microversion: 2.1 time: 0.348337 Aug 29 16:00:19.320469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2777/5734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:18 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1353 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:20.341965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:20.350518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:20.365069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:20.366092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:20.366975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:20.368398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:20.370509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:20.371414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:20.517797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:20.530263 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-570d0fc8-5168-4a23-b4ba-7bc13220bc9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1187 microversion: 2.1 time: 0.209967 Aug 29 16:00:20.531766 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2958/5735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:20 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1187 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:21.552194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:21.553500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:21.570324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:21.570597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:21.571224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:21.572088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:21.572740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:21.573358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:21.728247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:21.740519 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6855cc76-965f-4ab9-b707-0c325c74e96b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1187 microversion: 2.1 time: 0.192154 Aug 29 16:00:21.742529 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2778/5736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:21 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1187 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:22.769586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:22.770255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:22.791697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:22.792844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:22.794409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:22.797157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:22.797832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:22.801652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:23.057975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:23.067016 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1939fe4a-b266-4c1e-b976-a7149a7fdd30 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1187 microversion: 2.1 time: 0.302779 Aug 29 16:00:23.067734 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2959/5737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:22 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1187 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:24.088941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:24.090285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:24.110071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:24.110820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:24.113999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:24.120981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:24.121782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:24.122508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:24.239610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:24.256410 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0008c094-112e-4f76-a5b4-19cd512a6dff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1187 microversion: 2.1 time: 0.171417 Aug 29 16:00:24.257331 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2779/5738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:24 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:25.280722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:25.281350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:25.303372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:25.306076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:25.306540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:25.307984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:25.308471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:25.308914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:25.479278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:25.493223 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a52346b-c7fa-4c93-9a63-3295cf69ef1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1187 microversion: 2.1 time: 0.216890 Aug 29 16:00:25.517313 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2960/5739] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:25 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1187 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:26.519557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:26.520205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:26.543988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:26.544917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:26.545161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:26.545949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:26.547071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:26.547508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:26.749913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:26.773827 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a2de2e9-f99b-4997-b9ca-76873ab8d07f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1187 microversion: 2.1 time: 0.258698 Aug 29 16:00:26.780814 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2780/5740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:26 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1187 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:27.811738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:27.813578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:27.831300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:27.831860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:27.832871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:27.833957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:27.834758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:27.835352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:27.953357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:27.954198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:27.955689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:27.970585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lazy-loading 'fault' on Instance uuid 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:00:28.071161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:28.091685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2474e796-a812-46df-8131-dc7e4d0a2a44 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 200 len: 1146 microversion: 2.1 time: 0.290966 Aug 29 16:00:28.093220 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2961/5741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:27 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 1146 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:29.114891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:29.115846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:29.130766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.132636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.133342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.135406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.137875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.138695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.187536 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba could not be found. Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba HTTP/1.1 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba could not be found. Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '8ba00677-c08f-4f7b-8e53-2b27ba13c4ba'} Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba could not be found. Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba could not be found. Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:29.191351 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.197233 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:29.197233 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:29.197233 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:29.197233 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:29.197233 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:29.197233 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba could not be found. Aug 29 16:00:29.197233 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.201876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 8ba00677-c08f-4f7b-8e53-2b27ba13c4ba could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:29.202862 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d0fcbea2-e8ff-4065-a427-23f8ede024e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba" status: 404 len: 111 microversion: 2.1 time: 0.093402 Aug 29 16:00:29.204707 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2781/5742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:29 2022] GET /compute/v2.1/servers/8ba00677-c08f-4f7b-8e53-2b27ba13c4ba => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:38.850511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1651293486", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "afab4745-095e-4390-b9eb-71ad61cc8455", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:38.864159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:38.864838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:38.946730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:00:39.800231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:00:39.801183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:00:39.802569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:00:39.804318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:00:39.804958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:00:39.834092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:39.834899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:39.835364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:39.836140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:39.836610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:39.837079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:39.873783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:00:39.881328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:00:40.027864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:00:40.031234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afab4745-095e-4390-b9eb-71ad61cc8455',volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:00:40.318613 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8bcda785-256d-4418-8c38-babd86e317ab tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470135 Aug 29 16:00:40.322330 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2962/5743] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:00:40.330788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-22693c2d-8bb5-41c8-a868-4d1f2fb5e0a9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:40.331551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-22693c2d-8bb5-41c8-a868-4d1f2fb5e0a9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:40.338227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=27 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:40.342056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=79 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:40.498994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-22693c2d-8bb5-41c8-a868-4d1f2fb5e0a9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:40.510263 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-22693c2d-8bb5-41c8-a868-4d1f2fb5e0a9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1057 microversion: 2.1 time: 0.183641 Aug 29 16:00:40.511229 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2782/5744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:40 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1057 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:41.535978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:41.537400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:41.546009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:41.546594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:41.547112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:41.547923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:41.548463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:41.548966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:42.031069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:42.045223 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-09f82975-810c-4cd7-a881-f00f6783837c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1155 microversion: 2.1 time: 0.513976 Aug 29 16:00:42.057418 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2963/5745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:41 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1155 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:43.069814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:43.071120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:43.086105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.087657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.094584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.098325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.099058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.099755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.447466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:43.463472 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a88d1a57-553f-4e8a-a419-3cd559dc1776 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1215 microversion: 2.1 time: 0.397423 Aug 29 16:00:43.479636 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2783/5746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:43 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1215 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:44.487115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:44.490505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:44.511150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:44.512438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:44.513094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:44.514179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:44.514833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:44.515556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:45.262150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:45.274485 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0af4cbc4-b16e-4f54-b12c-6fffdfc52c4e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1215 microversion: 2.1 time: 0.788689 Aug 29 16:00:45.275451 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2964/5747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:44 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1215 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:45.419950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a5836264-c5fc-4ecf-827b-3c9e84d85317 req-c400046e-d538-4a6b-a385-6a12e4d48f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c469ad61-5b12-4046-9418-96d7044e4c81", "tag": "1365d2c9-0eaa-46d0-9fa7-005566d4edf6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:45.434182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a5836264-c5fc-4ecf-827b-3c9e84d85317 req-c400046e-d538-4a6b-a385-6a12e4d48f40 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:45.434681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a5836264-c5fc-4ecf-827b-3c9e84d85317 req-c400046e-d538-4a6b-a385-6a12e4d48f40 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:45.435158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a5836264-c5fc-4ecf-827b-3c9e84d85317 req-c400046e-d538-4a6b-a385-6a12e4d48f40 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:45.449608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a5836264-c5fc-4ecf-827b-3c9e84d85317 req-c400046e-d538-4a6b-a385-6a12e4d48f40 service nova] Creating event network-changed:1365d2c9-0eaa-46d0-9fa7-005566d4edf6 for instance c469ad61-5b12-4046-9418-96d7044e4c81 on n-h1-854882-3 Aug 29 16:00:45.456323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a5836264-c5fc-4ecf-827b-3c9e84d85317 req-c400046e-d538-4a6b-a385-6a12e4d48f40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043794 Aug 29 16:00:45.458047 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2784/5748] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:46.295592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:46.296182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:46.304428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:46.304964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:46.305421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:46.306334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:46.306992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:46.307677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:46.734887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:46.749162 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c2966edb-2471-483d-b0ad-513d47e51033 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1215 microversion: 2.1 time: 0.457101 Aug 29 16:00:46.750140 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2965/5749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:46 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1215 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:47.783175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:47.783886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:47.798725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:47.801970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:47.806049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:47.807037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:47.807682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:47.808320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.638600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:48.647412 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a5dc5e44-9029-4101-b700-3211aeea34a5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1215 microversion: 2.1 time: 0.870129 Aug 29 16:00:48.662249 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2785/5750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:47 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1215 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:49.708751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.709714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:49.724184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.725032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.725940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.727542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.728476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.729224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.861370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:49.889898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:50.016969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:50.029902 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-728dede4-f790-455f-8822-2c06c92a4df8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.351100 Aug 29 16:00:50.043648 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2966/5751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:49 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:51.052538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:51.053120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:51.056441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:51.064705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.065899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.066905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.067806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.068430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.069022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.442728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:51.453678 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8561fcc5-d16c-45dd-98c1-dc0012ea2192 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.405875 Aug 29 16:00:51.466320 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2786/5752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:51 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:52.492110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:52.493431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:52.510082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:52.510863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:52.511499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:52.512312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:52.512946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:52.513979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:52.793040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:52.804503 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1d823270-5cf4-48fc-a1a6-e9d485ed959a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.320455 Aug 29 16:00:52.805650 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2967/5753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:52 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:53.829551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:53.830280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:53.849718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:53.850362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:53.850932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:53.851730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:53.852429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:53.853075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:54.078470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:54.087030 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c18a93a9-f1ee-492e-bc7e-9c8f263a77d1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.261431 Aug 29 16:00:54.088331 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2787/5754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:53 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:55.108798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:55.110240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:55.118228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:55.119328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:55.120072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:55.121040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:55.121813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:55.122696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:55.351510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:55.374342 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-30f1e67d-ee32-45e2-99d0-d4bd3a128ccc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.270095 Aug 29 16:00:55.378901 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2968/5755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:55 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:56.408614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:56.410116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:56.435084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:56.436680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:56.438320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:56.439661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:56.442323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:56.443130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:56.878124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:56.890859 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0406f1fa-88b9-45b2-8149-5aa92195a1bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.493947 Aug 29 16:00:56.891830 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2788/5756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:56 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:57.912660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:57.913371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:57.935432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:57.936387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:57.937269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:57.938957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:57.940001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:57.941668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.134276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:58.145755 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c334e6e-2f86-4dfd-86cb-1120ce07f68f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.236967 Aug 29 16:00:58.156617 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2969/5757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:57 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:58.736444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5deacb9f-cae4-4678-8663-b604e0619a52 req-a39eaa71-b123-4f82-bee7-cd3f002fdfdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c469ad61-5b12-4046-9418-96d7044e4c81", "name": "network-vif-plugged", "status": "completed", "tag": "1365d2c9-0eaa-46d0-9fa7-005566d4edf6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:58.756051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5deacb9f-cae4-4678-8663-b604e0619a52 req-a39eaa71-b123-4f82-bee7-cd3f002fdfdb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:58.756857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5deacb9f-cae4-4678-8663-b604e0619a52 req-a39eaa71-b123-4f82-bee7-cd3f002fdfdb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:58.757532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5deacb9f-cae4-4678-8663-b604e0619a52 req-a39eaa71-b123-4f82-bee7-cd3f002fdfdb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.774153 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5deacb9f-cae4-4678-8663-b604e0619a52 req-a39eaa71-b123-4f82-bee7-cd3f002fdfdb service nova] Creating event network-vif-plugged:1365d2c9-0eaa-46d0-9fa7-005566d4edf6 for instance c469ad61-5b12-4046-9418-96d7044e4c81 on n-h1-854882-3 Aug 29 16:00:58.780334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5deacb9f-cae4-4678-8663-b604e0619a52 req-a39eaa71-b123-4f82-bee7-cd3f002fdfdb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048501 Aug 29 16:00:58.781900 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2789/5758] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:59.172733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:59.174131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:59.188974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:59.192211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:59.192697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:59.193967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:59.194437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:59.194873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:59.505506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:59.525150 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4b78d66-777c-4b62-ba5e-df5440592ca5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1203 microversion: 2.1 time: 0.356680 Aug 29 16:00:59.529743 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2970/5759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:59 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1203 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:00.559598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:00.561053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:00.567439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:00.568386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:00.569972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:00.571620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:00.572302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:00.572952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:01.206589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:01.226129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dcd6be0f-25b9-42ac-8f20-ee904b6e18ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1391 microversion: 2.1 time: 0.680472 Aug 29 16:01:01.227332 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2790/5760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:00 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1391 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:01.247932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:01.248569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:01.265185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:01.265645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:01.266101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:01.266837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:01.267310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:01.267748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:01.530073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:01.542401 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93c54373-4eda-4f5d-9d36-0513831bafb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1391 microversion: 2.1 time: 0.298474 Aug 29 16:01:01.571781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:01.578424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:01.584354 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2971/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:01 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1391 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:01.589495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:01.590405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:01.591911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:01.593235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:01.595142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:01.595649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:01.890303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:01.922321 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-125f6ad1-ae81-4f21-92af-ecc3a8d7406d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1391 microversion: 2.1 time: 0.356469 Aug 29 16:01:01.933445 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2791/5762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:01 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1391 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:01.943888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:01.945178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:01.951863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:01.952492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:01.953043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:01.953885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:01.954744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:01.955293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:01.987224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:01:02.102521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8517bfa0-4a9d-439f-a73b-c249feee3ac1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 204 len: 0 microversion: 2.1 time: 0.162558 Aug 29 16:01:02.104003 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2972/5763] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:01:01 2022] DELETE /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:01:02.112700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:02.113495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:02.120079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:02.120714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:02.121217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:02.122012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:02.122542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:02.123041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:02.340998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:02.351706 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ccf92265-cfa4-445a-8fa8-680e32b0ca7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1397 microversion: 2.1 time: 0.242531 Aug 29 16:01:02.353534 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2792/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:02 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:03.376500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:03.377402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:03.391178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:03.393823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:03.397315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:03.400100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:03.401178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:03.402646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:03.915520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:03.931246 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c81ba8c7-e5ec-4bde-afbd-b8839200ae12 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1397 microversion: 2.1 time: 0.560595 Aug 29 16:01:03.935283 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2973/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:03 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1397 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:04.723620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-03faca45-985c-4434-a39b-5d0028b7aca9 req-07b04cdb-3017-43f2-bbcb-20a2233b4f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c469ad61-5b12-4046-9418-96d7044e4c81", "name": "network-vif-deleted", "tag": "1365d2c9-0eaa-46d0-9fa7-005566d4edf6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:04.745072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03faca45-985c-4434-a39b-5d0028b7aca9 req-07b04cdb-3017-43f2-bbcb-20a2233b4f33 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:04.750076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03faca45-985c-4434-a39b-5d0028b7aca9 req-07b04cdb-3017-43f2-bbcb-20a2233b4f33 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:04.753169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03faca45-985c-4434-a39b-5d0028b7aca9 req-07b04cdb-3017-43f2-bbcb-20a2233b4f33 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:04.799288 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-03faca45-985c-4434-a39b-5d0028b7aca9 req-07b04cdb-3017-43f2-bbcb-20a2233b4f33 service nova] Creating event network-vif-deleted:1365d2c9-0eaa-46d0-9fa7-005566d4edf6 for instance c469ad61-5b12-4046-9418-96d7044e4c81 on n-h1-854882-3 Aug 29 16:01:04.831010 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-03faca45-985c-4434-a39b-5d0028b7aca9 req-07b04cdb-3017-43f2-bbcb-20a2233b4f33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106478 Aug 29 16:01:04.836691 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2793/5766] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:04.952760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:04.953777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:04.967438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:04.967719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:04.968279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:04.969099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:04.969621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:04.984187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:05.123943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:05.137365 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bd62b61d-0d9a-48fe-b38c-084f8ec3921c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1188 microversion: 2.1 time: 0.188872 Aug 29 16:01:05.156342 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2974/5767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:04 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1188 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:06.162829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:06.163542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:06.185012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:06.186206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:06.186651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:06.193543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:06.194216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:06.194666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:06.412495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:06.427051 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9eccd6f-0652-46ab-a78f-14b74369e665 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1188 microversion: 2.1 time: 0.264782 Aug 29 16:01:06.427916 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2794/5768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:06 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1188 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:07.448408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:07.449048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:07.470335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:07.470467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:07.470821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:07.471771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:07.472253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:07.475100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:07.607160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:07.622345 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b97c4676-a983-4c46-a78f-8eed3c751187 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1188 microversion: 2.1 time: 0.174500 Aug 29 16:01:07.624411 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2975/5769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:07 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1188 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:08.644891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:08.645539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:08.654645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:08.655363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:08.655965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:08.657069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:08.657706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:08.658583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:08.734174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:08.746327 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cd863b9-2600-4f1d-9d39-94d3e09cce29 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1188 microversion: 2.1 time: 0.105760 Aug 29 16:01:08.747370 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2795/5770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:08 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:09.767736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:09.768941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:09.772962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:09.806739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:09.807774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:09.808379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:09.809326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:09.810451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:09.811048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:09.814341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:09.891793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:09.901481 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-932581f0-066f-4909-bbf6-208ccc67433b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1188 microversion: 2.1 time: 0.138046 Aug 29 16:01:09.916123 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2976/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:09 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1188 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:10.925025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:10.926843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:10.937798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=31 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:10.939524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:10.940031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:10.940457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:10.941162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:10.943979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:10.946245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.004976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=67 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:11.244078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:11.261183 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-89451b81-a7c1-4e01-80d4-3992247f5dcf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 200 len: 1188 microversion: 2.1 time: 0.340435 Aug 29 16:01:11.262782 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2796/5772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:10 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 1188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:12.285814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:12.286580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c469ad61-5b12-4046-9418-96d7044e4c81] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:12.297566 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:01:12.298779 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:01:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 (ip 10.222.0.16) !!! Aug 29 16:01:12.309835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:12.311174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:12.312139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:12.314256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:12.314888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:12.316841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:12.359253 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance c469ad61-5b12-4046-9418-96d7044e4c81 could not be found. Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 HTTP/1.1 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c469ad61-5b12-4046-9418-96d7044e4c81 could not be found. Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c469ad61-5b12-4046-9418-96d7044e4c81'} Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c469ad61-5b12-4046-9418-96d7044e4c81 could not be found. Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c469ad61-5b12-4046-9418-96d7044e4c81 could not be found. Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:12.362902 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:12.369118 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:12.369118 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:12.369118 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:12.369118 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:12.369118 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:12.369118 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c469ad61-5b12-4046-9418-96d7044e4c81 could not be found. Aug 29 16:01:12.369118 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:12.372984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance c469ad61-5b12-4046-9418-96d7044e4c81 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:12.375612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b16bdf0a-4ae7-47d3-aaed-79b2031b0efa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81" status: 404 len: 111 microversion: 2.1 time: 0.095366 Aug 29 16:01:12.380209 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2977/5773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:12 2022] GET /compute/v2.1/servers/c469ad61-5b12-4046-9418-96d7044e4c81 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:37.854029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1861521450", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:37.866905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:37.868703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:37.951831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:01:38.466185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:01:38.467624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:01:38.469223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:01:38.469972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:01:38.470742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:01:38.483953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.484534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.497583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.499330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.500277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.500985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.548593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Getting quotas for project 3aa392f4c8b448018e5183c22d620b11. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:38.555502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Getting quotas for user 84c5079395c946f0ad9bdadfad78421f and project 3aa392f4c8b448018e5183c22d620b11. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:38.573585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:01:38.576101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:01:38.634462 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-46a3502a-5b59-4cbe-9e03-d989b2b3b2fd tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784588 Aug 29 16:01:38.635420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2797/5774] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:01:38.643436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:38.646861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=7 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:38.653028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc1feb64-e551-4a8f-bc21-3b2d4dbe2ee9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:38.653948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc1feb64-e551-4a8f-bc21-3b2d4dbe2ee9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:38.804161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc1feb64-e551-4a8f-bc21-3b2d4dbe2ee9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:38.812754 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc1feb64-e551-4a8f-bc21-3b2d4dbe2ee9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1215 microversion: 2.1 time: 0.170004 Aug 29 16:01:38.817258 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2978/5775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:38 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:39.836970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:39.837857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:39.856539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.857050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.857508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.859558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.860459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.861274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.987325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:39.999068 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c589c46-11fd-4fd6-a52d-040d4b86d69b tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1267 microversion: 2.1 time: 0.169723 Aug 29 16:01:40.013287 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2798/5776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:39 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:41.027638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:41.029515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:41.048208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.048996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.052883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.054155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.054600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.057222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.260726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:41.271650 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f415e3a6-ec80-4636-b306-eeecfefd44a7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1273 microversion: 2.1 time: 0.252221 Aug 29 16:01:41.275662 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2979/5777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:41 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:42.305339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:42.308988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:42.319764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.320421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.321183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.321410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.327105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.327435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.603490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:42.613858 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59242cf5-8628-4ce2-8b7a-29a5851cfe27 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.313846 Aug 29 16:01:42.617555 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2799/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:42 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:43.638651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:43.640450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:43.654219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:43.654950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:43.655573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.658443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:43.659135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:43.661657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.324973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:44.341933 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2341295b-82e4-4316-90e8-0cae87f9ed2f tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.706183 Aug 29 16:01:44.356789 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2980/5779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:43 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:44.755421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b631bd8d-2a34-4e71-ac18-a4d9b4cd6eb8 req-39c315e6-29e1-4b8a-a85f-a0b72b457e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8f114b-9be5-4828-9fb4-ca75dd88512f", "tag": "f89f98fb-cd14-4765-9b8b-ceb91acf4608"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:44.786242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b631bd8d-2a34-4e71-ac18-a4d9b4cd6eb8 req-39c315e6-29e1-4b8a-a85f-a0b72b457e2f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.788430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b631bd8d-2a34-4e71-ac18-a4d9b4cd6eb8 req-39c315e6-29e1-4b8a-a85f-a0b72b457e2f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.789097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b631bd8d-2a34-4e71-ac18-a4d9b4cd6eb8 req-39c315e6-29e1-4b8a-a85f-a0b72b457e2f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.813294 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b631bd8d-2a34-4e71-ac18-a4d9b4cd6eb8 req-39c315e6-29e1-4b8a-a85f-a0b72b457e2f service nova] Creating event network-changed:f89f98fb-cd14-4765-9b8b-ceb91acf4608 for instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f on n-h1-854882-3 Aug 29 16:01:44.819876 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b631bd8d-2a34-4e71-ac18-a4d9b4cd6eb8 req-39c315e6-29e1-4b8a-a85f-a0b72b457e2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071351 Aug 29 16:01:44.821343 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2800/5780] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:01:45.364692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:45.366133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:45.387599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:45.389473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:45.391578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:45.395577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:45.397597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:45.398428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:45.824720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:45.842873 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a66745b-a419-4356-8d43-32da1bd82cc6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.482781 Aug 29 16:01:45.851587 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2981/5781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:45 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:46.872281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:46.875134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:46.902688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.903188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.908148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.909226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.910761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.912885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:47.230300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:47.240254 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df7b622e-6c0c-4cc6-bb8d-38d606e84cb1 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.372131 Aug 29 16:01:47.241660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2801/5782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:46 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:48.265748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:48.266383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:48.286129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:48.287918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:48.289768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:48.290703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:48.294679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:48.295356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:48.620448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:48.633164 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e0f76a87-494f-44cd-9cc5-5a5045564861 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.374172 Aug 29 16:01:48.645888 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2982/5783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:48 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:49.654844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:49.656068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:49.659059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:49.659975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:49.668288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.669049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.669694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.670584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.671223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.671811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.830051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:49.840015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e179c236-fc19-4b5d-92d8-b8e818f85cb4 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.188782 Aug 29 16:01:49.854940 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2802/5784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:49 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:50.865332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:50.866425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:50.873828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:50.878807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.879899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.880733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.882128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.882816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.883462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.054538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-dac4a9a4-8f67-4c7b-82f4-3df39744cbba req-1dc04107-fc4d-4f2e-b259-53e167e075e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8f114b-9be5-4828-9fb4-ca75dd88512f", "name": "network-vif-plugged", "status": "completed", "tag": "f89f98fb-cd14-4765-9b8b-ceb91acf4608"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:51.077832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dac4a9a4-8f67-4c7b-82f4-3df39744cbba req-1dc04107-fc4d-4f2e-b259-53e167e075e9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.080607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dac4a9a4-8f67-4c7b-82f4-3df39744cbba req-1dc04107-fc4d-4f2e-b259-53e167e075e9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.083625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dac4a9a4-8f67-4c7b-82f4-3df39744cbba req-1dc04107-fc4d-4f2e-b259-53e167e075e9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.112182 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-dac4a9a4-8f67-4c7b-82f4-3df39744cbba req-1dc04107-fc4d-4f2e-b259-53e167e075e9 service nova] Creating event network-vif-plugged:f89f98fb-cd14-4765-9b8b-ceb91acf4608 for instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f on n-h1-854882-3 Aug 29 16:01:51.124860 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-dac4a9a4-8f67-4c7b-82f4-3df39744cbba req-1dc04107-fc4d-4f2e-b259-53e167e075e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077489 Aug 29 16:01:51.129876 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2803/5785] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:51.136932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:51.159121 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8bac442-f14f-47d5-9455-2f84598e12a9 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.298043 Aug 29 16:01:51.161371 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2983/5786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:50 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:52.187385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:52.188074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:52.200830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.201321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.201792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.202496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.202947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.203370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.452398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:52.463642 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-89cf9e60-afdf-4ee9-91fb-03304a5eebb7 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1315 microversion: 2.1 time: 0.279737 Aug 29 16:01:52.464938 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2804/5787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:52 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:53.492106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.493129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.503274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.504159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.504884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.506020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.506781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.507588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.710265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:53.724521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a74c7b5-0a3d-47d4-9c6f-059073cd14f6 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1465 microversion: 2.1 time: 0.238327 Aug 29 16:01:53.740797 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2984/5788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1465 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:53.773058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.774835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.784983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.785513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.785950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.786911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.787440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.787861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.817079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:01:53.920049 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c58a4980-85f1-4c7e-b7b2-c8074d919cea tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 204 len: 0 microversion: 2.1 time: 0.151316 Aug 29 16:01:53.921533 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2805/5789] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:01:53 2022] DELETE /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:01:53.930567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.930567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.938573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.939402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.940049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.940994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.941659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.942260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.999150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1376127260", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ac171881-9061-4c25-945a-5935da1da05a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:54.111679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:01:54.289355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:54.300443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c913c8f-2852-47d3-aa6b-c6cf9f3918ee tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1471 microversion: 2.1 time: 0.374706 Aug 29 16:01:54.305174 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2985/5790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:54.693875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:01:54.694718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:01:54.695784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:01:54.696429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:01:54.697540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:01:54.709665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.710607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.711239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.712205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.712844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.713497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.734835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:54.743214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:54.758678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:01:54.761052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ac171881-9061-4c25-945a-5935da1da05a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:01:54.891622 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-976fb81e-f5c3-4a86-a561-6214a77df3f0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897068 Aug 29 16:01:54.899823 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2806/5791] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:01:54.905153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b92a1c30-1184-4498-93ce-f77dc72e4d17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:54.905810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b92a1c30-1184-4498-93ce-f77dc72e4d17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:55.058374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b92a1c30-1184-4498-93ce-f77dc72e4d17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:55.070175 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b92a1c30-1184-4498-93ce-f77dc72e4d17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1057 microversion: 2.1 time: 0.168223 Aug 29 16:01:55.072309 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2986/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:54 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1057 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:55.329991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:55.341187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:55.348431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.348966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.349751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.350887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.351632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.352664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.688692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c5079395c946f0ad9bdadfad78421f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa392f4c8b448018e5183c22d620b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:55.698096 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a43b715c-e3ec-4ae0-84fa-2de929aef04e tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 200 len: 1471 microversion: 2.1 time: 0.377439 Aug 29 16:01:55.712760 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2807/5793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:55 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 1471 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:56.037113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f82a1e06-5aa5-44ed-a3c6-f1ff8af85e19 req-8e70d5ae-1a87-4ef8-952a-e3514aa7585c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8f114b-9be5-4828-9fb4-ca75dd88512f", "name": "network-vif-deleted", "tag": "f89f98fb-cd14-4765-9b8b-ceb91acf4608"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:56.060727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f82a1e06-5aa5-44ed-a3c6-f1ff8af85e19 req-8e70d5ae-1a87-4ef8-952a-e3514aa7585c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.061309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f82a1e06-5aa5-44ed-a3c6-f1ff8af85e19 req-8e70d5ae-1a87-4ef8-952a-e3514aa7585c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.061818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f82a1e06-5aa5-44ed-a3c6-f1ff8af85e19 req-8e70d5ae-1a87-4ef8-952a-e3514aa7585c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.090478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f82a1e06-5aa5-44ed-a3c6-f1ff8af85e19 req-8e70d5ae-1a87-4ef8-952a-e3514aa7585c service nova] Creating event network-vif-deleted:f89f98fb-cd14-4765-9b8b-ceb91acf4608 for instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f on n-h1-854882-3 Aug 29 16:01:56.093812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:56.094831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:56.106441 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f82a1e06-5aa5-44ed-a3c6-f1ff8af85e19 req-8e70d5ae-1a87-4ef8-952a-e3514aa7585c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072504 Aug 29 16:01:56.107160 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2987/5794] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:01:56.108323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.109617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.110803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.112992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.115857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.118022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.237519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:56.254857 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0f3f0928-006a-4672-b6fe-b48c9b413bf0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1109 microversion: 2.1 time: 0.166369 Aug 29 16:01:56.257031 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2808/5795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:56 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1109 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:56.723293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:56.724302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] [instance: 6b8f114b-9be5-4828-9fb4-ca75dd88512f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:56.739939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.742099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.742489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.743225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.743692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.746411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.774322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] HTTP exception thrown: Instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f could not be found. Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Request method failure captured: Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f HTTP/1.1 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOLeHMnCAqgCx-YsvqbdclHszmNi4pgLdxJ-dnwZrEMr0ceu8iB6TKUSbq2-H8pgws3KOLghudrfBvvTqKDslQ40fHpxSx-ckFxaL6WC9GDOv29rT2-0n5tNXuTxzzo01NmCNRoULMy69d5ISirxu77ejFitrgxXmF05h-tQ-Dmqegw Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 3aa392f4c8b448018e5183c22d620b11 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-VolumesNegativeTest-600563526 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa392f4c8b448018e5183c22d620b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3aa392f4c8b448018e5183c22d620b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3aa392f4c8b448018e5183c22d620b11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa392f4c8b448018e5183c22d620b11"}]}] Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-VolumesNegativeTest-600563526 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 3aa392f4c8b448018e5183c22d620b11 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-VolumesNegativeTest-600563526 Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-VolumesNegativeTest-600563526-project Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 84c5079395c946f0ad9bdadfad78421f Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-VolumesNegativeTest-600563526-project Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f could not be found. Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '6b8f114b-9be5-4828-9fb4-ca75dd88512f'} Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f could not be found. Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f could not be found. Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:56.783229 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f could not be found. Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] Returning 404 to user: Instance 6b8f114b-9be5-4828-9fb4-ca75dd88512f could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9dfdccb-ab97-4899-bbe7-988137008b72 tempest-VolumesNegativeTest-600563526 tempest-VolumesNegativeTest-600563526-project] 10.222.0.16 "GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f" status: 404 len: 111 microversion: 2.1 time: 0.068425 Aug 29 16:01:56.790886 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2988/5796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:56 2022] GET /compute/v2.1/servers/6b8f114b-9be5-4828-9fb4-ca75dd88512f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:57.276119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:57.277011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:57.297281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.303564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.304143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.309001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.312244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.312748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.958527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:57.972217 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-791f3cbe-cf7b-4400-9cc9-1cca9f6f8a18 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.700099 Aug 29 16:01:57.973046 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2809/5797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:57 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:58.997565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:58.998756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:59.018900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.020033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.020953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.022027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.022649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.023303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.095637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-97e51785-6cec-4862-be35-fdb35ea81b94 req-901e612a-4582-44b2-85df-af7c4aaa1003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69229f25-a318-4a95-97c7-baf1f06cf5e4", "tag": "e5e5d5a4-5162-4ab5-aa65-a1f19413886b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:59.113518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97e51785-6cec-4862-be35-fdb35ea81b94 req-901e612a-4582-44b2-85df-af7c4aaa1003 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.114008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97e51785-6cec-4862-be35-fdb35ea81b94 req-901e612a-4582-44b2-85df-af7c4aaa1003 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.116479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97e51785-6cec-4862-be35-fdb35ea81b94 req-901e612a-4582-44b2-85df-af7c4aaa1003 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.145355 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-97e51785-6cec-4862-be35-fdb35ea81b94 req-901e612a-4582-44b2-85df-af7c4aaa1003 service nova] Creating event network-changed:e5e5d5a4-5162-4ab5-aa65-a1f19413886b for instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 on n-h2-854882-3 Aug 29 16:01:59.150572 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-97e51785-6cec-4862-be35-fdb35ea81b94 req-901e612a-4582-44b2-85df-af7c4aaa1003 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060827 Aug 29 16:01:59.151926 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2810/5798] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:59.686819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:59.699211 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21768120-575f-4fc0-9880-1d1bdc2c309b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.704693 Aug 29 16:01:59.701930 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2989/5799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:58 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:00.725826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:00.727551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:00.745973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.746908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.749267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.751609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.753810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.754641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:01.208577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:01.223507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4cb05c36-1cbc-47b8-9b0e-bade10391988 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.502565 Aug 29 16:02:01.226938 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2811/5800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:00 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:02.251161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:02.258071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:02.274644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:02.295963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:02.296427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:02.297192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:02.308481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:02.310193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:02.723629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:02.735689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-68751a9a-14aa-4c62-9ee9-15e97161487b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.491710 Aug 29 16:02:02.750020 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2990/5801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:02 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:03.756118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:03.756730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:03.781128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:03.782081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:03.782830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:03.789053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:03.790166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:03.790865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:04.371613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:04.386894 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-665143d8-f4c7-413f-b158-b0aa16d7a1c8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.634562 Aug 29 16:02:04.387795 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2812/5802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:03 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:05.418081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:05.419284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:05.444339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:05.446357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.447039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.453192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:05.455320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.455851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.458507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:06.334280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:06.370275 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71dfd8e5-f9a6-4e3f-8a2b-1e693dbb1d43 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.958356 Aug 29 16:02:06.404595 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2991/5803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:05 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:07.412836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:07.413638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:07.415987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:07.416820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:07.444292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:07.444789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:07.449917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:07.450707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:07.451455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:07.452043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:08.026511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:08.033379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:08.038241 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-563368a5-e9b3-4956-b1e0-21c1c90d63f6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.629659 Aug 29 16:02:08.038828 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2813/5804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:07 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:09.075855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:09.076753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:09.088865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=33 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:09.106711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:09.110321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:09.111382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:09.116715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:09.119865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:09.121467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:09.157039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=65 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:09.653329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:09.677151 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df599f80-4e04-45a3-b4ec-451e6c2ddf41 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.614637 Aug 29 16:02:09.678101 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2992/5805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:09 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:10.698547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:10.699092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:10.715820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:10.717369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.731514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.736606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.737469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.737961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.745229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:11.247931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:11.273470 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9619b7d-ba7f-4f58-962e-2dd831ec8fce tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.579412 Aug 29 16:02:11.275029 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2814/5806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:10 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:12.298246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:12.299733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:12.321997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.322706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.323106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.323848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.324402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.325141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.594791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:12.613698 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56467725-4703-4011-99bc-2aa5525a2198 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.319310 Aug 29 16:02:12.617360 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2993/5807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:12 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:13.541636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f09a816c-b452-4f50-be4f-f8b62217cb24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: .version_select at 0x7fb0e1fb9940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-621813596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGujs/PwGZ34+HTVfVjYRaOpjHrryYOcv1/zc9wPVTql5L0HzRtX/v6MCewObIsIx05U/FLaP1Sgcn6McZa+OAnFZE+TOEcPZeEHAMtsMeMKZsaagR6XbpqcAlS6GDkGQ=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:13.583031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f09a816c-b452-4f50-be4f-f8b62217cb24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:02:13.593608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f09a816c-b452-4f50-be4f-f8b62217cb24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:02:13.642386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:13.644277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:13.658716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:13.659889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:13.662173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:13.663757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:13.665297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:13.665475 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f09a816c-b452-4f50-be4f-f8b62217cb24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.428291 Aug 29 16:02:13.666583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:13.667042 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2815/5808] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:02:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:13.989160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:14.015719 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8053531b-1335-4c0a-bdaf-657072166508 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.378273 Aug 29 16:02:14.021975 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2994/5809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:13 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:15.042453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:15.044979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:15.062015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.062891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.063833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.064962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.066483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.069645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.379886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:15.397481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ab039639-ffc2-470b-bdc0-3a117ee1c7e5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.358963 Aug 29 16:02:15.398870 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2816/5810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:15 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:16.420124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:16.420825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:16.454560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:16.456165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:16.460781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:16.468506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:16.474367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:16.489547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:17.047812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:17.069689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-53eb31b7-71be-4396-8426-0de989d94eee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.654129 Aug 29 16:02:17.070713 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2995/5811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:16 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:18.095108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:18.096494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:18.128337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:18.129603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:18.131004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:18.135404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:18.138525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:18.140927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:19.094659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:19.106148 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b3d5b2f3-a30a-4f17-a2ed-699f3455ca71 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 1.016877 Aug 29 16:02:19.108254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2817/5812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:18 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:20.128252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:20.129728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:20.151714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:20.152344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:20.152827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:20.153608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:20.162861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:20.163325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:20.885634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:20.910404 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af10e39c-872d-4579-b93b-955e171e3047 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.784677 Aug 29 16:02:20.912919 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2996/5813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:20 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:21.932548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:21.933260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:21.940830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:21.947188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:21.947735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:21.948542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:21.949080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:21.952678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:22.301071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:22.316232 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df56db30-893c-4d4c-823a-0256db48781f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1169 microversion: 2.1 time: 0.387548 Aug 29 16:02:22.323139 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2818/5814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:21 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1169 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:23.337212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:23.338672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:23.365934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.366867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.367629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:23.368582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.374070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.374777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:24.037124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:24.050513 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e4bc386-aa90-4c68-9495-c06a00283e79 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.717740 Aug 29 16:02:24.076930 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2997/5815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:23 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:25.089566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:25.091074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:25.097627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:25.106526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:25.107016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:25.107442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:25.108510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:25.108619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:25.132094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:25.827849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:25.844443 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a9923d3-df0a-4156-80f3-b9983e9a4aff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.758704 Aug 29 16:02:25.854945 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2819/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:25 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:26.870542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:26.871142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:26.898738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.899254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.899752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:26.900498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.901055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.901414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.411850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:27.425894 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3f4f2c21-0d91-4a11-aa8d-fc0e4e62153c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.561703 Aug 29 16:02:27.428247 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2998/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:26 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:27.965353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1177135608", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "eb512906-3c95-4944-a494-dfc479b49e39"}], "key_name": "tempest-TestNetworkAdvancedServerOps-621813596", "security_groups": [{"name": "tempest-secgroup-smoke-381513955"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:28.211615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] validate_networks() for [('eb512906-3c95-4944-a494-dfc479b49e39', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:02:28.448727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:28.449424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:28.463090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:28.463606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:28.464063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:28.464810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:28.465278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:28.465744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.093244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:02:29.093788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:02:29.094370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:02:29.094589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:02:29.095462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:02:29.122049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.122538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.127839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.128650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.146169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.146628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.198531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:02:29.207018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:02:29.237091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:02:29.239445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:02:29.287094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:29.311896 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aef456d5-aae9-40e4-ac38-96ad62aed113 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.868357 Aug 29 16:02:29.313777 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 2999/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:28 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:29.353948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63a8b3df-98ec-46b3-ad03-df782ace6aa1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.397291 Aug 29 16:02:29.356235 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2820/5819] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:02:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:02:29.370447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-823b501f-ab08-4edb-bf76-c4ecec2a9c94 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:29.372699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-823b501f-ab08-4edb-bf76-c4ecec2a9c94 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:29.591792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-823b501f-ab08-4edb-bf76-c4ecec2a9c94 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:29.604474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-823b501f-ab08-4edb-bf76-c4ecec2a9c94 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1266 microversion: 2.1 time: 0.238986 Aug 29 16:02:29.609738 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3000/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:29 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:30.334796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:30.338293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:30.346937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:30.347746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:30.348370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.349269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:30.350073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:30.350661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.633989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:30.636113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:30.660556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:30.682146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:30.686084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.687952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:30.688681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:30.690221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.720730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:30.729783 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0be07dba-f703-4884-ab33-8644acece132 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.399080 Aug 29 16:02:30.730397 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2821/5821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:30 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:30.985281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:30.994093 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ebe50f3f-2a90-4506-a42e-395498e78cab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1262 microversion: 2.1 time: 0.368390 Aug 29 16:02:30.998593 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3001/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:30 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1262 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:31.753440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:31.759841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:31.778120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:31.778120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:31.785025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:31.786506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:31.787292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:31.788121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:32.016699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:32.017330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:32.035629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:32.040267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:32.040786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:32.044422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:32.045950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:32.046640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:32.055864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:32.066188 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5da87329-0bad-44ee-8939-9c30f1caadd7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.316031 Aug 29 16:02:32.067181 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2822/5823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:31 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:32.208292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:32.218878 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-48a35de9-0a94-4e17-8e80-45b131c28c76 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1324 microversion: 2.1 time: 0.206303 Aug 29 16:02:32.223332 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3002/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:32 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:33.086586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:33.087405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:33.104682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.105122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.109779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.110538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.111011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.117942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.241773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:33.242956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:33.265113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.265782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.266232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.266957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.278169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.278637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.625017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:33.642387 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1cd46623-98e7-4141-9f93-7b2b5481675d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.560132 Aug 29 16:02:33.658248 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2823/5825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:33 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:33.684791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:33.692824 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24ab8c49-88ed-4df0-a986-67ab753a31f1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1391 microversion: 2.1 time: 0.456247 Aug 29 16:02:33.701723 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3003/5826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:33 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1391 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:34.051453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-848ed240-f976-4553-b70a-d706e4ceb865 req-db8f07b8-a8ea-471e-98b2-c82b4b9669d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69229f25-a318-4a95-97c7-baf1f06cf5e4", "name": "network-vif-plugged", "status": "completed", "tag": "e5e5d5a4-5162-4ab5-aa65-a1f19413886b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:34.074355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-848ed240-f976-4553-b70a-d706e4ceb865 req-db8f07b8-a8ea-471e-98b2-c82b4b9669d5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.075911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-848ed240-f976-4553-b70a-d706e4ceb865 req-db8f07b8-a8ea-471e-98b2-c82b4b9669d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.078900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-848ed240-f976-4553-b70a-d706e4ceb865 req-db8f07b8-a8ea-471e-98b2-c82b4b9669d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.121621 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-848ed240-f976-4553-b70a-d706e4ceb865 req-db8f07b8-a8ea-471e-98b2-c82b4b9669d5 service nova] Creating event network-vif-plugged:e5e5d5a4-5162-4ab5-aa65-a1f19413886b for instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 on n-h2-854882-3 Aug 29 16:02:34.135910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-848ed240-f976-4553-b70a-d706e4ceb865 req-db8f07b8-a8ea-471e-98b2-c82b4b9669d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219996 Aug 29 16:02:34.139620 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2824/5827] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:34.671525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:34.672159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:34.680096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.680824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.681494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.682408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.683046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.683653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.717009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:34.717923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:34.728954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.733268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.734152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.735208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.735941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.737678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.987744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:34.995751 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4f40d186-fd59-4412-b262-6b76f9cef31e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1203 microversion: 2.1 time: 0.328527 Aug 29 16:02:34.997554 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3004/5828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:34 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1203 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:35.025428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:35.035775 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-effba879-da0a-4e5d-8eef-40e13f88766c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1391 microversion: 2.1 time: 0.322922 Aug 29 16:02:35.050313 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2825/5829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:34 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1391 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:35.100345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8b61875e-0736-451b-8a54-c11cfd818d6f req-2360f85a-c1fd-4d72-a473-411e7e34a488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:35.122040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8b61875e-0736-451b-8a54-c11cfd818d6f req-2360f85a-c1fd-4d72-a473-411e7e34a488 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:35.122552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8b61875e-0736-451b-8a54-c11cfd818d6f req-2360f85a-c1fd-4d72-a473-411e7e34a488 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:35.123000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8b61875e-0736-451b-8a54-c11cfd818d6f req-2360f85a-c1fd-4d72-a473-411e7e34a488 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:35.161440 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8b61875e-0736-451b-8a54-c11cfd818d6f req-2360f85a-c1fd-4d72-a473-411e7e34a488 service nova] Creating event network-changed:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h1-854882-3 Aug 29 16:02:35.178473 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8b61875e-0736-451b-8a54-c11cfd818d6f req-2360f85a-c1fd-4d72-a473-411e7e34a488 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073238 Aug 29 16:02:35.179797 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3005/5830] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:36.020161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:36.021318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:36.033667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.044697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.045218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.046020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.046489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.046917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.061162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:36.062542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:36.072147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.072860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.073608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.074524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.078908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.078908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.317015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:36.325792 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3cc2c9e6-5ddd-47bb-bff4-5419063bc0e3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1391 microversion: 2.1 time: 0.270135 Aug 29 16:02:36.328370 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3006/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:36 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:36.364600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:36.374214 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07ef6a2d-490b-45b5-b22a-4b29e2913213 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1390 microversion: 2.1 time: 0.361757 Aug 29 16:02:36.379361 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2826/5832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:36 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:36.400684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:36.402067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:36.410177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.410936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.411619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.412543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.413169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.414053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.185446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:37.195238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2632a293-375d-44e3-903b-50b57b0fe9ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1390 microversion: 2.1 time: 0.798707 Aug 29 16:02:37.201868 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3007/5833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:36 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1390 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:37.224524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:37.225148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:37.238894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.240105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.242038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.242995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.246117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.246628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.348483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:37.349558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:37.359362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.360122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.368281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.369485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.370260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.370876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.516630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:37.526031 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d1a9633f-41e2-4f02-b80d-e047feb2ccb1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1390 microversion: 2.1 time: 0.305302 Aug 29 16:02:37.526668 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2827/5834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:37 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1390 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:37.627386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:37.628042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:37.635681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.636579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.638351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.639424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.640159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.640784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.688584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:02:37.741290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:37.754643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b709fafa-d54a-454f-9136-4417d8988c67 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1391 microversion: 2.1 time: 0.408724 Aug 29 16:02:37.759796 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3008/5835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:37 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:37.842913 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-082e0e33-a00a-479c-aa69-b19491ab1e16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 204 len: 0 microversion: 2.1 time: 0.219452 Aug 29 16:02:37.844002 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2828/5836] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:02:37 2022] DELETE /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:02:37.854834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:37.855290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:37.868804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.869310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.869783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.870526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.870990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.871416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:38.177507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:38.189451 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-efc1a728-92ff-4361-9953-e5916de04f53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1396 microversion: 2.1 time: 0.336736 Aug 29 16:02:38.207263 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3009/5837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:37 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1396 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:38.781339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:38.782378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:38.797212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:38.803829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:38.804924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:38.806016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:38.807132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:38.807653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.083102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:39.095106 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c1fa9912-3f04-431b-b4ff-7c9de19eea1c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1391 microversion: 2.1 time: 0.316735 Aug 29 16:02:39.100450 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2829/5838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:38 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:39.215201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:39.216412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:39.225864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=38 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:39.232182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.233129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.234593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.238303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.238993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.239945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.255556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:39.602133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:39.612642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:39.630936 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9bc65985-be97-47d3-9d36-5146a1a02f7f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1396 microversion: 2.1 time: 0.422587 Aug 29 16:02:39.632243 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3010/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:39 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1396 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:40.117303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:40.118074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:40.121209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:40.124564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:40.149627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:40.151385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:40.151850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.155484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:40.155995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:40.156441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.392079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:40.401586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e29fae72-b99d-4e4b-a70c-4e3aca597e7c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1391 microversion: 2.1 time: 0.288677 Aug 29 16:02:40.402186 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2830/5840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:40 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:40.652537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:40.653162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:40.692698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:40.695004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:40.696189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.698213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:40.698654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:40.699085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.722200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2ebfdd64-4bd5-48a7-af01-e11ef7cd112c req-79e07ad2-49b5-4be1-8bb2-79829617f789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69229f25-a318-4a95-97c7-baf1f06cf5e4", "name": "network-vif-deleted", "tag": "e5e5d5a4-5162-4ab5-aa65-a1f19413886b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:40.755450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2ebfdd64-4bd5-48a7-af01-e11ef7cd112c req-79e07ad2-49b5-4be1-8bb2-79829617f789 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:40.758976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2ebfdd64-4bd5-48a7-af01-e11ef7cd112c req-79e07ad2-49b5-4be1-8bb2-79829617f789 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:40.781888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2ebfdd64-4bd5-48a7-af01-e11ef7cd112c req-79e07ad2-49b5-4be1-8bb2-79829617f789 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.793115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:40.833130 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2ebfdd64-4bd5-48a7-af01-e11ef7cd112c req-79e07ad2-49b5-4be1-8bb2-79829617f789 service nova] Creating event network-vif-deleted:e5e5d5a4-5162-4ab5-aa65-a1f19413886b for instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 on n-h2-854882-3 Aug 29 16:02:40.842313 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2ebfdd64-4bd5-48a7-af01-e11ef7cd112c req-79e07ad2-49b5-4be1-8bb2-79829617f789 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124340 Aug 29 16:02:40.842929 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2831/5841] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:41.002645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:41.028225 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26540f96-70b2-40b8-95c1-49ac0a4e8c73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1354 microversion: 2.1 time: 0.379720 Aug 29 16:02:41.041365 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3011/5842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:40 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1354 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:41.243209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-97ea1bfc-a4c6-48c1-9676-a3094784d3e8 req-a32bd816-ec0a-40c7-9a6d-6264b78571f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "name": "network-vif-plugged", "status": "completed", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:41.280583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:41.283592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97ea1bfc-a4c6-48c1-9676-a3094784d3e8 req-a32bd816-ec0a-40c7-9a6d-6264b78571f4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.284277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97ea1bfc-a4c6-48c1-9676-a3094784d3e8 req-a32bd816-ec0a-40c7-9a6d-6264b78571f4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.284871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-97ea1bfc-a4c6-48c1-9676-a3094784d3e8 req-a32bd816-ec0a-40c7-9a6d-6264b78571f4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.299250 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-97ea1bfc-a4c6-48c1-9676-a3094784d3e8 req-a32bd816-ec0a-40c7-9a6d-6264b78571f4 service nova] Creating event network-vif-plugged:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h1-854882-3 Aug 29 16:02:41.306649 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-97ea1bfc-a4c6-48c1-9676-a3094784d3e8 req-a32bd816-ec0a-40c7-9a6d-6264b78571f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091224 Aug 29 16:02:41.307749 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2832/5843] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:41.429791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:41.430423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:41.448488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.449036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.452357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.453228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.453733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.454315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.812566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:41.827618 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-78b0fd33-6502-44f3-991a-e85669b0a48c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1391 microversion: 2.1 time: 0.403477 Aug 29 16:02:41.847425 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3012/5844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:41 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:42.051517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:42.052766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:42.071236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.072106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.073920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:42.076398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.077870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.081555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:42.199039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:42.217445 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-81e6e6a0-70dc-414b-8e1e-639dc1d0fbb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1188 microversion: 2.1 time: 0.162599 Aug 29 16:02:42.218181 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2833/5845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:42 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1188 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:42.856397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:42.857178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:42.869875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.872749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.875217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:42.876116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.876707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.880664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.240601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:43.241948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:43.249275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.254777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.255259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.256028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.256503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.267307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.283569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.294417 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7cca3ed3-eba3-47a2-886c-9cd0b0da2553 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1563 microversion: 2.1 time: 0.440659 Aug 29 16:02:43.296940 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3013/5846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:42 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1563 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:43.322594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:43.323561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:43.334146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.334935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.335614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.337012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.337733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.338625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.673757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.684581 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b140ff2b-f1c9-4066-8901-224a2cf74aec tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1188 microversion: 2.1 time: 0.448228 Aug 29 16:02:43.690329 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2834/5847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:43 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1188 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:43.811465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.821823 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d51660cb-e7c4-44d5-be51-8ea89aaa2ddf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1563 microversion: 2.1 time: 0.508045 Aug 29 16:02:43.822433 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3014/5848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:43 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1563 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:44.708748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:44.710023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:44.726318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.735356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.735822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.736648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.737170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.737949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.853725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:44.863454 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ffab495-24d1-4649-ae41-75e09e28e5d7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1188 microversion: 2.1 time: 0.159048 Aug 29 16:02:44.870235 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2835/5849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:44 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1188 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:45.892155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:45.893557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:45.905338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.911049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.918089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:45.919111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.922122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.925656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.151342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:46.168102 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8b7004c7-d76a-4518-876f-bafb1d0e832b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1188 microversion: 2.1 time: 0.273072 Aug 29 16:02:46.168775 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3015/5850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:45 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:47.188899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:47.190275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:47.209083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.210306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.210858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.214024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.217833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.218431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.405801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:47.427634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dd2a4249-2690-4283-bfcb-cdd7cbfa0f96 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1188 microversion: 2.1 time: 0.242843 Aug 29 16:02:47.431707 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2836/5851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:47 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1188 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:48.110630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:48.112236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:48.121986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-efc503db-46e8-435b-b0fb-9e2e112ed2b6 req-59b6ec8a-faed-47d0-a0f9-6024962bfac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:48.151329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.152473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.154039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.155124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-efc503db-46e8-435b-b0fb-9e2e112ed2b6 req-59b6ec8a-faed-47d0-a0f9-6024962bfac9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.155583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.156181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-efc503db-46e8-435b-b0fb-9e2e112ed2b6 req-59b6ec8a-faed-47d0-a0f9-6024962bfac9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.156847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.157920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.158295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-efc503db-46e8-435b-b0fb-9e2e112ed2b6 req-59b6ec8a-faed-47d0-a0f9-6024962bfac9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.191509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-efc503db-46e8-435b-b0fb-9e2e112ed2b6 req-59b6ec8a-faed-47d0-a0f9-6024962bfac9 service nova] Creating event network-changed:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h1-854882-3 Aug 29 16:02:48.209723 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-efc503db-46e8-435b-b0fb-9e2e112ed2b6 req-59b6ec8a-faed-47d0-a0f9-6024962bfac9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090676 Aug 29 16:02:48.213076 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2837/5852] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:48.457478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:48.458725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:48.486215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.487452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.487935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.503910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:48.508429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.509051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.511232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.523263 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-569e9768-43e0-4794-9c99-b8e1e5199c0e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1563 microversion: 2.1 time: 0.412531 Aug 29 16:02:48.526375 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3016/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:48 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1563 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:49.110937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:49.121534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5a2eee72-1ebc-4277-9289-247a25aa7c8d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1188 microversion: 2.1 time: 0.674186 Aug 29 16:02:49.126106 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2838/5854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:48 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1188 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:50.148795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:50.149456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:50.176094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.176662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.177447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:50.179363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.179844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.180345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:50.509066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:50.529704 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b259577-31bd-4a46-931d-099111b57b65 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 200 len: 1188 microversion: 2.1 time: 0.382613 Aug 29 16:02:50.556101 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3017/5855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:50 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 1188 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:51.566463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:51.571175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:51.624120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.625303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.626560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.646172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.652850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.653576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.700298 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 HTTP/1.1 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '69229f25-a318-4a95-97c7-baf1f06cf5e4'} Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:51.704339 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.709972 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:51.709972 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:51.709972 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:51.709972 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:51.709972 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:51.709972 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:51.709972 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.712725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:51.714414 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fca8791f-4a4e-48b4-8122-ce39ffdad5bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 404 len: 111 microversion: 2.1 time: 0.166190 Aug 29 16:02:51.720422 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2839/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:51 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:59.505683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:59.506249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:59.513442 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:02:59.518869 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:02:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 (ip 10.222.0.16) !!! Aug 29 16:02:59.539563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.540011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.542950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:59.543829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.545174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.545797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:59.570840 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 HTTP/1.1 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '69229f25-a318-4a95-97c7-baf1f06cf5e4'} Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:59.572761 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.578011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:59.579358 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-616acea3-2367-46c5-8938-cbbd296927e7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 404 len: 111 microversion: 2.1 time: 0.078457 Aug 29 16:02:59.580908 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3018/5857] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:02:59 2022] DELETE /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:59.590171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:59.590811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 69229f25-a318-4a95-97c7-baf1f06cf5e4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:59.606741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.607304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.607756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:59.608614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.609086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.610566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:59.640041 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 HTTP/1.1 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '69229f25-a318-4a95-97c7-baf1f06cf5e4'} Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:59.644438 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 69229f25-a318-4a95-97c7-baf1f06cf5e4 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:59.649849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3e7fc28-8a5c-458f-bb1e-5f457cb983a0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4" status: 404 len: 111 microversion: 2.1 time: 0.061321 Aug 29 16:02:59.719144 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2840/5858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:59 2022] GET /compute/v2.1/servers/69229f25-a318-4a95-97c7-baf1f06cf5e4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:08.026245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:08.029250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:08.036967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.045896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.046665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.047606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.048260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.057167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.201552 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-484cfc5e-c1e0-4bb5-9332-0e1aab1098a3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action" status: 200 len: 24570 microversion: 2.1 time: 0.179502 Aug 29 16:03:08.202243 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3019/5859] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:03:08 2022] POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action => generated 24570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:03:19.241125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:19.241874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:19.244638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=17 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.245317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=39 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.257819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.258800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.259599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.260551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.261252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.262205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.680097 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c6485c73-5667-4268-9825-440dc714775d tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1833 microversion: 2.1 time: 0.442576 Aug 29 16:03:19.682962 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2841/5860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:19 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1833 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:19.703416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:19.704724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:19.713199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=19 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.714129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=53 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.717765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.718484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.719103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.720818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.721704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.722283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.182417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:20.198126 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d334ca9-5e09-499d-83c8-cafe815e29f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1682 microversion: 2.1 time: 0.499490 Aug 29 16:03:20.203062 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3020/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:19 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1682 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:20.372135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:20.391849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:20.450632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.451556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.452150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.453867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.455117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.455682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.545529 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a06b4921-64b5-4943-9844-5e8d8132ccb3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action" status: 200 len: 32642 microversion: 2.1 time: 0.174249 Aug 29 16:03:20.546286 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2842/5862] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:03:20 2022] POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action => generated 32642 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:03:20.692967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:20.693804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:20.709811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.712234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.712829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.716233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.717925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.719964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.797137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a2100452cd4444db9467899791cd745c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72278a148b104eb88fee0e2384fc83b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:20.797853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] flavor_id is None. Assuming migration. {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 16:03:20.798559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:03:21.215609 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9231bec-7b37-4a1e-a3e3-efc3c104a12e tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action" status: 202 len: 0 microversion: 2.1 time: 0.525826 Aug 29 16:03:21.218411 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3021/5863] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:03:20 2022] POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:03:21.234270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:21.235144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:21.247965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.252484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.253134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.261811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.263594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.265070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.875682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:21.900175 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4ffe4e1b-c806-4085-83e2-aa5a1c9941c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1691 microversion: 2.1 time: 0.676561 Aug 29 16:03:21.901940 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2843/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:21 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1691 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:22.930844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:22.931731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:22.949872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.954091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.954659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.955492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.957501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.958186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.247384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:23.262910 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-70964bec-84e7-4745-8201-89aae3054963 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1691 microversion: 2.1 time: 0.335041 Aug 29 16:03:23.264102 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3022/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:22 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1691 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:24.286575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:24.287421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:24.311366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:24.312684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:24.313380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.314338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:24.315693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:24.316949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.639911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:24.673284 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-47757a94-6e47-4cd2-bce8-63ab6a3381f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1691 microversion: 2.1 time: 0.389763 Aug 29 16:03:24.681982 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2844/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:24 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1691 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:25.702008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:25.703272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:25.711422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.712321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.713319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.714969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.715767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.716430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.888878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:25.901738 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-020c9951-59d0-417c-a5c8-feb879d947da tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.203703 Aug 29 16:03:25.904673 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3023/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:25 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:26.926926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:26.928436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:26.937560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.938367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.939036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.940670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.941301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.941943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.124684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:27.139307 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-10ee2295-4539-43aa-983e-328793123502 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.217072 Aug 29 16:03:27.152456 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2845/5868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:26 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:28.162464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:28.163121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:28.178721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.179321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.179845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:28.180635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.181169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.188022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:28.565737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:28.585738 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b18c2219-142f-417d-a60b-7805a8f5fdab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.427823 Aug 29 16:03:28.587088 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3024/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:28 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:29.607653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:29.608272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:29.625178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.625991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.626709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.627626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.628283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.629078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.984085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:29.997750 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14b49cfe-6446-4848-b79c-7ffaad11a539 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.393924 Aug 29 16:03:30.000498 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2846/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:29 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:31.036652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:31.037438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:31.048265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:31.049051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:31.049642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:31.050482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:31.051133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:31.051796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:31.368049 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:31.383518 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bd91bf54-f038-40fd-9b5d-125fd4cf3619 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.351515 Aug 29 16:03:31.384409 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3025/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:31 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:32.408490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:32.410167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:32.434472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.435549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.436225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.440967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.441691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.442135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.745534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:32.757421 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5f50a413-f779-4f14-8777-1743f3c8ca24 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.353004 Aug 29 16:03:32.771416 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2847/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:32 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:33.786778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:33.797790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:33.819116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.820014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.820696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:33.821791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.822519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.823198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:34.358638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:34.371080 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1044a312-3252-452d-afb7-a92a42b3dc87 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.585516 Aug 29 16:03:34.372424 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3026/5873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:33 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:35.396223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:35.396994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:35.407865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:35.408356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:35.409278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:35.423997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:35.424860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:35.425504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:36.224814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:36.237278 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-119a450e-c940-46ef-85a4-845a7e4afbe1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.844182 Aug 29 16:03:36.240080 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2848/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:35 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:37.259384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:37.260232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:37.274085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:37.274601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:37.275050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:37.275778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:37.276239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:37.276692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:37.642440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:37.651171 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52d14ec8-e4d1-4e67-9379-cee3a1f1899b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1696 microversion: 2.1 time: 0.396491 Aug 29 16:03:37.655216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3027/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:37 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1696 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:38.681651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:38.682921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:38.699510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:38.701346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:38.704721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:38.708514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:38.709560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:38.709887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:39.136802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:39.150113 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2eefda3d-db66-4de4-8278-f5dd6f3a730f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1695 microversion: 2.1 time: 0.476439 Aug 29 16:03:39.165952 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2849/5876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:38 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1695 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:39.950610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-72a91e08-7759-4076-8b5d-e8eb4f53714f req-c6bfb167-7705-4c53-a6a4-271dfc7d94f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "name": "network-vif-unplugged", "status": "completed", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:39.971465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-72a91e08-7759-4076-8b5d-e8eb4f53714f req-c6bfb167-7705-4c53-a6a4-271dfc7d94f6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:39.972187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-72a91e08-7759-4076-8b5d-e8eb4f53714f req-c6bfb167-7705-4c53-a6a4-271dfc7d94f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:39.973704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-72a91e08-7759-4076-8b5d-e8eb4f53714f req-c6bfb167-7705-4c53-a6a4-271dfc7d94f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.007901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-72a91e08-7759-4076-8b5d-e8eb4f53714f req-c6bfb167-7705-4c53-a6a4-271dfc7d94f6 service nova] Creating event network-vif-unplugged:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h2-854882-3 Aug 29 16:03:40.022704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-72a91e08-7759-4076-8b5d-e8eb4f53714f req-c6bfb167-7705-4c53-a6a4-271dfc7d94f6 service nova] Instance d4970768-52d0-4082-afcc-13de3cf56b3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:03:40.041954 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-72a91e08-7759-4076-8b5d-e8eb4f53714f req-c6bfb167-7705-4c53-a6a4-271dfc7d94f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.451314 Aug 29 16:03:40.042990 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3028/5877] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:40.183823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:40.187085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:40.216121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.216633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.217087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.217939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.218349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.218782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.682584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:40.703127 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a14a8a7-9892-45e7-ade5-dcc8fc930832 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1695 microversion: 2.1 time: 0.535145 Aug 29 16:03:40.719027 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2850/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:40 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1695 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:41.433672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-972753548", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6ef4322d-c338-4cac-b31d-e366301b77af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:41.551084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:41.727023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:41.727653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:41.742210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:41.747720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:41.749779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:41.750742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:41.755669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:41.756279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.091001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:42.109431 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e871baa1-952e-428c-8e97-a1da0943b344 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1693 microversion: 2.1 time: 0.385578 Aug 29 16:03:42.111980 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2851/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:41 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1693 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:42.139911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1caf55db-8dec-4247-ad79-608fc80cdad1 req-57652750-384e-46e2-a8d4-89446a35c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:42.198841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1caf55db-8dec-4247-ad79-608fc80cdad1 req-57652750-384e-46e2-a8d4-89446a35c1d4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.199653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1caf55db-8dec-4247-ad79-608fc80cdad1 req-57652750-384e-46e2-a8d4-89446a35c1d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.200957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1caf55db-8dec-4247-ad79-608fc80cdad1 req-57652750-384e-46e2-a8d4-89446a35c1d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.234531 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1caf55db-8dec-4247-ad79-608fc80cdad1 req-57652750-384e-46e2-a8d4-89446a35c1d4 service nova] Creating event network-changed:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h2-854882-3 Aug 29 16:03:42.252605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-1caf55db-8dec-4247-ad79-608fc80cdad1 req-57652750-384e-46e2-a8d4-89446a35c1d4 service nova] Instance d4970768-52d0-4082-afcc-13de3cf56b3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:03:42.298903 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1caf55db-8dec-4247-ad79-608fc80cdad1 req-57652750-384e-46e2-a8d4-89446a35c1d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184149 Aug 29 16:03:42.300095 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2852/5880] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:42.670873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:42.671310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:42.671759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:42.672253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:42.673227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:42.692921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.695968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.696838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.697842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.712028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.715110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.767543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:42.781993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:42.967894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:03:42.972438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ef4322d-c338-4cac-b31d-e366301b77af',volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:03:43.136069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:43.137824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:43.165670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:43.171672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:43.172394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:43.175165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:43.176703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:43.181549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:43.417864 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c6d22129-15a8-4b60-aeaa-4f260cbe2110 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991945 Aug 29 16:03:43.422273 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3029/5881] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:03:43.436593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7b0f942a-25f2-4cf0-96e2-e854beeb5231 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:43.437259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7b0f942a-25f2-4cf0-96e2-e854beeb5231 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:43.584415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7b0f942a-25f2-4cf0-96e2-e854beeb5231 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:43.592441 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7b0f942a-25f2-4cf0-96e2-e854beeb5231 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1070 microversion: 2.1 time: 0.165742 Aug 29 16:03:43.605954 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3030/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:43 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1070 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:43.821806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:43.833933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59c204d4-27b2-4f1b-869e-b0723ccc0864 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1693 microversion: 2.1 time: 0.704201 Aug 29 16:03:43.835126 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2853/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:43 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1693 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:44.617154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:44.617815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:44.639097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:44.639661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:44.640121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.640852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:44.641318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:44.642310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.792630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:44.811154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aca19954-603b-4d3c-b6ee-c2a5acddedb7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1168 microversion: 2.1 time: 0.202798 Aug 29 16:03:44.811800 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3031/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:44 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1168 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:44.856864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:44.858296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:44.871225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:44.871996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:44.872676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.873673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:44.874445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:44.885767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.154669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:45.168860 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b33186f3-79b2-4034-ae76-fd51f2fb0583 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1690 microversion: 2.1 time: 0.316619 Aug 29 16:03:45.171802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2854/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:44 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1690 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:45.192139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:45.193071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:45.207842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.217193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.220136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.229873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.231196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.231785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.400975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-847de8e6-e4e3-477c-8205-afb2089bd49e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action" status: 204 len: 0 microversion: 2.1 time: 0.212785 Aug 29 16:03:45.405425 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3032/5886] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:03:45 2022] POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:03:45.413233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:45.414121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:45.426809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.427623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.431699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.434474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.435226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.435892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.799337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:45.817196 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2184b783-38d7-4689-9121-514134320930 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1690 microversion: 2.1 time: 0.410188 Aug 29 16:03:45.818189 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2855/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:45 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1690 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:45.848607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:45.849446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:45.866816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.871687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.875143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.876758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.885606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.886322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:46.133541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:46.160878 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-302ccec4-9d9b-4e00-8669-abe199c2ec17 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1186 microversion: 2.1 time: 0.318716 Aug 29 16:03:46.161970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3033/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:45 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1186 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:46.844095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:46.845362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:46.867335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:46.868118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:46.868750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:46.869675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:46.870320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:46.870928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.190395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:47.192696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:47.210506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.213017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.214691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.216000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.218006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.219538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.375610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:47.386515 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d0e40ea-003b-4543-b44f-c41d6bed556d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1690 microversion: 2.1 time: 0.546049 Aug 29 16:03:47.402639 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2856/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:46 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1690 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:47.423780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:47.436333 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ab3dc90-852e-4931-9665-748986efe1a6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1186 microversion: 2.1 time: 0.252434 Aug 29 16:03:47.439061 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3034/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:47 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1186 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:48.052709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b38b9bc7-3ff2-4484-b2ed-5c2b1a4667a8 req-cfa83d7d-2a64-4c7b-b30b-c3624096e098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "name": "network-vif-plugged", "status": "completed", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:48.082313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b38b9bc7-3ff2-4484-b2ed-5c2b1a4667a8 req-cfa83d7d-2a64-4c7b-b30b-c3624096e098 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.083010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b38b9bc7-3ff2-4484-b2ed-5c2b1a4667a8 req-cfa83d7d-2a64-4c7b-b30b-c3624096e098 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.083535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b38b9bc7-3ff2-4484-b2ed-5c2b1a4667a8 req-cfa83d7d-2a64-4c7b-b30b-c3624096e098 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.112006 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b38b9bc7-3ff2-4484-b2ed-5c2b1a4667a8 req-cfa83d7d-2a64-4c7b-b30b-c3624096e098 service nova] Creating event network-vif-plugged:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h2-854882-3 Aug 29 16:03:48.126127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-b38b9bc7-3ff2-4484-b2ed-5c2b1a4667a8 req-cfa83d7d-2a64-4c7b-b30b-c3624096e098 service nova] Instance d4970768-52d0-4082-afcc-13de3cf56b3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:03:48.153549 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b38b9bc7-3ff2-4484-b2ed-5c2b1a4667a8 req-cfa83d7d-2a64-4c7b-b30b-c3624096e098 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101827 Aug 29 16:03:48.154263 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2857/5891] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:48.409186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:48.410012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:48.424030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.433814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.433814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.433814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.433814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.433814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.460083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:48.460960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:48.479482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.481477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.482035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.488508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.498284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.499184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.560290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:48.890095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:48.912288 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a617dd6f-9a10-47eb-b9da-8f51e42d0d28 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.456262 Aug 29 16:03:48.913451 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2858/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:48 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:49.091494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:49.095290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:49.111295 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-89823deb-a450-4529-b8ac-518d347c8460 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1690 microversion: 2.1 time: 0.705062 Aug 29 16:03:49.112190 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3035/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:48 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1690 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:49.540118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-fd916296-e784-4db2-9a86-f766b4b0fac4 req-8b32f705-e487-475c-876f-b2ec51a93353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39", "tag": "217fb874-fce5-4d09-8652-376c2e4b37e6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:49.605789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=37 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:49.609587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fd916296-e784-4db2-9a86-f766b4b0fac4 req-8b32f705-e487-475c-876f-b2ec51a93353 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:49.611186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fd916296-e784-4db2-9a86-f766b4b0fac4 req-8b32f705-e487-475c-876f-b2ec51a93353 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:49.611751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fd916296-e784-4db2-9a86-f766b4b0fac4 req-8b32f705-e487-475c-876f-b2ec51a93353 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:49.670110 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fd916296-e784-4db2-9a86-f766b4b0fac4 req-8b32f705-e487-475c-876f-b2ec51a93353 service nova] Creating event network-changed:217fb874-fce5-4d09-8652-376c2e4b37e6 for instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 on n-h1-854882-3 Aug 29 16:03:49.681443 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-fd916296-e784-4db2-9a86-f766b4b0fac4 req-8b32f705-e487-475c-876f-b2ec51a93353 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146614 Aug 29 16:03:49.687675 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2859/5894] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:49.934326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:49.935055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:49.938598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:49.957323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:49.957925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:49.958546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:49.959432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:49.960069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:49.960749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.134478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:50.136172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:50.155356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.156227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:50.158830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.161788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.162451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:50.163056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.441980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:50.457172 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3ac2f114-a415-4e4c-885c-cfad1f635fb3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.526772 Aug 29 16:03:50.460599 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3036/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:49 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:50.580717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:50.599998 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f23c8f5c-fc9a-4e91-99fe-3fdc1453ad6e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1682 microversion: 2.1 time: 0.470624 Aug 29 16:03:50.600609 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2860/5896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:50 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1682 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:51.485112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:51.486085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:51.499429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:51.500195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:51.500900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:51.501831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:51.502466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:51.503048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:51.682214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:51.697432 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-25008e07-96b5-4bfb-90be-6d8ef2a6b5c6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.222217 Aug 29 16:03:51.698374 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3037/5897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:51 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:52.720492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:52.721707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:52.732951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.738155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.738759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.739520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.739989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.740538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:53.079385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:53.093807 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b707657-8ea6-4cf6-87b1-065ae49d9d27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.378261 Aug 29 16:03:53.106170 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2861/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:52 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:54.122360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:54.124410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:54.137527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:54.138627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:54.143255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:54.143952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:54.144394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.145430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:54.145889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:54.146464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.430004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:54.441676 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2f9431db-8012-48bb-a806-423dbf1422d8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.328712 Aug 29 16:03:54.454638 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3038/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:54 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:55.484438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:55.493525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:55.546686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:55.550442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:55.555172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:55.561462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:55.562514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:55.564690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:55.803595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:55.817296 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-89dfe3db-60bc-4548-8d37-3b874141ed50 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.353693 Aug 29 16:03:55.818611 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2862/5900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:55 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:56.841977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:56.842630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:56.866729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:56.869554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:56.872956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:56.877584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:56.878276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:56.883175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.176656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:57.195062 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-de923ff3-b7d5-4705-b6c8-b74e5c6613ee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.355933 Aug 29 16:03:57.198379 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3039/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:56 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:58.220052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:58.220684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:58.231290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:58.231790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:58.240895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:58.242463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:58.246873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:58.248047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:58.674946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:58.719201 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-704a1411-3742-489f-afb9-91d753b148ed tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1228 microversion: 2.1 time: 0.503564 Aug 29 16:03:58.738082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2863/5902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:58 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1228 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:59.749812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:59.758934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:59.783557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:59.784547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:59.785333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:59.786292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:59.786995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:59.787758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:00.023252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:00.043064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6a94216b-bf6c-4b46-8aad-4b00b6f0e636 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.300552 Aug 29 16:04:00.062118 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3040/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:59 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:01.070187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:01.070813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:01.079766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:01.080467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:01.081091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:01.082186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:01.082601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:01.083183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:01.436769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:01.461028 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-549d12ac-55bf-48aa-b21f-69a3cc0ea819 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.394865 Aug 29 16:04:01.474726 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2864/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:01 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:02.483955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:02.485951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:02.494226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:02.495042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:02.495637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:02.496518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:02.497159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:02.497817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:02.694765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:02.705818 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-854391b3-ad22-4f7e-9544-06a2001c94d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.226218 Aug 29 16:04:02.710829 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3041/5905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:02 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:03.726554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:03.727745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:03.734888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:03.735907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:03.736341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:03.737032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:03.737507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:03.737926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:03.900802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:03.909959 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-28053b7a-08b2-4f38-ba2e-49ef7f520cde tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.187158 Aug 29 16:04:03.911363 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2865/5906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:03 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:04.934078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:04.934874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:04.950703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:04.951605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:04.952264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:04.953278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:04.954116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:04.954818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:05.237809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:05.246293 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-768cf614-8567-4384-9e81-272b1e36ddee tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.316423 Aug 29 16:04:05.251729 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3042/5907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:04 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:06.295215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:06.295846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:06.314240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:06.314741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:06.315187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:06.315902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:06.316363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:06.316790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:06.613053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:06.628602 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f25db161-d84c-455c-8af3-e3b4ac7b399a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.337157 Aug 29 16:04:06.646967 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2866/5908] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:06 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:07.655008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:07.656363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:07.670871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:07.671648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:07.672364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:07.674170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:07.674867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:07.675512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:07.958233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:07.971782 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e534c9f-1d96-4d68-abae-cfcb14fd0cd8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.321155 Aug 29 16:04:07.982205 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3043/5909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:07 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:08.421271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-05e471ad-4113-44f0-bfb8-b1eed2e4eaff req-e10b0282-a44f-4c3e-9248-f3ea9a68d951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39", "name": "network-vif-plugged", "status": "completed", "tag": "217fb874-fce5-4d09-8652-376c2e4b37e6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:08.454545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05e471ad-4113-44f0-bfb8-b1eed2e4eaff req-e10b0282-a44f-4c3e-9248-f3ea9a68d951 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:08.456780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05e471ad-4113-44f0-bfb8-b1eed2e4eaff req-e10b0282-a44f-4c3e-9248-f3ea9a68d951 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:08.458208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05e471ad-4113-44f0-bfb8-b1eed2e4eaff req-e10b0282-a44f-4c3e-9248-f3ea9a68d951 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:08.495510 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-05e471ad-4113-44f0-bfb8-b1eed2e4eaff req-e10b0282-a44f-4c3e-9248-f3ea9a68d951 service nova] Creating event network-vif-plugged:217fb874-fce5-4d09-8652-376c2e4b37e6 for instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 on n-h1-854882-3 Aug 29 16:04:08.515180 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-05e471ad-4113-44f0-bfb8-b1eed2e4eaff req-e10b0282-a44f-4c3e-9248-f3ea9a68d951 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097629 Aug 29 16:04:08.517596 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2867/5910] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:08.881603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:08.885708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:08.895463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:08.896240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:08.896838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:08.898221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:08.899202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:08.899824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:08.978792 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-452e8773-8263-4248-bdbe-170fac22eedf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action" status: 200 len: 24578 microversion: 2.1 time: 0.102696 Aug 29 16:04:08.979562 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3044/5911] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:04:08 2022] POST /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b/action => generated 24578 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:04:09.018278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:09.019017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:09.042394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:09.043128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:09.043857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:09.044938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:09.045590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:09.046015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:09.283051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:09.295477 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d896f89e-4664-4922-b410-a1f0fe2829bc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1216 microversion: 2.1 time: 0.289597 Aug 29 16:04:09.296151 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2868/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:09 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:10.328267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:10.329845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:10.341950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:10.350129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:10.351153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:10.352148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:10.353111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:10.353879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:10.652336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:10.661882 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1281c67e-97eb-4964-bd58-e817b0627e5c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1403 microversion: 2.1 time: 0.339001 Aug 29 16:04:10.662479 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3045/5913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:10 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1403 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:10.692572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:10.694000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:10.708027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:10.708966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:10.709671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:10.710592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:10.711247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:10.711869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:11.140571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:11.150882 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9d5f6dcd-d15d-479c-aac8-3613a9d1ec5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1403 microversion: 2.1 time: 0.466570 Aug 29 16:04:11.155565 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2869/5914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:10 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1403 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:11.181886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1123604192"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:11.184470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:11.195941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:11.210253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:11.211072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:11.212031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:11.212709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:11.213339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:11.326386 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Attempting to quiesce instance before volume snapshot. Aug 29 16:04:11.392110 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 29 16:04:11.625933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Creating snapshot from volume 6ef4322d-c338-4cac-b31d-e366301b77af. {{(pid=130002) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 29 16:04:13.523197 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0e9be02e-9ee5-46f5-b67a-59b1fdd4628b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39/action" status: 202 len: 0 microversion: 2.1 time: 2.345206 Aug 29 16:04:13.526618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3046/5915] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:04:11 2022] POST /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39/action => generated 0 bytes in 2350 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 16:04:15.532369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:15.534004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:15.545994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:15.546751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:15.547504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:15.548369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:15.548963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:15.549587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:15.772656 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9f38fdd-8a6f-45b7-bcbd-6e654828a935 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1833 microversion: 2.1 time: 0.245846 Aug 29 16:04:15.773816 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2870/5916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:15 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1833 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:15.986417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1033287510", "imageRef": "082f7b07-f8f1-4000-8a2d-24e797a97767", "flavorRef": "452", "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:16.085263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:04:16.915058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:04:16.915540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:04:16.918478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:04:16.919479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:04:16.920129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:04:16.956721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:16.957535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:16.958575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:16.961185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:16.961876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:16.962970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:17.001231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:04:17.023385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:04:17.090304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:04:17.099659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='641c4b04-ae21-45ec-866e-cf68c855cbd7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:04:17.270337 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a3c3d16-7183-4fe3-bf56-d706dad5a8a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289665 Aug 29 16:04:17.275385 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3047/5917] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:04:17.288239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-798868b0-fd9f-4c2b-8401-4424509dff06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:17.289969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-798868b0-fd9f-4c2b-8401-4424509dff06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:17.426170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-798868b0-fd9f-4c2b-8401-4424509dff06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:17.434763 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-798868b0-fd9f-4c2b-8401-4424509dff06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1230 microversion: 2.1 time: 0.152484 Aug 29 16:04:17.438998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2871/5918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:17 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1230 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:17.608695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:17.610192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:17.634510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:17.634510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:17.634510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:17.634510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:17.634510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:17.634510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:17.686296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:04:17.948834 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ed648511-6370-42cd-aed7-4618ca90b3fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 204 len: 0 microversion: 2.1 time: 0.345806 Aug 29 16:04:17.952358 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3048/5919] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:04:17 2022] DELETE /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:04:17.974884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e23c14ba-bb89-41f7-a17c-dca066a4ea9b req-24828551-6685-460e-81c0-fe4ac10186de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:17.980266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:17.981062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:18.000401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e23c14ba-bb89-41f7-a17c-dca066a4ea9b req-24828551-6685-460e-81c0-fe4ac10186de service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:18.002162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e23c14ba-bb89-41f7-a17c-dca066a4ea9b req-24828551-6685-460e-81c0-fe4ac10186de service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:18.003628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e23c14ba-bb89-41f7-a17c-dca066a4ea9b req-24828551-6685-460e-81c0-fe4ac10186de service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:18.016917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:18.020819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:18.021660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:18.023586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:18.027584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:18.028375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:18.032180 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e23c14ba-bb89-41f7-a17c-dca066a4ea9b req-24828551-6685-460e-81c0-fe4ac10186de service nova] Creating event network-changed:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h2-854882-3 Aug 29 16:04:18.045213 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e23c14ba-bb89-41f7-a17c-dca066a4ea9b req-24828551-6685-460e-81c0-fe4ac10186de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.416505 Aug 29 16:04:18.048794 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2872/5920] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:18.092191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:18.470603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:18.475072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:18.489717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:18.491369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:18.492331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:18.494914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:18.497217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:18.508840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:18.571797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=72 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:18.689252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:18.720608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ca463263-cfa2-45a7-b3b8-bcfd8a594ff2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1234 microversion: 2.1 time: 0.260842 Aug 29 16:04:18.736132 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2873/5921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:18 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1234 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:18.803606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:18.816576 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ccb567ca-43d6-484e-8b9c-1d3f54098b48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1688 microversion: 2.1 time: 0.858455 Aug 29 16:04:18.832204 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3049/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:17 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1688 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:19.742147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:19.742884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:19.746204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=32 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:19.767785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:19.784930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:19.786146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:19.787560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:19.791017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:19.792194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:19.845494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:19.847463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:19.864211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:19.866798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:19.868019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:19.870625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:19.872856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:19.875954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:20.069844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:20.111331 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a94467c3-501d-41b2-91be-584699214482 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1282 microversion: 2.1 time: 0.371002 Aug 29 16:04:20.148647 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2874/5923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:19 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1282 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:20.317606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-48d8eae2-0a9a-4088-bbbd-6e4efff909b8 req-855cb989-688b-481a-bf73-68640badbf9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4970768-52d0-4082-afcc-13de3cf56b3b", "name": "network-vif-deleted", "tag": "091e231b-cd86-450e-8233-a1b67b1423d9"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:20.341656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-48d8eae2-0a9a-4088-bbbd-6e4efff909b8 req-855cb989-688b-481a-bf73-68640badbf9b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:20.353355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-48d8eae2-0a9a-4088-bbbd-6e4efff909b8 req-855cb989-688b-481a-bf73-68640badbf9b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:20.354429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-48d8eae2-0a9a-4088-bbbd-6e4efff909b8 req-855cb989-688b-481a-bf73-68640badbf9b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:20.378454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:20.389625 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-872a9faa-0add-4497-bf92-20509f9fdd5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 200 len: 1621 microversion: 2.1 time: 0.553781 Aug 29 16:04:20.393679 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-48d8eae2-0a9a-4088-bbbd-6e4efff909b8 req-855cb989-688b-481a-bf73-68640badbf9b service nova] Creating event network-vif-deleted:091e231b-cd86-450e-8233-a1b67b1423d9 for instance d4970768-52d0-4082-afcc-13de3cf56b3b on n-h2-854882-3 Aug 29 16:04:20.399686 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-48d8eae2-0a9a-4088-bbbd-6e4efff909b8 req-855cb989-688b-481a-bf73-68640badbf9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088434 Aug 29 16:04:20.400293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3050/5924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:19 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 1621 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:20.430802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2875/5925] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 16:04:21.153209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:21.153880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:21.161806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:21.189009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:21.190068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:21.190845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.192038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:21.192879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:21.193595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.429366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:21.430018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: d4970768-52d0-4082-afcc-13de3cf56b3b] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:21.457515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:21.464045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:21.464942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.466062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:21.474986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:21.476018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.515376 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] HTTP exception thrown: Instance d4970768-52d0-4082-afcc-13de3cf56b3b could not be found. Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Request method failure captured: Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b HTTP/1.1 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOMDofWL0Gi1PrJIY8t82vrIBBZztaj2mNO_3L1DtbH9leStvvDMCBkhbL7mNNLzYNjBscUFMF2Guoj7vN6KVc5Q9pi5V9tFjDj0bb8bJRUTAEHnRfvtnpJ7V0NxwCG5GfWcygmHRGhrhqJOq2_dgh88YvNXl077FRUJUonXEKnjLoY Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fa29b3844343454c8ade410470e7d897"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fa29b3844343454c8ade410470e7d897", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}] Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 64dd24ea45ac485d8d411837d7078301 Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d4970768-52d0-4082-afcc-13de3cf56b3b could not be found. Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd4970768-52d0-4082-afcc-13de3cf56b3b'} Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4970768-52d0-4082-afcc-13de3cf56b3b could not be found. Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4970768-52d0-4082-afcc-13de3cf56b3b could not be found. Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:04:21.517708 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4970768-52d0-4082-afcc-13de3cf56b3b could not be found. Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Returning 404 to user: Instance d4970768-52d0-4082-afcc-13de3cf56b3b could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3567623-a19c-4c3d-b7f3-c1a0397059c5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b" status: 404 len: 111 microversion: 2.1 time: 0.098747 Aug 29 16:04:21.526538 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2876/5926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:21 2022] GET /compute/v2.1/servers/d4970768-52d0-4082-afcc-13de3cf56b3b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:04:21.864116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:21.878374 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-047772c6-f294-40c4-b5a5-e073156726ff tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1300 microversion: 2.1 time: 0.729199 Aug 29 16:04:21.893903 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3051/5927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:21 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1300 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:22.906545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:22.907999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:22.923984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:22.924681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:22.925230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:22.926675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:22.928036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:22.932082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:23.651639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:23.675308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-19c067f8-9519-4a74-8a1e-89f3b4aa917b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.767169 Aug 29 16:04:23.676131 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2877/5928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:22 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:24.705635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:24.706325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:24.722761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.723436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.724005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:24.740631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.743539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.751114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:26.101163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:26.110868 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef8d20c8-23f8-4161-adc3-f90a94537cd5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 1.411874 Aug 29 16:04:26.111712 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3052/5929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:24 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:26.323669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-24b81d84-69b5-4a80-909e-3ec54f04faf3 req-5978de0f-853d-46fa-aa0e-63a2b323f663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36093934-3d47-42ad-b7dc-6b8afe26536c", "tag": "a562f56d-2da4-453e-a82a-257a8f90f177"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:26.362701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-24b81d84-69b5-4a80-909e-3ec54f04faf3 req-5978de0f-853d-46fa-aa0e-63a2b323f663 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:26.366115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-24b81d84-69b5-4a80-909e-3ec54f04faf3 req-5978de0f-853d-46fa-aa0e-63a2b323f663 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:26.366787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-24b81d84-69b5-4a80-909e-3ec54f04faf3 req-5978de0f-853d-46fa-aa0e-63a2b323f663 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:26.435255 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-24b81d84-69b5-4a80-909e-3ec54f04faf3 req-5978de0f-853d-46fa-aa0e-63a2b323f663 service nova] Creating event network-changed:a562f56d-2da4-453e-a82a-257a8f90f177 for instance 36093934-3d47-42ad-b7dc-6b8afe26536c on n-h2-854882-3 Aug 29 16:04:26.464616 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-24b81d84-69b5-4a80-909e-3ec54f04faf3 req-5978de0f-853d-46fa-aa0e-63a2b323f663 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146227 Aug 29 16:04:26.467472 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2878/5930] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:27.136148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:27.138090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:27.142040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:27.147740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:27.176292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:27.177102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:27.177807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:27.179043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:27.179750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:27.180655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:28.052870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:28.068347 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1510667c-536b-408b-9486-9ddc46254b24 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.936639 Aug 29 16:04:28.093891 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3053/5931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:27 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:29.104096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:29.111771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:29.133836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:29.149180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.154984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.158962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:29.162513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.165854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.168174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.205327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:30.229197 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1bfba0b-5095-4646-a7f4-ab0e5e3b32a4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 1.134533 Aug 29 16:04:30.253716 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2879/5932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:29 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:31.260909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:31.262490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:31.278577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:31.283314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:31.287347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:31.288376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:31.289209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:31.291059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:32.034109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:32.045803 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9114fafc-7a7e-412f-9e12-a2915a40411e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.788912 Aug 29 16:04:32.055823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3054/5933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:31 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:33.071020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:33.072307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:33.104172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:33.104712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:33.105172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:33.105940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:33.106404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:33.106831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:33.802998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-62f07cc6-b07b-4c4a-8f5d-65355259457f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '.version_select at 0x7fb0e26ecee0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:33.809968 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62f07cc6-b07b-4c4a-8f5d-65355259457f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [c9a61e61-af61-4c98-869c-d6306036732e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:04:33.981256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:34.021494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4d191b7f-a355-442b-94db-f462eb54443a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.944807 Aug 29 16:04:34.021494 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2880/5934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:33 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:34.823615 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [None req-62f07cc6-b07b-4c4a-8f5d-65355259457f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [c9a61e61-af61-4c98-869c-d6306036732e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38660. Aug 29 16:04:34.863735 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-62f07cc6-b07b-4c4a-8f5d-65355259457f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-621813596" status: 202 len: 0 microversion: 2.1 time: 1.065841 Aug 29 16:04:34.866242 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3055/5935] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Aug 29 16:04:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-621813596 => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:04:34.901957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a5fc9e03-a6a7-456f-8a1a-8084995ec77e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: .version_select at 0x7fb0e266c310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1978782960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLJZ0IU0i6pND2/JIPh+95lt9nFN621lI57zHs5WFK4F2hFDEx/tiW+XQRQem35dOPtL7LdnvVL0tFsjC0ORK+nhuoQEqDY32EisF1racPFEx9ZNUlZ2RFIBS851pPsuw=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:34.923666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a5fc9e03-a6a7-456f-8a1a-8084995ec77e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:04:34.931736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a5fc9e03-a6a7-456f-8a1a-8084995ec77e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:04:34.990193 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a5fc9e03-a6a7-456f-8a1a-8084995ec77e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.095040 Aug 29 16:04:34.991050 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2881/5936] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:04:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:35.081174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:35.083249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:35.118154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:35.118815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:35.119501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:35.120859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:35.121723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:35.122495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:35.384669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:35.412224 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a515393b-10be-4862-a8be-32907d614520 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.350353 Aug 29 16:04:35.415075 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3056/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:35 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:36.440848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:36.443659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:36.466659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:36.469888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:36.473765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:36.476155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:36.476926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:36.480250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:37.262336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:37.275051 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c8417a2-4c78-41af-a767-e4dc22846bfd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.839399 Aug 29 16:04:37.284320 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2882/5938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:36 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:38.306252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:38.307995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:38.320811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:38.321343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:38.322917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:38.323847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:38.325055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:38.325946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:38.570342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:38.585094 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f1f6bb22-5833-4ca0-b0eb-853b221e515f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.286319 Aug 29 16:04:38.590938 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3057/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:38 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:39.613262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:39.614757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:39.630756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:39.634045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:39.635089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:39.637687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:39.637687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:39.638728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:40.028797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:40.057722 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1b10631-0bc2-4fac-b18a-05d4e6333dac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.449658 Aug 29 16:04:40.065209 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2883/5940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:39 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:41.099228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:41.106152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:41.132130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.133218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.133734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.138050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.138594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.140579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.629361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:41.647546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12448e61-417e-4736-adb2-3dfd21b5bddf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.558626 Aug 29 16:04:41.649680 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3058/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:41 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:43.372993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:43.376828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:43.387132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.387929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.389017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:43.391040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.392099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.392715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:43.866188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:43.879030 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7c22668e-9d40-44ee-a69a-e9ef8f6e7fa0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 1.210633 Aug 29 16:04:43.895775 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2884/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:42 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:44.904889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:44.907105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:44.920069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:44.924866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:44.925651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:44.927296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:44.930858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:44.932186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:45.909245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:45.920114 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ff0fa88-fe78-40de-840e-e0931378a7f2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 1.020940 Aug 29 16:04:45.921405 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3059/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:44 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:46.948686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:46.949188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:46.960092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:46.968354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:46.968954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:46.973905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:46.974635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:46.975327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:46.994705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:47.340214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:47.360665 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-845586f6-cfb6-4dcb-8527-9afb3ed1c932 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.417205 Aug 29 16:04:47.364869 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2885/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:46 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:48.386672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:48.387341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:48.403825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:48.404360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:48.424815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:48.424815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:48.424815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:48.424815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:48.446207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=57 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:48.930234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:48.951818 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-05eb81d9-0570-4bd4-a252-959568d241b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.567681 Aug 29 16:04:48.962053 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3060/5945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:48 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:49.431431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-884603202", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f2648015-cfe2-48f1-8830-a27a290851ab"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1978782960", "security_groups": [{"name": "tempest-secgroup-smoke-524468187"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:49.683504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] validate_networks() for [('f2648015-cfe2-48f1-8830-a27a290851ab', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:04:49.963862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:49.997955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:49.998814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:50.044807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:50.052186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:50.056976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:50.061878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:50.063674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:50.064559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:50.514291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:50.524572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2414a742-e81b-4601-9d67-080d063705bb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1342 microversion: 2.1 time: 0.544565 Aug 29 16:04:50.525706 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3061/5946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:49 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1342 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:50.638646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:04:50.639700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:04:50.640757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:04:50.641319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:04:50.641897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:04:50.662503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:50.663296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:50.664108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:50.665018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:50.667532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:50.668199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:50.686431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=57 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:50.716137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:04:50.726533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:04:50.761281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:04:50.763799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:04:50.865687 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3460164b-a754-427b-bd72-0458d8628fd5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.438427 Aug 29 16:04:50.879353 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2886/5947] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:04:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:04:50.890839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d394add-4d63-43bf-846a-ef2f6f7a7f57 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:50.891472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d394add-4d63-43bf-846a-ef2f6f7a7f57 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:50.966627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d394add-4d63-43bf-846a-ef2f6f7a7f57 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:50.974716 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d394add-4d63-43bf-846a-ef2f6f7a7f57 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1266 microversion: 2.1 time: 0.088364 Aug 29 16:04:50.982748 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3062/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:50 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:51.550153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:51.550773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:51.558745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:51.565558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:51.566317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:51.567076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:51.567554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:51.567989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:51.857543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:51.865748 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b7938cd-5654-4355-8a09-b24d0bef7223 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1388 microversion: 2.1 time: 0.319578 Aug 29 16:04:51.880642 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2887/5949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:51 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1388 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:52.002663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:52.003588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:52.010709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:52.024664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.026818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.029029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.032417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.033758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.036208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.243108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:52.255099 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c84f3e4b-817b-4172-b3c5-27d4d3e09781 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1262 microversion: 2.1 time: 0.262333 Aug 29 16:04:52.275096 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3063/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:51 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1262 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:52.894055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:52.895673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:52.904047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.905184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.905933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.907927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.908671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.909414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:53.208814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:53.224134 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76250021-63bf-4d1c-8ac8-42ad2b3a4548 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.335145 Aug 29 16:04:53.225097 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2888/5951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:52 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:53.280248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:53.288263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:53.301334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:53.302138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:53.302832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:53.303983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:53.304625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:53.305376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:53.440612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:53.450363 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0737db74-b099-4f88-9830-250d5623c3bb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1324 microversion: 2.1 time: 0.176937 Aug 29 16:04:53.452144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3064/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:53 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:54.250748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:54.252353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:54.271113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:54.273051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:54.273775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:54.279406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:54.281776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:54.284137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:54.477287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:54.477975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:54.498817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:54.500317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:54.501008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:54.501775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:54.502443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:54.503059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:54.691315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:54.722116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8057b96d-5878-4c3f-bdfa-be91a7bb0888 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.478231 Aug 29 16:04:54.725279 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2889/5953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:54 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:54.901926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:54.924219 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3644b920-4f6d-475e-bf18-2ed782f1bdd3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1391 microversion: 2.1 time: 0.451729 Aug 29 16:04:54.925433 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3065/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:54 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1391 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:55.377525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-30984bb5-e5dc-4ee5-b0f6-e5bb3d9a2c1e req-24424bc8-e23e-4bc9-b31d-d33735343bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:55.396956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-30984bb5-e5dc-4ee5-b0f6-e5bb3d9a2c1e req-24424bc8-e23e-4bc9-b31d-d33735343bca service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:55.397459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-30984bb5-e5dc-4ee5-b0f6-e5bb3d9a2c1e req-24424bc8-e23e-4bc9-b31d-d33735343bca service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:55.403351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-30984bb5-e5dc-4ee5-b0f6-e5bb3d9a2c1e req-24424bc8-e23e-4bc9-b31d-d33735343bca service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:55.437657 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-30984bb5-e5dc-4ee5-b0f6-e5bb3d9a2c1e req-24424bc8-e23e-4bc9-b31d-d33735343bca service nova] Creating event network-changed:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:04:55.450803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-30984bb5-e5dc-4ee5-b0f6-e5bb3d9a2c1e req-24424bc8-e23e-4bc9-b31d-d33735343bca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077213 Aug 29 16:04:55.454358 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2890/5955] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:55.748114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:55.748753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:55.772234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:55.772824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:55.773612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:55.774800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:55.775430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:55.776036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:55.954693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:55.955451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:55.972054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:55.972568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:55.976917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:55.979166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:55.980075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:55.982581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:56.231428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:56.245856 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b1544bee-9a00-449d-aaf1-f81232fd048b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.496530 Aug 29 16:04:56.247216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3066/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:55 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:56.370784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:56.387478 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac0d2151-9abb-4f0b-8730-33826b049506 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1391 microversion: 2.1 time: 0.442683 Aug 29 16:04:56.389163 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2891/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:55 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1391 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:57.268829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:57.269599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:57.288254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.288847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.289500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:57.290768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.291419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.292126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:57.411865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:57.413009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:57.428652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.430864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.431678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:57.433791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.435315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.435914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:57.643061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:57.656080 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e3aad3e7-928e-4769-a714-73ac13e77f7c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.391938 Aug 29 16:04:57.658736 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3067/5958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:57 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:57.677034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:57.689793 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c453b340-f05e-412e-ab48-e3a6e2e384cc tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1391 microversion: 2.1 time: 0.279713 Aug 29 16:04:57.690943 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2892/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:57 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1391 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:04:58.681841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:58.682587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:58.692095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:58.692671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:58.692972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:58.694573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:58.695330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:58.695678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:58.713244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:58.714797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:58.730056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:58.732109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:58.732723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:58.736415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:58.738316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:58.738994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:58.939037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:58.956333 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d8f1c17-aeb5-4e4c-9c7f-75f5aa718349 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.279580 Aug 29 16:04:58.971047 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3068/5960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:58 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:58.996080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:59.007788 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9130319a-71a6-46ed-8b15-38e960da2074 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1391 microversion: 2.1 time: 0.299270 Aug 29 16:04:59.008860 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2893/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:58 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1391 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:04:59.985434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:59.986417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:00.002144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:00.003270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:00.003738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:00.007611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:00.008149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:00.008598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:00.018618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-035168bf-de2f-46ca-a79f-b24ca6e806b8 req-9c831078-d56a-4d3b-97fd-b9936e394234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "name": "network-vif-plugged", "status": "completed", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:00.041536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-035168bf-de2f-46ca-a79f-b24ca6e806b8 req-9c831078-d56a-4d3b-97fd-b9936e394234 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:00.041983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-035168bf-de2f-46ca-a79f-b24ca6e806b8 req-9c831078-d56a-4d3b-97fd-b9936e394234 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:00.042372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-035168bf-de2f-46ca-a79f-b24ca6e806b8 req-9c831078-d56a-4d3b-97fd-b9936e394234 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:00.067800 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-035168bf-de2f-46ca-a79f-b24ca6e806b8 req-9c831078-d56a-4d3b-97fd-b9936e394234 service nova] Creating event network-vif-plugged:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:05:00.073068 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-035168bf-de2f-46ca-a79f-b24ca6e806b8 req-9c831078-d56a-4d3b-97fd-b9936e394234 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058247 Aug 29 16:05:00.074301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2894/5962] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:00.080084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:00.080918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:00.104822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:00.105972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:00.106661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:00.108132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:00.129683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:00.130391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:00.295425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:00.311541 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2aa99a61-6359-4323-a0f9-66dea3b0b014 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.331494 Aug 29 16:05:00.328708 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3069/5963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:59 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:00.411461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:00.421013 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-68711c70-5b05-4484-905e-3eaee624fc74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1391 microversion: 2.1 time: 0.345320 Aug 29 16:05:00.437439 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2895/5964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:00 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1391 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:01.336242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:01.336855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:01.339431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:01.346843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.347595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.348192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.349418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.350038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.350691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.444535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:01.445782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:01.447950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:01.448612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:01.457482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.464836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.477664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.479264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.479928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.480556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.675782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:01.685187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:01.690978 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d51c7de-a1c3-4c9c-8556-64873633bfdd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.358232 Aug 29 16:05:01.705180 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3070/5965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:01 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:01.706998 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4c14e60-9870-434d-90e1-898570b0cc82 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1391 microversion: 2.1 time: 0.266540 Aug 29 16:05:01.707504 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2896/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:01 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:02.476765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e5ed79a3-b22d-49a2-8dbc-b97b32334ced req-bf5daa96-3918-4d37-9a03-4aae88e3e9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36093934-3d47-42ad-b7dc-6b8afe26536c", "name": "network-vif-plugged", "status": "completed", "tag": "a562f56d-2da4-453e-a82a-257a8f90f177"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:02.497499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e5ed79a3-b22d-49a2-8dbc-b97b32334ced req-bf5daa96-3918-4d37-9a03-4aae88e3e9f2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.503599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e5ed79a3-b22d-49a2-8dbc-b97b32334ced req-bf5daa96-3918-4d37-9a03-4aae88e3e9f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.504444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e5ed79a3-b22d-49a2-8dbc-b97b32334ced req-bf5daa96-3918-4d37-9a03-4aae88e3e9f2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.545051 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e5ed79a3-b22d-49a2-8dbc-b97b32334ced req-bf5daa96-3918-4d37-9a03-4aae88e3e9f2 service nova] Creating event network-vif-plugged:a562f56d-2da4-453e-a82a-257a8f90f177 for instance 36093934-3d47-42ad-b7dc-6b8afe26536c on n-h2-854882-3 Aug 29 16:05:02.555896 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e5ed79a3-b22d-49a2-8dbc-b97b32334ced req-bf5daa96-3918-4d37-9a03-4aae88e3e9f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084801 Aug 29 16:05:02.557671 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3071/5967] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:02.713012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:02.713796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:02.723823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.728633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.728633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.728633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.728633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.728633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.736357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:02.739586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:02.751214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.752043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.752747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.753921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.754631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.755293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:03.010078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:03.022163 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0174292f-263c-4784-b4f0-870df033cc32 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1376 microversion: 2.1 time: 0.313601 Aug 29 16:05:03.023816 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2897/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:02 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1376 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:03.047128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:03.061533 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ec09f834-2155-4a7e-a66e-a05dd1cd8524 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1564 microversion: 2.1 time: 0.330528 Aug 29 16:05:03.062263 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3072/5969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:02 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1564 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:03.082473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:03.083534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:03.089761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:03.090837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:03.091444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:03.092239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:03.094007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:03.094546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:03.418013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:03.427292 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63238d66-c81a-4687-b0eb-efb697c5cd2f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1564 microversion: 2.1 time: 0.348919 Aug 29 16:05:03.427997 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2898/5970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:03 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1564 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:04.052577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:04.054551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:04.066950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.067841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.068578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.069886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.070567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.071765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.440146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:04.453999 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df94b0e6-7885-4194-85ba-c383499d1bb6 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1563 microversion: 2.1 time: 0.409110 Aug 29 16:05:04.455694 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3073/5971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:04 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1563 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:04.476178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:04.477699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:04.485535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.486337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.487463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.488360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.489007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.489656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.867681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:04.879422 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-13773159-3324-4643-ab7e-09b54862bec0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1563 microversion: 2.1 time: 0.405843 Aug 29 16:05:04.881309 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2899/5972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:04 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1563 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:04.972969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:04.973849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:04.983349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.984087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.984726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.985676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.986361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.987261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:05.045312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:05:05.255386 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-49245757-dfdf-40df-938d-5946b0f37585 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 204 len: 0 microversion: 2.1 time: 0.286663 Aug 29 16:05:05.261997 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3074/5973] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:04 2022] DELETE /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:05:05.274507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:05.275138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:05.290427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:05.291249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:05.294508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:05.295460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:05.296107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:05.296939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:05.597099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:05.609691 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0103c579-f7c7-4df1-bf2b-7589693bddb4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1569 microversion: 2.1 time: 0.345859 Aug 29 16:05:05.614681 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2900/5974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:05 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1569 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:06.637171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:06.638062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:06.658887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:06.659104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:06.660585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:06.662476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:06.664137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:06.665533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:07.212352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:07.213264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:07.224658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:07.227353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:07.228141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:07.229152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:07.229913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:07.230391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:07.231094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:07.259889 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-28364b5c-ec1d-4ad2-acbe-caea480fde95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1569 microversion: 2.1 time: 0.627738 Aug 29 16:05:07.263039 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3075/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:06 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1569 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:07.278706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fae27ce9-d4c6-46eb-8aef-f1c538f81dd5 req-ad63b79a-0cd8-414e-867a-bb0f1849594f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:07.296121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fae27ce9-d4c6-46eb-8aef-f1c538f81dd5 req-ad63b79a-0cd8-414e-867a-bb0f1849594f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:07.297795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fae27ce9-d4c6-46eb-8aef-f1c538f81dd5 req-ad63b79a-0cd8-414e-867a-bb0f1849594f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:07.298441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fae27ce9-d4c6-46eb-8aef-f1c538f81dd5 req-ad63b79a-0cd8-414e-867a-bb0f1849594f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:07.337946 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fae27ce9-d4c6-46eb-8aef-f1c538f81dd5 req-ad63b79a-0cd8-414e-867a-bb0f1849594f service nova] Creating event network-changed:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:05:07.371086 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fae27ce9-d4c6-46eb-8aef-f1c538f81dd5 req-ad63b79a-0cd8-414e-867a-bb0f1849594f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106492 Aug 29 16:05:07.376168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3076/5976] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:07.702026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:07.713947 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c08b365-52d6-47e3-aac8-8f561a5db87f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1564 microversion: 2.1 time: 0.506731 Aug 29 16:05:07.715581 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2901/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:07 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1564 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:08.284905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:08.285650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:08.299608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:08.300220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:08.301941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:08.304445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:08.308795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:08.309566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:08.356396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:09.743227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:09.747207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1464cf72-ede7-4d74-a356-b87a7dee8b71 req-913e81e2-1f1b-4014-8ade-5d589484942c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36093934-3d47-42ad-b7dc-6b8afe26536c", "name": "network-vif-deleted", "tag": "a562f56d-2da4-453e-a82a-257a8f90f177"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:09.765724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1464cf72-ede7-4d74-a356-b87a7dee8b71 req-913e81e2-1f1b-4014-8ade-5d589484942c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:09.766306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1464cf72-ede7-4d74-a356-b87a7dee8b71 req-913e81e2-1f1b-4014-8ade-5d589484942c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:09.766827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1464cf72-ede7-4d74-a356-b87a7dee8b71 req-913e81e2-1f1b-4014-8ade-5d589484942c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:09.776472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-718bb8c2-f451-4e19-a4a0-773ebacd3d5d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1527 microversion: 2.1 time: 1.496752 Aug 29 16:05:09.789652 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3077/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:08 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1527 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:09.809562 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1464cf72-ede7-4d74-a356-b87a7dee8b71 req-913e81e2-1f1b-4014-8ade-5d589484942c service nova] Creating event network-vif-deleted:a562f56d-2da4-453e-a82a-257a8f90f177 for instance 36093934-3d47-42ad-b7dc-6b8afe26536c on n-h2-854882-3 Aug 29 16:05:09.821155 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1464cf72-ede7-4d74-a356-b87a7dee8b71 req-913e81e2-1f1b-4014-8ade-5d589484942c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082387 Aug 29 16:05:09.825716 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2902/5979] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:10.806319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:10.812897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:10.837289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:10.837786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:10.838255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:10.839008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:10.839528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:10.839919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:11.012028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:11.038888 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fbbd6a25-3bdb-4772-b8d3-325046b8f5cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1361 microversion: 2.1 time: 0.238812 Aug 29 16:05:11.045984 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3078/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:10 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:12.005906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1844182219", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "575ca104-9569-45ac-8491-e8bb85218829"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:12.066108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:12.066774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:12.080500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:12.081054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:12.082825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:12.083619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:12.084110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:12.088071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:12.125707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] validate_networks() for [('575ca104-9569-45ac-8491-e8bb85218829', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:05:12.235727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:12.248926 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af64a97e-5375-48fc-a842-6b8cacf478bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1361 microversion: 2.1 time: 0.187188 Aug 29 16:05:12.250161 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3079/5981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:12 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:12.647790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:05:12.648217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:05:12.648693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:05:12.649108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:05:12.649549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:05:12.663730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:12.664216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:12.664651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:12.665586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:12.666226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:12.666822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:12.685990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Getting quotas for project 8df11b687fb547f1b9fbfa1850faae8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:05:12.691736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Getting quotas for user f3e97edd3e10433ca84d2a6206c1c521 and project 8df11b687fb547f1b9fbfa1850faae8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:05:12.707341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:05:12.709796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:05:12.761543 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a65d03d2-7889-41bf-a493-ff40bca77811 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760399 Aug 29 16:05:12.762633 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2903/5982] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:05:12.774698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-abdbf206-a91b-423b-a7c1-7da95f1a77cf tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:12.775442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-abdbf206-a91b-423b-a7c1-7da95f1a77cf tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:12.866586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-abdbf206-a91b-423b-a7c1-7da95f1a77cf tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:12.883488 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-abdbf206-a91b-423b-a7c1-7da95f1a77cf tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1219 microversion: 2.1 time: 0.113239 Aug 29 16:05:12.884578 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3080/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:12 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:13.271873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:13.273623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:13.284393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:13.285138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:13.285599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:13.286501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:13.287122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:13.287624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:13.412033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:13.425929 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ff7b284-04ec-400a-9877-c4148707e046 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1361 microversion: 2.1 time: 0.158661 Aug 29 16:05:13.429679 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2904/5984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:13 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:13.906566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:13.907914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:13.916523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:13.917124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:13.917836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:13.918752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:13.919363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:13.920024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:14.010058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:14.019155 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8998cb99-6102-42c2-aa94-409c0362de94 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1271 microversion: 2.1 time: 0.118878 Aug 29 16:05:14.019756 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3081/5985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:13 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:14.452932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:14.454394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:14.473555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:14.474054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:14.474491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:14.475199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:14.475654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:14.476078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:14.574188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:14.584461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6623a3c7-0cf4-4220-a58f-343e73bae3c7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1361 microversion: 2.1 time: 0.138280 Aug 29 16:05:14.599457 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2905/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:14 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:15.041510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:15.042745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:15.057799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:15.059594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:15.060212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:15.063511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:15.064146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:15.066075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:15.402269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:15.412870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c0b5fb67-a290-46b2-92be-9789a2002035 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1319 microversion: 2.1 time: 0.376461 Aug 29 16:05:15.426883 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3082/5987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:15 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:15.608347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:15.609567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:15.616298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:15.616777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:15.617207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:15.617929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:15.618372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:15.618788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:15.623056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:15.673651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:15.674282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:15.674797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:15.675351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lazy-loading 'fault' on Instance uuid 36093934-3d47-42ad-b7dc-6b8afe26536c {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:05:15.720557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:15.728536 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6ba5d265-8670-4dec-b166-8e516066f607 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 200 len: 1366 microversion: 2.1 time: 0.125705 Aug 29 16:05:15.729450 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2906/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:15 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:15.785266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-553b1854-b9c8-4d13-addc-0f28886a4f10 req-4aef5301-fec0-4bbe-8f27-3b4b5baafb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad85f450-149c-4160-8eb8-dc19e17e2638", "tag": "8a5dd405-1010-43f8-b99d-f599eca3a14f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:15.819122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-553b1854-b9c8-4d13-addc-0f28886a4f10 req-4aef5301-fec0-4bbe-8f27-3b4b5baafb89 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:15.819666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-553b1854-b9c8-4d13-addc-0f28886a4f10 req-4aef5301-fec0-4bbe-8f27-3b4b5baafb89 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:15.820192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-553b1854-b9c8-4d13-addc-0f28886a4f10 req-4aef5301-fec0-4bbe-8f27-3b4b5baafb89 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:15.842446 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-553b1854-b9c8-4d13-addc-0f28886a4f10 req-4aef5301-fec0-4bbe-8f27-3b4b5baafb89 service nova] Creating event network-changed:8a5dd405-1010-43f8-b99d-f599eca3a14f for instance ad85f450-149c-4160-8eb8-dc19e17e2638 on n-h1-854882-3 Aug 29 16:05:15.849035 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-553b1854-b9c8-4d13-addc-0f28886a4f10 req-4aef5301-fec0-4bbe-8f27-3b4b5baafb89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070491 Aug 29 16:05:15.850279 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3083/5989] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:16.438221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:16.439105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:16.448646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:16.449598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:16.450367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:16.451366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:16.454484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:16.455921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:16.641857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:16.651458 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9883a404-01a3-4f04-ad07-0636b7e310b5 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1319 microversion: 2.1 time: 0.219223 Aug 29 16:05:16.652581 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2907/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:16 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:16.754657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:16.755400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:16.762146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:16.762667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:16.763124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:16.764060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:16.764697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:16.765348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:16.781128 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c HTTP/1.1 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '36093934-3d47-42ad-b7dc-6b8afe26536c'} Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:16.789583 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:16.793962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:16.793962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:16.793962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:16.793962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:16.793962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:16.793962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:16.793962 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:16.795411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:16.797108 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a12f3dc1-5d41-4e80-915c-d46c77cc5e9e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 404 len: 111 microversion: 2.1 time: 0.047712 Aug 29 16:05:16.798207 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3084/5991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:16 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:17.677650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:17.679646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:17.691821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:17.693353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:17.694026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:17.694940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:17.695608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:17.696226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:17.885011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:17.894874 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-023892c0-f1aa-4687-9ce2-95092ef12117 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1319 microversion: 2.1 time: 0.224321 Aug 29 16:05:17.897013 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2908/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:17 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:18.920241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:18.922094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:18.932238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:18.932917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:18.933621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:18.934570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:18.935196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:18.935798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:19.142806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:19.154921 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7cfb56bd-f780-45fc-b572-754727416394 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1319 microversion: 2.1 time: 0.239161 Aug 29 16:05:19.157010 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3085/5993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:18 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:20.030363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9b8300cf-3e80-452b-9c99-6a444560b4a0 req-4cd91ca4-8567-4fed-9474-b7d6c6b4e932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad85f450-149c-4160-8eb8-dc19e17e2638", "name": "network-vif-plugged", "status": "completed", "tag": "8a5dd405-1010-43f8-b99d-f599eca3a14f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:20.054786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9b8300cf-3e80-452b-9c99-6a444560b4a0 req-4cd91ca4-8567-4fed-9474-b7d6c6b4e932 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:20.055650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9b8300cf-3e80-452b-9c99-6a444560b4a0 req-4cd91ca4-8567-4fed-9474-b7d6c6b4e932 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:20.056252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9b8300cf-3e80-452b-9c99-6a444560b4a0 req-4cd91ca4-8567-4fed-9474-b7d6c6b4e932 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:20.094776 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9b8300cf-3e80-452b-9c99-6a444560b4a0 req-4cd91ca4-8567-4fed-9474-b7d6c6b4e932 service nova] Creating event network-vif-plugged:8a5dd405-1010-43f8-b99d-f599eca3a14f for instance ad85f450-149c-4160-8eb8-dc19e17e2638 on n-h1-854882-3 Aug 29 16:05:20.107812 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9b8300cf-3e80-452b-9c99-6a444560b4a0 req-4cd91ca4-8567-4fed-9474-b7d6c6b4e932 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081357 Aug 29 16:05:20.115683 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2909/5994] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:20.182075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:20.183928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:20.216118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:20.216989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:20.218369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:20.219357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:20.220191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:20.220793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:20.435403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:20.448274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc919b6d-5ad1-417f-9633-a57aba101e00 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1319 microversion: 2.1 time: 0.272013 Aug 29 16:05:20.449570 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3086/5995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:20 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:21.472853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:21.472853 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:21.474618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:21.480728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:21.481654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:21.482245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:21.483124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:21.483779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:21.484356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:21.660638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:21.668501 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4abb36a3-4f3e-4b78-a82f-60de3c49b289 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1319 microversion: 2.1 time: 0.202271 Aug 29 16:05:21.681864 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2910/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:21 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:22.692976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:22.694297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:22.704726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:22.716262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:22.719571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:22.719933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:22.722354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:22.722920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:22.723430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:22.871315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:22.904053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:22.914012 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f5e6c719-682e-45d5-96a1-2e48d18128c9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1507 microversion: 2.1 time: 0.225523 Aug 29 16:05:22.915020 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3087/5997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:22 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:23.369379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:23.369947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:23.373159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:23.373904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:23.382395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:23.383279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:23.384094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:23.384993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:23.386203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:23.386822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:23.425240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:05:23.567030 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fac1d0f9-5a17-4814-ae83-2a22e21ac5ad tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 204 len: 0 microversion: 2.1 time: 0.187966 Aug 29 16:05:23.570039 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2911/5998] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:23 2022] DELETE /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:05:23.585923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:23.590350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:23.598649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:23.599392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:23.600015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:23.600902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:23.601569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:23.602173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:23.772734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:23.780809 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-36dc55df-b6ac-4fee-80d7-afc4ee608e21 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1409 microversion: 2.1 time: 0.206726 Aug 29 16:05:23.781409 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3088/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:23 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1409 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:24.801367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:24.802093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:24.810186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:24.810963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:24.811387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:24.813632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:24.816356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:24.816781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:24.982768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:24.991891 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2d2dc4d4-86a6-4888-ab59-1c9b8cb8ba16 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1409 microversion: 2.1 time: 0.194878 Aug 29 16:05:25.005453 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2912/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:24 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:25.914035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fe7527e4-c0ed-499e-b6eb-98c18949661f req-410a9e35-c1a9-4516-9069-776f22ef20b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39", "name": "network-vif-deleted", "tag": "217fb874-fce5-4d09-8652-376c2e4b37e6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:25.940884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe7527e4-c0ed-499e-b6eb-98c18949661f req-410a9e35-c1a9-4516-9069-776f22ef20b0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:25.942466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe7527e4-c0ed-499e-b6eb-98c18949661f req-410a9e35-c1a9-4516-9069-776f22ef20b0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:25.942993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fe7527e4-c0ed-499e-b6eb-98c18949661f req-410a9e35-c1a9-4516-9069-776f22ef20b0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:25.975831 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fe7527e4-c0ed-499e-b6eb-98c18949661f req-410a9e35-c1a9-4516-9069-776f22ef20b0 service nova] Creating event network-vif-deleted:217fb874-fce5-4d09-8652-376c2e4b37e6 for instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 on n-h1-854882-3 Aug 29 16:05:25.981894 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fe7527e4-c0ed-499e-b6eb-98c18949661f req-410a9e35-c1a9-4516-9069-776f22ef20b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073771 Aug 29 16:05:25.983015 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3089/6001] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:26.019818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:26.020453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:26.032284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:26.032783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:26.033225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:26.034292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:26.038888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:26.041998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:26.146268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:26.158797 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2fa96574-382f-41cc-998c-cc5116042b34 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1201 microversion: 2.1 time: 0.143003 Aug 29 16:05:26.161087 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2913/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:26 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1201 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:26.430782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:26.455014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:26.468833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:26.469356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:26.476444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:26.477285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:26.477804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:26.478788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:26.576216 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-91fb66e5-7249-428b-a81a-c69f7bfc5fcb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action" status: 200 len: 24571 microversion: 2.1 time: 0.162914 Aug 29 16:05:26.578946 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3090/6003] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:26 2022] POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action => generated 24571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:05:27.180758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:27.182126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:27.197011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:27.197907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:27.198540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:27.199441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:27.202521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:27.203053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:27.328706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:27.337436 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d316e9c1-f600-4510-a435-9c748d2eb266 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1201 microversion: 2.1 time: 0.161160 Aug 29 16:05:27.338669 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2914/6004] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:27 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1201 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:28.360250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:28.363863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:28.371100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:28.371525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:28.371991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:28.379203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:28.379693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:28.380157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:28.518557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:28.534282 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2aaca35e-0e01-4d9e-a060-dd7a26da47cc tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1201 microversion: 2.1 time: 0.178602 Aug 29 16:05:28.535499 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3091/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:28 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1201 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:29.555027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:29.555641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:29.573944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:29.576072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:29.577950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:29.581084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:29.582325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:29.583519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:29.711179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:29.737563 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2aa38c72-f462-4e94-ae08-850803fd623d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1201 microversion: 2.1 time: 0.186498 Aug 29 16:05:29.739983 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2915/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:29 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1201 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:30.760901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:30.762326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:30.771017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:30.772537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:30.773441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:30.774854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:30.775592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:30.776588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:30.864905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:30.875925 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-79534a13-adbe-4394-9434-61ec95222024 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1201 microversion: 2.1 time: 0.119274 Aug 29 16:05:30.876902 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3092/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:30 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1201 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:31.896418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:31.897629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:31.907430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.908016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.908332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:31.922119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.924093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.927356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:32.038773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:32.039267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:32.042711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:32.043180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lazy-loading 'fault' on Instance uuid f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:05:32.153409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:32.163185 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bdbfdbe9-1368-4207-8456-e97d798fa5d5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 200 len: 1160 microversion: 2.1 time: 0.269959 Aug 29 16:05:32.164603 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2916/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:31 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 1160 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:33.192476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:33.193320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:33.212865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:33.213826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:33.214366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:33.218839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:33.219605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:33.220696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:33.259056 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 HTTP/1.1 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39'} Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:33.268934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:33.282729 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:33.282729 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:33.282729 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:33.282729 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:33.282729 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:33.282729 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:33.282729 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:33.283153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:33.283694 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b430414-a60c-4c70-949c-d290ee2afe92 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 404 len: 111 microversion: 2.1 time: 0.101120 Aug 29 16:05:33.284530 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3093/6009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:33 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:35.459020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:35.460140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:35.469877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.470738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.471637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.472583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.473254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.474006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.490697 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c HTTP/1.1 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '36093934-3d47-42ad-b7dc-6b8afe26536c'} Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:35.493423 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.497727 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.500592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:35.503442 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-07a006fe-3239-468f-b198-90de5b211173 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 404 len: 111 microversion: 2.1 time: 0.047582 Aug 29 16:05:35.504485 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2917/6010] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:35 2022] DELETE /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:35.516319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:35.517880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 36093934-3d47-42ad-b7dc-6b8afe26536c] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:35.531354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.531842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.532359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.533099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.533605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.534048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.588330 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c HTTP/1.1 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '36093934-3d47-42ad-b7dc-6b8afe26536c'} Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:35.590199 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 36093934-3d47-42ad-b7dc-6b8afe26536c could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-48d783ad-db9e-453c-b23c-38fdcb63556e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c" status: 404 len: 111 microversion: 2.1 time: 0.082705 Aug 29 16:05:35.596015 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3094/6011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:35 2022] GET /compute/v2.1/servers/36093934-3d47-42ad-b7dc-6b8afe26536c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:36.487630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:36.488868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:36.513542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.514093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:36.515244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:36.516591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.517553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:36.518446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:36.538092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 HTTP/1.1 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39'} Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:36.539697 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-edfca796-968a-43c6-9ec2-20f7c52f0937 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 404 len: 111 microversion: 2.1 time: 0.059063 Aug 29 16:05:36.543713 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2918/6012] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:36 2022] DELETE /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:36.551354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:36.552008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:36.562094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.562882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:36.563566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:36.564764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.565864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:36.566480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:36.599692 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 HTTP/1.1 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39'} Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:36.603436 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:36.608767 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-288f79ac-5ec7-4c36-b242-db9b4635669c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39" status: 404 len: 111 microversion: 2.1 time: 0.059940 Aug 29 16:05:36.619586 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3095/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:36 2022] GET /compute/v2.1/servers/f9e3ba5c-7edd-47d0-a792-d7ad0a5bfd39 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:36.702458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bc529245-7459-4c23-8ce7-41003d350a00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: .version_select at 0x7fb0e1fbba60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-95118366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwy0EhSJxSxCVrUAFPpSPumeOp/3pbO2ILzuf1N+9pwNwevg8OBcYyiLZsurmz9QP6mCwdqpav13eZnxGL2X6I6V68T7T3vZ1OL7rEiEcxHzbEdZHYkCWSu1AE9USA3zg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:36.728358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bc529245-7459-4c23-8ce7-41003d350a00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:05:36.749808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-bc529245-7459-4c23-8ce7-41003d350a00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:05:36.787362 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bc529245-7459-4c23-8ce7-41003d350a00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.089153 Aug 29 16:05:36.788680 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2919/6014] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:05:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:37.428319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:37.429493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:37.438549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.439249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.439875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.441109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.442624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.444024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.833993 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d08834e5-7a0b-4b9c-bea6-7c931400f56c tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1833 microversion: 2.1 time: 0.409390 Aug 29 16:05:37.837697 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3096/6015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:37 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1833 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:37.855327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:37.856032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:37.866761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.869926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.870642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.871568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.876047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.877962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.112760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:38.127128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-44c55b0e-eea1-4299-8ad6-dd12d65cf2f9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1682 microversion: 2.1 time: 0.275574 Aug 29 16:05:38.128041 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2920/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:37 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1682 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:38.280814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:38.283724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:38.292917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.293702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.294398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.295725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.297307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.298221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.361972 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-683673fb-e538-49cc-9519-2d8d2456ca64 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action" status: 200 len: 32641 microversion: 2.1 time: 0.086654 Aug 29 16:05:38.363267 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3097/6017] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:38 2022] POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action => generated 32641 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:05:38.520892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:38.521477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:38.527984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.536267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.537017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.538943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.540265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.542249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.619874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a2100452cd4444db9467899791cd745c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72278a148b104eb88fee0e2384fc83b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:38.620499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] flavor_id is None. Assuming migration. {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 16:05:38.620942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:05:39.017147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:39.077174 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e0408de-3e99-490b-b69a-5c4853a56221 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action" status: 202 len: 0 microversion: 2.1 time: 0.559420 Aug 29 16:05:39.078162 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2921/6018] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:38 2022] POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:05:39.088469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:39.090377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:39.110599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:39.111367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:39.113141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:39.115524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:39.117305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:39.118660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:39.133958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=90 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:39.454359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:39.464950 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4e4deff-cf01-47d2-8dc5-17bc73a3b8cb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1691 microversion: 2.1 time: 0.382408 Aug 29 16:05:39.470044 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3098/6019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:39 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1691 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:40.116634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1742115159", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:40.495042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] validate_networks() for None {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:05:40.496251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:40.507913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:40.521434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.522236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.523954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.524862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.526919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.530668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.840686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:40.850367 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-44800162-7eaf-4e55-a74b-4d3edd739c83 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1691 microversion: 2.1 time: 0.361803 Aug 29 16:05:40.850961 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3099/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:40 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1691 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:40.854856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:05:40.855568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:05:40.856362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:05:40.856981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:05:40.857524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:05:40.873769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.874015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.874655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.876293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.877049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.878269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.909622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Getting quotas for project 1e7d5ef767224e8fb02c48708db23238. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:05:40.916384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Getting quotas for user f75ae7a10ac14e0fb2b79127f39db44f and project 1e7d5ef767224e8fb02c48708db23238. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:05:40.934349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:05:40.939174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:05:41.033666 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac8ec32a-8f52-43c2-86c4-da870da26a9a tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922397 Aug 29 16:05:41.034610 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2922/6021] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:05:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:05:41.046687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa7029f2-bc48-4e31-b14e-f8f43b7f23af tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:41.047193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa7029f2-bc48-4e31-b14e-f8f43b7f23af tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:41.137075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa7029f2-bc48-4e31-b14e-f8f43b7f23af tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:41.146389 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa7029f2-bc48-4e31-b14e-f8f43b7f23af tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1214 microversion: 2.1 time: 0.105122 Aug 29 16:05:41.147844 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3100/6022] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:41 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:41.876011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:41.877345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:41.918869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.925188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.926137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.928481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.930801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.931397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:42.149133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:42.168404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:42.169044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:42.170071 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b2c7fc81-d81f-4f4d-99ae-befe6b63f2b4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1691 microversion: 2.1 time: 0.299927 Aug 29 16:05:42.173980 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2923/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:41 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:42.208877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:42.210775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:42.212778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:42.214144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:42.216250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:42.216896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:42.399005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:42.410180 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa851089-9cf2-4cb1-932d-6515f67557aa tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1210 microversion: 2.1 time: 0.245942 Aug 29 16:05:42.411345 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3101/6024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:42 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1210 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:43.200315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:43.201175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:43.225790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.231026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.231902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.235263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.236405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.239662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.427421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:43.437068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:43.437996 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d52c14c1-87b4-4625-8658-cd34cd3ee35f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.242916 Aug 29 16:05:43.440128 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2924/6025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:43 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:43.446400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:43.482966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.484059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.484714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.486170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.487022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.487476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.632486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:43.644156 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2fbceede-b8f7-4207-a1d1-99439d317fc9 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1272 microversion: 2.1 time: 0.215217 Aug 29 16:05:43.657821 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3102/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:43 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:44.461633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:44.462949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:44.476153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:44.476664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:44.477103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:44.477851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:44.478457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:44.479039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:44.667607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:44.669528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:44.693531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:44.696767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:44.703634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d16cd3d5-74cb-40e7-ba1c-6e635960621d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.246357 Aug 29 16:05:44.704579 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2925/6027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:44 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:44.710347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:44.710896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:44.711793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:44.712379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:44.712904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.039256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:45.048691 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5bd172f-5464-4e16-9d6d-07125d735c1d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.386738 Aug 29 16:05:45.050201 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3103/6028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:44 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:45.677470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b0596f6a-ecb3-4ac4-a64d-9833083542ce req-749bffdd-a1ea-4b20-819c-d3c2aea489f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727ddf91-212b-441e-a5a6-a8c993c89263", "tag": "2475d671-114e-4200-99bb-68844017d49a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:45.694988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b0596f6a-ecb3-4ac4-a64d-9833083542ce req-749bffdd-a1ea-4b20-819c-d3c2aea489f6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:45.704295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b0596f6a-ecb3-4ac4-a64d-9833083542ce req-749bffdd-a1ea-4b20-819c-d3c2aea489f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:45.705070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b0596f6a-ecb3-4ac4-a64d-9833083542ce req-749bffdd-a1ea-4b20-819c-d3c2aea489f6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.724767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:45.725540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:45.742912 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b0596f6a-ecb3-4ac4-a64d-9833083542ce req-749bffdd-a1ea-4b20-819c-d3c2aea489f6 service nova] Creating event network-changed:2475d671-114e-4200-99bb-68844017d49a for instance 727ddf91-212b-441e-a5a6-a8c993c89263 on n-h2-854882-3 Aug 29 16:05:45.743630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:45.744256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:45.744806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.749175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:45.749882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:45.750440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.763819 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b0596f6a-ecb3-4ac4-a64d-9833083542ce req-749bffdd-a1ea-4b20-819c-d3c2aea489f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090074 Aug 29 16:05:45.765349 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2926/6029] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:46.071159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:46.071441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:46.072413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:46.082007 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef865740-5148-4e93-a78c-a099205d88a9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.359269 Aug 29 16:05:46.086080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:46.088420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:46.090226 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3104/6030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:45 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:46.090921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:46.092509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:46.094387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:46.094965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:46.411407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:46.422821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-229c4f4f-2327-495c-b632-5e83c08689bc tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.355790 Aug 29 16:05:46.426282 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2927/6031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:46 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:47.110677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:47.111322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:47.121281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.122133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.122981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.123819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.124822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.125603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.399836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:47.417134 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-28d7d97b-f8b6-42ba-8617-a217a1208606 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.310278 Aug 29 16:05:47.419254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3105/6032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:47 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:47.444799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:47.445593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:47.465062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.465597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.466048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.466825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.467336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.468028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.649256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:47.670111 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b61acd89-f8eb-41cc-a1b1-89e8b7a2e3d0 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.229723 Aug 29 16:05:47.674862 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2928/6033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:47 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:48.441907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:48.442547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:48.450206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:48.450722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:48.451180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:48.451947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:48.452421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:48.452866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:48.615747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:48.625952 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-29ee3639-1e90-4253-bdf7-d136685e3ac5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.188002 Aug 29 16:05:48.626789 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3106/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:48 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:48.694729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:48.695365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:48.703173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:48.703651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:48.704111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:48.704972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:48.705551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:48.705986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:48.874211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:48.882552 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ff6ee3d-19f1-47eb-b264-29de8c3c1531 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.192779 Aug 29 16:05:48.883257 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2929/6035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:48 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:49.648388 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:49.648947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:49.657717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.669663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.671005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.671616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.672101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.672550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.748988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ace6813-ba9b-44c5-ae71-0a7f00156f04", "device": "/dev/sdb"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:49.751564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:49.768330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.769000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.770353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.771479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.772087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.772912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.857774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:49.866846 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ce6df97-1aca-4d46-a6d1-dcf554524b61 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.222363 Aug 29 16:05:49.881078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3107/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:49 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:49.906309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:49.906870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:49.915506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.916521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.917429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.918572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.919395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.920024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.135432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:50.136581 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-87b8dce8-7bf6-43c5-8bc2-5d8689d52c12 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "POST /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391080 Aug 29 16:05:50.142773 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2930/6037] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:05:49 2022] POST /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:50.153677 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cb2f428e-eebc-4da4-b590-dc681bed2560 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.253424 Aug 29 16:05:50.170108 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3108/6038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:49 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:50.888564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:50.889329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:50.901890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:50.908010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.908499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.908933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.909662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.910108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.910521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.941846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:51.095336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:51.107796 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3b363aca-451c-48d1-9520-8bcb49bdfcab tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.223189 Aug 29 16:05:51.108769 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2931/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:50 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:51.177912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:51.178998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:51.185469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:51.188859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:51.189587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:51.190202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.191085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:51.191715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:51.192313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.386753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:51.395468 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff62150f-9aed-41ae-8f14-7569cbac7dc6 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.222451 Aug 29 16:05:51.409352 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3109/6040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:51 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:52.130514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:52.132009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:52.140284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:52.143394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.144259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.144718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.146094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.147116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.147995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.334410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:52.345516 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4cc4227d-79e6-4ee2-8f9f-4dce653a1595 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.218781 Aug 29 16:05:52.357749 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2932/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:52 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:52.416099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:52.417446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:52.432305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.433260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.434408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.437194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.439091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.439618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.611585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9e820dbb-38ff-4cbd-ac51-5180185178fa req-e6a0a59e-667c-4c66-abeb-5bd240996b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727ddf91-212b-441e-a5a6-a8c993c89263", "name": "network-vif-plugged", "status": "completed", "tag": "2475d671-114e-4200-99bb-68844017d49a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:52.669811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e820dbb-38ff-4cbd-ac51-5180185178fa req-e6a0a59e-667c-4c66-abeb-5bd240996b23 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.671357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e820dbb-38ff-4cbd-ac51-5180185178fa req-e6a0a59e-667c-4c66-abeb-5bd240996b23 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.672548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9e820dbb-38ff-4cbd-ac51-5180185178fa req-e6a0a59e-667c-4c66-abeb-5bd240996b23 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.689636 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9e820dbb-38ff-4cbd-ac51-5180185178fa req-e6a0a59e-667c-4c66-abeb-5bd240996b23 service nova] Creating event network-vif-plugged:2475d671-114e-4200-99bb-68844017d49a for instance 727ddf91-212b-441e-a5a6-a8c993c89263 on n-h2-854882-3 Aug 29 16:05:52.696780 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9e820dbb-38ff-4cbd-ac51-5180185178fa req-e6a0a59e-667c-4c66-abeb-5bd240996b23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091052 Aug 29 16:05:52.698813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2933/6042] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:52.713130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:52.740747 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d92dc69a-306d-4ac9-aaf6-77db281f8d56 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.328234 Aug 29 16:05:52.741377 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3110/6043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:52 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:53.367660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:53.368367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:53.384013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.384752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.385407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.386321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.386937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.387370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.575727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:53.585979 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5dc3b504-ff40-4eb6-8639-1b4f830f39f5 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.222519 Aug 29 16:05:53.587069 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2934/6044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:53 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:53.764182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:53.765912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:53.772140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=50 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:53.780275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.781362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.782502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.783705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.785008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.785972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.012767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:54.025671 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-edacd58d-706d-4b7c-b0dc-b2b91eb3a7f2 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1314 microversion: 2.1 time: 0.266605 Aug 29 16:05:54.037175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3111/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:53 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:54.610110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:54.611370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:54.628083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.628775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.629413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.630304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.630913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.631496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.816220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:54.825608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b615960a-05c1-4e4c-bc74-67c2a0334c48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.219551 Aug 29 16:05:54.827405 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2935/6046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:54 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:55.047384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:55.048567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:55.056302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.056928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.057399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.058136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.058610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.059054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.231046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:55.240636 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a03fb55e-df04-4f48-87f7-25bb970489f7 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1464 microversion: 2.1 time: 0.197417 Aug 29 16:05:55.241334 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3112/6047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:55 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:55.261842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ee326a6-9daf-4e4f-8540-088ba7049424", "device": "/dev/sdb"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:55.264582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:55.272042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.272755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.273438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.274383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.275007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.275625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.653962 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3bb84929-2e19-4387-9ef8-4dd50c9cd419 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "POST /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396008 Aug 29 16:05:55.656355 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2936/6048] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:05:55 2022] POST /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:55.848665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:55.849781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:55.857005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.857710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.858575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.859697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.860517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.861272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.074640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:56.085059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-701c8750-a20f-43e3-a1e2-bf6f05b77a05 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.240096 Aug 29 16:05:56.086112 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3113/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:55 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:57.108978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:57.110545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:57.120513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.121260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.121898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:57.124704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.125181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.125647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:57.292130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:57.294494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:57.304198 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7eced88c-7a15-48df-a8de-bda2380509c3 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.200625 Aug 29 16:05:57.305800 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2937/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:57 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:58.326684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:58.327604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:58.335641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:58.336439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:58.336937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:58.338103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:58.338597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:58.339052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:58.493433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:58.504212 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bd6af5f5-005d-4ca9-a346-6aad484236fb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1696 microversion: 2.1 time: 0.181176 Aug 29 16:05:58.505419 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3114/6051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:58 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:59.526583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:59.527195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:59.536958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.538691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.540214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.542161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.543151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.544026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.769592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:59.784225 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-78ead786-8929-403b-a430-ca91ef0a139b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1695 microversion: 2.1 time: 0.261120 Aug 29 16:05:59.785440 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2938/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:59 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1695 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:59.808324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0cade87c-8fa7-47fa-b8aa-f02f1d9fd071 req-ba8ec4f1-0db2-4233-8f91-29b5703b6a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "name": "network-vif-unplugged", "status": "completed", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:59.822606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0cade87c-8fa7-47fa-b8aa-f02f1d9fd071 req-ba8ec4f1-0db2-4233-8f91-29b5703b6a5e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.823539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0cade87c-8fa7-47fa-b8aa-f02f1d9fd071 req-ba8ec4f1-0db2-4233-8f91-29b5703b6a5e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.824555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0cade87c-8fa7-47fa-b8aa-f02f1d9fd071 req-ba8ec4f1-0db2-4233-8f91-29b5703b6a5e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.845112 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0cade87c-8fa7-47fa-b8aa-f02f1d9fd071 req-ba8ec4f1-0db2-4233-8f91-29b5703b6a5e service nova] Creating event network-vif-unplugged:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h2-854882-3 Aug 29 16:05:59.853938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-0cade87c-8fa7-47fa-b8aa-f02f1d9fd071 req-ba8ec4f1-0db2-4233-8f91-29b5703b6a5e service nova] Instance 4da8ce59-6edd-4618-b424-20858338cad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:05:59.870616 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0cade87c-8fa7-47fa-b8aa-f02f1d9fd071 req-ba8ec4f1-0db2-4233-8f91-29b5703b6a5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070472 Aug 29 16:05:59.871578 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3115/6053] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:00.809896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:00.811459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:00.818471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:00.819048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:00.819720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:00.821028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:00.821737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:00.822438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:01.088637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:01.097892 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-69b6a543-8830-45c7-840f-08a7cdda7127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1695 microversion: 2.1 time: 0.292001 Aug 29 16:06:01.098469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2939/6054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:00 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1695 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:01.914251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-491ef9aa-f939-465b-8905-dc4396bf57a5 req-c5ed662d-b6e4-4f30-b9ca-f45a522f89a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:01.924616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-491ef9aa-f939-465b-8905-dc4396bf57a5 req-c5ed662d-b6e4-4f30-b9ca-f45a522f89a9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:01.925612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-491ef9aa-f939-465b-8905-dc4396bf57a5 req-c5ed662d-b6e4-4f30-b9ca-f45a522f89a9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:01.926156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-491ef9aa-f939-465b-8905-dc4396bf57a5 req-c5ed662d-b6e4-4f30-b9ca-f45a522f89a9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:01.929811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:01.942943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-491ef9aa-f939-465b-8905-dc4396bf57a5 req-c5ed662d-b6e4-4f30-b9ca-f45a522f89a9 service nova] Creating event network-changed:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h2-854882-3 Aug 29 16:06:01.949940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-491ef9aa-f939-465b-8905-dc4396bf57a5 req-c5ed662d-b6e4-4f30-b9ca-f45a522f89a9 service nova] Instance 4da8ce59-6edd-4618-b424-20858338cad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:06:01.961486 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-491ef9aa-f939-465b-8905-dc4396bf57a5 req-c5ed662d-b6e4-4f30-b9ca-f45a522f89a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052179 Aug 29 16:06:01.962168 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3116/6055] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:02.032941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-773669316", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-95118366", "security_groups": [{"name": "tempest-secgroup-smoke-663029004"}], "block_device_mapping_v2": [{"uuid": "a09a0aba-33e5-4574-b796-aa54899a53eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:02.125334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:02.130564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:02.147783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.149850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.150556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.155429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.158154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.159489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.231047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:06:02.538234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:02.552644 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-716c77f5-757c-4747-aad9-be549925ffbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1693 microversion: 2.1 time: 0.436065 Aug 29 16:06:02.554376 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3117/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:02 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1693 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:02.815646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:06:02.816077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:06:02.816715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:06:02.817137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:06:02.817586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:06:02.829169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.830079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.830758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.831737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.832475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.833143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.862177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:02.871265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:02.949758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:06:02.952385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a09a0aba-33e5-4574-b796-aa54899a53eb',volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:06:03.165503 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7d859220-bdc6-4bd8-919e-8d56bd5c97b3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.133527 Aug 29 16:06:03.168921 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2940/6057] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:06:03.178009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a21aa3a8-4df7-440f-86e7-0c333f796049 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:03.187159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a21aa3a8-4df7-440f-86e7-0c333f796049 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:03.263195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a21aa3a8-4df7-440f-86e7-0c333f796049 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:03.275077 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a21aa3a8-4df7-440f-86e7-0c333f796049 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1092 microversion: 2.1 time: 0.100884 Aug 29 16:06:03.290264 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3118/6058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:03 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1092 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:03.577784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:03.580017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:03.602195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.602817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.603362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:03.604199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.604730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.605233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:03.817118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:03.827288 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-02837a60-78a5-428c-8190-2bc3a6b31732 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1690 microversion: 2.1 time: 0.254319 Aug 29 16:06:03.828147 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2941/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:03 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:03.849656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:03.850216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:03.858080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.858598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.859443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:03.860307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.860793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.861247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.018705 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6ed20f19-d003-4cba-95da-51be4107e82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action" status: 202 len: 0 microversion: 2.1 time: 0.173753 Aug 29 16:06:04.020078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3119/6060] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:06:03 2022] POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:06:04.028563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:04.029605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:04.041323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.043514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.045349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.048474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.049185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.052415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.300607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:04.301188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:04.302420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:04.309828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.310688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.311860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.312747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.313380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.314009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.316322 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-326715e9-6934-4401-9365-c0853de9d12e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.292104 Aug 29 16:06:04.316950 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2942/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:04 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:04.630454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:04.640883 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a7cbf6b1-b84d-41da-a3b7-13fd3a32a60f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1190 microversion: 2.1 time: 0.346417 Aug 29 16:06:04.641909 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3120/6062] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:04 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1190 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:05.337612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:05.338908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:05.355074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:05.355825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:05.356673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:05.357645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:05.358971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:05.359567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:05.582615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:05.592116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-29fb21ae-8080-444d-828f-4e9c241d4cbb tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.257584 Aug 29 16:06:05.593882 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2943/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:05 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:05.663042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:05.663837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:05.676108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:05.676623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:05.677079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:05.677838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:05.678310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:05.678977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:05.780232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:05.788854 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-548f54ae-0eb9-42d6-b624-aabc8e5ec186 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1208 microversion: 2.1 time: 0.130787 Aug 29 16:06:05.790095 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3121/6064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:05 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1208 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:06.619741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:06.622102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:06.646540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.648428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.649072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.650027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.650652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.651106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.811095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:06.811742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:06.827243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.827759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.828219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.828968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.829511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.829958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.865981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:06.876673 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-18dffab7-1270-46e9-8a0b-5ae3cdd1bee8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.262363 Aug 29 16:06:06.877993 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2944/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:06 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:06.934465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-91b4df3b-e6b6-4d45-ba65-9e82adfb0848 req-d9e83b22-7381-4a33-b71d-67affdbc0fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "name": "network-vif-plugged", "status": "completed", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:06.950823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91b4df3b-e6b6-4d45-ba65-9e82adfb0848 req-d9e83b22-7381-4a33-b71d-67affdbc0fdc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.952337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91b4df3b-e6b6-4d45-ba65-9e82adfb0848 req-d9e83b22-7381-4a33-b71d-67affdbc0fdc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.953548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-91b4df3b-e6b6-4d45-ba65-9e82adfb0848 req-d9e83b22-7381-4a33-b71d-67affdbc0fdc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.970228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-91b4df3b-e6b6-4d45-ba65-9e82adfb0848 req-d9e83b22-7381-4a33-b71d-67affdbc0fdc service nova] Creating event network-vif-plugged:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h2-854882-3 Aug 29 16:06:06.977376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-91b4df3b-e6b6-4d45-ba65-9e82adfb0848 req-d9e83b22-7381-4a33-b71d-67affdbc0fdc service nova] Instance 4da8ce59-6edd-4618-b424-20858338cad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:06:06.991374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-91b4df3b-e6b6-4d45-ba65-9e82adfb0848 req-d9e83b22-7381-4a33-b71d-67affdbc0fdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061368 Aug 29 16:06:06.992015 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2945/6066] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:07.050844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:07.060329 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24cae3c8-ff36-44a8-8506-ba1eb1332db4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1275 microversion: 2.1 time: 0.253208 Aug 29 16:06:07.061554 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3122/6067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:06 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:07.899979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:07.900693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:07.924050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.924050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.924050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.924050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.924050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.924050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.086546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:08.087204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:08.110161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.110780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.114638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.115464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.115965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.116416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.244000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:08.269198 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d8ef28e7-6a9f-444a-bf53-0746105dce45 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.374299 Aug 29 16:06:08.271667 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2946/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:07 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:08.285441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c279d556-4e18-4138-aa67-6646dfabf694 req-de08269f-a9fc-4a9c-bffc-84fddaa8e1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6b0469-45a3-449a-b5a6-bd19f196cecb", "tag": "5ec0cd87-b778-4c36-ab31-84d01e2acc0e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:08.318553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c279d556-4e18-4138-aa67-6646dfabf694 req-de08269f-a9fc-4a9c-bffc-84fddaa8e1a3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.319361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c279d556-4e18-4138-aa67-6646dfabf694 req-de08269f-a9fc-4a9c-bffc-84fddaa8e1a3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.320042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c279d556-4e18-4138-aa67-6646dfabf694 req-de08269f-a9fc-4a9c-bffc-84fddaa8e1a3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.340468 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c279d556-4e18-4138-aa67-6646dfabf694 req-de08269f-a9fc-4a9c-bffc-84fddaa8e1a3 service nova] Creating event network-changed:5ec0cd87-b778-4c36-ab31-84d01e2acc0e for instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb on n-h2-854882-3 Aug 29 16:06:08.345883 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c279d556-4e18-4138-aa67-6646dfabf694 req-de08269f-a9fc-4a9c-bffc-84fddaa8e1a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072197 Aug 29 16:06:08.347265 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2947/6069] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:08.405008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:08.414172 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a93bbe8-2842-4320-bb5e-3752744efa73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1275 microversion: 2.1 time: 0.334863 Aug 29 16:06:08.421968 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3123/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:08 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1275 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:09.299917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:09.301668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:09.371076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.371909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.372723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.378352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.379798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.381677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.448161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:09.448793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:09.486385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.486907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.487370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.488116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.488678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.489140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.817684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:09.826440 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-11448ce4-df45-4873-b44e-a7be41d3ce74 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.536434 Aug 29 16:06:09.838117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2948/6071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:09 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:10.339975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:10.352887 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b422e4bb-888d-4bbb-8ba6-7bc5afb6b440 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1275 microversion: 2.1 time: 0.919556 Aug 29 16:06:10.353997 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3124/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:09 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1275 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:10.566843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3efc100a-5011-41f9-8f93-760b9c3d1836 req-b1ac88f1-d0dc-481b-b12b-38dd0f93397b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "name": "network-vif-unplugged", "status": "completed", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:10.587845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3efc100a-5011-41f9-8f93-760b9c3d1836 req-b1ac88f1-d0dc-481b-b12b-38dd0f93397b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:10.588325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3efc100a-5011-41f9-8f93-760b9c3d1836 req-b1ac88f1-d0dc-481b-b12b-38dd0f93397b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:10.588759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3efc100a-5011-41f9-8f93-760b9c3d1836 req-b1ac88f1-d0dc-481b-b12b-38dd0f93397b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:10.606695 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3efc100a-5011-41f9-8f93-760b9c3d1836 req-b1ac88f1-d0dc-481b-b12b-38dd0f93397b service nova] Creating event network-vif-unplugged:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:06:10.614683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-3efc100a-5011-41f9-8f93-760b9c3d1836 req-b1ac88f1-d0dc-481b-b12b-38dd0f93397b service nova] Instance 4da8ce59-6edd-4618-b424-20858338cad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:06:10.656984 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3efc100a-5011-41f9-8f93-760b9c3d1836 req-b1ac88f1-d0dc-481b-b12b-38dd0f93397b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093709 Aug 29 16:06:10.660413 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2949/6073] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:10.847876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:10.848614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:10.860689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:10.862791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:10.864786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:10.865668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:10.866229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:10.866769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.260966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:11.272216 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2674a2c-f00a-4119-aec8-b1878033dcbf tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.428216 Aug 29 16:06:11.272655 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3125/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:10 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:11.378777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:11.380037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:11.395739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.397498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.397977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.398744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.399186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.407241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.949006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:11.970743 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-535c784e-f9e1-4e0d-b7a1-2506dfd6c664 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1275 microversion: 2.1 time: 0.599093 Aug 29 16:06:11.972752 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2950/6075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:11 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1275 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:12.300350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:12.301308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:12.314621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.315295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.315771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.316255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.316720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.317343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.563635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:12.579053 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9777ae51-8133-4c60-a65b-da75ca5003f6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.283606 Aug 29 16:06:12.579792 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3126/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:12 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:12.683720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-824d3461-f394-464c-977b-1446993b9fb4 req-94c16b50-7047-4b51-adef-446e8e395035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:12.700171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-824d3461-f394-464c-977b-1446993b9fb4 req-94c16b50-7047-4b51-adef-446e8e395035 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.700899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-824d3461-f394-464c-977b-1446993b9fb4 req-94c16b50-7047-4b51-adef-446e8e395035 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.701583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-824d3461-f394-464c-977b-1446993b9fb4 req-94c16b50-7047-4b51-adef-446e8e395035 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.714780 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-824d3461-f394-464c-977b-1446993b9fb4 req-94c16b50-7047-4b51-adef-446e8e395035 service nova] Creating event network-changed:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:06:12.722185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-824d3461-f394-464c-977b-1446993b9fb4 req-94c16b50-7047-4b51-adef-446e8e395035 service nova] Instance 4da8ce59-6edd-4618-b424-20858338cad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:06:12.735194 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-824d3461-f394-464c-977b-1446993b9fb4 req-94c16b50-7047-4b51-adef-446e8e395035 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056952 Aug 29 16:06:12.739881 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2951/6077] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:12.992686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:12.994032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:13.001314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.002057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.002875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.003757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.004390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.004994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.267231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:13.272789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:13.284689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c17a7080-524d-45c9-a72e-78eb49529874 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1275 microversion: 2.1 time: 0.296452 Aug 29 16:06:13.286061 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3127/6078] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:12 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:13.600333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:13.602911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:13.608904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:13.610295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:13.633176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.633965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.636764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.637898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.640098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.640720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.870868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:13.880438 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ba37e088-7964-4771-853b-6c9a3f340951 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1689 microversion: 2.1 time: 0.281002 Aug 29 16:06:13.886220 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2952/6079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:13 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1689 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:14.306836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:14.307444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:14.319535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.320294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.326850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.327633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.328195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.328623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.743558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:14.752811 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e5caf26b-c672-4f9f-aa48-d104460b0aa9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.450289 Aug 29 16:06:14.757971 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3128/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:14 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:14.912715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:14.913331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:14.926280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.926996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.927855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.928605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.929030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.929480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.214426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:15.223556 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a728e8a-9022-4fbe-82d0-ca3b6d850641 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1682 microversion: 2.1 time: 0.314673 Aug 29 16:06:15.240477 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2953/6081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:14 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1682 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:15.778166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:15.779571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:15.786855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.787466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.787999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.788817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.789358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.790159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.938663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:15.946937 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f476ec6c-3a7e-4471-82f7-e38a39f6260f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.172781 Aug 29 16:06:15.947517 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3129/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:15 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:16.364446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-84006117-3825-43fb-92d6-fc55c21edf35 req-7dc20af2-03aa-474e-be49-d9d9eafe1e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "name": "network-vif-plugged", "status": "completed", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:16.385416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-84006117-3825-43fb-92d6-fc55c21edf35 req-7dc20af2-03aa-474e-be49-d9d9eafe1e3f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.386243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-84006117-3825-43fb-92d6-fc55c21edf35 req-7dc20af2-03aa-474e-be49-d9d9eafe1e3f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.386687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-84006117-3825-43fb-92d6-fc55c21edf35 req-7dc20af2-03aa-474e-be49-d9d9eafe1e3f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.409512 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-84006117-3825-43fb-92d6-fc55c21edf35 req-7dc20af2-03aa-474e-be49-d9d9eafe1e3f service nova] Creating event network-vif-plugged:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:06:16.416127 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-84006117-3825-43fb-92d6-fc55c21edf35 req-7dc20af2-03aa-474e-be49-d9d9eafe1e3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054432 Aug 29 16:06:16.419082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2954/6083] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:16.979667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:16.981047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:16.990039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.990943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.991629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.992560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.993486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.994038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.253349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.266035 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a1e3e4cb-ad20-4175-b7dd-f0367ac832ac tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.301436 Aug 29 16:06:17.266828 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3130/6084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:16 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:18.293378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:18.294913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:18.304168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.305218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.305895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.306811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.308132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.308797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.515758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:18.528604 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee349b5b-d8bb-4ffb-a471-1b3abc94886e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.242396 Aug 29 16:06:18.530609 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2955/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:18 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:19.554202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:19.556592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:19.563290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.564076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.564938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.567227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.567947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.568606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.753600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:19.772666 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1f1e7934-ea8c-4c67-b05a-188c941cee00 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.223612 Aug 29 16:06:19.773274 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3131/6086] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:19 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:20.797174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:20.798609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:20.805789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.806363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.806891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.807648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.808215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.808784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.915243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:20.920453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:20.932591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.933871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.937936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.939172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.940044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.942958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.950782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:21.031669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:21.048567 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c098cd1e-8bf5-404d-aef5-005e6c81a84d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.256280 Aug 29 16:06:21.049193 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2956/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:20 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:21.061270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lazy-loading 'services' on Instance uuid ad85f450-149c-4160-8eb8-dc19e17e2638 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:06:21.159782 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-28f2f952-3d3b-40ec-bfdc-4d8772bbe6b1 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638/os-volume_attachments/4ace6813-ba9b-44c5-ae71-0a7f00156f04" status: 202 len: 0 microversion: 2.1 time: 0.248174 Aug 29 16:06:21.160771 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3132/6088] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:06:20 2022] DELETE /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638/os-volume_attachments/4ace6813-ba9b-44c5-ae71-0a7f00156f04 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:06:22.072071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:22.073607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:22.081544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.082525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.083186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.084104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.084724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.085259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.109849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.294029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:22.313784 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8471448c-eceb-433a-a661-69cd9352d1c0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.245418 Aug 29 16:06:22.316316 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2957/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:22 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:23.337785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:23.338500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:23.349127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.359016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.359735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.360502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.361589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.362754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.587505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:23.603322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cf4c755b-ce94-4e0d-a14b-cd21660a2b06 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.270799 Aug 29 16:06:23.605247 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3133/6090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:23 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:24.624179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:24.624796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.627613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:24.633043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.633863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.634524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.635224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.635839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.636258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.728474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-01ecc157-c6eb-4eaa-ae51-aafc5760be90 req-d670d9e3-a047-40cf-972b-2dca4a3db25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6b0469-45a3-449a-b5a6-bd19f196cecb", "name": "network-vif-plugged", "status": "completed", "tag": "5ec0cd87-b778-4c36-ab31-84d01e2acc0e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:24.751609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=52 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:24.765198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-01ecc157-c6eb-4eaa-ae51-aafc5760be90 req-d670d9e3-a047-40cf-972b-2dca4a3db25d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.766157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-01ecc157-c6eb-4eaa-ae51-aafc5760be90 req-d670d9e3-a047-40cf-972b-2dca4a3db25d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.766795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-01ecc157-c6eb-4eaa-ae51-aafc5760be90 req-d670d9e3-a047-40cf-972b-2dca4a3db25d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.801754 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-01ecc157-c6eb-4eaa-ae51-aafc5760be90 req-d670d9e3-a047-40cf-972b-2dca4a3db25d service nova] Creating event network-vif-plugged:5ec0cd87-b778-4c36-ab31-84d01e2acc0e for instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb on n-h2-854882-3 Aug 29 16:06:24.825474 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-01ecc157-c6eb-4eaa-ae51-aafc5760be90 req-d670d9e3-a047-40cf-972b-2dca4a3db25d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095394 Aug 29 16:06:24.829469 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3134/6091] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:24.899158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.913007 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-21a264dd-5e7c-440e-926f-dfdc71f46ee8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.292655 Aug 29 16:06:24.926469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2958/6092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:24 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:25.940147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:25.941478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:25.950501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.951807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.952470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.953283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.954139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.954838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:26.277152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:26.287950 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6644cbe-4e95-43a4-ae12-cbd74c273b4a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1263 microversion: 2.1 time: 0.355529 Aug 29 16:06:26.289205 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3135/6093] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:25 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1263 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:26.678114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:26.679258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:26.691272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:26.691897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:26.692922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:26.694538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:26.695205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:26.695831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:26.734442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:26.860513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6151130-23e0-4952-9ca5-1017bb776908 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 204 len: 0 microversion: 2.1 time: 0.186432 Aug 29 16:06:26.861745 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2959/6094] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:26 2022] DELETE /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:26.874088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:26.874802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:26.880845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:26.881503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:26.882190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:26.882921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:26.883391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:26.883834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.161072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:27.171671 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea897e24-912a-4c7e-9c8c-65b6e09181e9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1513 microversion: 2.1 time: 0.305575 Aug 29 16:06:27.172861 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3136/6095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:26 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:27.309121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:27.309899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:27.322243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.322607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.323154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.323974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.324326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.324806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.604497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:27.623061 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79f9c7db-5684-43c9-98ae-60a4cb419a26 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1451 microversion: 2.1 time: 0.318313 Aug 29 16:06:27.624066 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2960/6096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:27 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1451 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:27.651085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:27.652271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:27.660462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.661121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.662197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.663030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.663580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.664096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.836709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:27.847473 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c87158e8-fb38-49ad-a7bf-044deec0dfaa tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1451 microversion: 2.1 time: 0.201572 Aug 29 16:06:27.864685 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3137/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:27 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:28.194496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:28.195196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:28.208202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:28.208822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:28.209150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:28.210070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:28.210548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:28.211010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:28.770995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:28.778879 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-264d14bb-1555-41d8-878a-03c4959944d6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 200 len: 1513 microversion: 2.1 time: 0.588510 Aug 29 16:06:28.790265 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2961/6098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:28 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 1513 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:29.112095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-70cc62f9-ce51-40ea-991c-d98952bef678 req-9241e8e5-cff3-44a6-ba6c-0e7eaf892904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad85f450-149c-4160-8eb8-dc19e17e2638", "name": "network-vif-deleted", "tag": "8a5dd405-1010-43f8-b99d-f599eca3a14f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:29.145975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-70cc62f9-ce51-40ea-991c-d98952bef678 req-9241e8e5-cff3-44a6-ba6c-0e7eaf892904 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.147474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-70cc62f9-ce51-40ea-991c-d98952bef678 req-9241e8e5-cff3-44a6-ba6c-0e7eaf892904 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.148117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-70cc62f9-ce51-40ea-991c-d98952bef678 req-9241e8e5-cff3-44a6-ba6c-0e7eaf892904 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.163852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-70cc62f9-ce51-40ea-991c-d98952bef678 req-9241e8e5-cff3-44a6-ba6c-0e7eaf892904 service nova] Creating event network-vif-deleted:8a5dd405-1010-43f8-b99d-f599eca3a14f for instance ad85f450-149c-4160-8eb8-dc19e17e2638 on n-h1-854882-3 Aug 29 16:06:29.171410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-70cc62f9-ce51-40ea-991c-d98952bef678 req-9241e8e5-cff3-44a6-ba6c-0e7eaf892904 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062164 Aug 29 16:06:29.172632 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3138/6099] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:29.813290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:29.814629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: ad85f450-149c-4160-8eb8-dc19e17e2638] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:29.822262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.823680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.824343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.825280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.826049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.826717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.847215 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] HTTP exception thrown: Instance ad85f450-149c-4160-8eb8-dc19e17e2638 could not be found. Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Request method failure captured: Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 HTTP/1.1 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDONdpBeF-brN6gBeWiP9FyLW_G7QrjxinijcqgSEufeWLHqqSo1RE4aOemwQ--jlwPdKxqLoadeJxPqFAk9qAtDEjbhYUoS9EHGkA15bPKR0gOF1MLFQ_cUK_yo1fqZEC70VXaCeOqYHScGcIss5L86Rxcp0p1WEvgn2oSL0KGa-iqg Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8df11b687fb547f1b9fbfa1850faae8d Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1099897162 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8df11b687fb547f1b9fbfa1850faae8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8df11b687fb547f1b9fbfa1850faae8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8df11b687fb547f1b9fbfa1850faae8d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8df11b687fb547f1b9fbfa1850faae8d"}]}] Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesSnapshotTestJSON-1099897162 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8df11b687fb547f1b9fbfa1850faae8d Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1099897162 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesSnapshotTestJSON-1099897162-project Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f3e97edd3e10433ca84d2a6206c1c521 Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesSnapshotTestJSON-1099897162-project Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance ad85f450-149c-4160-8eb8-dc19e17e2638 could not be found. Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'ad85f450-149c-4160-8eb8-dc19e17e2638'} Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad85f450-149c-4160-8eb8-dc19e17e2638 could not be found. Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad85f450-149c-4160-8eb8-dc19e17e2638 could not be found. Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:29.849662 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:06:29.855711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:29.855711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:29.855711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:29.855711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:06:29.855711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:06:29.855711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad85f450-149c-4160-8eb8-dc19e17e2638 could not be found. Aug 29 16:06:29.855711 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:06:29.857129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Returning 404 to user: Instance ad85f450-149c-4160-8eb8-dc19e17e2638 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:06:29.858621 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d164f169-be6f-47bf-b9fe-ab57ac4522e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638" status: 404 len: 111 microversion: 2.1 time: 0.050309 Aug 29 16:06:29.859279 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2962/6100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:29 2022] GET /compute/v2.1/servers/ad85f450-149c-4160-8eb8-dc19e17e2638 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:06:32.259176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-168c82b3-c988-4778-895c-82b445c787ae req-b330e4df-a975-472b-b66e-336c08bf0cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6b0469-45a3-449a-b5a6-bd19f196cecb", "tag": "5ec0cd87-b778-4c36-ab31-84d01e2acc0e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:32.272367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-168c82b3-c988-4778-895c-82b445c787ae req-b330e4df-a975-472b-b66e-336c08bf0cc4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:32.273987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-168c82b3-c988-4778-895c-82b445c787ae req-b330e4df-a975-472b-b66e-336c08bf0cc4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:32.275445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-168c82b3-c988-4778-895c-82b445c787ae req-b330e4df-a975-472b-b66e-336c08bf0cc4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:32.290943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-168c82b3-c988-4778-895c-82b445c787ae req-b330e4df-a975-472b-b66e-336c08bf0cc4 service nova] Creating event network-changed:5ec0cd87-b778-4c36-ab31-84d01e2acc0e for instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb on n-h2-854882-3 Aug 29 16:06:32.297041 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-168c82b3-c988-4778-895c-82b445c787ae req-b330e4df-a975-472b-b66e-336c08bf0cc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042753 Aug 29 16:06:32.298123 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3139/6101] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:39.480132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:39.480670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-729935593", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "575ca104-9569-45ac-8491-e8bb85218829"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:39.483671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:39.491819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:39.492605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:39.493216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:39.494160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:39.494779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:39.496700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:39.580040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] validate_networks() for [('575ca104-9569-45ac-8491-e8bb85218829', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:06:39.622733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14234f49-7017-4928-b768-e31021a86282 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action" status: 200 len: 63205 microversion: 2.1 time: 0.146454 Aug 29 16:06:39.624001 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2963/6102] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:06:39 2022] POST /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7/action => generated 63205 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:06:40.250713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:06:40.252001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:06:40.258447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:06:40.259272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:06:40.260153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:06:40.270406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.270904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.271350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:40.272138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.272605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.273046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:40.293709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Getting quotas for project 8df11b687fb547f1b9fbfa1850faae8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:40.299276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Getting quotas for user f3e97edd3e10433ca84d2a6206c1c521 and project 8df11b687fb547f1b9fbfa1850faae8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:40.312711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:06:40.315150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:06:40.366842 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cff13ec1-0535-4b46-b8cc-f9a004a26fd2 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890642 Aug 29 16:06:40.367676 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3140/6103] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:06:40.379549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-effd34cc-b42a-450f-8e94-caea17d396cd tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:40.380589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-effd34cc-b42a-450f-8e94-caea17d396cd tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:40.462456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-effd34cc-b42a-450f-8e94-caea17d396cd tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:40.470462 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-effd34cc-b42a-450f-8e94-caea17d396cd tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1218 microversion: 2.1 time: 0.094847 Aug 29 16:06:40.471107 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3141/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:40 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:40.485872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6244bb51-874d-459f-a440-b116a9766521 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Action: 'create', calling method: .version_select at 0x7fb0e38aa9d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-262606987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP0xtnD38d4TI443e7uL7XlSvm3cspy+7KVOK54lH7MoFo0pssSRH052vg4csa8CAHZ4nJx7m+68EMFwHYQ3+6FM35ePnOMugU+Q3gGfvoiMcqwYLNkCBpmVDXI0ZQA+Q=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:40.506612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6244bb51-874d-459f-a440-b116a9766521 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Getting quotas for project c88deb8d5f864d368528400104c35e1a. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:40.515233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6244bb51-874d-459f-a440-b116a9766521 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Getting quotas for user 627ff3308c2c43f28573edf551f779aa and project c88deb8d5f864d368528400104c35e1a. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:40.554840 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6244bb51-874d-459f-a440-b116a9766521 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.302372 Aug 29 16:06:40.555615 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2964/6105] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:06:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:41.506650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:41.508036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:41.518915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:41.519801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:41.520498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:41.521456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:41.522188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:41.522639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:41.605802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:41.614852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-58d5207a-acea-43ee-b582-be04547f5ed4 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1270 microversion: 2.1 time: 0.123848 Aug 29 16:06:41.618340 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3142/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:41 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:41.888103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1205973448", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-262606987", "security_groups": [{"name": "tempest-secgroup-smoke-1971281462"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "42acca04-6e3a-47b9-94c0-642731875ebe"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:42.043023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] validate_networks() for [('42acca04-6e3a-47b9-94c0-642731875ebe', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:06:42.585151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Getting quotas for project c88deb8d5f864d368528400104c35e1a. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:42.593233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Getting quotas for user 627ff3308c2c43f28573edf551f779aa and project c88deb8d5f864d368528400104c35e1a. Resources: dict_keys(['metadata_items']) {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:42.609363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:06:42.609997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:06:42.610821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:06:42.611427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:06:42.612072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:06:42.628467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.629182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.629706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.630504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.631176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.631733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.642391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:42.643678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:42.650399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.651168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.651980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.652901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.653624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.654822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.658254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Getting quotas for project c88deb8d5f864d368528400104c35e1a. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:42.665015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Getting quotas for user 627ff3308c2c43f28573edf551f779aa and project c88deb8d5f864d368528400104c35e1a. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:42.681684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:06:42.685916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:06:42.754528 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-065488ff-d380-40a9-8289-22366d5c499a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.871316 Aug 29 16:06:42.755740 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2965/6107] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:06:42.767498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a7dcb01c-a7f6-453f-8379-068f01924c2a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:42.773158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7dcb01c-a7f6-453f-8379-068f01924c2a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:42.856501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a7dcb01c-a7f6-453f-8379-068f01924c2a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:42.865627 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a7dcb01c-a7f6-453f-8379-068f01924c2a tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1302 microversion: 2.1 time: 0.101760 Aug 29 16:06:42.886947 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2966/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:42 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:42.967989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:42.977077 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c87ffe76-6f62-4012-a1b1-d9f9234e6aaa tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1318 microversion: 2.1 time: 0.341218 Aug 29 16:06:42.978001 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3143/6109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:42 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:43.891706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:43.892419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:43.913652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.914489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.915062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-42e25644-d1ea-4216-914b-a4ddfca666ad req-9bff5344-b105-4da7-9800-8faf98a6b4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ac63c0-412a-4b8a-989e-ed4a865ed4c0", "tag": "24aa5828-936b-41d2-87e9-a2763206f014"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:43.915567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.916741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.917201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.934142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-42e25644-d1ea-4216-914b-a4ddfca666ad req-9bff5344-b105-4da7-9800-8faf98a6b4d4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.936047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.938014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-42e25644-d1ea-4216-914b-a4ddfca666ad req-9bff5344-b105-4da7-9800-8faf98a6b4d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.940463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-42e25644-d1ea-4216-914b-a4ddfca666ad req-9bff5344-b105-4da7-9800-8faf98a6b4d4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.969593 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-42e25644-d1ea-4216-914b-a4ddfca666ad req-9bff5344-b105-4da7-9800-8faf98a6b4d4 service nova] Creating event network-changed:24aa5828-936b-41d2-87e9-a2763206f014 for instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 on n-h1-854882-3 Aug 29 16:06:43.978863 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-42e25644-d1ea-4216-914b-a4ddfca666ad req-9bff5344-b105-4da7-9800-8faf98a6b4d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065312 Aug 29 16:06:43.979779 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3144/6110] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:44.000822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:44.001710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:44.016633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:44.020037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:44.020637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:44.021545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:44.024829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:44.026539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:44.067062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:44.078454 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2af874cb-fa51-45fb-9119-ca64ab048b03 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1354 microversion: 2.1 time: 0.191623 Aug 29 16:06:44.079070 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2967/6111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:43 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1354 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:44.314252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:44.355718 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73a036d1-a122-4ad4-9be7-6b78dde8eada tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1318 microversion: 2.1 time: 0.359245 Aug 29 16:06:44.357018 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3145/6112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:43 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:45.100783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:45.102456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:45.110146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.110633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.111269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.112138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.112987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.113599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.382207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:45.383479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:45.392935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.393498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.394366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.395378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.396090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.397910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.407266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:45.426576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b765ec14-8bdd-412d-a5bc-43c7a4ea3fe0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1428 microversion: 2.1 time: 0.330030 Aug 29 16:06:45.433565 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2968/6113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:45 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1428 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:45.760800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:45.771862 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-870b8c38-0620-4e25-80be-2666f55f7635 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1318 microversion: 2.1 time: 0.395860 Aug 29 16:06:45.784980 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3146/6114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:45 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:45.972585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:45.973213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:45.979883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.980373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.980880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.981692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.982665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.983092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.298173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b85d861-7f75-468f-a065-749fa1765939 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1833 microversion: 2.1 time: 0.329830 Aug 29 16:06:46.299573 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2969/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:45 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1833 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:46.448556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:46.449376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:46.456523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.457038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.457527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.463254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.463785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.464256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.795870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:46.796550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:46.802985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.803739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.804363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.805552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.806255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.806950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.820432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:46.831704 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2dbe8fac-a2ac-4028-8ac3-53cf56ddd7a0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1428 microversion: 2.1 time: 0.386668 Aug 29 16:06:46.844704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3147/6116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:46 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1428 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:47.129628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:47.140864 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-065e70ea-8593-442c-91ac-b0be4229f177 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1318 microversion: 2.1 time: 0.349142 Aug 29 16:06:47.141925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e229ae66-3aea-4d20-9e25-0999c4482148 req-83a2237d-ab47-49bc-9442-cb5742be06a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43136247-64ba-4b4d-9558-875b4e6cb2d4", "tag": "64b31523-21b4-4da1-b155-92e575bf4758"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:47.144723 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2970/6117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:46 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:47.158699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e229ae66-3aea-4d20-9e25-0999c4482148 req-83a2237d-ab47-49bc-9442-cb5742be06a6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.165783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e229ae66-3aea-4d20-9e25-0999c4482148 req-83a2237d-ab47-49bc-9442-cb5742be06a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.166654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e229ae66-3aea-4d20-9e25-0999c4482148 req-83a2237d-ab47-49bc-9442-cb5742be06a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.181371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e229ae66-3aea-4d20-9e25-0999c4482148 req-83a2237d-ab47-49bc-9442-cb5742be06a6 service nova] Creating event network-changed:64b31523-21b4-4da1-b155-92e575bf4758 for instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 on n-h1-854882-3 Aug 29 16:06:47.187467 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e229ae66-3aea-4d20-9e25-0999c4482148 req-83a2237d-ab47-49bc-9442-cb5742be06a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049571 Aug 29 16:06:47.190714 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3148/6118] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:47.857512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:47.858293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:47.864659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.865226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.865760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.866689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.867305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.867877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.016159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:48.017871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:48.026961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.027997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.029636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.030750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.031700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.033195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.060543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:48.070346 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f8b05060-7253-4305-9e7f-31b93ed6e422 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1428 microversion: 2.1 time: 0.218969 Aug 29 16:06:48.070840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:48.071433 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2971/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:47 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1428 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:48.096475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-fe0f54c0-7af5-4ab3-b551-cc5deae6e0f3 req-320f659a-8df4-4774-93ee-c47beba91c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:48.108327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fe0f54c0-7af5-4ab3-b551-cc5deae6e0f3 req-320f659a-8df4-4774-93ee-c47beba91c09 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.109568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fe0f54c0-7af5-4ab3-b551-cc5deae6e0f3 req-320f659a-8df4-4774-93ee-c47beba91c09 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.110252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fe0f54c0-7af5-4ab3-b551-cc5deae6e0f3 req-320f659a-8df4-4774-93ee-c47beba91c09 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.126912 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fe0f54c0-7af5-4ab3-b551-cc5deae6e0f3 req-320f659a-8df4-4774-93ee-c47beba91c09 service nova] Creating event network-changed:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:06:48.132387 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-fe0f54c0-7af5-4ab3-b551-cc5deae6e0f3 req-320f659a-8df4-4774-93ee-c47beba91c09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051948 Aug 29 16:06:48.133568 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2972/6120] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:48.168276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:48.168974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:48.179052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.179639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.180644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.181322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.182003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.182686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.208756 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-56b083f0-6fa7-44ff-9c7e-9b511e3dd54d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 204 len: 0 microversion: 2.1 time: 0.197945 Aug 29 16:06:48.210073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3149/6121] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:48 2022] DELETE /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:06:48.223761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:48.225458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:48.235669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.236531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.237230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.238635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.239342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.241028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.417628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:48.431801 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1857fad9-73af-48ac-995f-90833e8628dd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1688 microversion: 2.1 time: 0.217245 Aug 29 16:06:48.448625 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3150/6122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:48 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:48.457032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:48.467682 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-88f97e7b-0e3e-4a43-8175-89a9636def93 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1318 microversion: 2.1 time: 0.306371 Aug 29 16:06:48.468903 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2973/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:48 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:48.617964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9a83fb14-1d7b-4c34-9d69-cc25cbbf305c req-272cfd5d-9db1-4b7a-9775-572c6b6ad107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ac63c0-412a-4b8a-989e-ed4a865ed4c0", "name": "network-vif-plugged", "status": "completed", "tag": "24aa5828-936b-41d2-87e9-a2763206f014"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:48.636688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9a83fb14-1d7b-4c34-9d69-cc25cbbf305c req-272cfd5d-9db1-4b7a-9775-572c6b6ad107 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.637196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9a83fb14-1d7b-4c34-9d69-cc25cbbf305c req-272cfd5d-9db1-4b7a-9775-572c6b6ad107 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.637677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9a83fb14-1d7b-4c34-9d69-cc25cbbf305c req-272cfd5d-9db1-4b7a-9775-572c6b6ad107 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.673135 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9a83fb14-1d7b-4c34-9d69-cc25cbbf305c req-272cfd5d-9db1-4b7a-9775-572c6b6ad107 service nova] Creating event network-vif-plugged:24aa5828-936b-41d2-87e9-a2763206f014 for instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 on n-h1-854882-3 Aug 29 16:06:48.690063 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9a83fb14-1d7b-4c34-9d69-cc25cbbf305c req-272cfd5d-9db1-4b7a-9775-572c6b6ad107 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074848 Aug 29 16:06:48.690063 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3151/6124] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:49.098957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:49.101416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:49.115045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.116108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.116822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.117676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.118446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.118880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.289329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:49.299928 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-da209cec-ed72-439e-b15e-b9e76abd01af tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1428 microversion: 2.1 time: 0.207038 Aug 29 16:06:49.300604 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2974/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:49 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1428 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:49.457113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:49.458074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:49.467075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.467581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.468037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.468823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.469295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.469806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.474332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:49.489558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:49.490672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:49.497209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.498779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.499553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.500425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.501036 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.501643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.706638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:49.715337 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-831fb2e8-49a4-4a46-80ad-00e5a5647cf2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1688 microversion: 2.1 time: 0.263263 Aug 29 16:06:49.716589 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3152/6126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:49 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1688 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:49.759962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:49.770950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2dfcaba1-cbb5-463f-a5c4-e7e0586eab61 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1318 microversion: 2.1 time: 0.285322 Aug 29 16:06:49.786116 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2975/6127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:49 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:50.322157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:50.322800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:50.324865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:50.348027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.351515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.353704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.354807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.357633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.359802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.467658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:50.587677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:50.599051 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cc48a802-2503-4cd9-87fd-85113078a18f tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1428 microversion: 2.1 time: 0.281026 Aug 29 16:06:50.614047 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3153/6128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:50 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1428 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:50.740455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:50.741241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:50.751206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.751878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.752386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.753267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.753892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.754408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.792995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:50.794136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:50.804759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.805838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.807062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.807321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.807949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.808618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.933959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:50.940876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:50.952845 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5893b244-225f-47e9-b45d-632c380eed1e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 200 len: 1621 microversion: 2.1 time: 0.218049 Aug 29 16:06:50.953926 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2976/6129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:50 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 1621 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:51.027832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-247e65b2-4290-4a0b-9477-cae71885668f req-7e81b8af-a3ac-4006-bf49-7a755bc08e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da8ce59-6edd-4618-b424-20858338cad7", "name": "network-vif-deleted", "tag": "e536787c-740a-4e95-968d-6f3206e257f4"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:51.041873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-247e65b2-4290-4a0b-9477-cae71885668f req-7e81b8af-a3ac-4006-bf49-7a755bc08e75 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.042601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-247e65b2-4290-4a0b-9477-cae71885668f req-7e81b8af-a3ac-4006-bf49-7a755bc08e75 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.043249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-247e65b2-4290-4a0b-9477-cae71885668f req-7e81b8af-a3ac-4006-bf49-7a755bc08e75 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.059178 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-247e65b2-4290-4a0b-9477-cae71885668f req-7e81b8af-a3ac-4006-bf49-7a755bc08e75 service nova] Creating event network-vif-deleted:e536787c-740a-4e95-968d-6f3206e257f4 for instance 4da8ce59-6edd-4618-b424-20858338cad7 on n-h1-854882-3 Aug 29 16:06:51.062233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:51.066334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-247e65b2-4290-4a0b-9477-cae71885668f req-7e81b8af-a3ac-4006-bf49-7a755bc08e75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042454 Aug 29 16:06:51.067981 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2977/6130] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:51.081955 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c78b5b1e-7448-45c7-afb3-ae118e289f66 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1318 microversion: 2.1 time: 0.293029 Aug 29 16:06:51.082975 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3154/6131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:50 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:51.620770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:51.621653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:51.629141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.629775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.630222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.630919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.631488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.632150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.785302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:51.793815 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8304a483-59de-4a46-ba41-23f3cf8c81ba tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1428 microversion: 2.1 time: 0.177295 Aug 29 16:06:51.795257 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2978/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:51 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1428 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:51.976195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:51.976828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4da8ce59-6edd-4618-b424-20858338cad7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:51.984785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.985291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.985848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.986639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.987164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.987611 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.001144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] HTTP exception thrown: Instance 4da8ce59-6edd-4618-b424-20858338cad7 could not be found. Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Request method failure captured: Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 HTTP/1.1 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOMDofWL0Gi1PrJIY8t82vrIBBZztaj2mNO_3L1DtbH9leStvvDMCBkhbL7mNNLzYNjBscUFMF2Guoj7vN6KVc5Q9pi5V9tFjDj0bb8bJRUTAEHnRfvtnpJ7V0NxwCG5GfWcygmHRGhrhqJOq2_dgh88YvNXl077FRUJUonXEKnjLoY Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fa29b3844343454c8ade410470e7d897"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fa29b3844343454c8ade410470e7d897", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}] Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 64dd24ea45ac485d8d411837d7078301 Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 4da8ce59-6edd-4618-b424-20858338cad7 could not be found. Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '4da8ce59-6edd-4618-b424-20858338cad7'} Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da8ce59-6edd-4618-b424-20858338cad7 could not be found. Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da8ce59-6edd-4618-b424-20858338cad7 could not be found. Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:06:52.002827 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da8ce59-6edd-4618-b424-20858338cad7 could not be found. Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Returning 404 to user: Instance 4da8ce59-6edd-4618-b424-20858338cad7 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eafa62e9-f596-4f42-8393-649b561733b2 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7" status: 404 len: 111 microversion: 2.1 time: 0.032068 Aug 29 16:06:52.007014 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3155/6133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:51 2022] GET /compute/v2.1/servers/4da8ce59-6edd-4618-b424-20858338cad7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:52.107130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.108026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.115487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.116515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.117198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.118331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.119021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.119670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.273657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:52.283014 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f18e4ee-7172-4115-b609-0e99c0cfe65f tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1507 microversion: 2.1 time: 0.180657 Aug 29 16:06:52.283632 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2979/6134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:52.305028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "703843a5-7216-4061-a416-38cac70d0e5c", "device": "/dev/sdb"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:52.307886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.314865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.315601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.316234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.317239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.317963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.318576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.579565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d85dd67a-f96a-4740-80d6-2adc913d356b req-dc04da54-c72f-4e45-b5eb-0ee407c3ba83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43136247-64ba-4b4d-9558-875b4e6cb2d4", "name": "network-vif-plugged", "status": "completed", "tag": "64b31523-21b4-4da1-b155-92e575bf4758"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:52.596420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d85dd67a-f96a-4740-80d6-2adc913d356b req-dc04da54-c72f-4e45-b5eb-0ee407c3ba83 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.597155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d85dd67a-f96a-4740-80d6-2adc913d356b req-dc04da54-c72f-4e45-b5eb-0ee407c3ba83 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.597848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d85dd67a-f96a-4740-80d6-2adc913d356b req-dc04da54-c72f-4e45-b5eb-0ee407c3ba83 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.625192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d85dd67a-f96a-4740-80d6-2adc913d356b req-dc04da54-c72f-4e45-b5eb-0ee407c3ba83 service nova] Creating event network-vif-plugged:64b31523-21b4-4da1-b155-92e575bf4758 for instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 on n-h1-854882-3 Aug 29 16:06:52.637767 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d85dd67a-f96a-4740-80d6-2adc913d356b req-dc04da54-c72f-4e45-b5eb-0ee407c3ba83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061239 Aug 29 16:06:52.639745 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2980/6135] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:52.679887 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e884b471-d910-4e7c-8e2c-95b0afbc55e6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "POST /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378906 Aug 29 16:06:52.686624 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3156/6136] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:06:52 2022] POST /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:52.813153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:52.818629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.819538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.834379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.835094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.835727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.836636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.837322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.839500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.866523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:53.074588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:53.083910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-902ae866-7451-4e85-b280-b43815f7fc0b tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1428 microversion: 2.1 time: 0.271606 Aug 29 16:06:53.099695 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2981/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1428 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:54.105054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:54.106703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:54.119088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.124087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.125256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.127732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.131319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.132047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.468835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:54.480901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e92bd44c-be22-41d8-a3c6-a36744477dec tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1607 microversion: 2.1 time: 0.380373 Aug 29 16:06:54.482771 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3157/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:54 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1607 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:54.506850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:54.508259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:54.521811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.523430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.524355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.529952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.530595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.531049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.811763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:54.850933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-28c12c72-7628-450e-b053-fbaf138470fd tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1607 microversion: 2.1 time: 0.349555 Aug 29 16:06:54.852493 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2982/6139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:54 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1607 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:54.873801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:54.874697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:54.877898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:54.882139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.882876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.883488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.884380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.885006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.885631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.322210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:55.338900 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-681fc638-40b7-4555-86ff-d9dcb0ab947c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1607 microversion: 2.1 time: 0.470859 Aug 29 16:06:55.339726 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3158/6140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:54 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1607 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:56.941231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb138648-693a-4ab7-91e0-798f8fa7af5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '.version_select at 0x7fb0e3120940>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:56.953883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:57.007640 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb138648-693a-4ab7-91e0-798f8fa7af5b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1978782960" status: 202 len: 0 microversion: 2.1 time: 0.071481 Aug 29 16:06:57.011975 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2983/6141] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Aug 29 16:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1978782960 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:06:57.051525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3b90530-fa44-4b29-a4e4-71fe7f10d050 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: .version_select at 0x7fb0e24d90d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-501949959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPLXlQlT76SpoAiS1V2HOkvW6J/9/uXz4edo35/nnsrgE4P1gzGmyf/Cq5vdDrJu30SoUcJwJ3w722/OwOheKKa9pidlrEa0qmy93+pw0gaMs/YoNMFe8Zu76xFTsbeBA=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:57.074878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d3b90530-fa44-4b29-a4e4-71fe7f10d050 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:57.083330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-d3b90530-fa44-4b29-a4e4-71fe7f10d050 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:57.116514 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3b90530-fa44-4b29-a4e4-71fe7f10d050 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.069344 Aug 29 16:06:57.117914 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3159/6142] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:06:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:58.454499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5072206e-c08b-475d-a83b-a474c33cc0b5 req-bcc16381-9789-44b7-911e-e1df949ee04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43136247-64ba-4b4d-9558-875b4e6cb2d4", "tag": "64b31523-21b4-4da1-b155-92e575bf4758"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:58.481716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5072206e-c08b-475d-a83b-a474c33cc0b5 req-bcc16381-9789-44b7-911e-e1df949ee04c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:58.484371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5072206e-c08b-475d-a83b-a474c33cc0b5 req-bcc16381-9789-44b7-911e-e1df949ee04c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:58.484980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5072206e-c08b-475d-a83b-a474c33cc0b5 req-bcc16381-9789-44b7-911e-e1df949ee04c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:58.507758 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5072206e-c08b-475d-a83b-a474c33cc0b5 req-bcc16381-9789-44b7-911e-e1df949ee04c service nova] Creating event network-changed:64b31523-21b4-4da1-b155-92e575bf4758 for instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 on n-h1-854882-3 Aug 29 16:06:58.523295 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5072206e-c08b-475d-a83b-a474c33cc0b5 req-bcc16381-9789-44b7-911e-e1df949ee04c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071074 Aug 29 16:06:58.525233 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2984/6143] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:04.668482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-318262748", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "ae44b386-dd4d-42b0-8df5-0621afede2c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-501949959", "security_groups": [{"name": "tempest-secgroup-smoke-1630484876"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:04.892390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] validate_networks() for [('ae44b386-dd4d-42b0-8df5-0621afede2c1', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:07:05.337800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:05.790806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:07:05.791400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:07:05.791986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:07:05.792427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:07:05.793356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:07:05.815216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:05.815737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:05.826244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:05.827219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:05.827775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:05.828281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:05.882194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:05.898480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:05.929574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:07:05.932778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:07:06.101973 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-278943e4-66e7-440d-890e-469e6c0d9f84 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.437178 Aug 29 16:07:06.103210 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3160/6144] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:07:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:07:06.117185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf30ff48-691a-43f8-b655-13feed6326e6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:06.118735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cf30ff48-691a-43f8-b655-13feed6326e6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:06.235896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cf30ff48-691a-43f8-b655-13feed6326e6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:06.244541 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cf30ff48-691a-43f8-b655-13feed6326e6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1265 microversion: 2.1 time: 0.133291 Aug 29 16:07:06.257754 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2985/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:06 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:07.274057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:07.274808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:07.287231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:07.287784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:07.288503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:07.289501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:07.291196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:07.291858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:07.376534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:07.388555 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1f7fc90e-978b-4d5f-b8dc-69bb3260a82c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1317 microversion: 2.1 time: 0.119955 Aug 29 16:07:07.389602 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3161/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:07 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1317 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:08.410228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:08.410850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:08.419129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:08.419653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:08.420096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:08.422119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:08.422898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:08.423505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:08.503903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:08.512228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0beb8ff4-37ef-434a-9972-f995f0ab2726 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1323 microversion: 2.1 time: 0.105778 Aug 29 16:07:08.513350 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2986/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:08 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1323 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:09.535840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:09.536766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:09.553542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:09.553542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:09.553747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:09.554343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:09.555261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:09.561888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:09.849824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:09.866514 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ad0e81e6-6d7b-4da3-8e3c-5c4a9f010e43 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1391 microversion: 2.1 time: 0.330515 Aug 29 16:07:09.867529 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3162/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:09 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1391 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:09.873930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-08894a88-30b6-41f0-aed6-f5469b878c14 req-77a3eaa7-56d9-4d33-b5f0-4c99dfa1e092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbc31a1-b29b-4248-842d-27f274cff9d9", "tag": "8704bd97-9d40-4812-8f32-b7af32256854"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:09.905325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-08894a88-30b6-41f0-aed6-f5469b878c14 req-77a3eaa7-56d9-4d33-b5f0-4c99dfa1e092 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:09.909768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-08894a88-30b6-41f0-aed6-f5469b878c14 req-77a3eaa7-56d9-4d33-b5f0-4c99dfa1e092 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:09.910550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-08894a88-30b6-41f0-aed6-f5469b878c14 req-77a3eaa7-56d9-4d33-b5f0-4c99dfa1e092 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:09.939092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-08894a88-30b6-41f0-aed6-f5469b878c14 req-77a3eaa7-56d9-4d33-b5f0-4c99dfa1e092 service nova] Creating event network-changed:8704bd97-9d40-4812-8f32-b7af32256854 for instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 on n-h2-854882-3 Aug 29 16:07:09.964231 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-08894a88-30b6-41f0-aed6-f5469b878c14 req-77a3eaa7-56d9-4d33-b5f0-4c99dfa1e092 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098558 Aug 29 16:07:09.964868 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2987/6149] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:10.888601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:10.889224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:10.896315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:10.896821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:10.897321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:10.898016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:10.898488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:10.899052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:11.044961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:11.053061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb121273-0a66-47c2-8b47-88ba86f4a592 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1391 microversion: 2.1 time: 0.168870 Aug 29 16:07:11.053868 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3163/6150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:10 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:12.077217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:12.078884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:12.086215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:12.086877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:12.087415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:12.088245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:12.088802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:12.089325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:12.264840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:12.273500 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee4e2c3d-b72c-498a-9fd5-292988ecb692 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1391 microversion: 2.1 time: 0.201906 Aug 29 16:07:12.274748 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2988/6151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:12 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:13.367841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:13.368529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:13.378189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:13.378351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:13.379170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:13.379953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:13.380490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:13.380997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:13.536174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:13.547549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e84af7bd-547c-496a-a5ed-f87c08732450 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1391 microversion: 2.1 time: 0.255501 Aug 29 16:07:13.548242 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3164/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:13 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:14.568284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:14.569613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:14.577634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:14.578446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:14.579144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:14.580089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:14.580807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:14.581486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:14.767910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:14.782134 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-676c0988-a1e6-488e-b626-463071e2cd66 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1391 microversion: 2.1 time: 0.217874 Aug 29 16:07:14.830812 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2989/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:14 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:15.832769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:15.833304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:15.841941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:15.842454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:15.846068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:15.850985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:15.852487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:15.854313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:15.855299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:15.914168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=10 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:16.026789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:16.037501 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d1b52097-4192-4586-bdf8-49de6d9d3bb4 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1391 microversion: 2.1 time: 0.214078 Aug 29 16:07:16.038295 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3165/6154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:15 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:16.996708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a1b13c67-04af-4ce5-991d-43ab58f2ee42 req-39df1598-be40-46a9-bf28-eda7e0cccc37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbc31a1-b29b-4248-842d-27f274cff9d9", "name": "network-vif-plugged", "status": "completed", "tag": "8704bd97-9d40-4812-8f32-b7af32256854"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:17.003495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:17.021614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a1b13c67-04af-4ce5-991d-43ab58f2ee42 req-39df1598-be40-46a9-bf28-eda7e0cccc37 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:17.022109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a1b13c67-04af-4ce5-991d-43ab58f2ee42 req-39df1598-be40-46a9-bf28-eda7e0cccc37 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:17.022542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a1b13c67-04af-4ce5-991d-43ab58f2ee42 req-39df1598-be40-46a9-bf28-eda7e0cccc37 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:17.044971 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a1b13c67-04af-4ce5-991d-43ab58f2ee42 req-39df1598-be40-46a9-bf28-eda7e0cccc37 service nova] Creating event network-vif-plugged:8704bd97-9d40-4812-8f32-b7af32256854 for instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 on n-h2-854882-3 Aug 29 16:07:17.052045 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a1b13c67-04af-4ce5-991d-43ab58f2ee42 req-39df1598-be40-46a9-bf28-eda7e0cccc37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060021 Aug 29 16:07:17.053346 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2990/6155] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:07:17.073518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:17.077047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:17.102646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:17.111921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:17.114122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:17.116365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:17.118653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:17.119196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:17.412175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:17.421407 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2297647b-a5ca-4ce4-9204-460e2d1fba7d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1391 microversion: 2.1 time: 0.364959 Aug 29 16:07:17.422259 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3166/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:17 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1391 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:18.415885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:18.417103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:18.423939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.426274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.426782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:18.428026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.428744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.429260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:18.444405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:18.445046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:18.465184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.465733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.466865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:18.467606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.468085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.479860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:18.573817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lazy-loading 'services' on Instance uuid 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:18.661117 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cef3162f-eec3-4931-8ecc-7b335cb38039 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0/os-volume_attachments/703843a5-7216-4061-a416-38cac70d0e5c" status: 202 len: 0 microversion: 2.1 time: 0.250691 Aug 29 16:07:18.661968 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2991/6157] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:07:18 2022] DELETE /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0/os-volume_attachments/703843a5-7216-4061-a416-38cac70d0e5c => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:07:18.809066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:18.817859 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-193d015e-036d-4c5e-91c0-629c97124760 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1563 microversion: 2.1 time: 0.377666 Aug 29 16:07:18.818454 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3167/6158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:18 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1563 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:18.838375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:18.839079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:18.846183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.846664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.847099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:18.847791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.848266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.848684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:18.990458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:18.998861 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-edb260c6-5690-4e64-9de5-29cc9f2f7630 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1563 microversion: 2.1 time: 0.164957 Aug 29 16:07:18.999480 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2992/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:18 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:19.709612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:19.710809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:19.718567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:19.719277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:19.719915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:19.720933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:19.721612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:19.722213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:19.856237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lazy-loading 'services' on Instance uuid 727ddf91-212b-441e-a5a6-a8c993c89263 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:19.938870 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-368f7fb3-fd1e-4ec3-b031-511eedbedd30 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263/os-volume_attachments/1ee326a6-9daf-4e4f-8540-088ba7049424" status: 202 len: 0 microversion: 2.1 time: 0.232651 Aug 29 16:07:19.940161 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3168/6160] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:07:19 2022] DELETE /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263/os-volume_attachments/1ee326a6-9daf-4e4f-8540-088ba7049424 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:07:20.780485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:20.781178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:20.782698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-38bea3ea-b7df-428d-88db-118589c611fd req-f508f9f5-d156-4b3d-87c3-410b77c11e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbc31a1-b29b-4248-842d-27f274cff9d9", "tag": "8704bd97-9d40-4812-8f32-b7af32256854"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:20.792899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.793417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.793887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.794602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.795061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.795491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.808145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38bea3ea-b7df-428d-88db-118589c611fd req-f508f9f5-d156-4b3d-87c3-410b77c11e21 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.808649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38bea3ea-b7df-428d-88db-118589c611fd req-f508f9f5-d156-4b3d-87c3-410b77c11e21 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.809095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-38bea3ea-b7df-428d-88db-118589c611fd req-f508f9f5-d156-4b3d-87c3-410b77c11e21 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.837787 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-38bea3ea-b7df-428d-88db-118589c611fd req-f508f9f5-d156-4b3d-87c3-410b77c11e21 service nova] Creating event network-changed:8704bd97-9d40-4812-8f32-b7af32256854 for instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 on n-h2-854882-3 Aug 29 16:07:20.843880 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-38bea3ea-b7df-428d-88db-118589c611fd req-f508f9f5-d156-4b3d-87c3-410b77c11e21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068504 Aug 29 16:07:20.845137 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3169/6161] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:20.979620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:20.991193 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-61c5214a-60fe-4d6c-8399-336ab4b7dc18 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1563 microversion: 2.1 time: 0.220731 Aug 29 16:07:20.993023 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2993/6162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:20 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:23.508835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:23.510047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:23.516971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.517512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.517972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.518694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.519169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.519624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.547188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:07:23.631694 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a13f0ce0-0041-4a40-b6bd-1ea65ebef788 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 204 len: 0 microversion: 2.1 time: 0.135395 Aug 29 16:07:23.632697 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3170/6163] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:07:23 2022] DELETE /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:07:23.640961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:23.641620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:23.652465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.652950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.653406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.654112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.654561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.654985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.657840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:23.795403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:23.803467 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-edc27488-c1b3-4a22-b88c-2ffe548afcbc tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1513 microversion: 2.1 time: 0.166326 Aug 29 16:07:23.803974 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2994/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:23 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:24.826744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:24.833859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:24.841493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.841997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.842448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.843167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.843634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.844073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.984588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:24.992894 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca070ebf-62ec-41bf-81b6-61dcdb159bf6 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1513 microversion: 2.1 time: 0.170887 Aug 29 16:07:24.993503 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3171/6165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:24 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:25.766012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-99a87c67-8c92-478f-9544-3be9217c6a39 req-51f63cd5-d655-4e66-9f4d-4879a061b7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ac63c0-412a-4b8a-989e-ed4a865ed4c0", "name": "network-vif-deleted", "tag": "24aa5828-936b-41d2-87e9-a2763206f014"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:25.778410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-99a87c67-8c92-478f-9544-3be9217c6a39 req-51f63cd5-d655-4e66-9f4d-4879a061b7a9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:25.779302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-99a87c67-8c92-478f-9544-3be9217c6a39 req-51f63cd5-d655-4e66-9f4d-4879a061b7a9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:25.779767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-99a87c67-8c92-478f-9544-3be9217c6a39 req-51f63cd5-d655-4e66-9f4d-4879a061b7a9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:25.795733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-99a87c67-8c92-478f-9544-3be9217c6a39 req-51f63cd5-d655-4e66-9f4d-4879a061b7a9 service nova] Creating event network-vif-deleted:24aa5828-936b-41d2-87e9-a2763206f014 for instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 on n-h1-854882-3 Aug 29 16:07:25.800717 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-99a87c67-8c92-478f-9544-3be9217c6a39 req-51f63cd5-d655-4e66-9f4d-4879a061b7a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039906 Aug 29 16:07:25.801610 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2995/6166] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:26.014730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:26.015372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:26.018373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:26.024265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:26.024769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:26.025226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:26.025982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:26.026458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:26.026906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:26.059274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:26.060422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:26.060922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:26.061405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lazy-loading 'fault' on Instance uuid 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:26.102031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e97edd3e10433ca84d2a6206c1c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df11b687fb547f1b9fbfa1850faae8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:26.111062 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1be979b0-c30a-4149-8b3b-8de16d1d54ac tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 200 len: 1308 microversion: 2.1 time: 0.100293 Aug 29 16:07:26.111975 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3172/6167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:26 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:27.134120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:27.134819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] [instance: 45ac63c0-412a-4b8a-989e-ed4a865ed4c0] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:27.141545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.142018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.142447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.143128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.143574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.143990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.157681 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] HTTP exception thrown: Instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 could not be found. Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Request method failure captured: Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 HTTP/1.1 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDONdpBeF-brN6gBeWiP9FyLW_G7QrjxinijcqgSEufeWLHqqSo1RE4aOemwQ--jlwPdKxqLoadeJxPqFAk9qAtDEjbhYUoS9EHGkA15bPKR0gOF1MLFQ_cUK_yo1fqZEC70VXaCeOqYHScGcIss5L86Rxcp0p1WEvgn2oSL0KGa-iqg Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 8df11b687fb547f1b9fbfa1850faae8d Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1099897162 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8df11b687fb547f1b9fbfa1850faae8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8df11b687fb547f1b9fbfa1850faae8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8df11b687fb547f1b9fbfa1850faae8d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8df11b687fb547f1b9fbfa1850faae8d"}]}] Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesSnapshotTestJSON-1099897162 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 8df11b687fb547f1b9fbfa1850faae8d Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1099897162 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesSnapshotTestJSON-1099897162-project Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f3e97edd3e10433ca84d2a6206c1c521 Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesSnapshotTestJSON-1099897162-project Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 could not be found. Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '45ac63c0-412a-4b8a-989e-ed4a865ed4c0'} Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 could not be found. Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 could not be found. Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:27.159313 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 could not be found. Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] Returning 404 to user: Instance 45ac63c0-412a-4b8a-989e-ed4a865ed4c0 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-09ea13af-4522-47fd-a0ae-44cdaf89c1d9 tempest-VolumesSnapshotTestJSON-1099897162 tempest-VolumesSnapshotTestJSON-1099897162-project] 10.222.0.16 "GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0" status: 404 len: 111 microversion: 2.1 time: 0.031896 Aug 29 16:07:27.163712 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2996/6168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:27 2022] GET /compute/v2.1/servers/45ac63c0-412a-4b8a-989e-ed4a865ed4c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:27.797455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:27.798004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:27.805072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.805603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.806307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.807019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.807481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.807950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.836176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:07:27.880330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:27.911868 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b816cc59-c8cd-4345-a5b9-0ae8871fa08f tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 204 len: 0 microversion: 2.1 time: 0.118001 Aug 29 16:07:27.912638 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3173/6169] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:07:27 2022] DELETE /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:07:27.921822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:27.922848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:27.928972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.929475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.929922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.930601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.931943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.932429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.067061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:28.075533 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fed35a90-4d58-435a-849a-0e7e9178e0dd tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1470 microversion: 2.1 time: 0.157928 Aug 29 16:07:28.076094 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2997/6170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:27 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:29.097443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:29.098161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:29.104933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:29.105451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:29.105897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:29.106596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:29.107063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:29.107497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:29.245435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:29.254420 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b1b21e4e-88ee-476a-b33a-77606af44146 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1470 microversion: 2.1 time: 0.161213 Aug 29 16:07:29.255026 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3174/6171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:29 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:30.071551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1973c6a3-2ee9-4e0b-a8f8-edd6716d296a req-551bdab7-b869-464a-8519-89f704167014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727ddf91-212b-441e-a5a6-a8c993c89263", "name": "network-vif-deleted", "tag": "2475d671-114e-4200-99bb-68844017d49a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:30.088497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:30.095525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1973c6a3-2ee9-4e0b-a8f8-edd6716d296a req-551bdab7-b869-464a-8519-89f704167014 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.096030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1973c6a3-2ee9-4e0b-a8f8-edd6716d296a req-551bdab7-b869-464a-8519-89f704167014 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.096787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1973c6a3-2ee9-4e0b-a8f8-edd6716d296a req-551bdab7-b869-464a-8519-89f704167014 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:30.113413 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1973c6a3-2ee9-4e0b-a8f8-edd6716d296a req-551bdab7-b869-464a-8519-89f704167014 service nova] Creating event network-vif-deleted:2475d671-114e-4200-99bb-68844017d49a for instance 727ddf91-212b-441e-a5a6-a8c993c89263 on n-h2-854882-3 Aug 29 16:07:30.118726 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1973c6a3-2ee9-4e0b-a8f8-edd6716d296a req-551bdab7-b869-464a-8519-89f704167014 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051043 Aug 29 16:07:30.119458 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2998/6172] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:07:30.275700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:30.276336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:30.283487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.283990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.284445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:30.285159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.285658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.286110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:30.318711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.319219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.319677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:30.320205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lazy-loading 'fault' on Instance uuid 727ddf91-212b-441e-a5a6-a8c993c89263 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:30.363391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75ae7a10ac14e0fb2b79127f39db44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d5ef767224e8fb02c48708db23238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:30.371459 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ddfb87f4-ae9e-4c33-a307-b8e801ffa7c5 tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 200 len: 1304 microversion: 2.1 time: 0.099827 Aug 29 16:07:30.372631 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3175/6173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:30 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:31.394774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:31.395381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] [instance: 727ddf91-212b-441e-a5a6-a8c993c89263] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:31.401727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:31.402211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:31.402647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:31.403944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:31.404396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:31.404822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:31.418478 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] HTTP exception thrown: Instance 727ddf91-212b-441e-a5a6-a8c993c89263 could not be found. Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Request method failure captured: Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 HTTP/1.1 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOPSJ3Sb9f1vQGBluVMyeZI72hBeQ2vECK9adfHPIJAyNA3VJBovHhWw-A9nRSauH5BFkusuCrtqy-wbU-tzrSvXneAIJ18ILtl4ZPD8ulxqGaQIhYmzlOIbpTAYAEdXvfBrs8fIBhWQbhUw3TSKRTizeUdkZpSt7iTtcAmX0GNXaeU Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 1e7d5ef767224e8fb02c48708db23238 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-VolumesBackupsTest-1692683812 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7d5ef767224e8fb02c48708db23238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e7d5ef767224e8fb02c48708db23238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e7d5ef767224e8fb02c48708db23238", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7d5ef767224e8fb02c48708db23238"}]}] Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-VolumesBackupsTest-1692683812 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 1e7d5ef767224e8fb02c48708db23238 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-VolumesBackupsTest-1692683812 Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-VolumesBackupsTest-1692683812-project Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f75ae7a10ac14e0fb2b79127f39db44f Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-VolumesBackupsTest-1692683812-project Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 727ddf91-212b-441e-a5a6-a8c993c89263 could not be found. Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '727ddf91-212b-441e-a5a6-a8c993c89263'} Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 727ddf91-212b-441e-a5a6-a8c993c89263 could not be found. Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 727ddf91-212b-441e-a5a6-a8c993c89263 could not be found. Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:31.420137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 727ddf91-212b-441e-a5a6-a8c993c89263 could not be found. Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] Returning 404 to user: Instance 727ddf91-212b-441e-a5a6-a8c993c89263 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e9090e07-b687-4425-b57c-4b9c3bbd1b7d tempest-VolumesBackupsTest-1692683812 tempest-VolumesBackupsTest-1692683812-project] 10.222.0.16 "GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263" status: 404 len: 111 microversion: 2.1 time: 0.032166 Aug 29 16:07:31.424535 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 2999/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:31 2022] GET /compute/v2.1/servers/727ddf91-212b-441e-a5a6-a8c993c89263 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:34.723749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:34.725511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:34.740161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:34.740672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:34.741126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:34.743024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:34.743323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:34.743768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:34.772701 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-268a698c-e426-4b25-a9d9-0300968e8e4c tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.054132 Aug 29 16:07:34.779038 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3176/6175] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 16:07:34 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4/os-server-password => generated 116 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:44.267615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:44.270551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:44.273664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:44.274506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=19 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:44.280168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.280882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.281520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.282411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.282861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.283463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.343986 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a428ccc9-2d82-4f62-b4ec-c94b0a1dcb9a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action" status: 200 len: 24564 microversion: 2.1 time: 0.080282 Aug 29 16:07:44.345064 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3000/6176] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:07:44 2022] POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action => generated 24564 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:07:55.420838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:55.421548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:55.428053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.429270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.431404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.431867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.432331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.433318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.433778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.434234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.620383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:55.643967 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8e01f45-13cf-4659-aa56-24fdf0e4d4be tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1681 microversion: 2.1 time: 0.223036 Aug 29 16:07:55.660952 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3177/6177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:55 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:55.765198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:55.769245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:55.783321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.783999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.786309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.786878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.787358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.788155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.788609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.789028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.846340 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8abc1b43-16da-4ee0-8e95-92e622beb0a8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action" status: 200 len: 32639 microversion: 2.1 time: 0.085496 Aug 29 16:07:55.847826 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3001/6178] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:07:55 2022] POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action => generated 32639 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:07:56.146397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:56.147315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:56.153945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.155036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.155682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.156579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.157218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.157845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.311179 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4fd21f09-9458-4ddb-af04-cedeb439ca9a tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1832 microversion: 2.1 time: 0.295467 Aug 29 16:07:56.312589 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3178/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:56 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1832 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:56.342586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:56.345488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:56.352587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.353072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.353727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.354619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.355234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.355821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.384524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lazy-loading 'flavor' on Instance uuid 4cbc31a1-b29b-4248-842d-27f274cff9d9 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:56.400392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Going to try to live migrate instance to another host {{(pid=130001) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 16:07:58.147281 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-914746b7-5e8f-4a25-b597-393e1f02b87f tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action" status: 202 len: 0 microversion: 2.1 time: 1.809301 Aug 29 16:07:58.148217 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3002/6180] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:07:56 2022] POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action => generated 0 bytes in 1811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:07:58.157104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:58.157831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:58.167681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:58.168496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:58.170468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:58.171454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:58.172093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:58.172728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:58.322410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:58.330828 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b643ee04-7212-4b01-b4d7-282a00723273 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1691 microversion: 2.1 time: 0.177913 Aug 29 16:07:58.331411 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3179/6181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:58 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:59.282894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-14c683ef-0cfd-472d-b6df-6fb6ab421f50 req-ec6e9b5b-a82b-4e62-9a0e-2db6eac0f8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbc31a1-b29b-4248-842d-27f274cff9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "8704bd97-9d40-4812-8f32-b7af32256854"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:59.297149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14c683ef-0cfd-472d-b6df-6fb6ab421f50 req-ec6e9b5b-a82b-4e62-9a0e-2db6eac0f8a6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:59.298044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14c683ef-0cfd-472d-b6df-6fb6ab421f50 req-ec6e9b5b-a82b-4e62-9a0e-2db6eac0f8a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:59.298697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-14c683ef-0cfd-472d-b6df-6fb6ab421f50 req-ec6e9b5b-a82b-4e62-9a0e-2db6eac0f8a6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:59.312593 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-14c683ef-0cfd-472d-b6df-6fb6ab421f50 req-ec6e9b5b-a82b-4e62-9a0e-2db6eac0f8a6 service nova] Creating event network-vif-unplugged:8704bd97-9d40-4812-8f32-b7af32256854 for instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 on n-h2-854882-3 Aug 29 16:07:59.326027 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-14c683ef-0cfd-472d-b6df-6fb6ab421f50 req-ec6e9b5b-a82b-4e62-9a0e-2db6eac0f8a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049406 Aug 29 16:07:59.327263 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3003/6182] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:59.352256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:59.352896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:59.360409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:59.361309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:59.362065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:59.363074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:59.363788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:59.364510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:59.552501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:59.566238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-308eec7f-3784-412b-90fb-b60d84ce8b20 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1691 microversion: 2.1 time: 0.217242 Aug 29 16:07:59.572537 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3180/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:59 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:00.590332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:00.591786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:00.599537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:00.600449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:00.601118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:00.602101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:00.602767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:00.603398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:00.769070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:00.780085 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3b2760b-bda8-4df3-a941-a0ff408f4162 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1691 microversion: 2.1 time: 0.192201 Aug 29 16:08:00.781676 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3004/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:00 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1691 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:01.361450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d0e36ca7-70da-4d70-9f4f-3a50a4253a1d req-cb304fbb-4e5a-4bbd-96a7-7b7c92486edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbc31a1-b29b-4248-842d-27f274cff9d9", "tag": "8704bd97-9d40-4812-8f32-b7af32256854"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:01.382100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d0e36ca7-70da-4d70-9f4f-3a50a4253a1d req-cb304fbb-4e5a-4bbd-96a7-7b7c92486edc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:01.382725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d0e36ca7-70da-4d70-9f4f-3a50a4253a1d req-cb304fbb-4e5a-4bbd-96a7-7b7c92486edc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:01.383240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d0e36ca7-70da-4d70-9f4f-3a50a4253a1d req-cb304fbb-4e5a-4bbd-96a7-7b7c92486edc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.395432 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d0e36ca7-70da-4d70-9f4f-3a50a4253a1d req-cb304fbb-4e5a-4bbd-96a7-7b7c92486edc service nova] Creating event network-changed:8704bd97-9d40-4812-8f32-b7af32256854 for instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 on n-h2-854882-3 Aug 29 16:08:01.401075 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d0e36ca7-70da-4d70-9f4f-3a50a4253a1d req-cb304fbb-4e5a-4bbd-96a7-7b7c92486edc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046278 Aug 29 16:08:01.405501 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3181/6185] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:01.805996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:01.807147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:01.816566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:01.817935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:01.818629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.820132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:01.820924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:01.822043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.974974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:01.986317 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-65b616e8-a957-4fd7-9361-01169e912e12 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1691 microversion: 2.1 time: 0.184404 Aug 29 16:08:01.987089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3005/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:01 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:03.010917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:03.011760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:03.018249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:03.018757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:03.019213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:03.020289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:03.020724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:03.021197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:03.167506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:03.198434 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff447fc3-5dcb-4b72-84a8-2e853a56e525 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1691 microversion: 2.1 time: 0.191070 Aug 29 16:08:03.199375 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3182/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:03 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:04.221138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:04.221979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:04.232641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:04.233514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:04.234185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:04.235308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:04.236037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:04.236704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:04.429170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:04.445148 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b7edf5b9-a660-410b-acb5-c26235e65b62 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1691 microversion: 2.1 time: 0.228585 Aug 29 16:08:04.448404 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3006/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:04 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1691 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:05.472639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:05.474350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:05.487619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:05.490496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:05.494046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:05.494881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:05.495321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:05.495770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:05.768166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:05.779599 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-43d803a1-17c8-478c-bf60-675049d4de46 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1691 microversion: 2.1 time: 0.310019 Aug 29 16:08:05.780826 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3183/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:05 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1691 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:06.802180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:06.803388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:06.811100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:06.812506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:06.813131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:06.814053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:06.814668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:06.815382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.029282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:07.038887 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-32a55a96-090d-485a-9d85-d3d85fc7a0a7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1681 microversion: 2.1 time: 0.240815 Aug 29 16:08:07.039721 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3007/6190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:06 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:07.062602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:07.063858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:07.072546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.073156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.073726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.074557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.075716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.076223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.225984 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d15a359-d731-4d6b-a349-007843d0baf0 tempest-TestNetworkAdvancedServerOps-476147526 tempest-TestNetworkAdvancedServerOps-476147526-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1832 microversion: 2.1 time: 0.168404 Aug 29 16:08:07.226690 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3184/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:07 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1832 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:07.250459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:07.251322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:07.259335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.260323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.260900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.261726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.262286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.262886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.465081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:07.475514 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b3501ab-0eda-4782-8bdf-b6d84efa685a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1681 microversion: 2.1 time: 0.230327 Aug 29 16:08:07.476638 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3008/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:07 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:07.615399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:07.617962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:07.624623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.625341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.626139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.627271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.628083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.628541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.687176 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-40e0b28c-ae29-4304-a21f-71641e529dd1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action" status: 200 len: 38628 microversion: 2.1 time: 0.077074 Aug 29 16:08:07.694720 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3185/6193] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:07 2022] POST /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9/action => generated 38628 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:08:09.219560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:09.220058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:09.230412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:09.236904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-304805da-9d1f-4bbb-90f8-ef8d1e1ad5da req-cd92e35d-3943-4006-a3e8-60b1db87f76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbc31a1-b29b-4248-842d-27f274cff9d9", "tag": "8704bd97-9d40-4812-8f32-b7af32256854"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:09.242110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:09.242601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.243342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:09.243806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:09.244226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.256328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-304805da-9d1f-4bbb-90f8-ef8d1e1ad5da req-cd92e35d-3943-4006-a3e8-60b1db87f76e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:09.256901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-304805da-9d1f-4bbb-90f8-ef8d1e1ad5da req-cd92e35d-3943-4006-a3e8-60b1db87f76e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:09.257257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-304805da-9d1f-4bbb-90f8-ef8d1e1ad5da req-cd92e35d-3943-4006-a3e8-60b1db87f76e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.281689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-304805da-9d1f-4bbb-90f8-ef8d1e1ad5da req-cd92e35d-3943-4006-a3e8-60b1db87f76e service nova] Creating event network-changed:8704bd97-9d40-4812-8f32-b7af32256854 for instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 on n-h1-854882-3 Aug 29 16:08:09.292787 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-304805da-9d1f-4bbb-90f8-ef8d1e1ad5da req-cd92e35d-3943-4006-a3e8-60b1db87f76e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060055 Aug 29 16:08:09.299089 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3186/6194] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:09.311513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:08:09.570228 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-69216c67-8bb8-4ff0-bedc-a8a12fcae94d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 204 len: 0 microversion: 2.1 time: 0.353710 Aug 29 16:08:09.572317 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3009/6195] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:09 2022] DELETE /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:08:09.581726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:09.582914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:09.595665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:09.602516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:09.603108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.603889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:09.604961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:09.605063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.826554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:09.837090 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85f39004-8c55-4c9e-99cb-ada2b44edb90 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1687 microversion: 2.1 time: 0.259470 Aug 29 16:08:09.837846 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3187/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:09 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1687 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:10.866179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:10.869744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:10.896692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.897288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.901915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:10.904039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.904587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.905074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.021173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:11.044324 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c107493e-bf8b-4cc8-b2f0-63af4c4adbbe tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 200 len: 1501 microversion: 2.1 time: 0.182814 Aug 29 16:08:11.044949 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3010/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:10 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:11.106246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7ba614f1-badd-42bc-a919-c5e7083119d3 req-3c5c0f7b-05c9-4151-afed-db3d6f8be385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbc31a1-b29b-4248-842d-27f274cff9d9", "name": "network-vif-deleted", "tag": "8704bd97-9d40-4812-8f32-b7af32256854"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:11.135595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7ba614f1-badd-42bc-a919-c5e7083119d3 req-3c5c0f7b-05c9-4151-afed-db3d6f8be385 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:11.136110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7ba614f1-badd-42bc-a919-c5e7083119d3 req-3c5c0f7b-05c9-4151-afed-db3d6f8be385 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:11.136567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7ba614f1-badd-42bc-a919-c5e7083119d3 req-3c5c0f7b-05c9-4151-afed-db3d6f8be385 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.157886 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7ba614f1-badd-42bc-a919-c5e7083119d3 req-3c5c0f7b-05c9-4151-afed-db3d6f8be385 service nova] Creating event network-vif-deleted:8704bd97-9d40-4812-8f32-b7af32256854 for instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 on n-h1-854882-3 Aug 29 16:08:11.164431 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7ba614f1-badd-42bc-a919-c5e7083119d3 req-3c5c0f7b-05c9-4151-afed-db3d6f8be385 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060997 Aug 29 16:08:11.166017 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3188/6198] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:12.066932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:12.067554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 4cbc31a1-b29b-4248-842d-27f274cff9d9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:12.074440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.075419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.075860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:12.076553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.077008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.077459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:12.091350 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] HTTP exception thrown: Instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 could not be found. Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Request method failure captured: Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 HTTP/1.1 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOMDofWL0Gi1PrJIY8t82vrIBBZztaj2mNO_3L1DtbH9leStvvDMCBkhbL7mNNLzYNjBscUFMF2Guoj7vN6KVc5Q9pi5V9tFjDj0bb8bJRUTAEHnRfvtnpJ7V0NxwCG5GfWcygmHRGhrhqJOq2_dgh88YvNXl077FRUJUonXEKnjLoY Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fa29b3844343454c8ade410470e7d897"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fa29b3844343454c8ade410470e7d897", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}] Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 64dd24ea45ac485d8d411837d7078301 Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 could not be found. Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '4cbc31a1-b29b-4248-842d-27f274cff9d9'} Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 could not be found. Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 could not be found. Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:08:12.092988 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 could not be found. Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Returning 404 to user: Instance 4cbc31a1-b29b-4248-842d-27f274cff9d9 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d27fcf2b-f41a-4a4a-beb8-7dc8ad994d88 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9" status: 404 len: 111 microversion: 2.1 time: 0.031498 Aug 29 16:08:12.097922 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3011/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:12 2022] GET /compute/v2.1/servers/4cbc31a1-b29b-4248-842d-27f274cff9d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:16.392741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-268eb864-ffd3-4e44-a51b-b3b6255d4c9d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '.version_select at 0x7fb0e0743af0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:16.429849 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-268eb864-ffd3-4e44-a51b-b3b6255d4c9d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-501949959" status: 202 len: 0 microversion: 2.1 time: 0.048152 Aug 29 16:08:16.430446 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3189/6200] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Aug 29 16:08:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-501949959 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:16.463326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57c487a1-902e-44da-ae08-84cad43c7a5a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: .version_select at 0x7fb0e31dd280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-48756906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7CcCeOTW8Bm536mcMmEpxVoX3HTmu86ErS7RA+eG1h14O/FOg8y5B13BM3l96hkkjeEa3qttGR9CF5sjgYwHtUoNHuYDzqvW+57CLlYqzVKCEQgqwJnR+69vm7HxlqIQ=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:16.480266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-57c487a1-902e-44da-ae08-84cad43c7a5a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:16.487184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-57c487a1-902e-44da-ae08-84cad43c7a5a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:16.521372 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57c487a1-902e-44da-ae08-84cad43c7a5a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.064862 Aug 29 16:08:16.522019 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3012/6201] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:08:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:25.808399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=58 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:25.814896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-987250549", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "df1bebd7-df6b-4a37-8789-459c6e503ed5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-48756906", "security_groups": [{"name": "tempest-secgroup-smoke-1952679514"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:25.834679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:26.004740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] validate_networks() for [('df1bebd7-df6b-4a37-8789-459c6e503ed5', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:26.768580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:26.769033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:26.769799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:26.770244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:26.770688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:26.794184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:26.794908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:26.795565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:26.798650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:26.799329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:26.800225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:26.852069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:26.859315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Getting quotas for user 64dd24ea45ac485d8d411837d7078301 and project fa29b3844343454c8ade410470e7d897. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:26.907649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:26.918755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:26.976084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:26.976585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:26.990206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:26.998513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:26.999196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:27.001126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.001655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.002094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.002833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.003272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.003701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.008703 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0883d5a8-e31e-4619-8296-622ce74231ca tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.202276 Aug 29 16:08:27.010007 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3190/6202] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:08:27.026371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5d4c999a-e567-4347-bd4b-85276bd11795 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:27.027332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5d4c999a-e567-4347-bd4b-85276bd11795 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:27.088642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:08:27.173337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5d4c999a-e567-4347-bd4b-85276bd11795 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:27.196440 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b77d3068-6b52-4d46-925f-4d19e374385c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 204 len: 0 microversion: 2.1 time: 0.223812 Aug 29 16:08:27.200685 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5d4c999a-e567-4347-bd4b-85276bd11795 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1264 microversion: 2.1 time: 0.178660 Aug 29 16:08:27.201608 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3013/6203] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:26 2022] DELETE /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:08:27.203418 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3191/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:27 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:27.207768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:27.208630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:27.216256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.217203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.219381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.221112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.221794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.222451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.451810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:27.463003 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cc03dce-8992-4388-9dcd-a2a6e65a2a1f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1576 microversion: 2.1 time: 0.259711 Aug 29 16:08:27.487546 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3014/6205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:27 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1576 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:28.224257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:28.225288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:28.244826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.247627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.249662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.253437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.254143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.254834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.392152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:28.401754 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1fa76b88-6d9e-4472-8a03-504436f95e23 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1268 microversion: 2.1 time: 0.182119 Aug 29 16:08:28.410595 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3192/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:28 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:28.490311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:28.491022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:28.508396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.508881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.509313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.510046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.516913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.517611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.948683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:28.976423 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b50b678d-65e9-407f-9a8c-b094536a7bf7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1576 microversion: 2.1 time: 0.490224 Aug 29 16:08:28.977016 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3015/6207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:28 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1576 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:29.431009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:29.431445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:29.446168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.446949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.447693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.448601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.449241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.449950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.684524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:29.693514 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26a01cea-4930-4c23-bb5f-cc7622b6b691 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1322 microversion: 2.1 time: 0.266435 Aug 29 16:08:29.694823 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3193/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:29 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:30.000142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:30.001420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:30.017505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.017969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.018417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:30.019135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.019778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.020217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:30.349455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:30.358037 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c8a9493c-87b6-465f-bfc8-eb4dbdf01391 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1576 microversion: 2.1 time: 0.361706 Aug 29 16:08:30.358635 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3016/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:29 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1576 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:30.726956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:30.728859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:30.740514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.741888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.743859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:30.747398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.748496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.750270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.380082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:31.381409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:31.392373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.398784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.399549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.400548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.401178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.401878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.789526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:31.813021 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-97af1b7e-6c69-40cd-8152-75a0b17c5b9f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1390 microversion: 2.1 time: 1.098135 Aug 29 16:08:31.816242 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3194/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:30 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1390 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:31.960944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8ba1f0fa-98ff-4e7d-a57f-7add34dba0fd req-3caa5b49-f65f-4c93-99cc-3ed85c174531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6b0469-45a3-449a-b5a6-bd19f196cecb", "name": "network-vif-deleted", "tag": "5ec0cd87-b778-4c36-ab31-84d01e2acc0e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:31.979927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8ba1f0fa-98ff-4e7d-a57f-7add34dba0fd req-3caa5b49-f65f-4c93-99cc-3ed85c174531 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.980456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8ba1f0fa-98ff-4e7d-a57f-7add34dba0fd req-3caa5b49-f65f-4c93-99cc-3ed85c174531 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.981145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8ba1f0fa-98ff-4e7d-a57f-7add34dba0fd req-3caa5b49-f65f-4c93-99cc-3ed85c174531 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.057520 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8ba1f0fa-98ff-4e7d-a57f-7add34dba0fd req-3caa5b49-f65f-4c93-99cc-3ed85c174531 service nova] Creating event network-vif-deleted:5ec0cd87-b778-4c36-ab31-84d01e2acc0e for instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb on n-h2-854882-3 Aug 29 16:08:32.064088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:32.078574 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a283c62-be7d-41cb-9e26-e83439c81b1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1509 microversion: 2.1 time: 0.702875 Aug 29 16:08:32.079177 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3017/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:31 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1509 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:32.096670 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8ba1f0fa-98ff-4e7d-a57f-7add34dba0fd req-3caa5b49-f65f-4c93-99cc-3ed85c174531 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139886 Aug 29 16:08:32.100364 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3195/6212] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:32.584635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-be426e8e-6692-4f9b-8282-674d95ac1a48 req-9196e49e-0f73-4580-b330-afef9a35b516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81afcd7f-8f18-43f8-9900-e82315e7bfba", "tag": "fb4244b4-5bd7-415a-b4e1-208214399ea7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:32.606579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-be426e8e-6692-4f9b-8282-674d95ac1a48 req-9196e49e-0f73-4580-b330-afef9a35b516 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.607084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-be426e8e-6692-4f9b-8282-674d95ac1a48 req-9196e49e-0f73-4580-b330-afef9a35b516 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.607495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-be426e8e-6692-4f9b-8282-674d95ac1a48 req-9196e49e-0f73-4580-b330-afef9a35b516 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.644757 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-be426e8e-6692-4f9b-8282-674d95ac1a48 req-9196e49e-0f73-4580-b330-afef9a35b516 service nova] Creating event network-changed:fb4244b4-5bd7-415a-b4e1-208214399ea7 for instance 81afcd7f-8f18-43f8-9900-e82315e7bfba on n-h1-854882-3 Aug 29 16:08:32.650384 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-be426e8e-6692-4f9b-8282-674d95ac1a48 req-9196e49e-0f73-4580-b330-afef9a35b516 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071218 Aug 29 16:08:32.651537 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3018/6213] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:32.836754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:32.837545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:32.848300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.854785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.861930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.862928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.863686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.864334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.105316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:33.111950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:33.148708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.150024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.151091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.158574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.159837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.161738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.440226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:33.471870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a14fa8c-ac3e-4355-8ed5-7c3d8f30a54a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1223 microversion: 2.1 time: 0.374251 Aug 29 16:08:33.485776 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3019/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:33 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1223 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:34.023113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:34.069988 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5fc8dc0c-0c74-44ba-b85d-1ad0ff471e48 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1390 microversion: 2.1 time: 1.231414 Aug 29 16:08:34.071910 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3196/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:32 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1390 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:34.524663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:34.527069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.540247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.541137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.543711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.545112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.548248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.549787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.703825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:34.716454 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-17197dd5-8496-43d7-9ff4-319015ed5f78 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1223 microversion: 2.1 time: 0.196926 Aug 29 16:08:34.718332 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3020/6216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:34 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1223 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:35.114225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:35.116079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:35.150893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.152578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.153212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.154366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.160032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.160728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.544063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:35.554499 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6b1bd470-3217-47c8-9f01-948e7e66dff1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1390 microversion: 2.1 time: 0.447746 Aug 29 16:08:35.555952 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3197/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:35 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1390 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:35.739741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:35.742687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:35.751340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.753055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.754421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.755427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.756065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.756662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.868744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:35.885598 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-93e602fb-a76d-4482-a658-f5a0937daf8a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1223 microversion: 2.1 time: 0.147912 Aug 29 16:08:35.886561 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3021/6218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:35 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:36.579143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:36.580212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:36.593708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.595405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.595895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.598267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.598377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.598791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.819684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:36.907820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:36.908449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:36.921962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.922371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.922811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.923535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.923984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.924410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.092224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:37.100416 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-933da54d-4563-4ca9-a21c-15612a3f4ea7 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1223 microversion: 2.1 time: 0.196400 Aug 29 16:08:37.103955 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3022/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:36 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1223 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:37.181444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:37.194515 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d639f674-7cdc-41e9-8df6-8dd7b6e35cf7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1390 microversion: 2.1 time: 0.622671 Aug 29 16:08:37.210094 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3198/6220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:36 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1390 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:38.128430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:38.129138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:38.144753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.145252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.146400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.147125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.147580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.148025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.219893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:38.221222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:38.238875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:38.254189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.256889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.257453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.261247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.262327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.262992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.310098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:38.337865 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d5565abd-f595-415d-bd8a-87f6281a1244 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1223 microversion: 2.1 time: 0.209163 Aug 29 16:08:38.339015 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3023/6221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:38 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1223 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:38.556561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:38.571692 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4126ba9-ae63-46bb-9f52-32d3ec19645b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1390 microversion: 2.1 time: 0.354349 Aug 29 16:08:38.573027 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3199/6222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:38 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:39.323380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe22b9fe-bd7a-4be4-ae53-0adecef15dc5 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-813076176", "availability_zone": "foo_zone"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:39.330814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.aggregate [None req-fe22b9fe-bd7a-4be4-ae53-0adecef15dc5 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Generated uuid b0f2edb4-f2d6-49a1-9086-70854e8398a4 for aggregate {{(pid=130001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 16:08:39.365937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-89e7a9f3-4bc1-4246-b040-2e71a8a480f1 req-82f703ff-508b-43fb-9e67-8001ef9baca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81afcd7f-8f18-43f8-9900-e82315e7bfba", "name": "network-vif-plugged", "status": "completed", "tag": "fb4244b4-5bd7-415a-b4e1-208214399ea7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:39.376712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-89e7a9f3-4bc1-4246-b040-2e71a8a480f1 req-82f703ff-508b-43fb-9e67-8001ef9baca2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.377872 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe22b9fe-bd7a-4be4-ae53-0adecef15dc5 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.270990 Aug 29 16:08:39.378372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-89e7a9f3-4bc1-4246-b040-2e71a8a480f1 req-82f703ff-508b-43fb-9e67-8001ef9baca2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.378996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-89e7a9f3-4bc1-4246-b040-2e71a8a480f1 req-82f703ff-508b-43fb-9e67-8001ef9baca2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.386391 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3024/6223] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Aug 29 16:08:39 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:39.393995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.405991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:39.413278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.413813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.414253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.414966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.415426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.415968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.426377 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-89e7a9f3-4bc1-4246-b040-2e71a8a480f1 req-82f703ff-508b-43fb-9e67-8001ef9baca2 service nova] Creating event network-vif-plugged:fb4244b4-5bd7-415a-b4e1-208214399ea7 for instance 81afcd7f-8f18-43f8-9900-e82315e7bfba on n-h1-854882-3 Aug 29 16:08:39.438718 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-89e7a9f3-4bc1-4246-b040-2e71a8a480f1 req-82f703ff-508b-43fb-9e67-8001ef9baca2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195880 Aug 29 16:08:39.440933 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3200/6224] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:39.459092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc84d176-56ff-4a59-a5c4-6f2b7426cbcc tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:39.502187 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc84d176-56ff-4a59-a5c4-6f2b7426cbcc tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.059666 Aug 29 16:08:39.509683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3201/6225] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 16:08:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:39.517202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.522392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.523095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.523705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.524603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.524741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:39.525372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.526026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.540948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a0a4a62-512b-4871-a348-eb9c3dbe4e70 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 200 len: 1223 microversion: 2.1 time: 0.152461 Aug 29 16:08:39.541899 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3025/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 1223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:39.566831 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99ed23ef-8807-473a-862a-1fe2d145307c tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055744 Aug 29 16:08:39.574395 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3202/6227] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:39.579786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a16f74b0-d0da-4379-b4c8-aef7f8f5c076 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.589016 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a16f74b0-d0da-4379-b4c8-aef7f8f5c076 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013126 Aug 29 16:08:39.597627 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3026/6228] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:39.599114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.599828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:39.603444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1b5218d5-9dd3-4da8-8e93-149c0b4b76bd tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854882-3"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:39.615251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b5218d5-9dd3-4da8-8e93-149c0b4b76bd tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.616610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b5218d5-9dd3-4da8-8e93-149c0b4b76bd tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.617232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1b5218d5-9dd3-4da8-8e93-149c0b4b76bd tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.619788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.622849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.623335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.624311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.624799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.625247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.797669 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1b5218d5-9dd3-4da8-8e93-149c0b4b76bd tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.198296 Aug 29 16:08:39.798801 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3027/6229] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 16:08:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:39.812766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b51e2550-9ce4-4d68-b4c5-ab7d83d637b9 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.824983 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b51e2550-9ce4-4d68-b4c5-ab7d83d637b9 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.017748 Aug 29 16:08:39.826570 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3028/6230] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:39.841069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc3049a1-e51c-4479-9989-4cf50c1398c5 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1297952094", "availability_zone": "foo_zone"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:39.871222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:39.893643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-433b78cb-b69c-40b3-9636-3f9b7bcb3a4c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1390 microversion: 2.1 time: 0.298085 Aug 29 16:08:39.895397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3203/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1390 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:40.003564 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dc3049a1-e51c-4479-9989-4cf50c1398c5 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.170326 Aug 29 16:08:40.004914 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3029/6232] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Aug 29 16:08:39 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:40.016070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3298edef-300b-45d8-88cf-6c33d42b51c5 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:40.049045 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3298edef-300b-45d8-88cf-6c33d42b51c5 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.037196 Aug 29 16:08:40.051275 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3204/6233] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 16:08:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:40.062600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ac4a5d9-961d-4e4a-bd66-c87ac5023dae tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.071427 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ac4a5d9-961d-4e4a-bd66-c87ac5023dae tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.012788 Aug 29 16:08:40.072097 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3030/6234] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 16:08:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:40.083915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7da29eff-d1a1-43e0-b680-eaeb7bc0aaf9 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854882-3"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:40.096880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7da29eff-d1a1-43e0-b680-eaeb7bc0aaf9 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.097516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7da29eff-d1a1-43e0-b680-eaeb7bc0aaf9 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.098195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7da29eff-d1a1-43e0-b680-eaeb7bc0aaf9 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.421243 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7da29eff-d1a1-43e0-b680-eaeb7bc0aaf9 tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.341100 Aug 29 16:08:40.423041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3205/6235] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Aug 29 16:08:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:40.435183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0ade24c7-8442-49fd-9d7b-39ae1c680b4f tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.476439 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0ade24c7-8442-49fd-9d7b-39ae1c680b4f tempest-TestAggregatesBasicOps-494050486 tempest-TestAggregatesBasicOps-494050486-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.045865 Aug 29 16:08:40.478007 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3031/6236] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 16:08:40 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 16:08:40.568608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.569445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:40.579846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.580591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.581506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.583527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.584684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.585420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.602204 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb HTTP/1.1 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '8d6b0469-45a3-449a-b5a6-bd19f196cecb'} Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:40.603895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-890ef6cc-0e0c-4f86-9bee-72dcfb75b8eb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 404 len: 111 microversion: 2.1 time: 0.041788 Aug 29 16:08:40.608445 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3206/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:40 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:40.729980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-155089876", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-95118366", "security_groups": [{"name": "tempest-secgroup-smoke-663029004"}], "block_device_mapping_v2": [{"uuid": "a09a0aba-33e5-4574-b796-aa54899a53eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:40.917040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.918222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:40.931355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.932714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.933295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:40.934602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.936162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.939260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.940834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.415475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:41.416295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:41.416925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:41.417542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:41.418665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:41.430233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.430919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.432016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.432887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.434258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.435019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.456285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:41.464120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:41.560297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:41.562933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a09a0aba-33e5-4574-b796-aa54899a53eb',volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:41.598479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:41.609982 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-309625b0-9632-45a3-bf76-2c27d70e51b7 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1562 microversion: 2.1 time: 0.697710 Aug 29 16:08:41.610569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3207/6238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:40 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1562 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:41.631720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:41.633177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:41.646723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.647507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.648231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.650864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.651673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.652526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.771571 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9bdeb754-6378-4669-a3b2-c555b684f95f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.045484 Aug 29 16:08:41.772812 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3032/6239] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:08:41.785503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-703d412f-a474-4ead-852a-b2343e589ca1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:41.787081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-703d412f-a474-4ead-852a-b2343e589ca1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:41.950085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-703d412f-a474-4ead-852a-b2343e589ca1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:41.959128 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-703d412f-a474-4ead-852a-b2343e589ca1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1092 microversion: 2.1 time: 0.179112 Aug 29 16:08:41.964997 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3033/6240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:41 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1092 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:42.056548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:42.066523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92903fca-beff-4b0c-a180-799f528d0afd tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1562 microversion: 2.1 time: 0.438982 Aug 29 16:08:42.095940 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3208/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:41 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1562 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:42.984575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:42.985972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:43.001089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.010535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.011634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.013258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.013998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.014672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.193170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:43.205198 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-378bf20a-52a0-47f7-82fb-a919cfa1408c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1190 microversion: 2.1 time: 0.225518 Aug 29 16:08:43.206485 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3034/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:42 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1190 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:44.229404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:44.230054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:44.251963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.252480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.252932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:44.256429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.256943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.257413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:44.767952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:44.777432 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a849932-24dc-4b5e-a011-c86e91ba9d10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1208 microversion: 2.1 time: 0.552395 Aug 29 16:08:44.780067 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3209/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:44 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1208 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:45.442264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:45.442889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:45.449877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c03742d9-b6ea-4189-b410-108cce45659c req-39261170-189b-4499-882c-432ae96405d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81afcd7f-8f18-43f8-9900-e82315e7bfba", "tag": "fb4244b4-5bd7-415a-b4e1-208214399ea7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:45.450376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:45.450481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:45.450908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:45.451610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:45.452068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:45.452497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:45.469704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c03742d9-b6ea-4189-b410-108cce45659c req-39261170-189b-4499-882c-432ae96405d5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:45.470497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c03742d9-b6ea-4189-b410-108cce45659c req-39261170-189b-4499-882c-432ae96405d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:45.471108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c03742d9-b6ea-4189-b410-108cce45659c req-39261170-189b-4499-882c-432ae96405d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:45.503539 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c03742d9-b6ea-4189-b410-108cce45659c req-39261170-189b-4499-882c-432ae96405d5 service nova] Creating event network-changed:fb4244b4-5bd7-415a-b4e1-208214399ea7 for instance 81afcd7f-8f18-43f8-9900-e82315e7bfba on n-h1-854882-3 Aug 29 16:08:45.509610 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c03742d9-b6ea-4189-b410-108cce45659c req-39261170-189b-4499-882c-432ae96405d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065168 Aug 29 16:08:45.510899 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3210/6244] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:45.801078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:45.802179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:45.822177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:45.823025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:45.823725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:45.825381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:45.826705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:45.829443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:46.289210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:46.302492 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cec86864-4687-45bb-98cb-dc0f9492d717 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1562 microversion: 2.1 time: 0.864923 Aug 29 16:08:46.305034 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3035/6245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:45 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1562 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:46.429871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:46.445852 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1216998b-0969-42e3-8449-d11a347b64fb tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1275 microversion: 2.1 time: 0.649294 Aug 29 16:08:46.474437 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3211/6246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:45 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1275 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:47.483129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:47.484052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:47.506852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.507352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.510765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:47.511773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.514110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.514591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:47.581361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:47.845558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:47.853822 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-752ac515-4e0a-4639-aa0f-043e063ea9bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1275 microversion: 2.1 time: 0.375587 Aug 29 16:08:47.854408 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3036/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:47 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1275 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:48.733812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3ce0b253-7c4c-4bd4-b120-d4b4728fd2f6 req-ed58a818-726c-4802-884c-55ace0bb52d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0de72a-7f17-4a9e-bcd8-28384e97ecc9", "tag": "cd1a99fb-e368-4f47-8add-4f232cca6f72"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:48.746303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3ce0b253-7c4c-4bd4-b120-d4b4728fd2f6 req-ed58a818-726c-4802-884c-55ace0bb52d8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:48.748627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3ce0b253-7c4c-4bd4-b120-d4b4728fd2f6 req-ed58a818-726c-4802-884c-55ace0bb52d8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:48.749257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3ce0b253-7c4c-4bd4-b120-d4b4728fd2f6 req-ed58a818-726c-4802-884c-55ace0bb52d8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:48.762950 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3ce0b253-7c4c-4bd4-b120-d4b4728fd2f6 req-ed58a818-726c-4802-884c-55ace0bb52d8 service nova] Creating event network-changed:cd1a99fb-e368-4f47-8add-4f232cca6f72 for instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 on n-h2-854882-3 Aug 29 16:08:48.768697 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3ce0b253-7c4c-4bd4-b120-d4b4728fd2f6 req-ed58a818-726c-4802-884c-55ace0bb52d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139027 Aug 29 16:08:48.769612 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3212/6248] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:48.878705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:48.880185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:48.892232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:48.901418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:48.903910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:48.905488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:48.906344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:48.909050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:48.909719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:49.582840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:49.594166 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c95e897-4a15-481b-9b3d-4c3e33ee81bf tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1275 microversion: 2.1 time: 0.720276 Aug 29 16:08:49.594913 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3037/6249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:48 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1275 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:50.618284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:50.619042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:50.621754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:50.629083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:50.629731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:50.630257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:50.631073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:50.631627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:50.632143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:50.907179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:50.920949 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-632f2867-24ca-48b1-a229-15fb4ebf4450 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1275 microversion: 2.1 time: 0.306675 Aug 29 16:08:50.936102 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3213/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:50 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1275 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:51.947126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:51.949060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:51.956786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:51.958374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:51.960475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.961177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.961662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.962390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.962849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.963285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:52.192732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:52.214160 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ca4d7710-011a-4a7b-9411-b3de4fa84092 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.273549 Aug 29 16:08:52.215501 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3038/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:51 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:53.239671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:53.240859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:53.248086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:53.248741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.249334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.250879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:53.251501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.252276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.270768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:53.426342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:53.451851 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b04d0b7-6711-464e-af8e-7c48c5a37b73 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.215942 Aug 29 16:08:53.452559 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3214/6252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:53 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:54.472928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:54.473575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:54.480435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:54.481537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:54.482150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:54.483038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:54.483493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:54.484100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:54.647103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:54.656456 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fd059a3c-3f68-46da-b75f-9e2b5221961c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.187288 Aug 29 16:08:54.657078 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3039/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:54 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:55.677424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:55.678319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:55.685600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:55.686202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:55.686742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:55.687650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:55.688118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:55.688709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:55.849036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:55.864020 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9c0493f4-d722-41d3-bae6-26b51d1d7d95 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.190610 Aug 29 16:08:55.864864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3215/6254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:55 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:56.887622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:56.888253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:56.897052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:56.897869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:56.899945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:56.900685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:56.901336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:56.901812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:57.303674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:57.333795 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1330f05c-9808-451b-b913-c40ee3eec79c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.451854 Aug 29 16:08:57.334898 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3040/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:56 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:58.355659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:58.356300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:58.375311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:58.377563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:58.378275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:58.379040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:58.380058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:58.380727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:58.381355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:58.643900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:58.653899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4578bf7c-a92d-422f-9ae3-caf10285c633 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.302076 Aug 29 16:08:58.656344 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3216/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:58 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:59.680566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:59.681874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:59.690269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:59.691115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:59.691660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:59.692471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:59.693033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:59.693605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:00.097844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:00.107813 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a62439af-e370-474f-abc6-6446dc632d88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.432309 Aug 29 16:09:00.108913 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3041/6257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:59 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:01.129909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:01.131478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:01.141346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.142055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.142597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.143427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.143998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.144539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.428506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b59e27c0-afb5-4966-b110-f2dc9d8e093d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'create', calling method: .version_select at 0x7fb0e31ddee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-702043702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBurggbnfraYu1b49IRc7vCsCmn6vVUqGKy8sWPi5+m137CmMlMaemBBjdCyNWRmaC2h/TT/h4bvfSj5Ow87Pd4qxaMWwjkVTxoHD2TOtoROjsicFmNINYtXa1S2x4hRZw=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:01.463666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b59e27c0-afb5-4966-b110-f2dc9d8e093d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for project 4bca2cda19a74c118c8564c694149b95. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:01.482106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b59e27c0-afb5-4966-b110-f2dc9d8e093d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for user 82d1a354ca7f421f803b50f2ff4a48c2 and project 4bca2cda19a74c118c8564c694149b95. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:01.521831 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b59e27c0-afb5-4966-b110-f2dc9d8e093d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.099746 Aug 29 16:09:01.523144 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3042/6258] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:09:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:09:01.544995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:01.557303 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b33f8211-41d0-4d48-8eda-6f9330dcd4ea tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.432286 Aug 29 16:09:01.557936 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3217/6259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:01 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:01.882709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-673a0de5-89b9-4a78-bd97-197d06d6c589 req-82606da1-4bcd-4740-b1d4-34d1ec8e2b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0de72a-7f17-4a9e-bcd8-28384e97ecc9", "name": "network-vif-plugged", "status": "completed", "tag": "cd1a99fb-e368-4f47-8add-4f232cca6f72"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:01.897472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-673a0de5-89b9-4a78-bd97-197d06d6c589 req-82606da1-4bcd-4740-b1d4-34d1ec8e2b8e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.898842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-673a0de5-89b9-4a78-bd97-197d06d6c589 req-82606da1-4bcd-4740-b1d4-34d1ec8e2b8e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.899489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-673a0de5-89b9-4a78-bd97-197d06d6c589 req-82606da1-4bcd-4740-b1d4-34d1ec8e2b8e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.951105 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-673a0de5-89b9-4a78-bd97-197d06d6c589 req-82606da1-4bcd-4740-b1d4-34d1ec8e2b8e service nova] Creating event network-vif-plugged:cd1a99fb-e368-4f47-8add-4f232cca6f72 for instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 on n-h2-854882-3 Aug 29 16:09:01.972151 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-673a0de5-89b9-4a78-bd97-197d06d6c589 req-82606da1-4bcd-4740-b1d4-34d1ec8e2b8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093158 Aug 29 16:09:01.974099 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3043/6260] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:09:02.578761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:02.579982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:02.586790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:02.587295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:02.587919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:02.588806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:02.589490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:02.590135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:02.810352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:02.818643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1642f4e6-891b-4236-a478-81c6bd21361c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1263 microversion: 2.1 time: 0.244276 Aug 29 16:09:02.819223 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3218/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:02 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1263 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:02.928306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1115634500", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "1fb177d3-7e20-4321-bb47-e8e5dbfdfe46"}], "key_name": "tempest-TestNetworkBasicOps-702043702", "security_groups": [{"name": "tempest-secgroup-smoke-1255296291"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:03.056322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] validate_networks() for [('1fb177d3-7e20-4321-bb47-e8e5dbfdfe46', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:09:03.513499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:09:03.514029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:09:03.514611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:09:03.515118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:09:03.515629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:09:03.524772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.525426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.525976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.526890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.527476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.527997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.553670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for project 4bca2cda19a74c118c8564c694149b95. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:03.560988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for user 82d1a354ca7f421f803b50f2ff4a48c2 and project 4bca2cda19a74c118c8564c694149b95. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:03.575538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:09:03.578160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:09:03.628151 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be2e3ee0-4438-4a23-b626-d37ac5178aef tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705503 Aug 29 16:09:03.633609 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3044/6262] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:09:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:09:03.653423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fae156ba-98bf-4480-a147-6bf5d77a6cc2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:03.653423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fae156ba-98bf-4480-a147-6bf5d77a6cc2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:03.723094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fae156ba-98bf-4480-a147-6bf5d77a6cc2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:03.732957 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fae156ba-98bf-4480-a147-6bf5d77a6cc2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1248 microversion: 2.1 time: 0.094705 Aug 29 16:09:03.742009 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3219/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:03 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:03.841098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:03.842037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:03.850666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.851225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.852142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.853522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.854406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.854887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.076801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:04.086084 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-668404b4-f7e6-46b0-97b8-2d9ac1954ce2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1451 microversion: 2.1 time: 0.249155 Aug 29 16:09:04.098169 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3045/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:03 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1451 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:04.119907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:04.121470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:04.149717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.150410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.150967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.152495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.153306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.154080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.388575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:04.432412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c11fce5e-c299-4502-9327-47a0f20be44a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1451 microversion: 2.1 time: 0.299681 Aug 29 16:09:04.433100 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3220/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:04 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1451 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:04.763794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:04.765586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:04.778253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.778751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.779200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.779910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.780368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.780798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.993253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:05.036018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:05.038418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:05.041018 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b4e14ab8-2bb0-4c24-ae2b-cb42cda09e49 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1300 microversion: 2.1 time: 0.281041 Aug 29 16:09:05.059131 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3046/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:04 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1300 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:05.061764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:05.062471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:05.077415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:05.079028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:05.079777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:05.080468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:05.181512 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-345ae41a-cd5f-4926-9b35-fd755cf2fcb0 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba/action" status: 200 len: 24563 microversion: 2.1 time: 0.153559 Aug 29 16:09:05.184374 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3221/6267] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:09:05 2022] POST /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba/action => generated 24563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:09:06.061751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:06.063429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:06.073241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.076261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.078245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.080346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.080989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.086473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.221155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:06.235513 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b8bf8b1-61c7-47b3-b939-f37d812031f3 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1306 microversion: 2.1 time: 0.177979 Aug 29 16:09:06.236721 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3047/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:06 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1306 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:07.153074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-687582ad-482e-4ce8-9eae-ded564adb6a2 req-17a9ab0a-6b6c-4fc5-9867-ce1a86f29818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0de72a-7f17-4a9e-bcd8-28384e97ecc9", "tag": "cd1a99fb-e368-4f47-8add-4f232cca6f72"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:07.167456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-687582ad-482e-4ce8-9eae-ded564adb6a2 req-17a9ab0a-6b6c-4fc5-9867-ce1a86f29818 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.168340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-687582ad-482e-4ce8-9eae-ded564adb6a2 req-17a9ab0a-6b6c-4fc5-9867-ce1a86f29818 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.168974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-687582ad-482e-4ce8-9eae-ded564adb6a2 req-17a9ab0a-6b6c-4fc5-9867-ce1a86f29818 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.192328 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-687582ad-482e-4ce8-9eae-ded564adb6a2 req-17a9ab0a-6b6c-4fc5-9867-ce1a86f29818 service nova] Creating event network-changed:cd1a99fb-e368-4f47-8add-4f232cca6f72 for instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 on n-h2-854882-3 Aug 29 16:09:07.197962 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-687582ad-482e-4ce8-9eae-ded564adb6a2 req-17a9ab0a-6b6c-4fc5-9867-ce1a86f29818 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050126 Aug 29 16:09:07.199722 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3222/6269] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:07.256988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:07.257642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:07.268878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.269919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.270601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.272144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.273042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.274020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.437133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:07.446489 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-373750e2-c85e-4a09-82df-546f4effe10f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1374 microversion: 2.1 time: 0.193129 Aug 29 16:09:07.465854 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3048/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:07 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:07.935143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1f420265-4cd5-418e-b329-50e5ff8b4749 req-b32681c5-4660-4e56-943f-019031b8a83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debc964f-8fc1-415e-812c-528a465ea1f7", "tag": "0f672571-d7af-4f04-8658-a28a28c19bfc"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:07.955857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1f420265-4cd5-418e-b329-50e5ff8b4749 req-b32681c5-4660-4e56-943f-019031b8a83c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.956360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1f420265-4cd5-418e-b329-50e5ff8b4749 req-b32681c5-4660-4e56-943f-019031b8a83c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.956812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1f420265-4cd5-418e-b329-50e5ff8b4749 req-b32681c5-4660-4e56-943f-019031b8a83c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.972184 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1f420265-4cd5-418e-b329-50e5ff8b4749 req-b32681c5-4660-4e56-943f-019031b8a83c service nova] Creating event network-changed:0f672571-d7af-4f04-8658-a28a28c19bfc for instance debc964f-8fc1-415e-812c-528a465ea1f7 on n-h2-854882-3 Aug 29 16:09:07.977724 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1f420265-4cd5-418e-b329-50e5ff8b4749 req-b32681c5-4660-4e56-943f-019031b8a83c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046762 Aug 29 16:09:07.979368 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3223/6271] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:08.470215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:08.470834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:08.477373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.481547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.482115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.482942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.483648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.484154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.656082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:08.663899 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5264869a-f6fe-4f8b-9d02-bd17cc77a1d2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1374 microversion: 2.1 time: 0.197495 Aug 29 16:09:08.664644 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3049/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:08 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:09.685777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:09.686515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:09.699614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.700039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.701460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.702378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.702871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.703311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.934370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:09.942787 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86196c6a-e0c7-4f11-8533-e0eeea60cfb9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1374 microversion: 2.1 time: 0.262074 Aug 29 16:09:09.943369 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3224/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:09 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1374 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:10.964187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:10.965587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:10.972425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.973020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.973593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.974385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.974938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.975472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:11.115052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:11.123479 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e40e92f-f818-4823-879e-c711b3c4b5b6 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1374 microversion: 2.1 time: 0.163356 Aug 29 16:09:11.124058 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3050/6274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:10 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:12.144390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:12.145093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:12.152881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.154036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.154500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.155224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.155826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.156282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.290013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:12.297936 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96829f5b-b75c-4595-9daf-b1a1d2589700 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1374 microversion: 2.1 time: 0.157605 Aug 29 16:09:12.298515 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3225/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:12 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:13.319429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:13.320042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:13.327851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.328335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.328956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.329687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.330140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.330566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.503194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:13.505726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-ec5b605b-d364-458b-a759-e917ba46e907 req-92be3c89-2ae2-4e6b-8855-f51a8746411b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debc964f-8fc1-415e-812c-528a465ea1f7", "name": "network-vif-plugged", "status": "completed", "tag": "0f672571-d7af-4f04-8658-a28a28c19bfc"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:13.513271 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6ec5f19d-9c58-47b9-b47f-9936ddfb9b22 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1374 microversion: 2.1 time: 0.197640 Aug 29 16:09:13.517465 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3051/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:13 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:13.524314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ec5b605b-d364-458b-a759-e917ba46e907 req-92be3c89-2ae2-4e6b-8855-f51a8746411b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.525028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ec5b605b-d364-458b-a759-e917ba46e907 req-92be3c89-2ae2-4e6b-8855-f51a8746411b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.525499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ec5b605b-d364-458b-a759-e917ba46e907 req-92be3c89-2ae2-4e6b-8855-f51a8746411b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.537351 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-ec5b605b-d364-458b-a759-e917ba46e907 req-92be3c89-2ae2-4e6b-8855-f51a8746411b service nova] Creating event network-vif-plugged:0f672571-d7af-4f04-8658-a28a28c19bfc for instance debc964f-8fc1-415e-812c-528a465ea1f7 on n-h2-854882-3 Aug 29 16:09:13.544796 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-ec5b605b-d364-458b-a759-e917ba46e907 req-92be3c89-2ae2-4e6b-8855-f51a8746411b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042696 Aug 29 16:09:13.545480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3226/6277] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:14.536320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:14.537800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:14.540287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:14.541255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:14.549740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.550367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.550822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.551549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.552058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.552530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.709617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:14.718618 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-058f2931-9cb7-4a1a-bc55-e111ea7754f2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1374 microversion: 2.1 time: 0.186732 Aug 29 16:09:14.719259 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3052/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:14 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:15.741348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:15.742852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:15.745119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:15.752037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.752590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.753037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.753783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.754250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.754688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.888638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:15.896503 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4ccd5ba-f21d-462e-a532-4f7a6d3af1fd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1546 microversion: 2.1 time: 0.160066 Aug 29 16:09:15.897073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3227/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:15 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:15.916735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:15.917885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:15.924717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.925216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.925696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.926392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.926850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.927278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.067115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:16.075127 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-51258fac-4b0d-4858-b93a-231499f43709 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1546 microversion: 2.1 time: 0.162240 Aug 29 16:09:16.075722 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3053/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:15 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:16.187775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:16.191310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:16.198302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.199262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.199893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.200797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.201456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.202067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.287146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:09:16.287891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:09:16.288583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:09:16.289230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:09:16.289896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:09:16.356581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:16.362704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.363432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.364052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.365644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.366317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.366919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.404617 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-99edc2d3-0714-4259-8301-083835f7fe6f tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba/action" status: 202 len: 1137 microversion: 2.1 time: 0.220791 Aug 29 16:09:16.422048 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3228/6281] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:09:16 2022] POST /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba/action => generated 1137 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 29 16:09:16.426337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:16.426967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:16.441375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.441904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.442536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.443434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.443898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.444526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.687479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:16.706444 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-74157ba8-993f-41f4-a7a1-286a5b8cf55a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.283852 Aug 29 16:09:16.723242 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3054/6282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:16 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:17.731718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:17.732366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:17.739173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.739672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.740126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.740835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.741331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.741814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.880276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:17.904144 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8f02b6cb-8716-4096-8f25-6d9ca72b6a1d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.176790 Aug 29 16:09:17.906352 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3229/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:17 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:18.055213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ecae34b9-72c6-49c1-bb0b-0a672cf7fc60 req-15d37223-0293-4eb4-9d8b-605b8b49c43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debc964f-8fc1-415e-812c-528a465ea1f7", "tag": "0f672571-d7af-4f04-8658-a28a28c19bfc"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:18.065541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ecae34b9-72c6-49c1-bb0b-0a672cf7fc60 req-15d37223-0293-4eb4-9d8b-605b8b49c43b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:18.066254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ecae34b9-72c6-49c1-bb0b-0a672cf7fc60 req-15d37223-0293-4eb4-9d8b-605b8b49c43b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:18.066694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ecae34b9-72c6-49c1-bb0b-0a672cf7fc60 req-15d37223-0293-4eb4-9d8b-605b8b49c43b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:18.070598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:18.079604 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ecae34b9-72c6-49c1-bb0b-0a672cf7fc60 req-15d37223-0293-4eb4-9d8b-605b8b49c43b service nova] Creating event network-changed:0f672571-d7af-4f04-8658-a28a28c19bfc for instance debc964f-8fc1-415e-812c-528a465ea1f7 on n-h2-854882-3 Aug 29 16:09:18.084665 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ecae34b9-72c6-49c1-bb0b-0a672cf7fc60 req-15d37223-0293-4eb4-9d8b-605b8b49c43b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201763 Aug 29 16:09:18.085343 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3055/6284] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:09:18.930588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:18.931860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:18.940166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:18.940951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:18.941350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:18.943345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:18.944317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:18.944780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.110041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:19.118254 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8391c306-b9f5-45fe-a235-4099f88e088a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.191749 Aug 29 16:09:19.119265 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3230/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:18 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:20.142229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:20.142918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:20.144859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:20.150494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.150982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.151431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:20.152132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.152619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.153050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:20.312177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:20.329444 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-055786c4-28e5-4de0-935a-14c126e686d8 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.192100 Aug 29 16:09:20.330482 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3056/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:20 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:21.356479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:21.357689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:21.366887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:21.367762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:21.368329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.369174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:21.369750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:21.370872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.516870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:21.525064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73e0f04f-44b1-4230-bcc1-8939da9b2220 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.173735 Aug 29 16:09:21.525683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3231/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:21 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:22.548419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:22.549044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:22.556197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.556685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.557127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.558132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.558591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.559021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.697168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:22.706916 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be013d68-b633-423b-8c51-652c5f74158e tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.162484 Aug 29 16:09:22.707708 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3057/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:22 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:23.728427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:23.729050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:23.736305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.736798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.737243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:23.737983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.738447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.738878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:23.741479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:23.883364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:23.892062 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-94100593-1ede-4a6f-b6dd-934e6c89fe65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.167695 Aug 29 16:09:23.892650 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3232/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:23 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:24.916613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:24.917783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:24.929808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:24.930551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:24.930992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:24.931771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:24.932248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:24.932933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:25.076120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:25.083947 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-94886167-ab58-4742-bcc6-504224373f30 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.174314 Aug 29 16:09:25.084526 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3058/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:24 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:26.106360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:26.107079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:26.114974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:26.115714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:26.116278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:26.117078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:26.117657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:26.118172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:26.265451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:26.274940 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2e9a506a-a04e-467e-a790-5b052c6a9127 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.172565 Aug 29 16:09:26.275561 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3233/6291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:26 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:27.295787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:27.296460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:27.304534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:27.305030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:27.305519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:27.306241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:27.306699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:27.307126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:27.460051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:27.468984 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2c2c994e-ff60-4ed8-9cfb-16e8d2619ac6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.177447 Aug 29 16:09:27.469590 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3059/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:27 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:28.491523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:28.492301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:28.495070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=42 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:28.501375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:28.502128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:28.502777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:28.503682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:28.504319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:28.504943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:28.656527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:28.664691 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-112c1eee-89e9-4d37-b671-1e3eb22f812a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.177246 Aug 29 16:09:28.665282 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3234/6293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:28 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:29.686218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:29.686840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:29.693872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:29.694364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:29.694804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:29.695509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:29.696006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:29.696433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:29.839884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:29.849926 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d253ef7a-bdb2-4e99-b5ed-9ba0274ef21b tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.167647 Aug 29 16:09:29.850523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3060/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:29 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:30.872684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:30.873970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:30.880804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:30.881304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:30.881803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:30.882518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:30.882994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:30.883435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.040799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:31.050840 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f9548d25-06d5-4a61-81b3-9a4242c0989c tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.182221 Aug 29 16:09:31.051592 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3235/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:30 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:32.073710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:32.074322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:32.082032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:32.082509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:32.082941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:32.083636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:32.084165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:32.084594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:32.234965 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:32.243590 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-abd32bd9-98ef-497e-946f-cfafe1adb031 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1690 microversion: 2.1 time: 0.173723 Aug 29 16:09:32.244203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3061/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:32 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:33.267905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:33.268705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:33.275602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.276127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.276576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:33.277290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.277910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.278347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:33.424278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:33.432250 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3b80574-f1ea-44e9-b999-c4d7d6ffe7de tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1696 microversion: 2.1 time: 0.170069 Aug 29 16:09:33.433095 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3236/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:33 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:34.454946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:34.455564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:34.462431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:34.462918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:34.463367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:34.464082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:34.464543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:34.464975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:34.617846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:34.626709 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aa883788-111c-4a2b-b542-72ccce42f3b6 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1696 microversion: 2.1 time: 0.176013 Aug 29 16:09:34.627665 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3062/6298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:34 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:35.648231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:35.648964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:35.656556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:35.657185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:35.657722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:35.658529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:35.659075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:35.659595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:35.808846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:35.818655 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c57530b-c7c9-41c7-9bd1-29570eacf25d tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1681 microversion: 2.1 time: 0.173571 Aug 29 16:09:35.819538 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3237/6299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:35 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:37.507580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5ec4077a-1855-46dc-9d19-4be20a832af3 req-b1082d85-6567-4530-8d80-00429c97a242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81afcd7f-8f18-43f8-9900-e82315e7bfba", "name": "network-vif-plugged", "status": "completed", "tag": "fb4244b4-5bd7-415a-b4e1-208214399ea7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:37.520191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ec4077a-1855-46dc-9d19-4be20a832af3 req-b1082d85-6567-4530-8d80-00429c97a242 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:37.520702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ec4077a-1855-46dc-9d19-4be20a832af3 req-b1082d85-6567-4530-8d80-00429c97a242 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:37.521230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5ec4077a-1855-46dc-9d19-4be20a832af3 req-b1082d85-6567-4530-8d80-00429c97a242 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:37.533608 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5ec4077a-1855-46dc-9d19-4be20a832af3 req-b1082d85-6567-4530-8d80-00429c97a242 service nova] Creating event network-vif-plugged:fb4244b4-5bd7-415a-b4e1-208214399ea7 for instance 81afcd7f-8f18-43f8-9900-e82315e7bfba on n-h1-854882-3 Aug 29 16:09:37.539051 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5ec4077a-1855-46dc-9d19-4be20a832af3 req-b1082d85-6567-4530-8d80-00429c97a242 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035314 Aug 29 16:09:37.540314 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3063/6300] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:09:40.208293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:40.210553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:40.217715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:40.218218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:40.218675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:40.219396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:40.219869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:40.220309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:40.272161 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d7c57f6d-9aa4-41a9-88ea-4f484e8209e9 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7/action" status: 200 len: 24567 microversion: 2.1 time: 0.067722 Aug 29 16:09:40.272849 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3238/6301] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:09:40 2022] POST /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7/action => generated 24567 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:09:56.216213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=15 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:56.217966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=45 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:56.225028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8ca1ee1-3781-4ebf-ba07-4423b5258778 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'create', calling method: .version_select at 0x7fb0e3244700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-621368187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgQ1MZycoejSpZkYj2rK9k9ER74PhWshoLVGU/8yiA/mn9L8dCiLBMS/InD0+pn5zxAUlivWfYhZ6S4/BiqF7TlR3DZ2PDCdVxPm91ixug/s2K6Sj8KdyK34RvEEZX14A=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:56.243672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a8ca1ee1-3781-4ebf-ba07-4423b5258778 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for project 4bca2cda19a74c118c8564c694149b95. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:56.250265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a8ca1ee1-3781-4ebf-ba07-4423b5258778 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for user 82d1a354ca7f421f803b50f2ff4a48c2 and project 4bca2cda19a74c118c8564c694149b95. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:56.276874 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8ca1ee1-3781-4ebf-ba07-4423b5258778 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.065099 Aug 29 16:09:56.277948 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3064/6302] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:09:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:57.532581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1244874347", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "123b13a9-9756-4ea0-a810-0e8c5c668b95"}], "key_name": "tempest-TestNetworkBasicOps-621368187", "security_groups": [{"name": "tempest-secgroup-smoke-1432561600"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:57.542285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=9 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:57.542959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=39 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:57.644536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] validate_networks() for [('123b13a9-9756-4ea0-a810-0e8c5c668b95', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:09:58.109904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:09:58.110346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:09:58.110843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:09:58.111296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:09:58.111792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:09:58.120754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.122146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.122513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.123268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.123742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.124370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.143671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for project 4bca2cda19a74c118c8564c694149b95. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:58.149435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for user 82d1a354ca7f421f803b50f2ff4a48c2 and project 4bca2cda19a74c118c8564c694149b95. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:58.165470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:09:58.168091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:09:58.228477 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6fa510db-085b-4d3e-9da3-7c88d144f7f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700380 Aug 29 16:09:58.229519 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3239/6303] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:09:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:09:58.241125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee55c267-b039-4375-bcc9-06342069f9f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:58.242468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee55c267-b039-4375-bcc9-06342069f9f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:58.370813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee55c267-b039-4375-bcc9-06342069f9f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:58.385539 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee55c267-b039-4375-bcc9-06342069f9f8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1248 microversion: 2.1 time: 0.148416 Aug 29 16:09:58.395073 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3065/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:58 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1248 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:59.409750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:59.411390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:59.421700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.422539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.423174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:59.423922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.424398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.424845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:59.516178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:59.525343 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aeb25e20-7f50-4880-9f54-b2f819d2f4cb tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1308 microversion: 2.1 time: 0.122701 Aug 29 16:09:59.526496 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3240/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:59 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:00.031636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:00.035329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:00.044973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.045901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.046592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.048520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.049095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.049945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.112413 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39478f9c-6642-4828-8fab-c09275492e3a tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "POST /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba/action" status: 200 len: 24550 microversion: 2.1 time: 0.084616 Aug 29 16:10:00.113983 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3066/6306] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:10:00 2022] POST /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba/action => generated 24550 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:10:00.549373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:00.551499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:00.559589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.560588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.561145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.562008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.562690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.563233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.731979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:00.746207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-897475a1-6b10-4fe6-995e-cca5edbaba28 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1374 microversion: 2.1 time: 0.203003 Aug 29 16:10:00.759964 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3241/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:00 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1374 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:01.229908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b45de037-f473-41eb-a17f-c3e65d345913 req-b56f6abf-92db-4a5f-9764-2c08c9a4b767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afe86a7-1134-479f-bef5-aa7198855fa5", "tag": "fa5db492-8271-4778-aa8b-9158c0ae6fc6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:01.255174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b45de037-f473-41eb-a17f-c3e65d345913 req-b56f6abf-92db-4a5f-9764-2c08c9a4b767 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:01.256294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b45de037-f473-41eb-a17f-c3e65d345913 req-b56f6abf-92db-4a5f-9764-2c08c9a4b767 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:01.256731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b45de037-f473-41eb-a17f-c3e65d345913 req-b56f6abf-92db-4a5f-9764-2c08c9a4b767 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:01.279758 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b45de037-f473-41eb-a17f-c3e65d345913 req-b56f6abf-92db-4a5f-9764-2c08c9a4b767 service nova] Creating event network-changed:fa5db492-8271-4778-aa8b-9158c0ae6fc6 for instance 2afe86a7-1134-479f-bef5-aa7198855fa5 on n-h1-854882-3 Aug 29 16:10:01.289374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b45de037-f473-41eb-a17f-c3e65d345913 req-b56f6abf-92db-4a5f-9764-2c08c9a4b767 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063940 Aug 29 16:10:01.290429 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3067/6308] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:01.767569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:01.768203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:01.775106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:01.775612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:01.776066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:01.776780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:01.777253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:01.777831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:01.918625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:01.926369 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a1c223b-ca9d-41d5-bd5f-1e7532484afd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1374 microversion: 2.1 time: 0.162723 Aug 29 16:10:01.926951 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3242/6309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:01 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:02.951479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:02.953005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:02.960930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.961757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.962423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.963151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.963616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.964051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:03.167020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:03.175506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8f6fdb35-e957-4b9e-a490-f741aa151eed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1374 microversion: 2.1 time: 0.230067 Aug 29 16:10:03.176238 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3068/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:02 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:04.197368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:04.198705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:04.206338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:04.207118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:04.207792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:04.208764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:04.209379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:04.209994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:04.357934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:04.366448 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0cf03db6-cfc9-444d-ac37-9ba2040f45ae tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1374 microversion: 2.1 time: 0.173102 Aug 29 16:10:04.367161 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3243/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:04 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:05.388558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:05.389202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:05.396926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:05.397432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:05.397873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:05.398602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:05.399058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:05.399484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:05.538684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:05.549039 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fd2a0580-3d4e-48ae-a031-89b190860a41 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1374 microversion: 2.1 time: 0.164378 Aug 29 16:10:05.549854 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3069/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:05 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:05.698141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-eccf55aa-76ca-497a-a2d3-4cf35a45cabe req-f402a3b2-0ee8-41f5-ac78-aa0ea72ad7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afe86a7-1134-479f-bef5-aa7198855fa5", "name": "network-vif-plugged", "status": "completed", "tag": "fa5db492-8271-4778-aa8b-9158c0ae6fc6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:05.712672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eccf55aa-76ca-497a-a2d3-4cf35a45cabe req-f402a3b2-0ee8-41f5-ac78-aa0ea72ad7d2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:05.713174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eccf55aa-76ca-497a-a2d3-4cf35a45cabe req-f402a3b2-0ee8-41f5-ac78-aa0ea72ad7d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:05.713659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-eccf55aa-76ca-497a-a2d3-4cf35a45cabe req-f402a3b2-0ee8-41f5-ac78-aa0ea72ad7d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:05.724879 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-eccf55aa-76ca-497a-a2d3-4cf35a45cabe req-f402a3b2-0ee8-41f5-ac78-aa0ea72ad7d2 service nova] Creating event network-vif-plugged:fa5db492-8271-4778-aa8b-9158c0ae6fc6 for instance 2afe86a7-1134-479f-bef5-aa7198855fa5 on n-h1-854882-3 Aug 29 16:10:05.730105 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-eccf55aa-76ca-497a-a2d3-4cf35a45cabe req-f402a3b2-0ee8-41f5-ac78-aa0ea72ad7d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035985 Aug 29 16:10:05.730903 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3244/6313] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:06.571629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:06.572882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:06.581273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:06.581996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:06.582618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:06.583425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:06.583978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:06.584785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:06.721641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:06.729373 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7fe0c2cf-6172-43fe-bcee-e303315d455b tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1374 microversion: 2.1 time: 0.161645 Aug 29 16:10:06.729959 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3070/6314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:06 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:07.750457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:07.751173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:07.758490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.758988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.759435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:07.760135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.760600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.761036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:07.895066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:07.904887 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b3419bdf-d8d2-4a60-aaa9-e9cdfd2c3ce0 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1547 microversion: 2.1 time: 0.158523 Aug 29 16:10:07.905514 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3245/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:07 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:07.926064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:07.926711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:07.934031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.934518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.934956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:07.935647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.936103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.936529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:08.073729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:08.082092 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a61f16bb-b183-4cbc-b5b5-463e67c372ee tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1547 microversion: 2.1 time: 0.160609 Aug 29 16:10:08.082660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3071/6316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:07 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:12.212072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bc4f2d96-c932-4bed-bcc1-c6e572561b8b req-6f1b884c-cb4e-4c8d-b277-84a3b7430eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81afcd7f-8f18-43f8-9900-e82315e7bfba", "tag": "fb4244b4-5bd7-415a-b4e1-208214399ea7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:12.215803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:12.216930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:12.230189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:12.232576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:12.232965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:12.247953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:12.251765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bc4f2d96-c932-4bed-bcc1-c6e572561b8b req-6f1b884c-cb4e-4c8d-b277-84a3b7430eb6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:12.260179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:12.260973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:12.261920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:12.262709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bc4f2d96-c932-4bed-bcc1-c6e572561b8b req-6f1b884c-cb4e-4c8d-b277-84a3b7430eb6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:12.263356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bc4f2d96-c932-4bed-bcc1-c6e572561b8b req-6f1b884c-cb4e-4c8d-b277-84a3b7430eb6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:12.263996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:12.267932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:12.300227 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bc4f2d96-c932-4bed-bcc1-c6e572561b8b req-6f1b884c-cb4e-4c8d-b277-84a3b7430eb6 service nova] Creating event network-changed:fb4244b4-5bd7-415a-b4e1-208214399ea7 for instance 81afcd7f-8f18-43f8-9900-e82315e7bfba on n-h1-854882-3 Aug 29 16:10:12.308986 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bc4f2d96-c932-4bed-bcc1-c6e572561b8b req-6f1b884c-cb4e-4c8d-b277-84a3b7430eb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100331 Aug 29 16:10:12.312108 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3072/6317] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:10:12.335784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:10:12.513957 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab364fe9-56f8-4323-8ab2-d2e665ea1b65 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 204 len: 0 microversion: 2.1 time: 0.309110 Aug 29 16:10:12.518987 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3246/6318] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:10:12 2022] DELETE /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:12.525097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:12.525961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:12.536128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:12.537063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:12.537745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:12.538642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:12.539450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:12.540044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:12.716631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:12.725210 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0de50667-444c-4377-a4a2-156da6ba0bf9 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1687 microversion: 2.1 time: 0.205219 Aug 29 16:10:12.738207 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3073/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:12 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1687 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:13.748896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:13.750165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:13.757410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:13.757941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:13.758400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:13.759131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:13.759606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:13.760056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:13.912384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:13.922853 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81d08054-e218-44da-a984-9c970172fee1 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1687 microversion: 2.1 time: 0.178283 Aug 29 16:10:13.923461 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3247/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:13 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:14.671539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ad9e92d3-9cfd-41c4-ad7b-31a7caec1ec9 req-175682d5-8405-4721-a0f4-14a0f852ec67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81afcd7f-8f18-43f8-9900-e82315e7bfba", "name": "network-vif-deleted", "tag": "fb4244b4-5bd7-415a-b4e1-208214399ea7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:14.685325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ad9e92d3-9cfd-41c4-ad7b-31a7caec1ec9 req-175682d5-8405-4721-a0f4-14a0f852ec67 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:14.685830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ad9e92d3-9cfd-41c4-ad7b-31a7caec1ec9 req-175682d5-8405-4721-a0f4-14a0f852ec67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:14.686254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ad9e92d3-9cfd-41c4-ad7b-31a7caec1ec9 req-175682d5-8405-4721-a0f4-14a0f852ec67 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:14.698025 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ad9e92d3-9cfd-41c4-ad7b-31a7caec1ec9 req-175682d5-8405-4721-a0f4-14a0f852ec67 service nova] Creating event network-vif-deleted:fb4244b4-5bd7-415a-b4e1-208214399ea7 for instance 81afcd7f-8f18-43f8-9900-e82315e7bfba on n-h1-854882-3 Aug 29 16:10:14.704289 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ad9e92d3-9cfd-41c4-ad7b-31a7caec1ec9 req-175682d5-8405-4721-a0f4-14a0f852ec67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036980 Aug 29 16:10:14.705025 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3074/6321] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:14.946220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:14.947095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:14.955086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:14.956158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:14.956925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:14.957920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:14.966625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:14.969738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:15.008849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:15.009476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:15.010126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:15.010597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lazy-loading 'fault' on Instance uuid 81afcd7f-8f18-43f8-9900-e82315e7bfba {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:10:15.063411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64dd24ea45ac485d8d411837d7078301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa29b3844343454c8ade410470e7d897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:15.071746 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6aaf7b22-c44a-4d32-a6d6-9fc9c97e9587 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 200 len: 1354 microversion: 2.1 time: 0.129370 Aug 29 16:10:15.072342 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3248/6322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:14 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 1354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:16.095018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:16.095859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] [instance: 81afcd7f-8f18-43f8-9900-e82315e7bfba] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:16.104270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.104764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.105203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.105940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.106425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.106822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.121364 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] HTTP exception thrown: Instance 81afcd7f-8f18-43f8-9900-e82315e7bfba could not be found. Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Request method failure captured: Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba HTTP/1.1 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOMDofWL0Gi1PrJIY8t82vrIBBZztaj2mNO_3L1DtbH9leStvvDMCBkhbL7mNNLzYNjBscUFMF2Guoj7vN6KVc5Q9pi5V9tFjDj0bb8bJRUTAEHnRfvtnpJ7V0NxwCG5GfWcygmHRGhrhqJOq2_dgh88YvNXl077FRUJUonXEKnjLoY Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fa29b3844343454c8ade410470e7d897"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fa29b3844343454c8ade410470e7d897", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa29b3844343454c8ade410470e7d897"}]}] Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: fa29b3844343454c8ade410470e7d897 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-700336131 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 64dd24ea45ac485d8d411837d7078301 Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-700336131-project Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 81afcd7f-8f18-43f8-9900-e82315e7bfba could not be found. Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '81afcd7f-8f18-43f8-9900-e82315e7bfba'} Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81afcd7f-8f18-43f8-9900-e82315e7bfba could not be found. Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81afcd7f-8f18-43f8-9900-e82315e7bfba could not be found. Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:16.123029 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81afcd7f-8f18-43f8-9900-e82315e7bfba could not be found. Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Returning 404 to user: Instance 81afcd7f-8f18-43f8-9900-e82315e7bfba could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1dba1fa0-617b-4d21-b8b0-a1bd3bf72c72 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba" status: 404 len: 111 microversion: 2.1 time: 0.034163 Aug 29 16:10:16.128301 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3075/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:16 2022] GET /compute/v2.1/servers/81afcd7f-8f18-43f8-9900-e82315e7bfba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:20.087925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3f262853-4f94-4c4e-be9b-7cd106668810 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] Calling method '.version_select at 0x7fb0e06a25e0>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:20.131126 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3f262853-4f94-4c4e-be9b-7cd106668810 tempest-TestNetworkAdvancedServerOps-700336131 tempest-TestNetworkAdvancedServerOps-700336131-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-48756906" status: 202 len: 0 microversion: 2.1 time: 0.056010 Aug 29 16:10:20.131863 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3249/6324] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 16:10:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-48756906 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:10:34.488768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:34.491614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:34.496101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:34.505487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=42 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:34.516670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:34.517752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:34.518634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:34.520189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:34.520813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:34.521250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:34.564381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:10:34.680269 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3be6d61b-edd9-4596-9322-336821bb272c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 204 len: 0 microversion: 2.1 time: 0.196145 Aug 29 16:10:34.681197 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3076/6325] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:10:34 2022] DELETE /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:34.691675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:34.694138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:34.696716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:34.698149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:34.745482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:34.747500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:34.748197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:34.751536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:34.753314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:34.753877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.247511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:35.258787 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f80669f4-d719-421b-9318-2dff8a1a99dd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1553 microversion: 2.1 time: 0.572646 Aug 29 16:10:35.259738 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3250/6326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:34 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1553 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:36.291907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:36.294523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:36.312943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.317900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.319071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.320636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.322276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.324001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.877290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:36.892531 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-44c8c2a8-a541-4425-9639-b46609243b8d tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 200 len: 1553 microversion: 2.1 time: 0.612212 Aug 29 16:10:36.897618 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3077/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:36 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 1553 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:37.005188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d39e587f-f3fe-4c03-ad03-72680fa4095c req-7fdf67d5-f1e6-4e9f-9572-13198728b7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afe86a7-1134-479f-bef5-aa7198855fa5", "name": "network-vif-deleted", "tag": "fa5db492-8271-4778-aa8b-9158c0ae6fc6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:37.028261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d39e587f-f3fe-4c03-ad03-72680fa4095c req-7fdf67d5-f1e6-4e9f-9572-13198728b7c8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.028990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d39e587f-f3fe-4c03-ad03-72680fa4095c req-7fdf67d5-f1e6-4e9f-9572-13198728b7c8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.029521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d39e587f-f3fe-4c03-ad03-72680fa4095c req-7fdf67d5-f1e6-4e9f-9572-13198728b7c8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.100220 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d39e587f-f3fe-4c03-ad03-72680fa4095c req-7fdf67d5-f1e6-4e9f-9572-13198728b7c8 service nova] Creating event network-vif-deleted:fa5db492-8271-4778-aa8b-9158c0ae6fc6 for instance 2afe86a7-1134-479f-bef5-aa7198855fa5 on n-h1-854882-3 Aug 29 16:10:37.129370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d39e587f-f3fe-4c03-ad03-72680fa4095c req-7fdf67d5-f1e6-4e9f-9572-13198728b7c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128392 Aug 29 16:10:37.138442 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3251/6328] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:37.918076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:37.919705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: 2afe86a7-1134-479f-bef5-aa7198855fa5] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:37.928454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.929634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.930399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.931814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.931910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.932460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.962350 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] HTTP exception thrown: Instance 2afe86a7-1134-479f-bef5-aa7198855fa5 could not be found. Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Request method failure captured: Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 HTTP/1.1 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOSWmHLoHz9xeKbAvUetmXcI6H3VxTta4iS8tNkJ6yNH7WsaZK_2fFbBLiYZ599mXUGi7V6HIxXnqBal_T0oz-WNvDGIbc9tSNF8Gnp73wpILKhXeDwEl-jWgK7iuSzAZPSkPX16ZMPFRB_S76x8zc4hknf9caojlu0sywuvpJvHnEI Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 4bca2cda19a74c118c8564c694149b95 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bca2cda19a74c118c8564c694149b95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4bca2cda19a74c118c8564c694149b95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4bca2cda19a74c118c8564c694149b95", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bca2cda19a74c118c8564c694149b95"}]}] Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 4bca2cda19a74c118c8564c694149b95 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkBasicOps-1270426923-project Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 82d1a354ca7f421f803b50f2ff4a48c2 Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkBasicOps-1270426923-project Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 2afe86a7-1134-479f-bef5-aa7198855fa5 could not be found. Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '2afe86a7-1134-479f-bef5-aa7198855fa5'} Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afe86a7-1134-479f-bef5-aa7198855fa5 could not be found. Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afe86a7-1134-479f-bef5-aa7198855fa5 could not be found. Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:37.964072 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afe86a7-1134-479f-bef5-aa7198855fa5 could not be found. Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Returning 404 to user: Instance 2afe86a7-1134-479f-bef5-aa7198855fa5 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a265867e-c1ad-4986-aec2-b6356263a8e7 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5" status: 404 len: 111 microversion: 2.1 time: 0.051976 Aug 29 16:10:37.968826 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3078/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:37 2022] GET /compute/v2.1/servers/2afe86a7-1134-479f-bef5-aa7198855fa5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:38.276322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3c13ee3-da69-4211-97da-3499a76d34dc tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '.version_select at 0x7fb0e06ec700>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:38.334529 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3c13ee3-da69-4211-97da-3499a76d34dc tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-621368187" status: 202 len: 0 microversion: 2.1 time: 0.063341 Aug 29 16:10:38.335139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3252/6330] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 16:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-621368187 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:10:42.694738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:42.694738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:42.705590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-14bef054-7c2b-4348-b10f-bf6a9ee4e234 req-77a47c60-ba75-40fb-9266-a7b9d9700dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debc964f-8fc1-415e-812c-528a465ea1f7", "tag": "0f672571-d7af-4f04-8658-a28a28c19bfc"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:42.723796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.724289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.724725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.726524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.729790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.730237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.739175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-14bef054-7c2b-4348-b10f-bf6a9ee4e234 req-77a47c60-ba75-40fb-9266-a7b9d9700dd8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.741792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-14bef054-7c2b-4348-b10f-bf6a9ee4e234 req-77a47c60-ba75-40fb-9266-a7b9d9700dd8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.743785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-14bef054-7c2b-4348-b10f-bf6a9ee4e234 req-77a47c60-ba75-40fb-9266-a7b9d9700dd8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.782528 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-14bef054-7c2b-4348-b10f-bf6a9ee4e234 req-77a47c60-ba75-40fb-9266-a7b9d9700dd8 service nova] Creating event network-changed:0f672571-d7af-4f04-8658-a28a28c19bfc for instance debc964f-8fc1-415e-812c-528a465ea1f7 on n-h2-854882-3 Aug 29 16:10:42.813899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-14bef054-7c2b-4348-b10f-bf6a9ee4e234 req-77a47c60-ba75-40fb-9266-a7b9d9700dd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110202 Aug 29 16:10:42.818489 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3253/6331] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:42.832822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:10:42.973129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0adf4efe-6a1e-4323-8bc8-c84f1f44eddd tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 204 len: 0 microversion: 2.1 time: 0.285306 Aug 29 16:10:42.978442 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3079/6332] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:10:42 2022] DELETE /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:42.984476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:42.985209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:42.994587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.995114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.995576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.996487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.996764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.997210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:43.254434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:43.271341 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7c1ff66b-9695-4eb6-946d-0c1e84d4d7e2 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1671 microversion: 2.1 time: 0.291839 Aug 29 16:10:43.275048 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3254/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:42 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1671 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:44.296490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:44.297225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:44.310232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.311045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.311737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.314020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.326427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.327169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.621426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:44.630051 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1f455368-1db8-40cc-97cb-ba696cdca4e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1671 microversion: 2.1 time: 0.339862 Aug 29 16:10:44.630656 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3080/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:44 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1671 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:45.654615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:45.655962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:45.665164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.665981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.666627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.668189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.668945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.669768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.675995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-03b9f6d7-03ac-40e4-9c0a-69c92bd55970 req-061a3969-225d-4149-a6bb-39e54d6da3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debc964f-8fc1-415e-812c-528a465ea1f7", "name": "network-vif-deleted", "tag": "0f672571-d7af-4f04-8658-a28a28c19bfc"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:45.717053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03b9f6d7-03ac-40e4-9c0a-69c92bd55970 req-061a3969-225d-4149-a6bb-39e54d6da3cc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.719886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03b9f6d7-03ac-40e4-9c0a-69c92bd55970 req-061a3969-225d-4149-a6bb-39e54d6da3cc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.720757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-03b9f6d7-03ac-40e4-9c0a-69c92bd55970 req-061a3969-225d-4149-a6bb-39e54d6da3cc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.751839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-03b9f6d7-03ac-40e4-9c0a-69c92bd55970 req-061a3969-225d-4149-a6bb-39e54d6da3cc service nova] Creating event network-vif-deleted:0f672571-d7af-4f04-8658-a28a28c19bfc for instance debc964f-8fc1-415e-812c-528a465ea1f7 on n-h2-854882-3 Aug 29 16:10:45.762766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-03b9f6d7-03ac-40e4-9c0a-69c92bd55970 req-061a3969-225d-4149-a6bb-39e54d6da3cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110581 Aug 29 16:10:45.766542 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3081/6335] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:45.815653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:45.836089 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f7a18530-0c71-4562-ac88-3fb0c8724879 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 200 len: 1484 microversion: 2.1 time: 0.186045 Aug 29 16:10:45.841783 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3255/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:45 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 1484 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:46.874999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:46.875769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: debc964f-8fc1-415e-812c-528a465ea1f7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:46.909452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.909968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.910418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:46.911143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.925858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.929265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.021452 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] HTTP exception thrown: Instance debc964f-8fc1-415e-812c-528a465ea1f7 could not be found. Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Request method failure captured: Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 HTTP/1.1 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOSWmHLoHz9xeKbAvUetmXcI6H3VxTta4iS8tNkJ6yNH7WsaZK_2fFbBLiYZ599mXUGi7V6HIxXnqBal_T0oz-WNvDGIbc9tSNF8Gnp73wpILKhXeDwEl-jWgK7iuSzAZPSkPX16ZMPFRB_S76x8zc4hknf9caojlu0sywuvpJvHnEI Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 4bca2cda19a74c118c8564c694149b95 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bca2cda19a74c118c8564c694149b95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4bca2cda19a74c118c8564c694149b95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4bca2cda19a74c118c8564c694149b95", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bca2cda19a74c118c8564c694149b95"}]}] Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 4bca2cda19a74c118c8564c694149b95 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkBasicOps-1270426923-project Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 82d1a354ca7f421f803b50f2ff4a48c2 Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkBasicOps-1270426923-project Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance debc964f-8fc1-415e-812c-528a465ea1f7 could not be found. Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'debc964f-8fc1-415e-812c-528a465ea1f7'} Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance debc964f-8fc1-415e-812c-528a465ea1f7 could not be found. Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance debc964f-8fc1-415e-812c-528a465ea1f7 could not be found. Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:47.034354 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:47.043918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:47.043918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:47.043918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:47.043918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:10:47.043918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:10:47.043918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance debc964f-8fc1-415e-812c-528a465ea1f7 could not be found. Aug 29 16:10:47.043918 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:10:47.048837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Returning 404 to user: Instance debc964f-8fc1-415e-812c-528a465ea1f7 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:10:47.053074 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b1dadba9-f383-4b94-912f-3a63e24f2c4e tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7" status: 404 len: 111 microversion: 2.1 time: 0.183697 Aug 29 16:10:47.053884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3082/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:46 2022] GET /compute/v2.1/servers/debc964f-8fc1-415e-812c-528a465ea1f7 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:47.501648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5326c4b1-b68c-43b4-a045-8536a15bbf0f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '.version_select at 0x7fb0e065f940>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:47.550421 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5326c4b1-b68c-43b4-a045-8536a15bbf0f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-702043702" status: 202 len: 0 microversion: 2.1 time: 0.055622 Aug 29 16:10:47.568935 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3256/6338] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 16:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-702043702 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:10:55.738200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-565221169", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-95118366", "security_groups": [{"name": "tempest-secgroup-smoke-663029004"}], "block_device_mapping_v2": [{"uuid": "3017a24f-ba85-4fa9-949e-60c2507b8434", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2324c8d-ba66-4845-839e-801a1b67b3ff"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:56.166687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] validate_networks() for [('b2324c8d-ba66-4845-839e-801a1b67b3ff', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:10:57.018510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:57.177960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:10:57.178686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:10:57.179279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:10:57.179839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:10:57.180360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:10:57.195829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:57.200753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:57.201805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:57.203786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:57.207446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:57.208298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:57.245428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:10:57.256702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Getting quotas for user e276b9fae4594c17a1883dd4e48184c2 and project 6fa1c2b97c8748ba831eb63c98d978c2. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:10:57.356195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:10:57.359451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3017a24f-ba85-4fa9-949e-60c2507b8434',volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:10:57.586949 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8d7644c-8a1c-49f0-b0da-fbaa160d6a1a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.860165 Aug 29 16:10:57.588554 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3083/6339] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:10:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:10:57.597641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=22 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:57.599010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:57.605025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8b38b82e-21db-47fb-af0d-51cd7a0a481f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:57.611054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8b38b82e-21db-47fb-af0d-51cd7a0a481f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:58.246820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8b38b82e-21db-47fb-af0d-51cd7a0a481f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:58.257491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8b38b82e-21db-47fb-af0d-51cd7a0a481f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1092 microversion: 2.1 time: 0.661716 Aug 29 16:10:58.260890 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3257/6340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:57 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1092 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:59.285716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:59.288624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:59.297406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:59.297957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:59.298582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:59.299726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:59.300351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:59.300950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:59.388329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:59.399955 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c4e0a5a4-9dc8-4eed-8ad9-5ebf47873b88 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1190 microversion: 2.1 time: 0.121157 Aug 29 16:10:59.400753 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3084/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:59 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1190 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:00.423420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:00.424069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:00.447486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:00.449067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:00.450431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:00.452853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:00.453559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:00.457227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:00.603263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:00.615901 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e74f332b-2c2b-4548-a80f-d126b93105b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1208 microversion: 2.1 time: 0.195466 Aug 29 16:11:00.616895 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3258/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:00 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1208 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:01.638066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:01.638683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:01.648145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:01.658487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:01.691678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:01.694544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:01.697088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:01.698381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:02.575877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:02.598988 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f17f3abd-c0ff-4e1e-bc48-6d0944873a27 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1275 microversion: 2.1 time: 0.962746 Aug 29 16:11:02.600841 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3085/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:01 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1275 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:03.102314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0384fafe-c6ca-41a0-921a-20436b6db9c0 req-f8536a96-0d2e-43bd-9a6e-2a564dcf8699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c300daac-2287-46c9-a193-41b68b641251", "tag": "649afc0d-e4da-4765-ac67-c99bd7d2d48a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:03.133524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0384fafe-c6ca-41a0-921a-20436b6db9c0 req-f8536a96-0d2e-43bd-9a6e-2a564dcf8699 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:03.134241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0384fafe-c6ca-41a0-921a-20436b6db9c0 req-f8536a96-0d2e-43bd-9a6e-2a564dcf8699 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:03.136203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0384fafe-c6ca-41a0-921a-20436b6db9c0 req-f8536a96-0d2e-43bd-9a6e-2a564dcf8699 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:03.203188 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0384fafe-c6ca-41a0-921a-20436b6db9c0 req-f8536a96-0d2e-43bd-9a6e-2a564dcf8699 service nova] Creating event network-changed:649afc0d-e4da-4765-ac67-c99bd7d2d48a for instance c300daac-2287-46c9-a193-41b68b641251 on n-h1-854882-3 Aug 29 16:11:03.227834 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0384fafe-c6ca-41a0-921a-20436b6db9c0 req-f8536a96-0d2e-43bd-9a6e-2a564dcf8699 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130372 Aug 29 16:11:03.228852 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3259/6344] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:03.628772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:03.629696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:03.655286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:03.657601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:03.667786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:03.669476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:03.670138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:03.671392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:04.400583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:04.415054 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4cddaa30-2851-442d-8b6a-6c89facdc71d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1275 microversion: 2.1 time: 0.797441 Aug 29 16:11:04.430412 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3086/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:03 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1275 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:05.438201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:05.440148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:05.449626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:05.451340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:05.452741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:05.453966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:05.454818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:05.455547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:06.024482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:06.079757 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ed0b862-42d3-4070-a59d-4c6e77209960 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1275 microversion: 2.1 time: 0.643822 Aug 29 16:11:06.080405 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3260/6346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:05 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1275 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:07.100277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:07.100894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:07.104403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:07.125573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:07.126376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:07.130013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:07.130950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:07.131717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:07.132355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:07.234201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:07.272385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:07.467054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:07.476967 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-870fdf51-5c1c-4f82-911a-5477bd6d136f tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1275 microversion: 2.1 time: 0.380527 Aug 29 16:11:07.483044 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3087/6347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:07 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1275 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:07.524221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f330edd-9a53-4d45-8cc6-c4547c2d70ed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'create', calling method: .version_select at 0x7fb0e0644c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1452064630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC12KILuDYQvo148rriLrJjLIUTMUf0kJmLoIO3opXQGVShZLeDpiEJAdmZr0w3HWSnruyz++FysOYWf9cj+zl0jVisDF/EysXdI2JBVQTpAG4sCpOBUublgHnDLj0xIRg=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:07.576159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5f330edd-9a53-4d45-8cc6-c4547c2d70ed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for project 4bca2cda19a74c118c8564c694149b95. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:11:07.597014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5f330edd-9a53-4d45-8cc6-c4547c2d70ed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for user 82d1a354ca7f421f803b50f2ff4a48c2 and project 4bca2cda19a74c118c8564c694149b95. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:11:07.650774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f330edd-9a53-4d45-8cc6-c4547c2d70ed tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.131143 Aug 29 16:11:07.652057 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3261/6348] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:11:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:08.503690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:08.505074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:08.521339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:08.524846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:08.525312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:08.526088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:08.526572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:08.526984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:08.798803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:08.808334 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d602b801-594b-49f4-9e67-e32913f3e1f5 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1275 microversion: 2.1 time: 0.308500 Aug 29 16:11:08.809581 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3088/6349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:08 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:09.429474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1073176628", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "68e334cc-821d-4fac-87e7-4b264351ec78"}], "key_name": "tempest-TestNetworkBasicOps-1452064630", "security_groups": [{"name": "tempest-secgroup-smoke-652909605"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:09.568345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] validate_networks() for [('68e334cc-821d-4fac-87e7-4b264351ec78', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:11:09.830768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:09.831933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:09.838666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:09.839155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:09.839595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:09.840300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:09.840753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:09.841214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:10.110034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:10.116051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:11:10.117748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:11:10.117748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:11:10.123821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:11:10.124316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:11:10.125150 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-587b6dc8-c7b7-4e5f-9534-bf2c3bf60aba tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1275 microversion: 2.1 time: 0.299346 Aug 29 16:11:10.139734 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3089/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:09 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1275 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:10.147850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:10.148375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:10.148835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:10.154179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:10.155750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:10.156402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:10.201159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for project 4bca2cda19a74c118c8564c694149b95. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:11:10.216392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Getting quotas for user 82d1a354ca7f421f803b50f2ff4a48c2 and project 4bca2cda19a74c118c8564c694149b95. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:11:10.257668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:11:10.262932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:11:10.376478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e178e55b-1218-4702-91fe-2ec30936301c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.951511 Aug 29 16:11:10.377967 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3262/6351] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:11:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:11:10.391111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-48e94eb2-aec3-4677-ae6b-2b7f0da35361 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:10.392259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-48e94eb2-aec3-4677-ae6b-2b7f0da35361 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:10.526236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48e94eb2-aec3-4677-ae6b-2b7f0da35361 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:10.544534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-48e94eb2-aec3-4677-ae6b-2b7f0da35361 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1249 microversion: 2.1 time: 0.160090 Aug 29 16:11:10.548205 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3090/6352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:10 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1249 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:11.149251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:11.150821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:11.159069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:11.160111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:11.160900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:11.162663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:11.163493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:11.164241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:11.369108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:11.380610 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66a8da25-a78c-43e4-8c73-ab22172d7e90 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.237564 Aug 29 16:11:11.382090 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3263/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:11 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:11.567069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:11.568434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:11.576801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:11.577613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:11.578241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:11.578956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:11.579599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:11.580209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:11.658113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:11.669808 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6b2b16f6-2772-4b95-9ae7-fa6712b1cb6a tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1301 microversion: 2.1 time: 0.106456 Aug 29 16:11:11.670760 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3091/6354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:11 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:12.402162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:12.402806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:12.423747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:12.424269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:12.427156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:12.429253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:12.430134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:12.430764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:12.667517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:12.684318 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-34f8df5c-ca61-45ea-a3dd-6a44bb7608b0 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.286077 Aug 29 16:11:12.686569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3264/6355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:12 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:12.699920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:12.700608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:12.715364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:12.721652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:12.725124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:12.726107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:12.727380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:12.728798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:12.912142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:12.923432 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36800d0f-26dd-4ed8-a438-cdb430316b90 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.228536 Aug 29 16:11:12.929519 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3092/6356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:12 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:13.591892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-436c7fb6-c0aa-4ae0-bb5f-8ce8d9039fa3 req-40c4e330-08dc-4c48-89af-21020203e286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b513b69f-8b2c-429c-9bbb-b5c48b3d47d8", "tag": "4f6f6494-fb2f-4aa7-9295-4a98747a6295"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:13.614042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-436c7fb6-c0aa-4ae0-bb5f-8ce8d9039fa3 req-40c4e330-08dc-4c48-89af-21020203e286 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.614594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-436c7fb6-c0aa-4ae0-bb5f-8ce8d9039fa3 req-40c4e330-08dc-4c48-89af-21020203e286 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.615235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-436c7fb6-c0aa-4ae0-bb5f-8ce8d9039fa3 req-40c4e330-08dc-4c48-89af-21020203e286 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:13.629947 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-436c7fb6-c0aa-4ae0-bb5f-8ce8d9039fa3 req-40c4e330-08dc-4c48-89af-21020203e286 service nova] Creating event network-changed:4f6f6494-fb2f-4aa7-9295-4a98747a6295 for instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 on n-h2-854882-3 Aug 29 16:11:13.635399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-436c7fb6-c0aa-4ae0-bb5f-8ce8d9039fa3 req-40c4e330-08dc-4c48-89af-21020203e286 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047298 Aug 29 16:11:13.636362 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3265/6357] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:13.708788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:13.709661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:13.721568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.722195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.722637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:13.723343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.728636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.729126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:13.899775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:13.908480 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b75ca32-a45e-4217-80de-9c80ddc1936b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.204839 Aug 29 16:11:13.922134 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3093/6358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:13 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:13.950979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:13.952359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:13.959229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.960061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.960970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:13.962095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.962797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.963463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:14.173747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:14.187031 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5f9cbc89-3f90-457d-97b3-7118e79c2ba5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.240197 Aug 29 16:11:14.188597 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3266/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:13 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:14.931032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:14.931754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:14.939970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:14.940512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:14.940907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:14.941800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:14.942261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:14.942689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:15.116428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:15.132555 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a1d41a7-44b5-43ca-ac82-660c4fce4a05 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.205556 Aug 29 16:11:15.134831 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3094/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:14 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:15.209206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:15.210119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:15.218602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:15.219244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:15.219863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:15.220722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:15.221311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:15.221868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:15.444762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:15.453537 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-48b9d040-dd5b-4a1f-ada1-2576caa25336 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.248513 Aug 29 16:11:15.454825 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3267/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:15 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:16.156201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:16.156975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:16.164494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:16.165106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:16.165678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:16.166590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:16.167145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:16.167687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:16.318272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:16.326570 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5bdecb53-9bc6-4a38-a822-cbc751bc77f9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.175646 Aug 29 16:11:16.327932 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3095/6362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:16 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:16.475999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:16.476647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:16.484279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:16.485067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:16.485607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:16.486351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:16.487061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:16.487528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:16.636797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:16.644598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-41b0d376-40b0-4b80-a945-b468ddb68c54 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.172592 Aug 29 16:11:16.645172 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3268/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:16 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:17.351135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:17.353013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:17.364740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.365751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.366751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:17.367626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.368483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.369098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:17.588348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:17.599952 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c8fa5801-e51d-442b-bb6f-61e436ba94d4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.255491 Aug 29 16:11:17.600585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3096/6364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:17 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:17.666000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:17.667348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:17.675263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.676143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.676492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:17.677228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.677905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.678356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:17.927204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:17.942341 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7265ef1e-25a5-4d94-a60e-3c86717fb235 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.280640 Aug 29 16:11:17.946553 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3269/6365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:17 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:18.627604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:18.630205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:18.638510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:18.639357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:18.639928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:18.640772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:18.641348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:18.641905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:18.856392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:18.869348 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-56ede7e1-6352-4daa-90d6-fe428881914e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.249019 Aug 29 16:11:18.870382 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3097/6366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:18 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:18.963504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:18.964144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:18.971941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:18.972805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:18.973474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:18.974904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:18.975547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:18.976157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:19.126868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:19.136619 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fa489578-2d9b-424d-9ff1-48b0eb339864 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.177174 Aug 29 16:11:19.137650 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3270/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:18 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:19.892416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:19.894371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:19.903489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:19.904053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:19.904778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:19.905727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:19.906275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:19.906844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:20.119721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:20.128541 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-263a2f44-ebda-4a39-8caa-86738267c289 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.241078 Aug 29 16:11:20.129145 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3098/6368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:19 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:20.156930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:20.157668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:20.169967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:20.171004 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:20.171468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:20.172203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:20.172668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:20.173111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:20.174081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:20.253575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:20.350987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-107a67fe-a8ae-4929-8bb9-99e89ff7ae0e req-0fa519d1-762b-4f0e-a8c3-7b53b429cabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b513b69f-8b2c-429c-9bbb-b5c48b3d47d8", "name": "network-vif-plugged", "status": "completed", "tag": "4f6f6494-fb2f-4aa7-9295-4a98747a6295"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:20.383706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-107a67fe-a8ae-4929-8bb9-99e89ff7ae0e req-0fa519d1-762b-4f0e-a8c3-7b53b429cabb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:20.384204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-107a67fe-a8ae-4929-8bb9-99e89ff7ae0e req-0fa519d1-762b-4f0e-a8c3-7b53b429cabb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:20.384702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-107a67fe-a8ae-4929-8bb9-99e89ff7ae0e req-0fa519d1-762b-4f0e-a8c3-7b53b429cabb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:20.415933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-107a67fe-a8ae-4929-8bb9-99e89ff7ae0e req-0fa519d1-762b-4f0e-a8c3-7b53b429cabb service nova] Creating event network-vif-plugged:4f6f6494-fb2f-4aa7-9295-4a98747a6295 for instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 on n-h2-854882-3 Aug 29 16:11:20.418421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:20.432156 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7973cc33-95be-4d66-9546-6c703a8aa470 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.279103 Aug 29 16:11:20.433486 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3271/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:20 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:20.449008 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-107a67fe-a8ae-4929-8bb9-99e89ff7ae0e req-0fa519d1-762b-4f0e-a8c3-7b53b429cabb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086062 Aug 29 16:11:20.451683 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3099/6370] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:21.158812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:21.159456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:21.166791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:21.167308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:21.167764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.168519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:21.168978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:21.169442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.327381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:21.335986 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bd3c9ef6-f7d6-4ee9-bfb2-f4927e6d493d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.180901 Aug 29 16:11:21.336608 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3272/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:21 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:21.455808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:21.456556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:21.461832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:21.465192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:21.465711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:21.466139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.466903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:21.467912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:21.468334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.627913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:21.636954 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59f57707-a6e9-444d-96d8-6afaa31f828f tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1374 microversion: 2.1 time: 0.185417 Aug 29 16:11:21.641513 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3100/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:21 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:22.357123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:22.357775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:22.364683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.365181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.365655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.366364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.366831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.367272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.479679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d479bba7-3730-48eb-a85f-423f5792fd5a req-cbd49de3-fb7a-455f-a087-c2e5a9737bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c300daac-2287-46c9-a193-41b68b641251", "name": "network-vif-plugged", "status": "completed", "tag": "649afc0d-e4da-4765-ac67-c99bd7d2d48a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:22.490128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d479bba7-3730-48eb-a85f-423f5792fd5a req-cbd49de3-fb7a-455f-a087-c2e5a9737bf9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.490792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d479bba7-3730-48eb-a85f-423f5792fd5a req-cbd49de3-fb7a-455f-a087-c2e5a9737bf9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.491214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d479bba7-3730-48eb-a85f-423f5792fd5a req-cbd49de3-fb7a-455f-a087-c2e5a9737bf9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.507653 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d479bba7-3730-48eb-a85f-423f5792fd5a req-cbd49de3-fb7a-455f-a087-c2e5a9737bf9 service nova] Creating event network-vif-plugged:649afc0d-e4da-4765-ac67-c99bd7d2d48a for instance c300daac-2287-46c9-a193-41b68b641251 on n-h1-854882-3 Aug 29 16:11:22.512389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:22.516534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d479bba7-3730-48eb-a85f-423f5792fd5a req-cbd49de3-fb7a-455f-a087-c2e5a9737bf9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040432 Aug 29 16:11:22.517209 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3101/6373] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:11:22.523200 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0cbe94a0-17d5-4c8c-8b88-3801348cde9d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.169844 Aug 29 16:11:22.523787 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3273/6374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:22 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:22.659770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:22.660645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:22.666887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.667436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.667953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.668714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.669231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.669760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.688855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:22.808303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:22.817134 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ac75950-848a-40cb-a04a-e9d6d006b3e5 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1547 microversion: 2.1 time: 0.162302 Aug 29 16:11:22.817740 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3102/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:22 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:22.838627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:22.839255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:22.845371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.845904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.846353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.847052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.847535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.847952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.984275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:22.992475 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b24f345f-0184-4a02-a736-1dd67d608179 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1547 microversion: 2.1 time: 0.157935 Aug 29 16:11:22.993755 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3274/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:22 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:23.544162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:23.544957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:23.552051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:23.552539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:23.553182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:23.553913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:23.554367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:23.554992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:23.754377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:23.762584 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d39f062-1bf0-432f-86d8-84be790118ef tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1263 microversion: 2.1 time: 0.222188 Aug 29 16:11:23.763631 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3103/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:23 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1263 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:24.787005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:24.788624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:24.803542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:24.804730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:24.805463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:24.806447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:24.807155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:24.807829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:25.053968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:25.072742 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ed6a8f01-93eb-49fa-890b-3fba28091ca9 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1451 microversion: 2.1 time: 0.290629 Aug 29 16:11:25.075231 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3275/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:24 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1451 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:25.097424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:25.099424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:25.127697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:25.129731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:25.130488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:25.131620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:25.134804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:25.135842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:25.333576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:25.350217 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6346d3d4-f60e-41d8-9d60-6cbe65ebfec2 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1451 microversion: 2.1 time: 0.260153 Aug 29 16:11:25.366161 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3104/6379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:25 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1451 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:25.819504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-14741f7c-256c-4258-910a-cba872ac3761 req-afc559d9-e735-43cb-b2f4-5d749ae1e5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b513b69f-8b2c-429c-9bbb-b5c48b3d47d8", "tag": "4f6f6494-fb2f-4aa7-9295-4a98747a6295"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:25.839261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-14741f7c-256c-4258-910a-cba872ac3761 req-afc559d9-e735-43cb-b2f4-5d749ae1e5ea service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:25.839760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-14741f7c-256c-4258-910a-cba872ac3761 req-afc559d9-e735-43cb-b2f4-5d749ae1e5ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:25.840202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-14741f7c-256c-4258-910a-cba872ac3761 req-afc559d9-e735-43cb-b2f4-5d749ae1e5ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:25.874212 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-14741f7c-256c-4258-910a-cba872ac3761 req-afc559d9-e735-43cb-b2f4-5d749ae1e5ea service nova] Creating event network-changed:4f6f6494-fb2f-4aa7-9295-4a98747a6295 for instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 on n-h2-854882-3 Aug 29 16:11:25.886176 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-14741f7c-256c-4258-910a-cba872ac3761 req-afc559d9-e735-43cb-b2f4-5d749ae1e5ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071192 Aug 29 16:11:25.889627 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3276/6380] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:27.797062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-063a9246-40bb-4fd4-83a4-c2d34d14e888 req-c81624f8-5c25-4082-b1ae-845afbd1e111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c300daac-2287-46c9-a193-41b68b641251", "tag": "649afc0d-e4da-4765-ac67-c99bd7d2d48a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:27.809665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-063a9246-40bb-4fd4-83a4-c2d34d14e888 req-c81624f8-5c25-4082-b1ae-845afbd1e111 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:27.810838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-063a9246-40bb-4fd4-83a4-c2d34d14e888 req-c81624f8-5c25-4082-b1ae-845afbd1e111 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:27.811602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-063a9246-40bb-4fd4-83a4-c2d34d14e888 req-c81624f8-5c25-4082-b1ae-845afbd1e111 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:27.823989 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-063a9246-40bb-4fd4-83a4-c2d34d14e888 req-c81624f8-5c25-4082-b1ae-845afbd1e111 service nova] Creating event network-changed:649afc0d-e4da-4765-ac67-c99bd7d2d48a for instance c300daac-2287-46c9-a193-41b68b641251 on n-h1-854882-3 Aug 29 16:11:27.841938 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-063a9246-40bb-4fd4-83a4-c2d34d14e888 req-c81624f8-5c25-4082-b1ae-845afbd1e111 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049118 Aug 29 16:11:27.843454 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3105/6381] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:38.356048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:38.356704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:38.359559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:38.360220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=92 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:38.367181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.368058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.368314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:38.368814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.369277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.369969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:38.399966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:11:38.484327 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e5b0e13-3ed6-430d-899d-9f5815a78239 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 204 len: 0 microversion: 2.1 time: 0.132436 Aug 29 16:11:38.485158 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3277/6382] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:11:38 2022] DELETE /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:11:38.491403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=39 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:38.492637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:38.496832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:38.497568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:38.512168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.512660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.513093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:38.513833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.514817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.515265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:38.649138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:38.656962 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bdc6e565-c545-4b88-9a16-dee5a2b2be0d tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1732 microversion: 2.1 time: 0.167672 Aug 29 16:11:38.657558 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3106/6383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:38 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:39.678695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:39.679426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:39.687288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:39.687789 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:39.688249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:39.688957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:39.689448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:39.689925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:39.833123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:39.841015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a722db47-50e1-4388-919b-0ed66f1dfeb0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1732 microversion: 2.1 time: 0.166868 Aug 29 16:11:39.841667 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3278/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:39 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:41.213528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d84f474e-cb25-4728-bd95-501411197dd1 req-6ee48d66-d2f8-410b-a49c-63fe55204991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43136247-64ba-4b4d-9558-875b4e6cb2d4", "name": "network-vif-deleted", "tag": "64b31523-21b4-4da1-b155-92e575bf4758"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:41.241129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d84f474e-cb25-4728-bd95-501411197dd1 req-6ee48d66-d2f8-410b-a49c-63fe55204991 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.241666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d84f474e-cb25-4728-bd95-501411197dd1 req-6ee48d66-d2f8-410b-a49c-63fe55204991 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.242118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d84f474e-cb25-4728-bd95-501411197dd1 req-6ee48d66-d2f8-410b-a49c-63fe55204991 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.263878 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d84f474e-cb25-4728-bd95-501411197dd1 req-6ee48d66-d2f8-410b-a49c-63fe55204991 service nova] Creating event network-vif-deleted:64b31523-21b4-4da1-b155-92e575bf4758 for instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 on n-h1-854882-3 Aug 29 16:11:41.274350 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d84f474e-cb25-4728-bd95-501411197dd1 req-6ee48d66-d2f8-410b-a49c-63fe55204991 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101070 Aug 29 16:11:41.278090 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3279/6385] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:41.323623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:41.324908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:41.336113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.336942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.337587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.340088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.340738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.342284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.385213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.385920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.386551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.387171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lazy-loading 'fault' on Instance uuid 43136247-64ba-4b4d-9558-875b4e6cb2d4 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:11:41.436242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627ff3308c2c43f28573edf551f779aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88deb8d5f864d368528400104c35e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:41.446919 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7b5430f4-9600-4b08-8f83-2e9199137844 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 200 len: 1388 microversion: 2.1 time: 0.587622 Aug 29 16:11:41.457026 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3107/6386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:40 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 1388 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:42.473399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:42.474150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:42.481354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:42.481891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:42.482349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:42.483069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:42.483549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:42.483999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:42.497489 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] HTTP exception thrown: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Request method failure captured: Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 HTTP/1.1 Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOQI_yyLogC8knA7prxvXXLigEhttJ7hOiIeIbonbgrLZ4CLaFre_SE6d9H2T2J-SBAJYiy2DqBukKChHDlIQ_2z9HLLRhlmBK9X_pnTnsxgMWbkGGpQXDPs_S0Sh9FMFdIgW9kTrQjWkKU_wluuZ_Aqrhspvrj-Cifn9J5pK00fllU Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: c88deb8d5f864d368528400104c35e1a Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestServerBasicOps-147067146 Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c88deb8d5f864d368528400104c35e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c88deb8d5f864d368528400104c35e1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c88deb8d5f864d368528400104c35e1a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c88deb8d5f864d368528400104c35e1a"}]}] Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestServerBasicOps-147067146 Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: c88deb8d5f864d368528400104c35e1a Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestServerBasicOps-147067146 Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestServerBasicOps-147067146-project Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 627ff3308c2c43f28573edf551f779aa Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestServerBasicOps-147067146-project Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '43136247-64ba-4b4d-9558-875b4e6cb2d4'} Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:42.499685 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Returning 404 to user: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:11:42.504508 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d71185cb-805a-4760-b77d-797947da6539 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 404 len: 111 microversion: 2.1 time: 0.032541 Aug 29 16:11:42.506529 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3280/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:42 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:11:42.968526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:42.969132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:42.975983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:42.976457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:42.976884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:42.977618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:42.978064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:42.978479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:42.992238 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] HTTP exception thrown: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Request method failure captured: Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 HTTP/1.1 Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOQI_yyLogC8knA7prxvXXLigEhttJ7hOiIeIbonbgrLZ4CLaFre_SE6d9H2T2J-SBAJYiy2DqBukKChHDlIQ_2z9HLLRhlmBK9X_pnTnsxgMWbkGGpQXDPs_S0Sh9FMFdIgW9kTrQjWkKU_wluuZ_Aqrhspvrj-Cifn9J5pK00fllU Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: c88deb8d5f864d368528400104c35e1a Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestServerBasicOps-147067146 Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c88deb8d5f864d368528400104c35e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c88deb8d5f864d368528400104c35e1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c88deb8d5f864d368528400104c35e1a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c88deb8d5f864d368528400104c35e1a"}]}] Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestServerBasicOps-147067146 Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: c88deb8d5f864d368528400104c35e1a Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestServerBasicOps-147067146 Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestServerBasicOps-147067146-project Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 627ff3308c2c43f28573edf551f779aa Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestServerBasicOps-147067146-project Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '43136247-64ba-4b4d-9558-875b4e6cb2d4'} Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:11:42.993940 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Returning 404 to user: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7cfdbab8-2893-49d0-97ec-8a5bea1a88c0 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 404 len: 111 microversion: 2.1 time: 0.031293 Aug 29 16:11:42.999159 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3108/6388] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:11:42 2022] DELETE /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:11:43.006134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:43.006776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] [instance: 43136247-64ba-4b4d-9558-875b4e6cb2d4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:43.012699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:43.013197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:43.013705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:43.014458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:43.014934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:43.015380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:43.028596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] HTTP exception thrown: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Request method failure captured: Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 HTTP/1.1 Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOQI_yyLogC8knA7prxvXXLigEhttJ7hOiIeIbonbgrLZ4CLaFre_SE6d9H2T2J-SBAJYiy2DqBukKChHDlIQ_2z9HLLRhlmBK9X_pnTnsxgMWbkGGpQXDPs_S0Sh9FMFdIgW9kTrQjWkKU_wluuZ_Aqrhspvrj-Cifn9J5pK00fllU Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: c88deb8d5f864d368528400104c35e1a Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestServerBasicOps-147067146 Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c88deb8d5f864d368528400104c35e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c88deb8d5f864d368528400104c35e1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c88deb8d5f864d368528400104c35e1a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c88deb8d5f864d368528400104c35e1a"}]}] Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestServerBasicOps-147067146 Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: c88deb8d5f864d368528400104c35e1a Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestServerBasicOps-147067146 Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestServerBasicOps-147067146-project Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 627ff3308c2c43f28573edf551f779aa Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestServerBasicOps-147067146-project Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '43136247-64ba-4b4d-9558-875b4e6cb2d4'} Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:43.030678 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Returning 404 to user: Instance 43136247-64ba-4b4d-9558-875b4e6cb2d4 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c48419e3-4432-4103-b74e-433d9e3b8d64 tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4" status: 404 len: 111 microversion: 2.1 time: 0.029922 Aug 29 16:11:43.036881 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3281/6389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:43 2022] GET /compute/v2.1/servers/43136247-64ba-4b4d-9558-875b4e6cb2d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:11:43.205177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-582cee01-9f30-48f2-8fbd-7a79f1d8d10e tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] Calling method '.version_select at 0x7fb0e28f8ee0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:43.228930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-582cee01-9f30-48f2-8fbd-7a79f1d8d10e tempest-TestServerBasicOps-147067146 tempest-TestServerBasicOps-147067146-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-262606987" status: 202 len: 0 microversion: 2.1 time: 0.028723 Aug 29 16:11:43.229902 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3109/6390] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 16:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-262606987 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:11:46.461995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:46.464024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:46.480947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:46.483745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:46.484547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:46.485744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:46.486396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:46.487033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:46.591707 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c05c7b09-75af-417e-a485-0b7fd946ea3c tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8/action" status: 200 len: 24571 microversion: 2.1 time: 0.135241 Aug 29 16:11:46.592828 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3282/6391] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:11:46 2022] POST /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8/action => generated 24571 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:11:57.749473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:57.752042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:57.761229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:57.762783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:57.765649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:57.766522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:57.767233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:57.768136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:57.768767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:57.769361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:57.839131 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-95257da6-2d38-4171-8862-2976205d0e93 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "POST /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8/action" status: 200 len: 32649 microversion: 2.1 time: 0.095592 Aug 29 16:11:57.840740 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3110/6392] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:11:57 2022] POST /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8/action => generated 32649 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:11:59.378002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:59.381350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-33055607-58d9-4faf-ad4a-5c1540749694 req-153583a3-d893-4ec9-a965-d6f42578013e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b513b69f-8b2c-429c-9bbb-b5c48b3d47d8", "tag": "4f6f6494-fb2f-4aa7-9295-4a98747a6295"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:59.381827 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:59.399709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:59.400775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:59.415638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-33055607-58d9-4faf-ad4a-5c1540749694 req-153583a3-d893-4ec9-a965-d6f42578013e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.416144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-33055607-58d9-4faf-ad4a-5c1540749694 req-153583a3-d893-4ec9-a965-d6f42578013e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.416588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-33055607-58d9-4faf-ad4a-5c1540749694 req-153583a3-d893-4ec9-a965-d6f42578013e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.426536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.430601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.439528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.442938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.444483 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-33055607-58d9-4faf-ad4a-5c1540749694 req-153583a3-d893-4ec9-a965-d6f42578013e service nova] Creating event network-changed:4f6f6494-fb2f-4aa7-9295-4a98747a6295 for instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 on n-h2-854882-3 Aug 29 16:11:59.447733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.448244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.458573 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-33055607-58d9-4faf-ad4a-5c1540749694 req-153583a3-d893-4ec9-a965-d6f42578013e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080988 Aug 29 16:11:59.459742 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3111/6393] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:11:59.532127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:11:59.658057 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-17cef8f0-1217-400b-a7c3-58a02f041d73 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 204 len: 0 microversion: 2.1 time: 0.281506 Aug 29 16:11:59.663690 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3283/6394] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:11:59 2022] DELETE /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:11:59.669803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:59.670516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:59.691324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.693446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.701811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.702948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.703433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.704059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:00.000569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:00.009909 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-482ceafc-4a87-4370-a1b0-470ec33fae25 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1672 microversion: 2.1 time: 0.345906 Aug 29 16:12:00.023109 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3112/6395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:59 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1672 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:01.042744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:01.043706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:01.056093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.060421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.061042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.064677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.065308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.065910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.848365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:01.865365 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ed84a5e0-379d-4d3e-ac07-2919de8f93ce tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1672 microversion: 2.1 time: 0.827261 Aug 29 16:12:01.866381 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3284/6396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:01 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1672 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:02.411482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a0e47e68-1ade-4160-a33b-cbf0866911a5 req-5fe78930-d440-40ad-a827-603b85a141e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b513b69f-8b2c-429c-9bbb-b5c48b3d47d8", "name": "network-vif-deleted", "tag": "4f6f6494-fb2f-4aa7-9295-4a98747a6295"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:02.433012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a0e47e68-1ade-4160-a33b-cbf0866911a5 req-5fe78930-d440-40ad-a827-603b85a141e2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:02.433653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a0e47e68-1ade-4160-a33b-cbf0866911a5 req-5fe78930-d440-40ad-a827-603b85a141e2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:02.434979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a0e47e68-1ade-4160-a33b-cbf0866911a5 req-5fe78930-d440-40ad-a827-603b85a141e2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:02.464951 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a0e47e68-1ade-4160-a33b-cbf0866911a5 req-5fe78930-d440-40ad-a827-603b85a141e2 service nova] Creating event network-vif-deleted:4f6f6494-fb2f-4aa7-9295-4a98747a6295 for instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 on n-h2-854882-3 Aug 29 16:12:02.477515 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a0e47e68-1ade-4160-a33b-cbf0866911a5 req-5fe78930-d440-40ad-a827-603b85a141e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070185 Aug 29 16:12:02.479007 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3113/6397] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:02.888904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:02.890521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:02.948240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:02.962527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:02.969646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:02.970576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:02.973797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:02.974287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:03.094523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:03.101170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:03.103796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:03.104981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lazy-loading 'fault' on Instance uuid b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:12:03.280953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d1a354ca7f421f803b50f2ff4a48c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca2cda19a74c118c8564c694149b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:03.290425 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e5501ce0-0067-450d-8c78-f677e44447e8 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 200 len: 1339 microversion: 2.1 time: 0.405569 Aug 29 16:12:03.291880 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3285/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:02 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 1339 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:04.314068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:04.314862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] [instance: b513b69f-8b2c-429c-9bbb-b5c48b3d47d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:04.332313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.333302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.333857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.334829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.335512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.336161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.367209 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] HTTP exception thrown: Instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 could not be found. Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Request method failure captured: Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 HTTP/1.1 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOSWmHLoHz9xeKbAvUetmXcI6H3VxTta4iS8tNkJ6yNH7WsaZK_2fFbBLiYZ599mXUGi7V6HIxXnqBal_T0oz-WNvDGIbc9tSNF8Gnp73wpILKhXeDwEl-jWgK7iuSzAZPSkPX16ZMPFRB_S76x8zc4hknf9caojlu0sywuvpJvHnEI Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 4bca2cda19a74c118c8564c694149b95 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bca2cda19a74c118c8564c694149b95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4bca2cda19a74c118c8564c694149b95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4bca2cda19a74c118c8564c694149b95", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bca2cda19a74c118c8564c694149b95"}]}] Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 4bca2cda19a74c118c8564c694149b95 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestNetworkBasicOps-1270426923 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestNetworkBasicOps-1270426923-project Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 82d1a354ca7f421f803b50f2ff4a48c2 Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestNetworkBasicOps-1270426923-project Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 could not be found. Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b513b69f-8b2c-429c-9bbb-b5c48b3d47d8'} Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 could not be found. Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 could not be found. Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:04.369411 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:04.375637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:04.375637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:04.375637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:04.375637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:04.375637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:04.375637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 could not be found. Aug 29 16:12:04.375637 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:04.381685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Returning 404 to user: Instance b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:04.383250 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8ae99366-16f9-47ec-961e-62fcc9183e86 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8" status: 404 len: 111 microversion: 2.1 time: 0.074884 Aug 29 16:12:04.384339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3286/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:04 2022] GET /compute/v2.1/servers/b513b69f-8b2c-429c-9bbb-b5c48b3d47d8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:12:04.460090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:04.462956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.463704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.464378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.466274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.467557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.468249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.497011 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-49365203-dd8b-4fc5-81f1-4f00e4b4a80e tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.203256 Aug 29 16:12:04.508025 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3114/6400] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Aug 29 16:12:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:04.659492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-902608686", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "availability_zone": "nova:n-h1-854882-3", "networks": [{"uuid": "716a8942-e253-4f95-9ba2-4d145ed3680d"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:04.688663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed9d4f1f-d3de-4577-a52e-4da67ff15963 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] Calling method '.version_select at 0x7fb0eb629700>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:04.749062 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed9d4f1f-d3de-4577-a52e-4da67ff15963 tempest-TestNetworkBasicOps-1270426923 tempest-TestNetworkBasicOps-1270426923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1452064630" status: 202 len: 0 microversion: 2.1 time: 0.065641 Aug 29 16:12:04.751239 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3115/6401] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 16:12:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1452064630 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:12:04.794194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] validate_networks() for [('716a8942-e253-4f95-9ba2-4d145ed3680d', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:12:06.215263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:12:06.216398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:12:06.217911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:12:06.218527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:12:06.219152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:12:06.238381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:06.239198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:06.244810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:06.248252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:06.249044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:06.250989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:06.311232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Getting quotas for project b5be276dead34d0198b8996a7a9b1201. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:12:06.325901 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Getting quotas for user fb06ceeca6664223b156d1bc7b1c32a1 and project b5be276dead34d0198b8996a7a9b1201. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:12:06.364397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:12:06.366945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:12:06.443692 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-72a83e1a-57c3-47be-ba53-bf217c4ce57d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789056 Aug 29 16:12:06.454206 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3287/6402] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:12:06.458634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f5057fb4-690a-4013-bace-c02fd6363f02 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:06.459362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f5057fb4-690a-4013-bace-c02fd6363f02 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:06.608658 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f5057fb4-690a-4013-bace-c02fd6363f02 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1328 microversion: 2.1 time: 0.153274 Aug 29 16:12:06.609289 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3116/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:06 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:07.647411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:07.648203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:07.668666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:07.673224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:07.683746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:07.686652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:07.688337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:07.689160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:07.820059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-358ce0bb-dcd9-4527-814f-492f80446f2d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1415 microversion: 2.1 time: 0.189166 Aug 29 16:12:07.828985 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3288/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:07 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1415 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:08.847854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:08.849073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:08.856566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:08.857099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:08.877858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:08.878712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:08.879237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:08.879681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:09.214293 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25ca7fa5-c07b-48e9-9e09-a1a584f33c31 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1463 microversion: 2.1 time: 0.370653 Aug 29 16:12:09.218377 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3117/6405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:08 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1463 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:10.145329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0154c986-3422-46fb-8d7c-b698063da7c4 req-dfc2af14-82dd-4bb9-8a42-9284eaa6eb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a30e33-27a9-41e3-bb72-c0adb555e12f", "tag": "763d9d1b-cec6-4848-a693-b473adb739ff"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:10.158994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0154c986-3422-46fb-8d7c-b698063da7c4 req-dfc2af14-82dd-4bb9-8a42-9284eaa6eb50 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:10.159506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0154c986-3422-46fb-8d7c-b698063da7c4 req-dfc2af14-82dd-4bb9-8a42-9284eaa6eb50 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:10.159961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0154c986-3422-46fb-8d7c-b698063da7c4 req-dfc2af14-82dd-4bb9-8a42-9284eaa6eb50 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:10.176033 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0154c986-3422-46fb-8d7c-b698063da7c4 req-dfc2af14-82dd-4bb9-8a42-9284eaa6eb50 service nova] Creating event network-changed:763d9d1b-cec6-4848-a693-b473adb739ff for instance d4a30e33-27a9-41e3-bb72-c0adb555e12f on n-h1-854882-3 Aug 29 16:12:10.179699 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0154c986-3422-46fb-8d7c-b698063da7c4 req-dfc2af14-82dd-4bb9-8a42-9284eaa6eb50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 Aug 29 16:12:10.180714 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3289/6406] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:10.239665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:10.240277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:10.256009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:10.256625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:10.257873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:10.258710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:10.259277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:10.259806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:10.887329 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bb03a3a7-2229-495b-b73f-3b2301828a10 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1463 microversion: 2.1 time: 0.648804 Aug 29 16:12:10.900732 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3118/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:10 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1463 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:11.910775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:11.911736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:11.918830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:11.919344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:11.919810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:11.920721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:11.921227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:11.921699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:12.117551 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8140c615-be21-418f-811f-e033fae4e9b3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1463 microversion: 2.1 time: 0.212259 Aug 29 16:12:12.131077 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3290/6408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:11 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:13.147055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:13.147804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:13.155024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.155408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.155837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:13.156564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.156953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.157371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:13.311048 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d9ddd887-0705-4cca-bdcd-b197dc3193f1 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1463 microversion: 2.1 time: 0.166404 Aug 29 16:12:13.311703 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3119/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:13 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:14.334207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:14.334846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:14.342446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:14.343156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:14.343609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:14.344355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:14.344999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:14.345459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:14.489695 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55bc811d-e02a-443f-922a-28672ed04ae5 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1463 microversion: 2.1 time: 0.159171 Aug 29 16:12:14.490290 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3291/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:14 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:15.510964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:15.511801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:15.514830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:15.520321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:15.520808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:15.521248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:15.522067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:15.522719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:15.523194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:15.665777 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-93ba9ef7-f411-456b-91be-9021c79b325a tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1463 microversion: 2.1 time: 0.158227 Aug 29 16:12:15.666578 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3120/6411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:15 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:16.277539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c8aaefe7-cbae-4aa5-bc62-3d688f320b53 req-5c2ece6c-ebb8-4d16-b290-81ed296be2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a30e33-27a9-41e3-bb72-c0adb555e12f", "name": "network-vif-plugged", "status": "completed", "tag": "763d9d1b-cec6-4848-a693-b473adb739ff"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:16.285645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:16.291764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c8aaefe7-cbae-4aa5-bc62-3d688f320b53 req-5c2ece6c-ebb8-4d16-b290-81ed296be2b8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:16.292313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c8aaefe7-cbae-4aa5-bc62-3d688f320b53 req-5c2ece6c-ebb8-4d16-b290-81ed296be2b8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:16.292777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c8aaefe7-cbae-4aa5-bc62-3d688f320b53 req-5c2ece6c-ebb8-4d16-b290-81ed296be2b8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:16.306445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c8aaefe7-cbae-4aa5-bc62-3d688f320b53 req-5c2ece6c-ebb8-4d16-b290-81ed296be2b8 service nova] Creating event network-vif-plugged:763d9d1b-cec6-4848-a693-b473adb739ff for instance d4a30e33-27a9-41e3-bb72-c0adb555e12f on n-h1-854882-3 Aug 29 16:12:16.311836 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c8aaefe7-cbae-4aa5-bc62-3d688f320b53 req-5c2ece6c-ebb8-4d16-b290-81ed296be2b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038589 Aug 29 16:12:16.312643 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3292/6412] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:16.689329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:16.689974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:16.692641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:16.698462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:16.699152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:16.699521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:16.700218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:16.700701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:16.701126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:16.835681 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-32448043-ad51-40f9-8855-600958799f83 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1463 microversion: 2.1 time: 0.151299 Aug 29 16:12:16.836613 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3121/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:16 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:17.857840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:17.858488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:17.860516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:17.867249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.867759 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.868218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:17.868947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.869448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.869897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.010014 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cebd22a8-7e5b-4120-97a1-57f5206353cc tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1647 microversion: 2.1 time: 0.156312 Aug 29 16:12:18.010608 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3293/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:17 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1647 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:18.030929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:18.031546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:18.038633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.039111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.039543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.040235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.040686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.041111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.173826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-448be990-a312-45c6-a84e-e1333a58c054 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1647 microversion: 2.1 time: 0.147332 Aug 29 16:12:18.174405 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3122/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:18 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1647 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:18.193646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:18.194313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:18.200409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.201027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.201373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.202648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.203114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.203743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.351272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0fa8b3e6-dff2-41c5-b5dd-72486e4d20b0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1647 microversion: 2.1 time: 0.161208 Aug 29 16:12:18.351853 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3294/6416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:18 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1647 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:18.476337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-772886072", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "availability_zone": "nova:n-h2-854882-3", "networks": [{"uuid": "716a8942-e253-4f95-9ba2-4d145ed3680d"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:18.539712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] validate_networks() for [('716a8942-e253-4f95-9ba2-4d145ed3680d', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:12:18.955499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:12:18.955915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:12:18.956383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:12:18.956785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:12:18.957220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:12:18.966098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.966576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.967003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.967736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.968179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.968603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.985597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Getting quotas for project b5be276dead34d0198b8996a7a9b1201. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:12:18.990751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Getting quotas for user fb06ceeca6664223b156d1bc7b1c32a1 and project b5be276dead34d0198b8996a7a9b1201. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:12:19.003595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:12:19.005923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:12:19.051326 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-106150a3-63c8-407d-a593-062dd675d871 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578750 Aug 29 16:12:19.052711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3123/6417] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:12:19.063980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-deb86397-685d-4d1f-9ec3-8ecfe3f58793 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:19.064616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-deb86397-685d-4d1f-9ec3-8ecfe3f58793 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:19.130702 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-deb86397-685d-4d1f-9ec3-8ecfe3f58793 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1328 microversion: 2.1 time: 0.071121 Aug 29 16:12:19.131368 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3295/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:19 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1328 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:20.151718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:20.152312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:20.162861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:20.164348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:20.165122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:20.165858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:20.166309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:20.166730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:20.243042 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3f820d32-606d-4cea-9da4-10dc93f28311 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1433 microversion: 2.1 time: 0.095805 Aug 29 16:12:20.243699 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3124/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:20 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1433 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:21.264376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:21.265353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:21.273197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:21.273728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:21.274176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:21.275152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:21.275627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:21.276068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:21.520117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e1521872-0480-4125-a314-4ddf5d6955db tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1463 microversion: 2.1 time: 0.259474 Aug 29 16:12:21.526301 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3296/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:21 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1463 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:21.647259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-37a7975e-c776-44af-bf7f-4779a52c36de req-733fadd6-04cc-4331-8df7-d5e3ddec0674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c86f03-02c1-4c60-8d46-4c7dbd4e90c4", "tag": "cfdb699c-d00d-4b2b-a00f-75c1998cb4b6"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:21.673200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-37a7975e-c776-44af-bf7f-4779a52c36de req-733fadd6-04cc-4331-8df7-d5e3ddec0674 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:21.673962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-37a7975e-c776-44af-bf7f-4779a52c36de req-733fadd6-04cc-4331-8df7-d5e3ddec0674 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:21.675048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-37a7975e-c776-44af-bf7f-4779a52c36de req-733fadd6-04cc-4331-8df7-d5e3ddec0674 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:21.694884 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-37a7975e-c776-44af-bf7f-4779a52c36de req-733fadd6-04cc-4331-8df7-d5e3ddec0674 service nova] Creating event network-changed:cfdb699c-d00d-4b2b-a00f-75c1998cb4b6 for instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 on n-h2-854882-3 Aug 29 16:12:21.700248 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-37a7975e-c776-44af-bf7f-4779a52c36de req-733fadd6-04cc-4331-8df7-d5e3ddec0674 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058013 Aug 29 16:12:21.701141 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3125/6421] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:22.542214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:22.542908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:22.550008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:22.550514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:22.550993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:22.551713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:22.552189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:22.552631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:22.689090 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a5848cd-109c-46de-94ea-975a669877f0 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1463 microversion: 2.1 time: 0.150811 Aug 29 16:12:22.689717 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3297/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:22 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:23.711462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:23.712156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:23.718840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:23.719631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:23.720142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:23.720826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:23.721270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:23.721710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:23.856896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ffd46004-04d9-4a45-8d55-97a804128194 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1463 microversion: 2.1 time: 0.150170 Aug 29 16:12:23.857459 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3126/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:23 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:24.878050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:24.878852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:24.886218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.886842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.887314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:24.888043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.888523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.889003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.031892 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-741b0ece-b841-4291-97be-e8839e64d1fe tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1463 microversion: 2.1 time: 0.158396 Aug 29 16:12:25.032579 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3298/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:24 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:26.052378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:26.053086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:26.060258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.060751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.061330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.062053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.062514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.062943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.206450 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-78d7ac3c-861d-493f-8100-1dd38e741158 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1463 microversion: 2.1 time: 0.157473 Aug 29 16:12:26.207255 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3127/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:26 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:26.328988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-296151de-2f6b-4391-b51b-c4c446ff1c1f req-86e4c996-5c95-4da7-b69c-6ba5e48a9ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c86f03-02c1-4c60-8d46-4c7dbd4e90c4", "name": "network-vif-plugged", "status": "completed", "tag": "cfdb699c-d00d-4b2b-a00f-75c1998cb4b6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:26.345959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-296151de-2f6b-4391-b51b-c4c446ff1c1f req-86e4c996-5c95-4da7-b69c-6ba5e48a9ba9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.346833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-296151de-2f6b-4391-b51b-c4c446ff1c1f req-86e4c996-5c95-4da7-b69c-6ba5e48a9ba9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.347322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-296151de-2f6b-4391-b51b-c4c446ff1c1f req-86e4c996-5c95-4da7-b69c-6ba5e48a9ba9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.364495 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-296151de-2f6b-4391-b51b-c4c446ff1c1f req-86e4c996-5c95-4da7-b69c-6ba5e48a9ba9 service nova] Creating event network-vif-plugged:cfdb699c-d00d-4b2b-a00f-75c1998cb4b6 for instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 on n-h2-854882-3 Aug 29 16:12:26.369775 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-296151de-2f6b-4391-b51b-c4c446ff1c1f req-86e4c996-5c95-4da7-b69c-6ba5e48a9ba9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046716 Aug 29 16:12:26.370699 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3299/6426] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:27.227913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:27.228573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:27.236107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:27.236588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:27.237022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:27.237752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:27.238209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:27.238636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:27.370086 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-edd617a9-5bbb-4eea-b167-aaaf3b298dbd tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1463 microversion: 2.1 time: 0.145936 Aug 29 16:12:27.370837 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3128/6427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:27 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:28.392712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:28.393581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:28.400035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.400549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.401013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.401771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.402250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.402705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.545874 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ecf6a6a2-1cdd-431c-809f-ab46a82856ce tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1648 microversion: 2.1 time: 0.159508 Aug 29 16:12:28.546464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3300/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:28 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1648 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:28.567405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:28.567998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:28.570801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:28.576284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.577288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.577747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.578484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.578917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.579333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.583911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=81 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:28.718520 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3568299a-e6e3-4ed1-a212-1764ac66f79d tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1648 microversion: 2.1 time: 0.154723 Aug 29 16:12:28.719124 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3129/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:28 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1648 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:28.738326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:28.738969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:28.745127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.745671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.746136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.746855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.747337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.747803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.870326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:28.876309 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d247a8cc-9043-47e2-a2a9-8d99ef08a95f tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1648 microversion: 2.1 time: 0.141924 Aug 29 16:12:28.876898 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3301/6430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:28 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1648 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:28.899893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:28.900491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:28.911795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.912545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.913078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.914170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.914626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.915050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.944610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:28.978889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:28.997597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:29.025536 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a7573dcc-3bfb-4a29-b458-c05644c9a2fa tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 204 len: 0 microversion: 2.1 time: 0.131745 Aug 29 16:12:29.026285 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3130/6431] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:28 2022] DELETE /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:29.035232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:29.036133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:29.043631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:29.044147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:29.044604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:29.045534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:29.046584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:29.047037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:29.127800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:29.189801 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73fff7aa-9116-4ca0-910f-5594fb6617ef tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1654 microversion: 2.1 time: 0.158187 Aug 29 16:12:29.190432 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3302/6432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:29 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:30.211566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:30.212327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:30.219925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:30.220416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:30.220849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:30.221575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:30.222025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:30.222450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:30.369894 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9c86ba8a-8bbb-4b77-b247-9840d63ee9fb tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1654 microversion: 2.1 time: 0.162429 Aug 29 16:12:30.370474 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3131/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:30 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:30.845223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-46ece3e6-e60c-4e02-9f4e-a40d445ace64 req-a09cbd1a-6512-43ea-8cd7-99f35c7716d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c86f03-02c1-4c60-8d46-4c7dbd4e90c4", "name": "network-vif-deleted", "tag": "cfdb699c-d00d-4b2b-a00f-75c1998cb4b6"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:30.860355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:30.887099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-46ece3e6-e60c-4e02-9f4e-a40d445ace64 req-a09cbd1a-6512-43ea-8cd7-99f35c7716d5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:30.888161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-46ece3e6-e60c-4e02-9f4e-a40d445ace64 req-a09cbd1a-6512-43ea-8cd7-99f35c7716d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:30.901482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-46ece3e6-e60c-4e02-9f4e-a40d445ace64 req-a09cbd1a-6512-43ea-8cd7-99f35c7716d5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:30.938202 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-46ece3e6-e60c-4e02-9f4e-a40d445ace64 req-a09cbd1a-6512-43ea-8cd7-99f35c7716d5 service nova] Creating event network-vif-deleted:cfdb699c-d00d-4b2b-a00f-75c1998cb4b6 for instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 on n-h2-854882-3 Aug 29 16:12:30.945106 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-46ece3e6-e60c-4e02-9f4e-a40d445ace64 req-a09cbd1a-6512-43ea-8cd7-99f35c7716d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111611 Aug 29 16:12:30.945106 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3303/6434] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:31.392460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:31.394833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:31.401899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:31.402686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:31.403196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:31.404125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:31.404678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:31.405870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:31.444034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:31.444524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:31.445206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:31.445695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lazy-loading 'fault' on Instance uuid 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:12:31.502681 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f0d729bd-bd03-43b9-8701-7bc38754b3c8 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 200 len: 1453 microversion: 2.1 time: 0.114349 Aug 29 16:12:31.503292 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3132/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:31 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:32.525308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:32.526797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:32.534266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.534779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.535238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.535962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.536583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.537034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.551613 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] HTTP exception thrown: Instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 could not be found. Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Request method failure captured: Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 HTTP/1.1 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOVUFsZvRWtUmHQm82-2nmwTA4bzbIiXseSTTOg1fHqXaDlwOSKShEQoHdnRYOQdjDppKpsHRefaX59WFcMuBQSry6n9F02NqPi_IVNYSOh-xFAO9QM-4wTrqC_8I02mvF1GvG3cBFjvYgGA2arRYrel3SGv1cQWIfl7BwlW4FDQ3jo Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b5be276dead34d0198b8996a7a9b1201 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestServerMultinode-898941716 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5be276dead34d0198b8996a7a9b1201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5be276dead34d0198b8996a7a9b1201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5be276dead34d0198b8996a7a9b1201", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5be276dead34d0198b8996a7a9b1201"}]}] Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestServerMultinode-898941716 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b5be276dead34d0198b8996a7a9b1201 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestServerMultinode-898941716 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestServerMultinode-898941716-project-admin Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: fb06ceeca6664223b156d1bc7b1c32a1 Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestServerMultinode-898941716-project-admin Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 could not be found. Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '76c86f03-02c1-4c60-8d46-4c7dbd4e90c4'} Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 could not be found. Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 could not be found. Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:32.553298 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 could not be found. Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Returning 404 to user: Instance 76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c5280958-e0b8-4a44-bf35-39c720511eba tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4" status: 404 len: 111 microversion: 2.1 time: 0.034061 Aug 29 16:12:32.562272 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3304/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:32 2022] GET /compute/v2.1/servers/76c86f03-02c1-4c60-8d46-4c7dbd4e90c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:32.564357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:32.564854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:32.572058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.572530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.572959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.573682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.574128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.574545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.599843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:32.676143 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-096f9c5b-4b3a-4352-a1b2-ba3d20d96ff3 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 204 len: 0 microversion: 2.1 time: 0.115363 Aug 29 16:12:32.680075 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3133/6437] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:32 2022] DELETE /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:32.686329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:32.686965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:32.693131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.693671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.694124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.694829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.695294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.695732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.830831 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83dba9e8-0efc-4d63-b8f8-6cd670a0d8ab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1653 microversion: 2.1 time: 0.148697 Aug 29 16:12:32.831418 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3305/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:32 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:33.852575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:33.853284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:33.860800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:33.861284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:33.861748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:33.862449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:33.862901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:33.863324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:34.027032 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5794133e-958e-4e40-b6b3-5065b56a2201 tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 200 len: 1653 microversion: 2.1 time: 0.178534 Aug 29 16:12:34.027652 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3134/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:33 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 1653 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:34.429366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b7aeecdf-4d9b-408f-8925-7cdbda9b806d req-d94e9fa0-c687-4730-b4b2-b340e476e604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a30e33-27a9-41e3-bb72-c0adb555e12f", "name": "network-vif-deleted", "tag": "763d9d1b-cec6-4848-a693-b473adb739ff"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:34.449896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7aeecdf-4d9b-408f-8925-7cdbda9b806d req-d94e9fa0-c687-4730-b4b2-b340e476e604 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:34.451103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7aeecdf-4d9b-408f-8925-7cdbda9b806d req-d94e9fa0-c687-4730-b4b2-b340e476e604 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:34.452216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7aeecdf-4d9b-408f-8925-7cdbda9b806d req-d94e9fa0-c687-4730-b4b2-b340e476e604 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:34.473207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b7aeecdf-4d9b-408f-8925-7cdbda9b806d req-d94e9fa0-c687-4730-b4b2-b340e476e604 service nova] Creating event network-vif-deleted:763d9d1b-cec6-4848-a693-b473adb739ff for instance d4a30e33-27a9-41e3-bb72-c0adb555e12f on n-h1-854882-3 Aug 29 16:12:34.478715 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b7aeecdf-4d9b-408f-8925-7cdbda9b806d req-d94e9fa0-c687-4730-b4b2-b340e476e604 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053915 Aug 29 16:12:34.480614 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3306/6440] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:35.049406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:35.050250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] [instance: d4a30e33-27a9-41e3-bb72-c0adb555e12f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:35.058213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:35.058703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:35.059143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:35.059849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:35.060611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:35.061717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:35.075702 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] HTTP exception thrown: Instance d4a30e33-27a9-41e3-bb72-c0adb555e12f could not be found. Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Request method failure captured: Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f HTTP/1.1 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOVUFsZvRWtUmHQm82-2nmwTA4bzbIiXseSTTOg1fHqXaDlwOSKShEQoHdnRYOQdjDppKpsHRefaX59WFcMuBQSry6n9F02NqPi_IVNYSOh-xFAO9QM-4wTrqC_8I02mvF1GvG3cBFjvYgGA2arRYrel3SGv1cQWIfl7BwlW4FDQ3jo Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: b5be276dead34d0198b8996a7a9b1201 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestServerMultinode-898941716 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5be276dead34d0198b8996a7a9b1201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5be276dead34d0198b8996a7a9b1201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5be276dead34d0198b8996a7a9b1201", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5be276dead34d0198b8996a7a9b1201"}]}] Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestServerMultinode-898941716 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: b5be276dead34d0198b8996a7a9b1201 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestServerMultinode-898941716 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestServerMultinode-898941716-project-admin Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: fb06ceeca6664223b156d1bc7b1c32a1 Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestServerMultinode-898941716-project-admin Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d4a30e33-27a9-41e3-bb72-c0adb555e12f could not be found. Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd4a30e33-27a9-41e3-bb72-c0adb555e12f'} Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a30e33-27a9-41e3-bb72-c0adb555e12f could not be found. Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a30e33-27a9-41e3-bb72-c0adb555e12f could not be found. Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:35.077447 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a30e33-27a9-41e3-bb72-c0adb555e12f could not be found. Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] Returning 404 to user: Instance d4a30e33-27a9-41e3-bb72-c0adb555e12f could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cf60c2b3-a02f-4b72-a2fe-65044de0cfab tempest-TestServerMultinode-898941716 tempest-TestServerMultinode-898941716-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f" status: 404 len: 111 microversion: 2.1 time: 0.034914 Aug 29 16:12:35.083579 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3135/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:35 2022] GET /compute/v2.1/servers/d4a30e33-27a9-41e3-bb72-c0adb555e12f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:56.676684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:56.677303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:56.678862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5167b6b6-7b18-4b31-ba87-b7cc5618eaa4 req-6957b827-63cb-4576-80e9-906dff169b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c300daac-2287-46c9-a193-41b68b641251", "tag": "649afc0d-e4da-4765-ac67-c99bd7d2d48a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:56.680606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=7 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:56.681272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=18 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:56.685073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:56.689911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.690404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:56.690975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.691475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.692541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.693400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.694093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.707346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5167b6b6-7b18-4b31-ba87-b7cc5618eaa4 req-6957b827-63cb-4576-80e9-906dff169b90 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.708073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5167b6b6-7b18-4b31-ba87-b7cc5618eaa4 req-6957b827-63cb-4576-80e9-906dff169b90 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.708664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5167b6b6-7b18-4b31-ba87-b7cc5618eaa4 req-6957b827-63cb-4576-80e9-906dff169b90 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.722018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:56.726715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5167b6b6-7b18-4b31-ba87-b7cc5618eaa4 req-6957b827-63cb-4576-80e9-906dff169b90 service nova] Creating event network-changed:649afc0d-e4da-4765-ac67-c99bd7d2d48a for instance c300daac-2287-46c9-a193-41b68b641251 on n-h1-854882-3 Aug 29 16:12:56.732145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5167b6b6-7b18-4b31-ba87-b7cc5618eaa4 req-6957b827-63cb-4576-80e9-906dff169b90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057206 Aug 29 16:12:56.733319 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3136/6442] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:56.818221 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-177b1d04-7ebe-4b46-bf94-563708fff9b4 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 204 len: 0 microversion: 2.1 time: 0.144968 Aug 29 16:12:56.819348 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3307/6443] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:56 2022] DELETE /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:56.830999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:56.831710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:56.838760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.839279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.839716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.840415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.840864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.841291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.988362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:56.999018 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8b9a56b-d30a-44ef-b81d-a906f5565f7e tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1576 microversion: 2.1 time: 0.174182 Aug 29 16:12:56.999738 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3137/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:56 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:58.022440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:58.023314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:58.030944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:58.031577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:58.032138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:58.032975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:58.033604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:58.034150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:58.179845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:58.188370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b909b1a6-7939-4e33-a311-07f07d03ac53 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1576 microversion: 2.1 time: 0.170402 Aug 29 16:12:58.188948 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3308/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:58 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:58.932085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-fc4edf4c-5de8-4f85-b697-d671c47aebe4 req-340449c2-5e7c-4c2d-82f0-d5b24027e6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c300daac-2287-46c9-a193-41b68b641251", "name": "network-vif-deleted", "tag": "649afc0d-e4da-4765-ac67-c99bd7d2d48a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:58.944348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fc4edf4c-5de8-4f85-b697-d671c47aebe4 req-340449c2-5e7c-4c2d-82f0-d5b24027e6eb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:58.944827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fc4edf4c-5de8-4f85-b697-d671c47aebe4 req-340449c2-5e7c-4c2d-82f0-d5b24027e6eb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:58.945254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fc4edf4c-5de8-4f85-b697-d671c47aebe4 req-340449c2-5e7c-4c2d-82f0-d5b24027e6eb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:58.957924 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fc4edf4c-5de8-4f85-b697-d671c47aebe4 req-340449c2-5e7c-4c2d-82f0-d5b24027e6eb service nova] Creating event network-vif-deleted:649afc0d-e4da-4765-ac67-c99bd7d2d48a for instance c300daac-2287-46c9-a193-41b68b641251 on n-h1-854882-3 Aug 29 16:12:58.963139 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-fc4edf4c-5de8-4f85-b697-d671c47aebe4 req-340449c2-5e7c-4c2d-82f0-d5b24027e6eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034662 Aug 29 16:12:58.963753 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3138/6446] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:59.209848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:59.210495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:59.218323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:59.218844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:59.219306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:59.220046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:59.220525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:59.220977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:59.287394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:59.299131 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2590655-e8e9-48f4-a3d7-b6e510c0a220 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1223 microversion: 2.1 time: 0.092864 Aug 29 16:12:59.300060 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3309/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:59 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:00.321579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:00.322289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:00.329104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:00.329600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:00.330034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:00.330720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:00.331168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:00.331588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:00.400357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:00.408636 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-508d2cb5-05c0-49bb-94c3-e7c7a26ec13b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1223 microversion: 2.1 time: 0.092092 Aug 29 16:13:00.409224 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3139/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:00 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:01.429370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:01.430108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:01.438005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:01.438522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:01.438980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:01.439703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:01.440206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:01.440635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:01.504210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:01.512488 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b06e373d-12ec-4dcc-a64b-dbbb7c734a10 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1223 microversion: 2.1 time: 0.087121 Aug 29 16:13:01.513075 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3310/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:01 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:02.403815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-be6495bf-d3b1-4be8-aa89-af84deb6c603 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Action: 'create', calling method: .version_select at 0x7fb0e288df70>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-764430932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOouid/ZoTka8eGoeKovPkeEjpKhLWfkopwCKnrnHOQRKBjIOkeDHwGNdMld3e8L/n+9uY++sI9wZuSnAKUQtXB7aXlk8tlWehDWQIfChaLP+jSw3az6Ry7KTm/gyReFFg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:02.420333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-be6495bf-d3b1-4be8-aa89-af84deb6c603 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Getting quotas for project b055f0d12a17435cb8f8491123b4c8e8. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:13:02.426139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-be6495bf-d3b1-4be8-aa89-af84deb6c603 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Getting quotas for user 549d35b431a947eda45ea502b0dc753f and project b055f0d12a17435cb8f8491123b4c8e8. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:13:02.451344 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-be6495bf-d3b1-4be8-aa89-af84deb6c603 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.051282 Aug 29 16:13:02.451950 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3140/6450] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:13:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:02.535338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:02.536135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:02.544219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:02.545534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:02.546073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:02.546889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:02.547472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:02.548024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:02.623470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:02.632684 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-520aa244-3a55-4dcd-b020-4d1f411009e3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1223 microversion: 2.1 time: 0.101923 Aug 29 16:13:02.633925 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3311/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:02 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:03.546799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-477162210", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ef6e4925-f9ab-424b-9ad1-acde419ce9bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-764430932", "security_groups": [{"name": "tempest-secgroup-smoke-51014497"}], "networks": [{"uuid": "320634fa-8728-41ec-8a96-f87876b20bc3"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:03.656969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:03.657594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:03.664863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:03.665487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:03.665893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:03.667808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] validate_networks() for [('320634fa-8728-41ec-8a96-f87876b20bc3', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:13:03.673107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:03.673667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:03.674222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:03.746080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:03.754478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0d35816-de96-47f1-9cea-c4d976df53f8 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1223 microversion: 2.1 time: 0.102593 Aug 29 16:13:03.755066 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3312/6452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:03 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:04.059752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:13:04.060918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:13:04.061878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:13:04.062413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:13:04.062901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:13:04.072217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.072996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.073572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.074435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.074897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.075320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.092519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Getting quotas for project b055f0d12a17435cb8f8491123b4c8e8. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:13:04.097991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Getting quotas for user 549d35b431a947eda45ea502b0dc753f and project b055f0d12a17435cb8f8491123b4c8e8. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:13:04.166612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:13:04.168753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef6e4925-f9ab-424b-9ad1-acde419ce9bc',volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:13:04.312770 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d361964f-d870-4177-b9ff-80a4d2ec8081 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.771419 Aug 29 16:13:04.313685 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3141/6453] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:13:03 2022] POST /compute/v2.1/servers => generated 404 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:13:04.324248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-73fd0e3d-f5e0-4cfc-85a2-f0b71b67f34c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:04.325162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-73fd0e3d-f5e0-4cfc-85a2-f0b71b67f34c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:04.394078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-73fd0e3d-f5e0-4cfc-85a2-f0b71b67f34c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:04.403000 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-73fd0e3d-f5e0-4cfc-85a2-f0b71b67f34c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1097 microversion: 2.1 time: 0.082601 Aug 29 16:13:04.405290 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3313/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:04 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1097 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:04.776489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:04.777905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:04.788259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.788912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.789748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.790589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.791131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.791598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.875355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:04.885916 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96126dc6-cc60-470a-92d2-c20b8e6d615c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1223 microversion: 2.1 time: 0.114035 Aug 29 16:13:04.886500 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3142/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:04 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:05.424775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:05.425483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:05.435973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.436598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.437140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.438001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.442018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.442647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.524159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:05.533331 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2be6f825-c440-4d84-bf87-e48b59f7ad6c tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1203 microversion: 2.1 time: 0.112546 Aug 29 16:13:05.534757 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3314/6456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:05 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1203 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:05.907962 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:05.908803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:05.916746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.917679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.918359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.919448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.920121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.920764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.959062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.959986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.960658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.961670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lazy-loading 'fault' on Instance uuid c300daac-2287-46c9-a193-41b68b641251 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:13:06.015571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:06.024711 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1508d06e-3323-4488-a00e-6ade4596e8b1 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 200 len: 1228 microversion: 2.1 time: 0.121471 Aug 29 16:13:06.025358 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3143/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:05 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 1228 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:06.556082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:06.556730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:06.565034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.565577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.566237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:06.566968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.567446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.567896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:06.730872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:06.742370 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fc3f4864-8189-40b9-91c1-46adeb94b695 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1279 microversion: 2.1 time: 0.190259 Aug 29 16:13:06.743290 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3315/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:06 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:07.047218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:07.047874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: c300daac-2287-46c9-a193-41b68b641251] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:07.055513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.056018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.056437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.057147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.057624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.058053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.076415 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance c300daac-2287-46c9-a193-41b68b641251 could not be found. Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 HTTP/1.1 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance c300daac-2287-46c9-a193-41b68b641251 could not be found. Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'c300daac-2287-46c9-a193-41b68b641251'} Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c300daac-2287-46c9-a193-41b68b641251 could not be found. Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c300daac-2287-46c9-a193-41b68b641251 could not be found. Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:07.078137 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:07.083784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:07.083784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:07.083784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:07.083784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:07.083784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:07.083784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c300daac-2287-46c9-a193-41b68b641251 could not be found. Aug 29 16:13:07.083784 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:07.085221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance c300daac-2287-46c9-a193-41b68b641251 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:07.086132 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2685ac50-1782-4bdb-aed5-380b00566c89 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251" status: 404 len: 111 microversion: 2.1 time: 0.043607 Aug 29 16:13:07.087065 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3144/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:07 2022] GET /compute/v2.1/servers/c300daac-2287-46c9-a193-41b68b641251 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:13:07.250209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f7df042f-50ae-42a0-9c18-ab6ed01ec01a req-9f8f39f0-fdbc-4278-bf26-d639a8240126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66373f7-bd0c-44b6-a32b-0652d3c64b8f", "tag": "99000f96-a58d-41f0-bd91-86305f249f4e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:07.260327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f7df042f-50ae-42a0-9c18-ab6ed01ec01a req-9f8f39f0-fdbc-4278-bf26-d639a8240126 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.261085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f7df042f-50ae-42a0-9c18-ab6ed01ec01a req-9f8f39f0-fdbc-4278-bf26-d639a8240126 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.261825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f7df042f-50ae-42a0-9c18-ab6ed01ec01a req-9f8f39f0-fdbc-4278-bf26-d639a8240126 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.277175 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f7df042f-50ae-42a0-9c18-ab6ed01ec01a req-9f8f39f0-fdbc-4278-bf26-d639a8240126 service nova] Creating event network-changed:99000f96-a58d-41f0-bd91-86305f249f4e for instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f on n-h1-854882-3 Aug 29 16:13:07.285167 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f7df042f-50ae-42a0-9c18-ab6ed01ec01a req-9f8f39f0-fdbc-4278-bf26-d639a8240126 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038859 Aug 29 16:13:07.286582 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3316/6460] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:07.764625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:07.765246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:07.771467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.771950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.772385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.773082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.773686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.774114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:08.011641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:08.020331 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3ea2f337-bfb7-46ae-9be7-b0328c1400ca tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1279 microversion: 2.1 time: 0.260577 Aug 29 16:13:08.020950 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3145/6461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:07 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:09.042269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:09.042992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:09.050160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:09.050662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:09.051115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:09.051828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:09.052296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:09.052736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:09.190183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:09.198397 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bd26185f-9e85-4a45-98e2-315c0e1a7903 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1279 microversion: 2.1 time: 0.160783 Aug 29 16:13:09.198982 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3317/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:09 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:10.219531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:10.220500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:10.228026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.228627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.229146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.230017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.230557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.231085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.386817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:10.404716 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-886c34c3-475c-4bed-8524-ad391577c837 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1279 microversion: 2.1 time: 0.189674 Aug 29 16:13:10.405316 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3146/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:10 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:11.425530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:11.426163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:11.433354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:11.433981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:11.434463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:11.435825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:11.436308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:11.436768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:11.615748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:11.624585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-57441a27-b959-4bac-b22b-aea87da06151 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1279 microversion: 2.1 time: 0.203198 Aug 29 16:13:11.625174 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3318/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:11 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:12.645259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:12.646621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:12.654401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:12.654895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:12.655338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:12.656047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:12.656506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:12.656942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:12.837982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:12.846964 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6179964d-6eee-4980-809c-419260bd40f2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.206627 Aug 29 16:13:12.847756 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3147/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:12 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:13.868402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:13.868969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:13.876443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:13.876954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:13.877642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:13.878374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:13.878863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:13.879318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.022953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:14.031429 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-953013e1-70e8-4426-b003-cd79427d68b2 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.167056 Aug 29 16:13:14.032006 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3319/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:13 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:15.053199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:15.054024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:15.056988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:15.057987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:15.064312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.064795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.065219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.065942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.066390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.066805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.215735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:15.224988 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7b9e8e65-1ef4-4f55-9293-e41042fa307b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.176726 Aug 29 16:13:15.225617 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3148/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:15 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:15.577655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:15.578246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:15.579674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c8c3237d-a6a7-4035-be39-bc886628f45e req-e4991b7c-1f14-4372-b030-24f4f51864c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0de72a-7f17-4a9e-bcd8-28384e97ecc9", "tag": "cd1a99fb-e368-4f47-8add-4f232cca6f72"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:15.580903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:15.588132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.588713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.589404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.590297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.590421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c8c3237d-a6a7-4035-be39-bc886628f45e req-e4991b7c-1f14-4372-b030-24f4f51864c2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.590801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c8c3237d-a6a7-4035-be39-bc886628f45e req-e4991b7c-1f14-4372-b030-24f4f51864c2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.590934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.591232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c8c3237d-a6a7-4035-be39-bc886628f45e req-e4991b7c-1f14-4372-b030-24f4f51864c2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.591443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.603255 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-c8c3237d-a6a7-4035-be39-bc886628f45e req-e4991b7c-1f14-4372-b030-24f4f51864c2 service nova] Creating event network-changed:cd1a99fb-e368-4f47-8add-4f232cca6f72 for instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 on n-h2-854882-3 Aug 29 16:13:15.609890 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c8c3237d-a6a7-4035-be39-bc886628f45e req-e4991b7c-1f14-4372-b030-24f4f51864c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034079 Aug 29 16:13:15.612135 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3149/6468] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:15.623658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:13:15.709978 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66a243c3-4f0b-4d15-bb20-e825843cff1c tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 204 len: 0 microversion: 2.1 time: 0.135979 Aug 29 16:13:15.713463 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3320/6469] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:13:15 2022] DELETE /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:13:15.722955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:15.724034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:15.731560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.733021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.733760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.734831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.735573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.736198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.882861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:15.891824 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7b55c144-fdac-4c54-91ee-fcd3d804e259 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1575 microversion: 2.1 time: 0.175767 Aug 29 16:13:15.892551 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3150/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:15 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:16.247069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:16.248451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:16.254556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:16.255063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:16.255521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:16.256241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:16.256718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:16.257163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:16.401903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:16.405610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:16.410663 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9c8fb847-691b-4c32-a012-f1dbc8786805 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.167953 Aug 29 16:13:16.411242 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3321/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:16 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:16.914725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:16.915283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:16.922828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:16.923310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:16.923738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:16.924423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:16.924876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:16.925294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.060942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:17.068910 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6c3679ce-8433-460d-8851-56130bb72985 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1575 microversion: 2.1 time: 0.158270 Aug 29 16:13:17.069523 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3151/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:16 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:17.432780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:17.433437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:17.442697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:17.443206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:17.443662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.444384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:17.444859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:17.445426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.666559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:17.674387 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cdbb26f0-216c-4443-b485-10f63dd66eda tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.246439 Aug 29 16:13:17.674979 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3322/6473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:17 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:17.773698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1559254b-5d62-42ef-8a35-a8721b533d97 req-c1a803fc-ea2b-4e2a-9ac2-00bf85ea4941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0de72a-7f17-4a9e-bcd8-28384e97ecc9", "name": "network-vif-deleted", "tag": "cd1a99fb-e368-4f47-8add-4f232cca6f72"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:17.785004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1559254b-5d62-42ef-8a35-a8721b533d97 req-c1a803fc-ea2b-4e2a-9ac2-00bf85ea4941 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:17.785619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1559254b-5d62-42ef-8a35-a8721b533d97 req-c1a803fc-ea2b-4e2a-9ac2-00bf85ea4941 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:17.786050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1559254b-5d62-42ef-8a35-a8721b533d97 req-c1a803fc-ea2b-4e2a-9ac2-00bf85ea4941 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.798236 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1559254b-5d62-42ef-8a35-a8721b533d97 req-c1a803fc-ea2b-4e2a-9ac2-00bf85ea4941 service nova] Creating event network-vif-deleted:cd1a99fb-e368-4f47-8add-4f232cca6f72 for instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 on n-h2-854882-3 Aug 29 16:13:17.803001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1559254b-5d62-42ef-8a35-a8721b533d97 req-c1a803fc-ea2b-4e2a-9ac2-00bf85ea4941 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033202 Aug 29 16:13:17.803802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3152/6474] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:18.090735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:18.091471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:18.099765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.100445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.100909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.101670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.102151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.102632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.169267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:18.178271 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85018b4d-c880-4a89-9e2b-f600f963e82b tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1223 microversion: 2.1 time: 0.091537 Aug 29 16:13:18.191923 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3323/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:18 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:18.697092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:18.697825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:18.704127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.704611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.705048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.705762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.706218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.706640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.841631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:18.849606 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fd889340-6da7-4515-9b97-d3992b562975 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.157491 Aug 29 16:13:18.850189 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3153/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:18 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:19.199782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:19.200323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:19.208075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:19.208589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:19.209058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:19.209811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:19.210291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:19.210741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:19.278550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:19.287148 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81bc6dc7-7bef-4785-b568-4ed455dad835 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1223 microversion: 2.1 time: 0.091444 Aug 29 16:13:19.297551 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3324/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:19 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:19.870408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:19.871029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:19.878475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:19.878991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:19.879437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:19.880130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:19.880586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:19.881041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.018014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:20.026062 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3c8153b-c4a3-4347-a91a-a6bb029c9907 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.159579 Aug 29 16:13:20.026645 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3154/6478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:19 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:20.308354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:20.308996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:20.316177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:20.316685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:20.317139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.317884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:20.318360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:20.318807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.382542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:20.391003 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bac543b1-e1dc-4b1b-a0ec-2f0e3170030a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1223 microversion: 2.1 time: 0.086713 Aug 29 16:13:20.391581 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3325/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:20 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:21.047540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:21.048803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:21.056050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:21.056713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:21.057163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:21.057988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:21.058481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:21.058914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:21.199983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:21.208034 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67030664-af03-45c2-8937-a801932e1fa4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.165196 Aug 29 16:13:21.208629 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3155/6480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:21 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:21.412385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:21.412934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:21.420495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:21.421007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:21.421483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:21.422204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:21.422677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:21.423152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:21.486774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e276b9fae4594c17a1883dd4e48184c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa1c2b97c8748ba831eb63c98d978c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:21.494933 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe9c4a93-1c2f-4c36-a5eb-0e1f6c2655bd tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 200 len: 1223 microversion: 2.1 time: 0.086575 Aug 29 16:13:21.495508 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3326/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:21 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:22.228960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:22.229537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:22.237122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:22.237638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:22.238080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:22.238771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:22.239226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:22.239652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:22.379749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:22.391049 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6262de97-868e-4c63-a761-98f77c6d5739 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.166000 Aug 29 16:13:22.391736 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3156/6482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:22 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:22.516329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:22.516975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: dc0de72a-7f17-4a9e-bcd8-28384e97ecc9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:22.523844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:22.524350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:22.524830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:22.525580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:22.526054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:22.526501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:22.543647 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 could not be found. Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 HTTP/1.1 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 could not be found. Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'dc0de72a-7f17-4a9e-bcd8-28384e97ecc9'} Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 could not be found. Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 could not be found. Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:22.545431 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 could not be found. Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23296071-0501-4a2e-a7db-453bef4dc09d tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9" status: 404 len: 111 microversion: 2.1 time: 0.035124 Aug 29 16:13:22.550898 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3327/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:22 2022] GET /compute/v2.1/servers/dc0de72a-7f17-4a9e-bcd8-28384e97ecc9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:13:22.676443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-5306d68e-d8e7-48a8-9c14-3d0736341a08 req-b166bf2a-2cb3-484d-8fe3-769e25af4169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66373f7-bd0c-44b6-a32b-0652d3c64b8f", "name": "network-vif-plugged", "status": "completed", "tag": "99000f96-a58d-41f0-bd91-86305f249f4e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:22.689231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5306d68e-d8e7-48a8-9c14-3d0736341a08 req-b166bf2a-2cb3-484d-8fe3-769e25af4169 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:22.689949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5306d68e-d8e7-48a8-9c14-3d0736341a08 req-b166bf2a-2cb3-484d-8fe3-769e25af4169 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:22.690549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-5306d68e-d8e7-48a8-9c14-3d0736341a08 req-b166bf2a-2cb3-484d-8fe3-769e25af4169 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:22.702966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:22.705847 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-5306d68e-d8e7-48a8-9c14-3d0736341a08 req-b166bf2a-2cb3-484d-8fe3-769e25af4169 service nova] Creating event network-vif-plugged:99000f96-a58d-41f0-bd91-86305f249f4e for instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f on n-h1-854882-3 Aug 29 16:13:22.712870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-5306d68e-d8e7-48a8-9c14-3d0736341a08 req-b166bf2a-2cb3-484d-8fe3-769e25af4169 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040563 Aug 29 16:13:22.714463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3157/6484] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:23.015286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:23.015811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:23.022071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.022502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.022967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.023722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.024232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.024686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.038091 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb HTTP/1.1 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '8d6b0469-45a3-449a-b5a6-bd19f196cecb'} Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:23.039696 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-162241ed-0a99-483d-88d2-8d67fc96f7d3 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 404 len: 111 microversion: 2.1 time: 0.030409 Aug 29 16:13:23.045405 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3328/6485] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:13:23 2022] DELETE /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:13:23.050883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:23.051589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] [instance: 8d6b0469-45a3-449a-b5a6-bd19f196cecb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:23.057727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.058208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.058644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.059327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.059779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.061147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.074096 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] HTTP exception thrown: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Request method failure captured: Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb HTTP/1.1 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOJhbLbKeSmYQGcO_SaOJV06FXemdQYgeQvUPqQDrIHRhLO60HC00XWFfG0DaX2y1amWqQWj_sB57cNMBlxNzxU9MzdGtXKBqLwvteWe1d_BS8zIL7TbkyKMZPBsi-c1vtc45VXuK02aCpeyQ51fvMGaVOC__U8pjULsacOM7Szsue4 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fa1c2b97c8748ba831eb63c98d978c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fa1c2b97c8748ba831eb63c98d978c2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fa1c2b97c8748ba831eb63c98d978c2"}]}] Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 6fa1c2b97c8748ba831eb63c98d978c2 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1755505855 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: e276b9fae4594c17a1883dd4e48184c2 Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestVolumeBootPattern-1755505855-project Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '8d6b0469-45a3-449a-b5a6-bd19f196cecb'} Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:23.075683 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Returning 404 to user: Instance 8d6b0469-45a3-449a-b5a6-bd19f196cecb could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f08afc3c-aa57-4f61-87cd-3e3ebb557f36 tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb" status: 404 len: 111 microversion: 2.1 time: 0.030468 Aug 29 16:13:23.081518 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3158/6486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:23 2022] GET /compute/v2.1/servers/8d6b0469-45a3-449a-b5a6-bd19f196cecb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:13:23.412709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:23.413248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:23.419945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.420457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.420926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.421670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.422175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.422626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.572297 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:23.580284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-07264055-d61c-4520-81f8-4a8435991067 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1267 microversion: 2.1 time: 0.171612 Aug 29 16:13:23.580853 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3329/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:23 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:24.601101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:24.601806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:24.608841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:24.609319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:24.609775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:24.610526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:24.610982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:24.611403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:24.749157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:24.757130 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ececb311-af90-4424-a06b-716d271483c3 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1457 microversion: 2.1 time: 0.160070 Aug 29 16:13:24.757905 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3159/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:24 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1457 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:24.777608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:24.778254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:24.786191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:24.786703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:24.787163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:24.787888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:24.788367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:24.788815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:24.921496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:24.929458 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ece45b43-0986-4b04-a62f-9263897b1525 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1457 microversion: 2.1 time: 0.155955 Aug 29 16:13:24.930038 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3330/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:24 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:26.553743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a12f60e8-49fa-4e26-844d-f58d5b48232a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] Calling method '.version_select at 0x7fb0e2812f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:26.602088 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a12f60e8-49fa-4e26-844d-f58d5b48232a tempest-TestVolumeBootPattern-1755505855 tempest-TestVolumeBootPattern-1755505855-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-95118366" status: 202 len: 0 microversion: 2.1 time: 0.063773 Aug 29 16:13:26.603117 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3160/6490] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 16:13:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-95118366 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:13:27.092542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d819d2e5-4d63-437f-ac67-d4bf99f6cec1 req-dcecf8a9-f162-402f-aeed-41c1bbf26e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66373f7-bd0c-44b6-a32b-0652d3c64b8f", "tag": "99000f96-a58d-41f0-bd91-86305f249f4e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:27.107072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:27.109845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d819d2e5-4d63-437f-ac67-d4bf99f6cec1 req-dcecf8a9-f162-402f-aeed-41c1bbf26e9e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:27.110663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d819d2e5-4d63-437f-ac67-d4bf99f6cec1 req-dcecf8a9-f162-402f-aeed-41c1bbf26e9e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:27.111643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d819d2e5-4d63-437f-ac67-d4bf99f6cec1 req-dcecf8a9-f162-402f-aeed-41c1bbf26e9e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:27.127529 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d819d2e5-4d63-437f-ac67-d4bf99f6cec1 req-dcecf8a9-f162-402f-aeed-41c1bbf26e9e service nova] Creating event network-changed:99000f96-a58d-41f0-bd91-86305f249f4e for instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f on n-h1-854882-3 Aug 29 16:13:27.136139 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d819d2e5-4d63-437f-ac67-d4bf99f6cec1 req-dcecf8a9-f162-402f-aeed-41c1bbf26e9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Aug 29 16:13:27.138564 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3331/6491] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:29.157819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-fa29b00d-aff1-48e2-bf42-ab215d926f2b req-c282938c-dfa1-4578-8038-a10cbb11938d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66373f7-bd0c-44b6-a32b-0652d3c64b8f", "tag": "99000f96-a58d-41f0-bd91-86305f249f4e"}, {"name": "network-changed", "server_uuid": "e66373f7-bd0c-44b6-a32b-0652d3c64b8f", "tag": "99000f96-a58d-41f0-bd91-86305f249f4e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:29.168747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:29.171674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fa29b00d-aff1-48e2-bf42-ab215d926f2b req-c282938c-dfa1-4578-8038-a10cbb11938d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:29.172429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fa29b00d-aff1-48e2-bf42-ab215d926f2b req-c282938c-dfa1-4578-8038-a10cbb11938d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:29.173081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-fa29b00d-aff1-48e2-bf42-ab215d926f2b req-c282938c-dfa1-4578-8038-a10cbb11938d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:29.191566 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fa29b00d-aff1-48e2-bf42-ab215d926f2b req-c282938c-dfa1-4578-8038-a10cbb11938d service nova] Creating event network-changed:99000f96-a58d-41f0-bd91-86305f249f4e for instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f on n-h1-854882-3 Aug 29 16:13:29.198445 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-fa29b00d-aff1-48e2-bf42-ab215d926f2b req-c282938c-dfa1-4578-8038-a10cbb11938d service nova] Creating event network-changed:99000f96-a58d-41f0-bd91-86305f249f4e for instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f on n-h1-854882-3 Aug 29 16:13:29.204348 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-fa29b00d-aff1-48e2-bf42-ab215d926f2b req-c282938c-dfa1-4578-8038-a10cbb11938d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050145 Aug 29 16:13:29.205712 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3161/6492] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:57.881074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:57.881716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:57.884598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=48 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:57.884860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:57.891494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:57.891989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:57.892443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:57.894254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:57.894751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:57.895409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:57.922695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:13:58.014761 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12aef570-00ac-4f94-9eca-1410cf04fd11 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 204 len: 0 microversion: 2.1 time: 0.138177 Aug 29 16:13:58.015428 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3332/6493] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:13:57 2022] DELETE /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:13:58.027451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:58.028194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:58.034888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:58.035415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:58.035994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:58.036859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:58.037579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:58.038175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:58.185487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-43d69206-282b-4b89-80fe-97b36092c5e3 req-5a40e8c8-d5ea-4858-b91a-b4ad14dc68df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66373f7-bd0c-44b6-a32b-0652d3c64b8f", "tag": "99000f96-a58d-41f0-bd91-86305f249f4e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:58.193722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:58.199856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-43d69206-282b-4b89-80fe-97b36092c5e3 req-5a40e8c8-d5ea-4858-b91a-b4ad14dc68df service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:58.201199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-43d69206-282b-4b89-80fe-97b36092c5e3 req-5a40e8c8-d5ea-4858-b91a-b4ad14dc68df service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:58.202066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-43d69206-282b-4b89-80fe-97b36092c5e3 req-5a40e8c8-d5ea-4858-b91a-b4ad14dc68df service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:58.203732 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db6a0876-3692-4d7e-9010-fe6b35415bb4 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1582 microversion: 2.1 time: 0.183304 Aug 29 16:13:58.217132 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-43d69206-282b-4b89-80fe-97b36092c5e3 req-5a40e8c8-d5ea-4858-b91a-b4ad14dc68df service nova] Creating event network-changed:99000f96-a58d-41f0-bd91-86305f249f4e for instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f on n-h1-854882-3 Aug 29 16:13:58.218239 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3333/6494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:58 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1582 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:58.224782 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-43d69206-282b-4b89-80fe-97b36092c5e3 req-5a40e8c8-d5ea-4858-b91a-b4ad14dc68df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.342513 Aug 29 16:13:58.226187 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3162/6495] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:59.227399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:59.228021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:59.235306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:59.235816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:59.236270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:59.237020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:59.237538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:59.237985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:59.377977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:59.386538 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4f57144b-8d9b-4ab6-b58f-addc06e74291 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1582 microversion: 2.1 time: 0.163180 Aug 29 16:13:59.387134 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3334/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:59 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1582 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:00.175487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-560f231d-3484-4eb9-bf60-65225513a42f req-16e93c31-a391-43d9-b3c8-d5887ef011c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66373f7-bd0c-44b6-a32b-0652d3c64b8f", "name": "network-vif-deleted", "tag": "99000f96-a58d-41f0-bd91-86305f249f4e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:00.188372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-560f231d-3484-4eb9-bf60-65225513a42f req-16e93c31-a391-43d9-b3c8-d5887ef011c4 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.188964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-560f231d-3484-4eb9-bf60-65225513a42f req-16e93c31-a391-43d9-b3c8-d5887ef011c4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.189502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-560f231d-3484-4eb9-bf60-65225513a42f req-16e93c31-a391-43d9-b3c8-d5887ef011c4 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.201961 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-560f231d-3484-4eb9-bf60-65225513a42f req-16e93c31-a391-43d9-b3c8-d5887ef011c4 service nova] Creating event network-vif-deleted:99000f96-a58d-41f0-bd91-86305f249f4e for instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f on n-h1-854882-3 Aug 29 16:14:00.206606 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-560f231d-3484-4eb9-bf60-65225513a42f req-16e93c31-a391-43d9-b3c8-d5887ef011c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035603 Aug 29 16:14:00.207321 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3163/6497] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:00.408029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:00.408581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:00.416378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.416877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.417330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.418066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.418530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.418967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.495155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:00.503858 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ca3cf4f4-d24f-43a1-91c6-6baa8a8c599e tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1228 microversion: 2.1 time: 0.099919 Aug 29 16:14:00.504657 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3335/6498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:00 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:01.525952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:01.526657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:01.532906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:01.533404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:01.533848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:01.534538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:01.534988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:01.535409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:01.602300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:01.610328 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39a03f11-f015-4d48-a4a3-228b0de61445 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1228 microversion: 2.1 time: 0.089691 Aug 29 16:14:01.610998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3164/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:01 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:02.634843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:02.635522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:02.642303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:02.642809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:02.643266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:02.643983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:02.644461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:02.644904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:02.707319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:02.715964 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-45201884-6272-4ce1-847f-c72c872ddac9 tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1228 microversion: 2.1 time: 0.085643 Aug 29 16:14:02.716533 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3336/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:02 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:03.736340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:03.736912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:03.744553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:03.745041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:03.745531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:03.746232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:03.746692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:03.747118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:03.809154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549d35b431a947eda45ea502b0dc753f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b055f0d12a17435cb8f8491123b4c8e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:03.817323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8e921b65-c412-4111-9873-2fabd70f741b tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 200 len: 1228 microversion: 2.1 time: 0.085085 Aug 29 16:14:03.818566 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3165/6501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:03 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:04.839062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:04.839991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] [instance: e66373f7-bd0c-44b6-a32b-0652d3c64b8f] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:04.846974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:04.847905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:04.848487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.850010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:04.850673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:04.851434 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.866497 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] HTTP exception thrown: Instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f could not be found. Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Request method failure captured: Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f HTTP/1.1 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOUATqePNSmtM9z3V2TjpVvKNfhjW3xJA9mK7J999kOBIbU7zlrnRPkNzpWOCXtf1icElgjgRF0GRbKAkWGeUOhv-64d_kkEqfO_OSc6BMQL7zp0IVMm4VaiWNPzVSWopUbNOXJXp4z4xFYpD0kEcXpn8EJC9GMaUG0yz9uaxrculS0 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: b055f0d12a17435cb8f8491123b4c8e8 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestVolumeBackupRestore-308080818 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b055f0d12a17435cb8f8491123b4c8e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b055f0d12a17435cb8f8491123b4c8e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b055f0d12a17435cb8f8491123b4c8e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b055f0d12a17435cb8f8491123b4c8e8"}]}] Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestVolumeBackupRestore-308080818 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: b055f0d12a17435cb8f8491123b4c8e8 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestVolumeBackupRestore-308080818 Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestVolumeBackupRestore-308080818-project Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 549d35b431a947eda45ea502b0dc753f Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestVolumeBackupRestore-308080818-project Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f could not be found. Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'e66373f7-bd0c-44b6-a32b-0652d3c64b8f'} Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f could not be found. Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f could not be found. Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:04.868127 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f could not be found. Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Returning 404 to user: Instance e66373f7-bd0c-44b6-a32b-0652d3c64b8f could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:04.873090 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ccbb6583-d294-4b8f-b32d-ebad6e84474a tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f" status: 404 len: 111 microversion: 2.1 time: 0.034534 Aug 29 16:14:04.882970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3337/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:04 2022] GET /compute/v2.1/servers/e66373f7-bd0c-44b6-a32b-0652d3c64b8f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:14:05.040104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-388ef2d3-ec84-4d21-807b-8aed044505fd tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] Calling method '.version_select at 0x7fb0e3c34430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:05.068592 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-388ef2d3-ec84-4d21-807b-8aed044505fd tempest-TestVolumeBackupRestore-308080818 tempest-TestVolumeBackupRestore-308080818-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-764430932" status: 202 len: 0 microversion: 2.1 time: 0.032317 Aug 29 16:14:05.069182 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3166/6503] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 16:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-764430932 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:27.482265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:27.483162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:27.611787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1568647526", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:27.666283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] validate_networks() for None {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:14:27.941229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:14:27.941716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:14:27.942893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:14:27.943332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:14:27.943805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:14:27.952722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:27.953229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:27.953729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:27.954487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:27.954966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:27.955418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:27.972347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Getting quotas for project 743c0e85dcf147169ac52edc63bb0172. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:27.977706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Getting quotas for user de59265ac5514a038de91425701e40b7 and project 743c0e85dcf147169ac52edc63bb0172. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:27.990355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:14:27.992677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:14:28.036584 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c3e26db2-8b6e-437c-9a01-ccf45b666ec2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559962 Aug 29 16:14:28.037254 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3338/6504] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:14:28.047905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:28.049195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:28.054782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-becd6efc-aa76-4b41-818f-1af844718109 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:28.055398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-becd6efc-aa76-4b41-818f-1af844718109 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:28.112732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-becd6efc-aa76-4b41-818f-1af844718109 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:28.120286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-becd6efc-aa76-4b41-818f-1af844718109 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1222 microversion: 2.1 time: 0.074460 Aug 29 16:14:28.121008 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3167/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:28 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:29.142128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:29.142619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:29.152200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:29.152717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:29.153319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:29.154343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:29.154607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:29.155059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:29.227580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:29.237297 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-01a08d6b-2c4c-4f12-ba43-801d2c60a023 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1282 microversion: 2.1 time: 0.099473 Aug 29 16:14:29.250361 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3339/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:29 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:30.261092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:30.262026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:30.269421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.270024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.271108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.271823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.272419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.272854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.479983 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:30.487903 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cdc63f0-412e-4077-9f53-19a3e8be3187 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1322 microversion: 2.1 time: 0.231043 Aug 29 16:14:30.488490 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3168/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:30 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:30.799466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5943f94a-c704-4cd7-b746-52e4ce44023b req-177503bf-db83-4664-b783-6f0af7780800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf16dd2-fbaf-4632-8515-2a1b50cb73cc", "tag": "b6633cbf-66ca-4202-a05f-01e4a7948bcb"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:30.809689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5943f94a-c704-4cd7-b746-52e4ce44023b req-177503bf-db83-4664-b783-6f0af7780800 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.810307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5943f94a-c704-4cd7-b746-52e4ce44023b req-177503bf-db83-4664-b783-6f0af7780800 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.810760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5943f94a-c704-4cd7-b746-52e4ce44023b req-177503bf-db83-4664-b783-6f0af7780800 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.822594 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5943f94a-c704-4cd7-b746-52e4ce44023b req-177503bf-db83-4664-b783-6f0af7780800 service nova] Creating event network-changed:b6633cbf-66ca-4202-a05f-01e4a7948bcb for instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc on n-h1-854882-3 Aug 29 16:14:30.827918 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5943f94a-c704-4cd7-b746-52e4ce44023b req-177503bf-db83-4664-b783-6f0af7780800 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100623 Aug 29 16:14:30.828683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3340/6508] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:31.508898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:31.509531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:31.516318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:31.516797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:31.517245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:31.517943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:31.518387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:31.518807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:31.650416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:31.658266 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-443431b2-66e2-4683-b00c-d3d952ddb288 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1322 microversion: 2.1 time: 0.153211 Aug 29 16:14:31.658849 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3169/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:31 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:32.681883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:32.682608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:32.689194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:32.689723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:32.690178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:32.690885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:32.691351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:32.691791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:32.826812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:32.835034 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b62de342-3e89-4145-bf57-90d80433dd9d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1322 microversion: 2.1 time: 0.158911 Aug 29 16:14:32.835622 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3341/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:32 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:33.855892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:33.856425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:33.864789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:33.865291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:33.865748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:33.866437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:33.866888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:33.867310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:34.001473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:34.009776 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-124d3730-6a56-4468-a044-36c62b84159d tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1322 microversion: 2.1 time: 0.157815 Aug 29 16:14:34.010359 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3170/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:33 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:35.030616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:35.031262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:35.038216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:35.038724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:35.039180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:35.039906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:35.040383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:35.040865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:35.179711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:35.188006 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1e9c5da1-a417-4821-bfb4-a89e6ccc7bcb tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1322 microversion: 2.1 time: 0.161340 Aug 29 16:14:35.188607 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3342/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:35 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:36.209223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:36.209889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:36.216675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:36.217193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:36.217669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:36.218363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:36.218819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:36.219246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:36.348444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:36.356755 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42a542a7-9009-471f-ac45-f4ec68473869 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1322 microversion: 2.1 time: 0.151472 Aug 29 16:14:36.357349 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3171/6513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:36 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:37.092951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3d7a46f3-f5cb-4698-bfe0-e169d4d9f4f5 req-df0f2bc7-f8bd-47ad-ba9b-274a99b346bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf16dd2-fbaf-4632-8515-2a1b50cb73cc", "name": "network-vif-plugged", "status": "completed", "tag": "b6633cbf-66ca-4202-a05f-01e4a7948bcb"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:37.103510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3d7a46f3-f5cb-4698-bfe0-e169d4d9f4f5 req-df0f2bc7-f8bd-47ad-ba9b-274a99b346bd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.104031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3d7a46f3-f5cb-4698-bfe0-e169d4d9f4f5 req-df0f2bc7-f8bd-47ad-ba9b-274a99b346bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.104520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3d7a46f3-f5cb-4698-bfe0-e169d4d9f4f5 req-df0f2bc7-f8bd-47ad-ba9b-274a99b346bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:37.116556 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3d7a46f3-f5cb-4698-bfe0-e169d4d9f4f5 req-df0f2bc7-f8bd-47ad-ba9b-274a99b346bd service nova] Creating event network-vif-plugged:b6633cbf-66ca-4202-a05f-01e4a7948bcb for instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc on n-h1-854882-3 Aug 29 16:14:37.121496 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3d7a46f3-f5cb-4698-bfe0-e169d4d9f4f5 req-df0f2bc7-f8bd-47ad-ba9b-274a99b346bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096319 Aug 29 16:14:37.122109 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3343/6514] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:37.378197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:37.378737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:37.387896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.388386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.388820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:37.389538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.390029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.390454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:37.521032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:37.528741 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-911bb173-624f-4d20-8f76-39a85260842c tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1322 microversion: 2.1 time: 0.154603 Aug 29 16:14:37.529319 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3172/6515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:37 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:38.547324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:38.548307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:38.554206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:38.555087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:38.563347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:38.563857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:38.564320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.565043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:38.565565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:38.566022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.700368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:38.708929 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8a47e4e4-b1a8-4150-83ca-61138fa5feef tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1471 microversion: 2.1 time: 0.162167 Aug 29 16:14:38.709569 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3344/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:38 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:38.732440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:38.785845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53277bfe-ad00-4cc8-8303-8f9bf90a681b tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Calling method '.version_select at 0x7fb0e285b0d0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:38.853004 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53277bfe-ad00-4cc8-8303-8f9bf90a681b tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f0b4d6bc931c4700afce5852912c4250" status: 200 len: 371 microversion: 2.1 time: 0.125072 Aug 29 16:14:38.853610 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3173/6517] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 16:14:38 2022] GET /compute/v2.1/os-quota-sets/f0b4d6bc931c4700afce5852912c4250 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:38.865156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d885855e-4b22-4b98-a997-c9622e7ab20c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-882728641", "id": 2112582292, "os-flavor-access:is_public": "True"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:38.882969 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d885855e-4b22-4b98-a997-c9622e7ab20c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021657 Aug 29 16:14:38.883544 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3345/6518] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:38 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:38.895102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2112582292"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:38.898105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:38.904174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:38.904656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:38.905092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.905810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:38.906268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:38.906693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.994804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f430534b394e4defb5322b65f2ece059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4d6bc931c4700afce5852912c4250', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:39.001311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-882728641 {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:14:39.008633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.009049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.009516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.010242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.010692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.011111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.031126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Getting quotas for project 743c0e85dcf147169ac52edc63bb0172. Resources: {'cores', 'ram'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:39.036136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Getting quotas for user de59265ac5514a038de91425701e40b7 and project 743c0e85dcf147169ac52edc63bb0172. Resources: {'cores', 'ram'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:39.048101 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.compute.api [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] ram quota exceeded for f0b4d6bc931c4700afce5852912c4250, tried to resize instance. Aug 29 16:14:39.048634 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Request method failure captured: Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc/action HTTP/1.1 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 39 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOXjWxMlzX0t98Vig3ZqUuXesxn3gLaWjvSRWnHry-cFHSM-a2N1NsbFQITltuFB28WbbsZdZ0AqmKM3OT2aod4YLybOTlaOPRtriie0Tq_rDCEoFp8sLEcY4swk2HBrGqO6lW_hsUFKTveEVeoCuqM5lXwkGM99CG4zg7-7adX4VWU Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f0b4d6bc931c4700afce5852912c4250 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1955494277 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,admin,reader Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,admin,reader Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0b4d6bc931c4700afce5852912c4250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0b4d6bc931c4700afce5852912c4250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0b4d6bc931c4700afce5852912c4250", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0b4d6bc931c4700afce5852912c4250"}]}] Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1955494277 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f0b4d6bc931c4700afce5852912c4250 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1955494277 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersAdminNegativeTestJSON-1955494277-project-admin Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: f430534b394e4defb5322b65f2ece059 Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1955494277-project-admin Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: {"resize": {"flavorRef": "2112582292"}} Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'bbf16dd2-fbaf-4632-8515-2a1b50cb73cc', 'body': {'resize': {'flavorRef': '2112582292'}}} Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:14:39.055383 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5fe1937f-011c-4ed7-b627-be3a89e84b0d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc/action" status: 403 len: 118 microversion: 2.1 time: 0.165658 Aug 29 16:14:39.059093 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3174/6519] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:38 2022] POST /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc/action => generated 118 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:14:39.067301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-80d8bd92-3364-425b-b2ed-361a12395a0b tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.085032 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-80d8bd92-3364-425b-b2ed-361a12395a0b tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2112582292" status: 202 len: 0 microversion: 2.1 time: 0.021600 Aug 29 16:14:39.085635 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3346/6520] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Aug 29 16:14:39 2022] DELETE /compute/v2.1/flavors/2112582292 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:39.094026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a11cb4af-2eb2-4b9c-97c8-a166011c25fc tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.114960 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a11cb4af-2eb2-4b9c-97c8-a166011c25fc tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024661 Aug 29 16:14:39.115521 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3175/6521] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:39.135037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15000226-d4a6-4472-9518-b1f7212f7aa9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Calling method '.version_select at 0x7fb0e0744a60>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.206107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-15000226-d4a6-4472-9518-b1f7212f7aa9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f0b4d6bc931c4700afce5852912c4250" status: 200 len: 371 microversion: 2.1 time: 0.074730 Aug 29 16:14:39.206688 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3347/6522] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/os-quota-sets/f0b4d6bc931c4700afce5852912c4250 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:39.217859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ac0ed48-abd1-408e-bf02-7aa35bca6dd7 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-590520232", "id": 857271653, "os-flavor-access:is_public": "True"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:39.236533 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ac0ed48-abd1-408e-bf02-7aa35bca6dd7 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022473 Aug 29 16:14:39.237116 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3176/6523] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:39 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:39.249007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "857271653"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:39.251391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.258238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.258790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.259190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.259895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.260369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.260810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.344736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f430534b394e4defb5322b65f2ece059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4d6bc931c4700afce5852912c4250', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:39.351487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-590520232 {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:14:39.358106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.358596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.359044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.359779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.360248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.360684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.384424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Getting quotas for project 743c0e85dcf147169ac52edc63bb0172. Resources: {'cores', 'ram'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:39.389550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Getting quotas for user de59265ac5514a038de91425701e40b7 and project 743c0e85dcf147169ac52edc63bb0172. Resources: {'cores', 'ram'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:39.403643 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] cores quota exceeded for f0b4d6bc931c4700afce5852912c4250, tried to resize instance. Aug 29 16:14:39.404209 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Request method failure captured: Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc/action HTTP/1.1 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 38 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOXjWxMlzX0t98Vig3ZqUuXesxn3gLaWjvSRWnHry-cFHSM-a2N1NsbFQITltuFB28WbbsZdZ0AqmKM3OT2aod4YLybOTlaOPRtriie0Tq_rDCEoFp8sLEcY4swk2HBrGqO6lW_hsUFKTveEVeoCuqM5lXwkGM99CG4zg7-7adX4VWU Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f0b4d6bc931c4700afce5852912c4250 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1955494277 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,admin,reader Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,admin,reader Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0b4d6bc931c4700afce5852912c4250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0b4d6bc931c4700afce5852912c4250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0b4d6bc931c4700afce5852912c4250", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0b4d6bc931c4700afce5852912c4250"}]}] Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1955494277 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f0b4d6bc931c4700afce5852912c4250 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1955494277 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersAdminNegativeTestJSON-1955494277-project-admin Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: f430534b394e4defb5322b65f2ece059 Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1955494277-project-admin Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: {"resize": {"flavorRef": "857271653"}} Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'bbf16dd2-fbaf-4632-8515-2a1b50cb73cc', 'body': {'resize': {'flavorRef': '857271653'}}} Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:14:39.406349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:39.410231 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c5ce284e-3232-4f32-86e6-17168f5d918c tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc/action" status: 403 len: 113 microversion: 2.1 time: 0.162822 Aug 29 16:14:39.413270 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3348/6524] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:39 2022] POST /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc/action => generated 113 bytes in 168 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:14:39.417701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc29e59f-3bde-426d-951b-0ac8ab737351 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.437224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cc29e59f-3bde-426d-951b-0ac8ab737351 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/857271653" status: 202 len: 0 microversion: 2.1 time: 0.023198 Aug 29 16:14:39.437935 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3177/6525] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 16:14:39 2022] DELETE /compute/v2.1/flavors/857271653 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:14:39.446093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-17af3470-f024-4ff1-92c4-58670d8025c9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.465951 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-17af3470-f024-4ff1-92c4-58670d8025c9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023556 Aug 29 16:14:39.466513 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3349/6526] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:39.487005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.487545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.494423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.494909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.495350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.496043 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.496500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.496927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.522511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:14:39.597823 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d031fb7d-a759-48e7-bbad-d33d5d2782e5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 204 len: 0 microversion: 2.1 time: 0.114454 Aug 29 16:14:39.598420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3178/6527] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:14:39 2022] DELETE /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:14:39.607269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.608414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.615868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.616367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.616822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.617559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.618028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.618472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.756489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:39.765596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0fdffbab-05e2-4986-a26c-a1733679ceb5 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1477 microversion: 2.1 time: 0.162187 Aug 29 16:14:39.766172 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3350/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:40.788280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:40.788987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:40.795536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.795967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.796437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.797154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.797634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.798059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.992783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de59265ac5514a038de91425701e40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743c0e85dcf147169ac52edc63bb0172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:41.000895 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0febf6fc-bb37-4f8a-8d6f-28dd4ce321b2 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 200 len: 1477 microversion: 2.1 time: 0.217899 Aug 29 16:14:41.001607 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3179/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:40 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:41.376748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-bacdeda6-013f-4e16-9c67-d6f30b710d8a req-57882828-06ac-4d14-aa3e-7161c6ec5649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf16dd2-fbaf-4632-8515-2a1b50cb73cc", "name": "network-vif-deleted", "tag": "b6633cbf-66ca-4202-a05f-01e4a7948bcb"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:41.392564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bacdeda6-013f-4e16-9c67-d6f30b710d8a req-57882828-06ac-4d14-aa3e-7161c6ec5649 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.392988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bacdeda6-013f-4e16-9c67-d6f30b710d8a req-57882828-06ac-4d14-aa3e-7161c6ec5649 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.393675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-bacdeda6-013f-4e16-9c67-d6f30b710d8a req-57882828-06ac-4d14-aa3e-7161c6ec5649 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.408112 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-bacdeda6-013f-4e16-9c67-d6f30b710d8a req-57882828-06ac-4d14-aa3e-7161c6ec5649 service nova] Creating event network-vif-deleted:b6633cbf-66ca-4202-a05f-01e4a7948bcb for instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc on n-h1-854882-3 Aug 29 16:14:41.415969 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-bacdeda6-013f-4e16-9c67-d6f30b710d8a req-57882828-06ac-4d14-aa3e-7161c6ec5649 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043906 Aug 29 16:14:41.416638 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3351/6530] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:42.023356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:42.023883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] [instance: bbf16dd2-fbaf-4632-8515-2a1b50cb73cc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:42.031265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:42.031747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:42.032187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:42.032879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:42.033335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:42.033790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:42.048192 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] HTTP exception thrown: Instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc could not be found. Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Request method failure captured: Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc HTTP/1.1 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOXiJEo5Kk3iUScbaCbYnijHRl8NYlPndqR7Kr0CNqxrvhRq_rfiyXRAnfqW3s7eqCBJ5XXvy48ckCilMOn3NUV0zSktup4UD5tpFNgn2vEVpyaerIdjqxLZcN12PQIAxsaNulS_MzrVtib07Y9_9bSkr80twhktgq1SEN5S9QZn0Kg Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 743c0e85dcf147169ac52edc63bb0172 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1858426866 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/743c0e85dcf147169ac52edc63bb0172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/743c0e85dcf147169ac52edc63bb0172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_743c0e85dcf147169ac52edc63bb0172", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/743c0e85dcf147169ac52edc63bb0172"}]}] Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1858426866 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 743c0e85dcf147169ac52edc63bb0172 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1858426866 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersAdminNegativeTestJSON-1858426866-project Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: de59265ac5514a038de91425701e40b7 Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1858426866-project Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc could not be found. Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'bbf16dd2-fbaf-4632-8515-2a1b50cb73cc'} Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc could not be found. Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc could not be found. Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:42.050040 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc could not be found. Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] Returning 404 to user: Instance bbf16dd2-fbaf-4632-8515-2a1b50cb73cc could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79b72d32-96ff-44b8-9e29-8e1f413e5f84 tempest-ServersAdminNegativeTestJSON-1858426866 tempest-ServersAdminNegativeTestJSON-1858426866-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc" status: 404 len: 111 microversion: 2.1 time: 0.032852 Aug 29 16:14:42.054138 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3180/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:42 2022] GET /compute/v2.1/servers/bbf16dd2-fbaf-4632-8515-2a1b50cb73cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:14:48.776993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-690266229", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "144f0d1b-1014-4b98-bf65-9dccf32ca16e"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:48.832083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] validate_networks() for [('144f0d1b-1014-4b98-bf65-9dccf32ca16e', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:14:49.197683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:49.217212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:14:49.217692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:14:49.218182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:14:49.218610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:14:49.219068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:14:49.227938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:49.228431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:49.228879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:49.229649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:49.230115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:49.230559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:49.247129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Getting quotas for project a1f6f2ec58644e48a2575089343cab92. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:49.252392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Getting quotas for user 27aab9392b0a4b428463d86c8d517714 and project a1f6f2ec58644e48a2575089343cab92. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:49.264965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:14:49.267371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:14:49.312536 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-79ea3eea-b072-4d23-bbb1-a65b0de93872 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689595 Aug 29 16:14:49.313217 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3352/6532] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:14:49.324604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2db93625-63f0-4b8f-844d-906fba3ed926 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:49.325211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2db93625-63f0-4b8f-844d-906fba3ed926 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:49.328048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:49.328865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:49.392396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2db93625-63f0-4b8f-844d-906fba3ed926 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:49.404717 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2db93625-63f0-4b8f-844d-906fba3ed926 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1214 microversion: 2.1 time: 0.083828 Aug 29 16:14:49.405648 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3181/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:49 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:50.427361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:50.428541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:50.437149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:50.437728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:50.438193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:50.439412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:50.439904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:50.440505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:50.516059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:50.539585 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8844979-3152-42d7-a3da-aef820ea1607 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1266 microversion: 2.1 time: 0.117916 Aug 29 16:14:50.541377 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3353/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:50 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:51.560236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:51.561702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:51.570643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:51.571406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:51.571947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:51.572752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:51.573377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:51.573828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:51.781622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:51.791842 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a07cd41-00e9-4e9f-8ce2-b5ea6974f1df tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1314 microversion: 2.1 time: 0.235260 Aug 29 16:14:51.792918 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3182/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:51 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:52.015477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-297e1f5a-1750-40b6-8824-84f1f0a71349 req-9df2bbae-2de2-4212-a194-26fc0a317676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1814da01-c78a-46ef-aa92-6d3ab66a5dcc", "tag": "ef68c89a-5568-44b9-ad2a-8ffeced9201e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:52.025894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-297e1f5a-1750-40b6-8824-84f1f0a71349 req-9df2bbae-2de2-4212-a194-26fc0a317676 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:52.026633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-297e1f5a-1750-40b6-8824-84f1f0a71349 req-9df2bbae-2de2-4212-a194-26fc0a317676 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:52.027091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-297e1f5a-1750-40b6-8824-84f1f0a71349 req-9df2bbae-2de2-4212-a194-26fc0a317676 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:52.046916 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-297e1f5a-1750-40b6-8824-84f1f0a71349 req-9df2bbae-2de2-4212-a194-26fc0a317676 service nova] Creating event network-changed:ef68c89a-5568-44b9-ad2a-8ffeced9201e for instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc on n-h1-854882-3 Aug 29 16:14:52.052189 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-297e1f5a-1750-40b6-8824-84f1f0a71349 req-9df2bbae-2de2-4212-a194-26fc0a317676 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041453 Aug 29 16:14:52.052864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3354/6536] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:52.813981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:52.814601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:52.822510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:52.822992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:52.823430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:52.824184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:52.824639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:52.825068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:52.957336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:52.964968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-79dc4fee-4b88-44e6-936d-8665d1e77ac7 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1314 microversion: 2.1 time: 0.155294 Aug 29 16:14:52.965559 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3183/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:52 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:53.987086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:53.987721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:53.994586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:53.995082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:53.995532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:53.996233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:53.996703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:53.997144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:54.131135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:54.139017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f04c2d3b-a7e3-43de-849c-50eb180e586d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1314 microversion: 2.1 time: 0.157215 Aug 29 16:14:54.139598 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3355/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:53 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:55.165317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:55.166645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:55.174045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:55.174563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:55.175014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:55.175711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:55.176202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:55.177274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:55.319195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:55.328491 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8d26919-f701-41ae-af1e-3eea89869a50 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1314 microversion: 2.1 time: 0.169993 Aug 29 16:14:55.329184 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3184/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:55 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:56.349417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:56.350059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:56.356859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:56.357359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:56.357837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:56.358542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:56.359010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:56.359449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:56.488666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:56.496382 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-76f06fc5-bfb2-4988-924f-7376d8949f7c tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1314 microversion: 2.1 time: 0.151548 Aug 29 16:14:56.496956 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3356/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:56 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:57.111234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-aa6a5110-c092-4da8-bc44-b6c06a4ec87a req-876d583d-fc5c-463f-b445-773d3b20b4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1814da01-c78a-46ef-aa92-6d3ab66a5dcc", "name": "network-vif-plugged", "status": "completed", "tag": "ef68c89a-5568-44b9-ad2a-8ffeced9201e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:57.121902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa6a5110-c092-4da8-bc44-b6c06a4ec87a req-876d583d-fc5c-463f-b445-773d3b20b4bd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:57.122522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa6a5110-c092-4da8-bc44-b6c06a4ec87a req-876d583d-fc5c-463f-b445-773d3b20b4bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:57.123031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa6a5110-c092-4da8-bc44-b6c06a4ec87a req-876d583d-fc5c-463f-b445-773d3b20b4bd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:57.136705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-aa6a5110-c092-4da8-bc44-b6c06a4ec87a req-876d583d-fc5c-463f-b445-773d3b20b4bd service nova] Creating event network-vif-plugged:ef68c89a-5568-44b9-ad2a-8ffeced9201e for instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc on n-h1-854882-3 Aug 29 16:14:57.141854 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-aa6a5110-c092-4da8-bc44-b6c06a4ec87a req-876d583d-fc5c-463f-b445-773d3b20b4bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034379 Aug 29 16:14:57.142463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3185/6541] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:57.516880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:57.517549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:57.520379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:57.525809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:57.526318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:57.526787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:57.527510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:57.527991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:57.528443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:57.531872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=74 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:57.661591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:57.669250 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a7bc382-d6cb-487f-8944-095811a6a2b8 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1314 microversion: 2.1 time: 0.156306 Aug 29 16:14:57.669870 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3357/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:57 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:58.691485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:58.692190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:58.694953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:58.700478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:58.700963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:58.701420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:58.702170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:58.702581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:58.703031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:58.706344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:58.843405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:58.851791 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-96de816b-1079-4721-a4dd-14910c2ee53b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1500 microversion: 2.1 time: 0.164873 Aug 29 16:14:58.852368 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3186/6543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:58 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:58.872272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:58.874627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:58.881957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:58.882456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:58.882924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:58.883647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:58.884121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:58.884564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:58.915511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:58.921316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Old instance type m1.heat2, new instance type m1.heat {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:14:58.927726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:14:58.928162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:14:58.928654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:14:58.929081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:14:58.929603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:14:58.991405 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ee4f839-7769-4113-8361-21c0568ca2ef tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "POST /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.122904 Aug 29 16:14:58.992105 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3358/6544] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:58 2022] POST /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:59.000349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:59.001210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:59.008811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:59.009300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:59.009788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:59.010480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:59.010937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:59.011365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:59.146494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:59.155725 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-850a47dc-6dcd-4234-8c2d-796f21d80ae3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1509 microversion: 2.1 time: 0.159269 Aug 29 16:14:59.156319 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3187/6545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:58 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:00.173370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=5 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:00.174183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:00.179683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:00.180307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:00.188519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:00.189022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:00.189498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:00.190205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:00.190673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:00.191118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:00.332012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:00.340023 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c824c3f-03d3-44ef-8024-e6ad20b702a3 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1509 microversion: 2.1 time: 0.167850 Aug 29 16:15:00.340606 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3359/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:00 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:01.361496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:01.362132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:01.364037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:01.370101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.370580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.371015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.371706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.372160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.372588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.504285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:01.512507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2271eb8a-5edc-4a37-8b66-988315b979c4 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.155030 Aug 29 16:15:01.513078 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3188/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:01 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:02.533533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:02.534179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:02.541606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:02.542121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:02.542590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:02.543319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:02.543800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:02.544251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:02.683794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:02.691997 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85916288-8a10-43e1-a8e3-c1e9b8bba623 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.162510 Aug 29 16:15:02.692580 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3360/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:02 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:03.713328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:03.713960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:03.720766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:03.721236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:03.721702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:03.722381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:03.722826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:03.723240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:03.855712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:03.864839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c0163817-66bd-48ca-83b1-feaecd75b5a0 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.154872 Aug 29 16:15:03.865446 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3189/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:03 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:04.886779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:04.887351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:04.894465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.894974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.896071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:04.896803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.897281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.897753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.032314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:05.040202 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1c0b1ed8-c0e0-4d0c-b0d2-01ee5ba825ee tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.157516 Aug 29 16:15:05.040785 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3361/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:04 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:06.060455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:06.061135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:06.069832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.070319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.070756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.071454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.071910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.072336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.202662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:06.210322 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-338c0d75-3282-47fe-a707-368cc1f58b0a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.153751 Aug 29 16:15:06.210885 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3190/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:06 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:07.231212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:07.231879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:07.238896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:07.239397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:07.239848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:07.240555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:07.241024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:07.241502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:07.376416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:07.385807 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a44e690c-708c-4897-a9e1-02f337f9b07b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.158421 Aug 29 16:15:07.386397 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3362/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:07 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:08.406410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:08.406986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:08.413791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:08.414269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:08.414700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:08.415383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:08.415832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:08.416253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:08.553466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:08.561124 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d2f936eb-c1cf-4135-90f4-2856cf4daeae tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.158646 Aug 29 16:15:08.561806 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3191/6553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:08 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:09.583264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:09.583902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:09.590992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:09.591504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:09.591966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:09.592686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:09.593165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:09.593653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:09.727995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:09.735774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-755ca928-ec40-4df0-92c2-98da3a4fbed2 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.156487 Aug 29 16:15:09.736339 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3363/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:09 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:10.756697 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:10.757299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:10.764296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.764757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.765192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:10.765920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.766372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.766795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:11.200564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:11.208807 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2cec570a-ea47-47b6-9c38-52ad277ff219 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.456035 Aug 29 16:15:11.209378 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3192/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:10 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:12.229791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:12.230432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:12.237474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.238003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.238441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.239657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.240213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.240662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.373354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:12.381166 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3afc5274-a8c5-458d-9cf8-cdb2a97dabfc tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.155194 Aug 29 16:15:12.381723 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3364/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:12 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:13.402470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:13.403080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:13.410049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.410529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.410994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.411683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.412133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.412556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.544797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:13.552993 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d2b64d8-eb76-4f7a-9b76-1e476db2192d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.154492 Aug 29 16:15:13.553581 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3193/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:13 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:14.573482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:14.574128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:14.581141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:14.581685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:14.582145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:14.583353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:14.583830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:14.584279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:14.714128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:14.722011 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9591f0b-be0b-465c-95cf-16b294a6aa87 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.152555 Aug 29 16:15:14.722591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3365/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:14 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:15.743626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:15.744230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:15.751110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:15.751583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:15.752009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.752686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:15.753133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:15.753589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.883499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:15.891205 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-307aeb39-5415-4d5e-a72b-9972f181a828 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.151513 Aug 29 16:15:15.891779 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3194/6559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:15 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:16.912551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:16.913108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.920015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.920520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.920976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.921728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.922208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.922655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.050669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:17.059302 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6286eb0-9607-40d1-9fd5-472094c7e433 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.151250 Aug 29 16:15:17.059887 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3366/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:16 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:18.080569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:18.081190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:18.087976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.088452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.088878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.089588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.090064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.090482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.217368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.224985 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e32469c-7699-4848-954c-2bb4007d29fa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.148332 Aug 29 16:15:18.225646 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3195/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:18 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:19.245903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:19.246543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:19.253460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.253970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.254436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.255159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.255635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.256090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.390955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:19.398853 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6a579d3a-d2e7-44a1-a3d2-77d13662065b tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.156907 Aug 29 16:15:19.399432 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3367/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:19 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:20.420250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:20.420873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:20.428324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:20.428809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:20.429281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:20.430010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:20.430465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:20.430895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:20.566558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:20.575070 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0e5032b-5e5e-4d90-a848-47070ce7a33d tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.158842 Aug 29 16:15:20.575644 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3196/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:20 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:21.596463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:21.597108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:21.604223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.604729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.605190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.605943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.606424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.606872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.736531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.745056 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66d98044-6ec9-42ad-9cc0-a93ccc4a27aa tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.152613 Aug 29 16:15:21.745666 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3368/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:21 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:22.767443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.768032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.775402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.775894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.776335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.777152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.777800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.778278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.914358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.922452 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-846347ee-c2ff-4cc8-bbf8-3569f6882aba tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.159215 Aug 29 16:15:22.923088 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3197/6565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:22 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:23.946364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:23.946962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:23.953699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.954208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.954670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:23.955390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.955869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.956328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.103866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:24.111751 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e5ed7fb9-aa15-4a24-a880-a311302b82cb tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.170139 Aug 29 16:15:24.112341 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3369/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:23 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:25.133679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:25.134360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:25.141675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.142249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.142732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.143436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.143981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.144421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.280396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:25.288158 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ebb738cf-8b43-4912-85ff-64b4f3b77693 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.159027 Aug 29 16:15:25.288735 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3198/6567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:25 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:26.310043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:26.310686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:26.317893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.318400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.318865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.319586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.320070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.320523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.454254 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:26.462353 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-224295ef-bef3-44f6-a4f0-8830889eafa5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.156251 Aug 29 16:15:26.462937 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3370/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:26 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:27.484370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:27.484996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:27.491884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.492393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.492885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.493622 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.494089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.494527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.626386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.634139 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3a08a893-556e-4bf5-8710-d9983aeb4df5 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1514 microversion: 2.1 time: 0.153739 Aug 29 16:15:27.634715 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3199/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:27 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:28.655255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:28.655818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:28.658653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=32 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:28.663985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.664494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.664955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.665721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.666204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.667309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.671540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:28.992793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:29.001601 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2057fa15-7933-4eaa-975b-be2ff766f45f tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1513 microversion: 2.1 time: 0.350872 Aug 29 16:15:29.002495 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3371/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:28 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:29.017715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7fe78338-2ea7-4642-9c8c-257479084b9e req-60d6aa3e-7c37-40d7-8d56-6187938032ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1814da01-c78a-46ef-aa92-6d3ab66a5dcc", "name": "network-vif-unplugged", "status": "completed", "tag": "ef68c89a-5568-44b9-ad2a-8ffeced9201e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:29.023359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=28 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:29.029812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7fe78338-2ea7-4642-9c8c-257479084b9e req-60d6aa3e-7c37-40d7-8d56-6187938032ab service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:29.030282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7fe78338-2ea7-4642-9c8c-257479084b9e req-60d6aa3e-7c37-40d7-8d56-6187938032ab service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:29.030704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7fe78338-2ea7-4642-9c8c-257479084b9e req-60d6aa3e-7c37-40d7-8d56-6187938032ab service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:29.034604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=84 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:29.043218 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7fe78338-2ea7-4642-9c8c-257479084b9e req-60d6aa3e-7c37-40d7-8d56-6187938032ab service nova] Creating event network-vif-unplugged:ef68c89a-5568-44b9-ad2a-8ffeced9201e for instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc on n-h2-854882-3 Aug 29 16:15:29.049014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-7fe78338-2ea7-4642-9c8c-257479084b9e req-60d6aa3e-7c37-40d7-8d56-6187938032ab service nova] Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:15:29.060300 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7fe78338-2ea7-4642-9c8c-257479084b9e req-60d6aa3e-7c37-40d7-8d56-6187938032ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060456 Aug 29 16:15:29.060978 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3200/6571] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:15:30.022711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:30.023453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:30.030772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:30.031292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:30.031753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.032484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:30.032996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:30.033491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.195203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:30.204059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c5652441-6d45-4c13-8565-51468d1b7630 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1513 microversion: 2.1 time: 0.185224 Aug 29 16:15:30.204652 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3372/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:30 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:31.076657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-84702f77-dd55-499d-bc74-a0166c83901e req-85c6fa68-e7c5-4c25-a904-f889c5fb9613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1814da01-c78a-46ef-aa92-6d3ab66a5dcc", "tag": "ef68c89a-5568-44b9-ad2a-8ffeced9201e"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:31.086088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-84702f77-dd55-499d-bc74-a0166c83901e req-85c6fa68-e7c5-4c25-a904-f889c5fb9613 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.086562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-84702f77-dd55-499d-bc74-a0166c83901e req-85c6fa68-e7c5-4c25-a904-f889c5fb9613 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.086989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-84702f77-dd55-499d-bc74-a0166c83901e req-85c6fa68-e7c5-4c25-a904-f889c5fb9613 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.098419 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-84702f77-dd55-499d-bc74-a0166c83901e req-85c6fa68-e7c5-4c25-a904-f889c5fb9613 service nova] Creating event network-changed:ef68c89a-5568-44b9-ad2a-8ffeced9201e for instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc on n-h2-854882-3 Aug 29 16:15:31.103607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-84702f77-dd55-499d-bc74-a0166c83901e req-85c6fa68-e7c5-4c25-a904-f889c5fb9613 service nova] Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:15:31.114607 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-84702f77-dd55-499d-bc74-a0166c83901e req-85c6fa68-e7c5-4c25-a904-f889c5fb9613 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043023 Aug 29 16:15:31.115192 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3201/6573] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:31.226676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:31.227456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:31.234892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.235472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.236015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.236797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.237335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.237891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.371572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:31.379591 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0ee2873f-2160-4864-8b7a-d9071e609f67 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1511 microversion: 2.1 time: 0.157103 Aug 29 16:15:31.393459 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3373/6574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:31 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:32.402049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:32.402701 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:32.408923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:32.409433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:32.409873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:32.410558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:32.411009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:32.411432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:32.548556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:32.556241 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-588379b0-9992-43c2-881c-440e575ae7bf tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1508 microversion: 2.1 time: 0.159359 Aug 29 16:15:32.556812 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3202/6575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:32 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:32.577413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:32.577999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:32.584522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:32.585029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:32.585519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:32.586232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:32.586715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:32.587154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:32.612680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:15:32.661648 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.compute.api [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Found an unconfirmed migration during delete, id: 16, status: finished Aug 29 16:15:34.049845 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d0f2018e-a419-4f2a-9124-80221fce5c6a tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 204 len: 0 microversion: 2.1 time: 1.475614 Aug 29 16:15:34.050638 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3374/6576] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:15:32 2022] DELETE /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 0 bytes in 1478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:15:34.059145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:34.059762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:34.066873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.067382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.067811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.068498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.068949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.069373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.202439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:34.210116 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5b078bf2-cd42-4644-89e5-85be60e47301 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1500 microversion: 2.1 time: 0.155230 Aug 29 16:15:34.210688 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3203/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:34 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:34.992908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-67175336-f9bb-4f42-a0b4-bf2d36c1e327 req-9dcf0b09-d318-40ba-8bc7-b1a5efa12498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1814da01-c78a-46ef-aa92-6d3ab66a5dcc", "name": "network-vif-plugged", "status": "completed", "tag": "ef68c89a-5568-44b9-ad2a-8ffeced9201e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:35.005133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-67175336-f9bb-4f42-a0b4-bf2d36c1e327 req-9dcf0b09-d318-40ba-8bc7-b1a5efa12498 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.005662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-67175336-f9bb-4f42-a0b4-bf2d36c1e327 req-9dcf0b09-d318-40ba-8bc7-b1a5efa12498 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.006107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-67175336-f9bb-4f42-a0b4-bf2d36c1e327 req-9dcf0b09-d318-40ba-8bc7-b1a5efa12498 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.017537 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-67175336-f9bb-4f42-a0b4-bf2d36c1e327 req-9dcf0b09-d318-40ba-8bc7-b1a5efa12498 service nova] Creating event network-vif-plugged:ef68c89a-5568-44b9-ad2a-8ffeced9201e for instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc on n-h2-854882-3 Aug 29 16:15:35.022618 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-67175336-f9bb-4f42-a0b4-bf2d36c1e327 req-9dcf0b09-d318-40ba-8bc7-b1a5efa12498 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033872 Aug 29 16:15:35.023620 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3375/6578] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:35.235154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:35.236466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:35.243734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.244223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.244676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.245872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.246321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.246834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.379744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27aab9392b0a4b428463d86c8d517714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f6f2ec58644e48a2575089343cab92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:35.388374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9aad5e1-f6d7-4faa-8f4c-da85d13cb967 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 200 len: 1500 microversion: 2.1 time: 0.160719 Aug 29 16:15:35.389339 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3204/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:35 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:35.812369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-49602428-5ce5-418c-93c3-4a9c73f68fdb req-f4fe8c57-049f-4309-adaa-ee64e036d777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1814da01-c78a-46ef-aa92-6d3ab66a5dcc", "name": "network-vif-deleted", "tag": "ef68c89a-5568-44b9-ad2a-8ffeced9201e"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:35.823113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-49602428-5ce5-418c-93c3-4a9c73f68fdb req-f4fe8c57-049f-4309-adaa-ee64e036d777 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.823877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-49602428-5ce5-418c-93c3-4a9c73f68fdb req-f4fe8c57-049f-4309-adaa-ee64e036d777 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.824501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-49602428-5ce5-418c-93c3-4a9c73f68fdb req-f4fe8c57-049f-4309-adaa-ee64e036d777 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.847890 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-49602428-5ce5-418c-93c3-4a9c73f68fdb req-f4fe8c57-049f-4309-adaa-ee64e036d777 service nova] Creating event network-vif-deleted:ef68c89a-5568-44b9-ad2a-8ffeced9201e for instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc on n-h2-854882-3 Aug 29 16:15:35.857070 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-49602428-5ce5-418c-93c3-4a9c73f68fdb req-f4fe8c57-049f-4309-adaa-ee64e036d777 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045731 Aug 29 16:15:35.857070 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3376/6580] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:36.409280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:36.409909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:36.416579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.417619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.418055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.418728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.419170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.419583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.432809 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] HTTP exception thrown: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Request method failure captured: Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc HTTP/1.1 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOX4eknlh-YAj3ZW0TpU6fj5uGIXRFDnojYp6L-aIhGigO8ejOsdQL6DzHx29QcnWQu-3zLzBB6-bwKo6rHhsTLpa4aDk4sZDd6jcn4GsC4IWl8pI_GNkKFvIXeDJ__cFNvHwhzRHlc2JdfCi1fu91wHJ2xVSrq0Gl7AiYCEWPMmXTY Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a1f6f2ec58644e48a2575089343cab92 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1f6f2ec58644e48a2575089343cab92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1f6f2ec58644e48a2575089343cab92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1f6f2ec58644e48a2575089343cab92", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1f6f2ec58644e48a2575089343cab92"}]}] Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a1f6f2ec58644e48a2575089343cab92 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-2084352986-project Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 27aab9392b0a4b428463d86c8d517714 Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-2084352986-project Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1814da01-c78a-46ef-aa92-6d3ab66a5dcc'} Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:36.434955 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Returning 404 to user: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0fdfea79-e1a0-4cc7-96cd-76a95ae9a3ea tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 404 len: 111 microversion: 2.1 time: 0.030934 Aug 29 16:15:36.439366 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3205/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:36 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:15:36.452553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:36.453188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:36.459913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.460445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.460896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.461634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.462103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.462539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.475648 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] HTTP exception thrown: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Request method failure captured: Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc HTTP/1.1 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOX4eknlh-YAj3ZW0TpU6fj5uGIXRFDnojYp6L-aIhGigO8ejOsdQL6DzHx29QcnWQu-3zLzBB6-bwKo6rHhsTLpa4aDk4sZDd6jcn4GsC4IWl8pI_GNkKFvIXeDJ__cFNvHwhzRHlc2JdfCi1fu91wHJ2xVSrq0Gl7AiYCEWPMmXTY Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: a1f6f2ec58644e48a2575089343cab92 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1f6f2ec58644e48a2575089343cab92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1f6f2ec58644e48a2575089343cab92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1f6f2ec58644e48a2575089343cab92", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1f6f2ec58644e48a2575089343cab92"}]}] Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: a1f6f2ec58644e48a2575089343cab92 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-DeleteServersTestJSON-2084352986-project Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 27aab9392b0a4b428463d86c8d517714 Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-DeleteServersTestJSON-2084352986-project Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '1814da01-c78a-46ef-aa92-6d3ab66a5dcc'} Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:15:36.477318 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Returning 404 to user: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f58514ea-d353-4f62-9912-14ae8d1a56ec tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 404 len: 111 microversion: 2.1 time: 0.031448 Aug 29 16:15:36.481837 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3377/6582] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:15:36 2022] DELETE /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:15:36.488735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:36.489292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] [instance: 1814da01-c78a-46ef-aa92-6d3ab66a5dcc] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:36.495967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.496447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.496885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.497667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.498123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.498547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.512242 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] HTTP exception thrown: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Request method failure captured: Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc HTTP/1.1 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOX4eknlh-YAj3ZW0TpU6fj5uGIXRFDnojYp6L-aIhGigO8ejOsdQL6DzHx29QcnWQu-3zLzBB6-bwKo6rHhsTLpa4aDk4sZDd6jcn4GsC4IWl8pI_GNkKFvIXeDJ__cFNvHwhzRHlc2JdfCi1fu91wHJ2xVSrq0Gl7AiYCEWPMmXTY Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: a1f6f2ec58644e48a2575089343cab92 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1f6f2ec58644e48a2575089343cab92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1f6f2ec58644e48a2575089343cab92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1f6f2ec58644e48a2575089343cab92", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1f6f2ec58644e48a2575089343cab92"}]}] Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: a1f6f2ec58644e48a2575089343cab92 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084352986 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-DeleteServersTestJSON-2084352986-project Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 27aab9392b0a4b428463d86c8d517714 Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-DeleteServersTestJSON-2084352986-project Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '1814da01-c78a-46ef-aa92-6d3ab66a5dcc'} Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:36.513830 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] Returning 404 to user: Instance 1814da01-c78a-46ef-aa92-6d3ab66a5dcc could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-56a03dc2-cd8e-4a5a-aeb1-18d7b08ddb39 tempest-DeleteServersTestJSON-2084352986 tempest-DeleteServersTestJSON-2084352986-project] 10.222.0.16 "GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc" status: 404 len: 111 microversion: 2.1 time: 0.030417 Aug 29 16:15:36.517744 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3206/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:36 2022] GET /compute/v2.1/servers/1814da01-c78a-46ef-aa92-6d3ab66a5dcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:15:44.997236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1513814532", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8add81b1-22b5-4fdc-acc4-a74016328582"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:45.056887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] validate_networks() for [('8add81b1-22b5-4fdc-acc4-a74016328582', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:45.492967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:45.493444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:45.493943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:45.494367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:45.494804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:45.504552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:45.505057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:45.505544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:45.506296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:45.506769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:45.507391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:45.524815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Getting quotas for project f416d812b5734ed5857f18d76e572411. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:45.530148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Getting quotas for user bf3ff92a939c4f08bc18125e3b2c1123 and project f416d812b5734ed5857f18d76e572411. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:45.544544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:45.546946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:45.594366 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3441a909-8f37-4ff8-8d61-e8aa2fd6c207 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733037 Aug 29 16:15:45.595235 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3378/6584] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:15:45.606963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9e072652-be9f-49ce-a4cd-f05a67e54565 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:45.607588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9e072652-be9f-49ce-a4cd-f05a67e54565 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:45.982611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9e072652-be9f-49ce-a4cd-f05a67e54565 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:45.990089 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9e072652-be9f-49ce-a4cd-f05a67e54565 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1218 microversion: 2.1 time: 0.387894 Aug 29 16:15:45.990671 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3207/6585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:45 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1218 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:47.012548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:47.013991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:47.020944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.021738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.022420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.023361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.024062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.024814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.104700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:47.114249 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bdfd0924-f35e-4487-9ad1-d07090c57857 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1276 microversion: 2.1 time: 0.107250 Aug 29 16:15:47.114895 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3379/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:47 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:48.075718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-47ce4cb2-5d01-49a5-9da2-4bf1deedfa7f req-c62bb2cc-e8db-4510-bcdc-6a46cbaaf187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a50ce3c-c377-468a-a3e2-c5eeaf29c43d", "tag": "709f8535-440b-419a-ab00-4186c77f5be7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:48.085509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=29 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:48.094205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47ce4cb2-5d01-49a5-9da2-4bf1deedfa7f req-c62bb2cc-e8db-4510-bcdc-6a46cbaaf187 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:48.094715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47ce4cb2-5d01-49a5-9da2-4bf1deedfa7f req-c62bb2cc-e8db-4510-bcdc-6a46cbaaf187 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:48.095176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47ce4cb2-5d01-49a5-9da2-4bf1deedfa7f req-c62bb2cc-e8db-4510-bcdc-6a46cbaaf187 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:48.106787 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-47ce4cb2-5d01-49a5-9da2-4bf1deedfa7f req-c62bb2cc-e8db-4510-bcdc-6a46cbaaf187 service nova] Creating event network-changed:709f8535-440b-419a-ab00-4186c77f5be7 for instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d on n-h2-854882-3 Aug 29 16:15:48.117793 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-47ce4cb2-5d01-49a5-9da2-4bf1deedfa7f req-c62bb2cc-e8db-4510-bcdc-6a46cbaaf187 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047421 Aug 29 16:15:48.118416 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3208/6587] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:48.136290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:48.138117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:48.145605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:48.146355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:48.146965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:48.147846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:48.153978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:48.155126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:48.404331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:48.412634 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0b1b1ddd-1304-44c0-a588-a711c2de4163 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1318 microversion: 2.1 time: 0.280323 Aug 29 16:15:48.413858 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3380/6588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:48 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:49.437377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:49.438748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:49.446702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:49.447035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:49.447472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:49.448178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:49.448628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:49.449048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:49.583604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:49.591691 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c6556a2-5252-4d58-bb14-b317bbc6c2b4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1318 microversion: 2.1 time: 0.160883 Aug 29 16:15:49.592298 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3209/6589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:49 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:50.612678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:50.613321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:50.620243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:50.620748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:50.621200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:50.621934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:50.622407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:50.622854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:50.751405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:50.759147 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-046c7bd3-960b-4c26-9d43-0a1ff0e1d5ab tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1318 microversion: 2.1 time: 0.150484 Aug 29 16:15:50.759719 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3381/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:50 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:51.783200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:51.783817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:51.789957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:51.790373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:51.790811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:51.791499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:51.791955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:51.792377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:51.922313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:51.929895 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45e1fe8c-08c7-4444-b57c-88b0f737bf6b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1318 microversion: 2.1 time: 0.151414 Aug 29 16:15:51.930741 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3210/6591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:51 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:52.951547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:52.952265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:52.959116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:52.959622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:52.960097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:52.960801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:52.961276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:52.961750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:53.050176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-12c61ca9-947c-49ca-83ae-6cd872d50bcf req-3d997116-016d-4630-b736-c5ae31c84ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a50ce3c-c377-468a-a3e2-c5eeaf29c43d", "name": "network-vif-plugged", "status": "completed", "tag": "709f8535-440b-419a-ab00-4186c77f5be7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:53.061577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-12c61ca9-947c-49ca-83ae-6cd872d50bcf req-3d997116-016d-4630-b736-c5ae31c84ddf service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:53.062047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-12c61ca9-947c-49ca-83ae-6cd872d50bcf req-3d997116-016d-4630-b736-c5ae31c84ddf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:53.062466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-12c61ca9-947c-49ca-83ae-6cd872d50bcf req-3d997116-016d-4630-b736-c5ae31c84ddf service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:53.074363 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-12c61ca9-947c-49ca-83ae-6cd872d50bcf req-3d997116-016d-4630-b736-c5ae31c84ddf service nova] Creating event network-vif-plugged:709f8535-440b-419a-ab00-4186c77f5be7 for instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d on n-h2-854882-3 Aug 29 16:15:53.080119 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-12c61ca9-947c-49ca-83ae-6cd872d50bcf req-3d997116-016d-4630-b736-c5ae31c84ddf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033475 Aug 29 16:15:53.080745 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3211/6592] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:15:53.107354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:53.116056 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-20ddc730-a075-424a-83df-f5c3a65358f3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1318 microversion: 2.1 time: 0.168773 Aug 29 16:15:53.117009 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3382/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:52 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:54.143388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:54.144099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:54.153424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:54.154284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:54.154967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:54.155961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:54.156554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:54.157086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:54.296192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:54.303863 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d60dbfd-d89a-4051-a1ca-ae48bf9d7118 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1318 microversion: 2.1 time: 0.170471 Aug 29 16:15:54.304440 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3212/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:54 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:55.327209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:55.327833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:55.334056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.334850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.335310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.336021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.336524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.337021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.463134 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:55.470949 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-252188f6-e7ab-47fd-ad39-74d0ec972dd5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1508 microversion: 2.1 time: 0.149246 Aug 29 16:15:55.471527 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3383/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:55 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:55.492361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:55.492980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:55.500343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.500826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.501271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.501993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.502448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.502872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.639010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:55.646769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cfcb4d63-e1af-41f9-8dc5-7f92f913df15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1508 microversion: 2.1 time: 0.158322 Aug 29 16:15:55.647351 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3213/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:55 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:55.666786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:55.670014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:55.671990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:55.672796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:55.678323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.678829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.679278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.679992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.680464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.680902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.743503 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b11560d-41c8-41da-9400-b85c3cc37c04 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "PUT /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1080 microversion: 2.1 time: 0.080535 Aug 29 16:15:55.744750 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3384/6597] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 16:15:55 2022] PUT /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1080 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:55.761223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:55.761925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:55.767806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.768285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.768717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.769642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.770094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.770515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.898863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:55.907021 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf84b8e3-b2f0-469d-8a29-e71295ef116b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1506 microversion: 2.1 time: 0.149564 Aug 29 16:15:55.907610 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3214/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:55 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:55.927103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:55.927870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:55.934857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.935358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.935814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.936527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.937002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.937471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.075526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:56.083414 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0c88a0b6-7838-4440-9b48-bdc3ff7b3cc2 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1506 microversion: 2.1 time: 0.160176 Aug 29 16:15:56.083986 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3385/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:55 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:56.103788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:56.106686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:56.108636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:56.114602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:56.115089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:56.115528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.116250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:56.116704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:56.117124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.144969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:56.150795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Old instance type m1.heat2, new instance type m1.heat {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:15:56.157798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:56.158216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:56.158685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:56.159089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:56.159500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:56.220076 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [5532f74b-3702-4c18-8be4-5ffd54ee2d03] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:15:57.226886 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [5532f74b-3702-4c18-8be4-5ffd54ee2d03] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51060. Aug 29 16:15:57.230027 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d4301c07-a362-4f55-8df7-d172ed4403a5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "POST /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d/action" status: 202 len: 0 microversion: 2.1 time: 1.130290 Aug 29 16:15:57.230646 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3215/6600] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:15:56 2022] POST /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:15:57.238734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:57.239384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:57.246472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:57.246978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:57.247433 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:57.248155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:57.248632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:57.249085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:57.407152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:57.415262 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0a3b4cb1-dad7-4e9b-8d4b-ede1f7a34352 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1517 microversion: 2.1 time: 0.180430 Aug 29 16:15:57.415835 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3386/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:57 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:58.437058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:58.438013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:58.445004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:58.445531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:58.445975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:58.447261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:58.447719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:58.448147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:58.587388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:58.595712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08aabb6a-d018-453f-bde7-6c4e297d82c3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1517 microversion: 2.1 time: 0.163514 Aug 29 16:15:58.596391 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3216/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:58 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:59.616932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:59.617596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:59.620321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:59.626235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:59.626732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:59.627174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.627879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:59.628344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:59.628783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.632071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:59.758897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:59.766715 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1c519e03-25ea-4e97-a1e2-75a17e706ca9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.153660 Aug 29 16:15:59.767280 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3387/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:59 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:00.787326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:00.787944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:00.790744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=40 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:00.796908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:00.797408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:00.797851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:00.798540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:00.798993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:00.799415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:00.932194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:00.940865 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67ca3d7c-1fdb-4c38-b838-b2a8daeb3580 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.157593 Aug 29 16:16:00.941452 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3217/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:00 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:01.961832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:01.962394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:01.969424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:01.969931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:01.970390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:01.971107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:01.971584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:01.972032 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:02.115419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:02.123171 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a94a8124-bd66-4667-82f9-9c6614a1e7c9 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.165448 Aug 29 16:16:02.123752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3388/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:01 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:03.144110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:03.144724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:03.151483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:03.151954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:03.152433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:03.153111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:03.153587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:03.154003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:03.342689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:03.350307 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5e3d69c-9a29-4a42-b043-2b49ac483214 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.210093 Aug 29 16:16:03.350869 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3218/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:03 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:04.371133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:04.371794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:04.378845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:04.379291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:04.379751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:04.380460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:04.380932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:04.381377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:04.515072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:04.522943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1c8bdb9-33f2-4910-a2dd-6d6545d8f666 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.156121 Aug 29 16:16:04.523543 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3389/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:04 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:05.544723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:05.545346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:05.552297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:05.552796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:05.553226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:05.553945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:05.554401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:05.554823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:05.690078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:05.697710 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ed1a88e-f2bd-47af-921e-64d901d705d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.157001 Aug 29 16:16:05.698289 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3219/6608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:05 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:06.719374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:06.720014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:06.727183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:06.727691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:06.728149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:06.728870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:06.729349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:06.729826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:06.911974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:06.920263 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d2c68775-a502-4085-9c73-45d965a8e533 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.205393 Aug 29 16:16:06.920841 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3390/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:06 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:07.941525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:07.942147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:07.949049 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:07.949525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:07.949948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:07.950625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:07.951063 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:07.951476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:08.079663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:08.087269 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-452c0cfc-577d-4fb9-a026-bcaa0d011c83 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.149871 Aug 29 16:16:08.087847 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3220/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:07 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:09.108627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:09.109255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:09.116448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:09.116966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:09.117451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:09.118178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:09.118658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:09.119110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:09.252660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:09.260600 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e27be90e-b057-4428-bfe7-ec1b04b6f7fc tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.155902 Aug 29 16:16:09.261172 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3391/6611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:09 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:10.282353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:10.282980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:10.289504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:10.289985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:10.290431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:10.291123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:10.291579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:10.292005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:10.420631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:10.428414 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-111119b4-ea88-4227-9d11-c14b74826521 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.150819 Aug 29 16:16:10.428988 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3221/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:10 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:11.450879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:11.451442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:11.458375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.458883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.459339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.460053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.460531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.460980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.591768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:11.599537 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-39a83523-2e63-4a4c-ab5d-477e0d679721 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.153344 Aug 29 16:16:11.600110 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3392/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:11 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:12.620474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:12.621092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:12.628514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:12.628986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:12.629431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:12.630107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:12.630548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:12.630964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:12.765543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:12.773191 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a52bd94a-e283-4828-bd47-9d946b760859 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.156567 Aug 29 16:16:12.773802 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3222/6614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:12 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:13.794528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:13.795220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:13.802170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:13.802672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:13.803129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:13.803843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:13.804317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:13.804762 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:13.935763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:13.943773 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-21118a5e-ee07-4976-9f23-86708af47331 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.153287 Aug 29 16:16:13.944348 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3393/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:13 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:14.965854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:14.966400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:14.973108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:14.973709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:14.974145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:14.974819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:14.975266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:14.975678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:15.108235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:15.116224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dc7e8147-7243-4ae3-89af-e93b965d3029 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.154933 Aug 29 16:16:15.116815 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3223/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:14 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:16.139557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:16.140197 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:16.147396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:16.147897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:16.148530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:16.149268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:16.149792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:16.150233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:16.283431 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:16.291248 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f0349c89-fae4-4e63-8d8d-a1855c6ef03d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.156350 Aug 29 16:16:16.291839 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3394/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:16 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:17.312207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:17.312821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:17.320114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:17.320596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:17.321034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:17.321746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:17.322206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:17.322632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:17.341312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:17.457599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:17.465773 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f1f5afe5-cf16-400d-a383-a292199c6fb7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.157560 Aug 29 16:16:17.466340 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3224/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:17 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:18.485948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:18.486508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:18.493797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:18.494301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:18.494755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:18.495460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:18.495945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:18.496389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:18.625451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:18.633125 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a6f6c764-264d-4c17-839b-b1c1d8cb6d85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.151466 Aug 29 16:16:18.633750 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3395/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:18 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:19.654751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:19.655369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:19.662855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:19.663335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:19.663770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:19.664459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:19.664914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:19.665346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:19.796217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:19.803926 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-364a63c3-b16a-48a3-8f33-229c3d8ea469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.153117 Aug 29 16:16:19.804516 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3225/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:19 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:20.825673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:20.826230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:20.833093 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:20.833636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:20.834086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:20.834786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:20.835249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:20.835687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:20.969313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:20.977029 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8ec3c91-262e-42c1-8316-f161627bdc32 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.155362 Aug 29 16:16:20.977637 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3396/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:20 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:21.999462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:22.000015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:22.006836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:22.007320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:22.007759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:22.008451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:22.008903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:22.009330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:22.144097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:22.151948 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d11d0364-ca2f-4012-92c2-81a959f24266 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.157431 Aug 29 16:16:22.152563 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3226/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:21 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:23.172877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:23.173541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:23.180218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:23.180719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:23.181247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:23.181987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:23.182468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:23.182914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:23.312778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:23.320770 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7d20eaa3-e783-4c87-944a-43326c3b5c37 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.151964 Aug 29 16:16:23.321352 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3397/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:23 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:24.341971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:24.342587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:24.349272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:24.349787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:24.350223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:24.350912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:24.351365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:24.351792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:24.498607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:24.506455 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45301447-86ea-4b92-905b-d89815211a81 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.169164 Aug 29 16:16:24.507050 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3227/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:24 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:25.528531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:25.529193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:25.536207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:25.536709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:25.537158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:25.537915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:25.538380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:25.538818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:25.675479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:25.683336 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-12a24522-d393-4ccb-b8a9-f3489a0b05e8 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.159440 Aug 29 16:16:25.683915 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3398/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:25 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:26.705866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:26.707415 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:26.713341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:26.713843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:26.714275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:26.714958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:26.715406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:26.715825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:26.843045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:26.850744 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8c2b9bca-e6ec-4093-a9df-4151f646676b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.148798 Aug 29 16:16:26.851331 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3228/6626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:26 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:27.872132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:27.872807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:27.879718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:27.880225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:27.880686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:27.881413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:27.881899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:27.882349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:28.010164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:28.018577 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-53cc8eef-966e-48c7-b5a1-320c93a325c6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.150445 Aug 29 16:16:28.019197 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3399/6627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:27 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:29.039852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:29.040467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:29.048077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:29.048551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:29.048990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:29.049708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:29.050158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:29.050579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:29.182891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:29.191418 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f56d95f9-8ab8-480a-b549-8c11aa7f94ae tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.155604 Aug 29 16:16:29.191987 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3229/6628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:29 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:30.212300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:30.212942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:30.215843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=26 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:30.221273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:30.222078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:30.222295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:30.223142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:30.223697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:30.224289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:30.229130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=78 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:30.358024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:30.365902 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-862e9000-071b-4ac1-bf41-2d66b2db16e4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1522 microversion: 2.1 time: 0.157526 Aug 29 16:16:30.366481 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3400/6629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:30 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:31.387249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:31.387857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:31.390603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=26 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:31.396082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:31.396562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:31.396996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:31.397742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:31.398195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:31.398617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:31.535102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:31.543292 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6e7ef434-b01f-4076-8df2-11ae47b034dd tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1521 microversion: 2.1 time: 0.159821 Aug 29 16:16:31.544704 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3230/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:31 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:32.006479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-10287057-9f1c-42da-a797-dc6a233cbbe2 req-1a08e7aa-ae12-48ca-8500-66459971254a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a50ce3c-c377-468a-a3e2-c5eeaf29c43d", "name": "network-vif-unplugged", "status": "completed", "tag": "709f8535-440b-419a-ab00-4186c77f5be7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:32.017724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-10287057-9f1c-42da-a797-dc6a233cbbe2 req-1a08e7aa-ae12-48ca-8500-66459971254a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:32.018232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-10287057-9f1c-42da-a797-dc6a233cbbe2 req-1a08e7aa-ae12-48ca-8500-66459971254a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:32.018687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-10287057-9f1c-42da-a797-dc6a233cbbe2 req-1a08e7aa-ae12-48ca-8500-66459971254a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:32.031053 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-10287057-9f1c-42da-a797-dc6a233cbbe2 req-1a08e7aa-ae12-48ca-8500-66459971254a service nova] Creating event network-vif-unplugged:709f8535-440b-419a-ab00-4186c77f5be7 for instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d on n-h1-854882-3 Aug 29 16:16:32.036543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-10287057-9f1c-42da-a797-dc6a233cbbe2 req-1a08e7aa-ae12-48ca-8500-66459971254a service nova] Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:16:32.047759 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-10287057-9f1c-42da-a797-dc6a233cbbe2 req-1a08e7aa-ae12-48ca-8500-66459971254a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045213 Aug 29 16:16:32.048400 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3401/6631] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:32.566073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:32.566723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:32.574301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:32.574789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:32.575229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:32.575936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:32.576397 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:32.576825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:32.793158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:32.802182 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e86269db-f137-45df-84b1-cf7de9093183 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1521 microversion: 2.1 time: 0.240267 Aug 29 16:16:32.802944 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3231/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:32 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:33.825758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:33.826445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:33.832692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.833194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.833677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.834393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.834877 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.835327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.965770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:33.973466 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-637342e8-1429-4b31-a5a2-fba7439477d5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1519 microversion: 2.1 time: 0.153706 Aug 29 16:16:33.974036 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3402/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:33 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:34.071572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-47c08684-0cbd-44e9-a839-c71993a64c93 req-27776040-0293-4b86-9aca-a5e849c1c532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a50ce3c-c377-468a-a3e2-c5eeaf29c43d", "tag": "709f8535-440b-419a-ab00-4186c77f5be7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:34.081599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47c08684-0cbd-44e9-a839-c71993a64c93 req-27776040-0293-4b86-9aca-a5e849c1c532 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:34.082016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47c08684-0cbd-44e9-a839-c71993a64c93 req-27776040-0293-4b86-9aca-a5e849c1c532 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:34.082441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-47c08684-0cbd-44e9-a839-c71993a64c93 req-27776040-0293-4b86-9aca-a5e849c1c532 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:34.093767 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-47c08684-0cbd-44e9-a839-c71993a64c93 req-27776040-0293-4b86-9aca-a5e849c1c532 service nova] Creating event network-changed:709f8535-440b-419a-ab00-4186c77f5be7 for instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d on n-h1-854882-3 Aug 29 16:16:34.098961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-47c08684-0cbd-44e9-a839-c71993a64c93 req-27776040-0293-4b86-9aca-a5e849c1c532 service nova] Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:16:34.110114 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-47c08684-0cbd-44e9-a839-c71993a64c93 req-27776040-0293-4b86-9aca-a5e849c1c532 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042329 Aug 29 16:16:34.110726 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3232/6634] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:34.995140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:34.995747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:35.003320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.003825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.004286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.004999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.005509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.005965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.138953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:35.146785 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7d245a2b-5504-439d-b70d-6cba2c423b1e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1516 microversion: 2.1 time: 0.155774 Aug 29 16:16:35.147373 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3403/6635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:34 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:16:35.168604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:35.169227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:35.176555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.177045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.177738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.178486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.178973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.179402 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.235688 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2c92c9c5-b739-4704-853c-17d430561d3f tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "POST /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d/action" status: 204 len: 0 microversion: 2.1 time: 0.072018 Aug 29 16:16:35.236316 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3233/6636] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:16:35 2022] POST /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:16:35.244494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:35.245300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:35.251989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.252540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.252998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.253780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.254280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.254654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.508149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:35.516293 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e18e29fb-4fd1-454a-9362-3c136772109e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1516 microversion: 2.1 time: 0.275754 Aug 29 16:16:35.516871 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3404/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:35 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:36.538740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:36.539452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:36.546021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:36.546505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:36.546940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:36.547638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:36.548147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:36.548570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:36.679091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:36.687263 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a663b1c-e48b-444a-b87a-a5bbbd412a85 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1508 microversion: 2.1 time: 0.153815 Aug 29 16:16:36.688095 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3234/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:36 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:36.708743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:36.709312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:36.716159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:36.716657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:36.717102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:36.717833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:36.718298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:36.718734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:36.847660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:36.855278 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a14984d-5182-43d9-84ba-001a38bdb6a7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1508 microversion: 2.1 time: 0.150473 Aug 29 16:16:36.855850 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3405/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:36 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:36.878497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6af69f20-0b0b-42b7-a174-4c5e62c8f4d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'create', calling method: .version_select at 0x7fb0e2060d30>, body: {"keypair": {"name": "tempest-keypair-1963306667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+cqtboXlMe9hGtrroFlcmSADpjGABhECmqJI2QVT5kPBMpODRhsySOpKuOuT+/PWOF7YErZrX4NdFlCSFCV6HoCrC0Pc2uhLUfxeXtr2AS2BXykaOh6cepcllPgsJlAA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:36.894412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6af69f20-0b0b-42b7-a174-4c5e62c8f4d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Getting quotas for project f416d812b5734ed5857f18d76e572411. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:16:36.899477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-6af69f20-0b0b-42b7-a174-4c5e62c8f4d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Getting quotas for user bf3ff92a939c4f08bc18125e3b2c1123 and project f416d812b5734ed5857f18d76e572411. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:16:36.924766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6af69f20-0b0b-42b7-a174-4c5e62c8f4d7 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050113 Aug 29 16:16:36.925381 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3235/6640] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:16:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:37.733311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a1c63a9c-148c-433b-8cad-62b172d8810c req-01133853-a219-4cc5-8848-44915f3ee685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a50ce3c-c377-468a-a3e2-c5eeaf29c43d", "name": "network-vif-plugged", "status": "completed", "tag": "709f8535-440b-419a-ab00-4186c77f5be7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:37.747935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a1c63a9c-148c-433b-8cad-62b172d8810c req-01133853-a219-4cc5-8848-44915f3ee685 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:37.748650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a1c63a9c-148c-433b-8cad-62b172d8810c req-01133853-a219-4cc5-8848-44915f3ee685 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:37.749109 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a1c63a9c-148c-433b-8cad-62b172d8810c req-01133853-a219-4cc5-8848-44915f3ee685 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:37.761252 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a1c63a9c-148c-433b-8cad-62b172d8810c req-01133853-a219-4cc5-8848-44915f3ee685 service nova] Creating event network-vif-plugged:709f8535-440b-419a-ab00-4186c77f5be7 for instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d on n-h1-854882-3 Aug 29 16:16:37.767131 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a1c63a9c-148c-433b-8cad-62b172d8810c req-01133853-a219-4cc5-8848-44915f3ee685 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038218 Aug 29 16:16:37.768009 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3406/6641] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:38.127206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:38.127860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:38.134985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.135468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.135908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.136595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.137732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.138162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.271841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:38.279464 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5c1104e3-7e9a-4184-ad89-71081268fca0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 200 len: 1508 microversion: 2.1 time: 0.156243 Aug 29 16:16:38.280033 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3236/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:38 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:38.300127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:38.300757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:38.306943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.307439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.307883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.308591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.309574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.310012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.339077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:16:38.412831 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd658024-390d-40e7-a346-e471a6a2617b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 204 len: 0 microversion: 2.1 time: 0.116591 Aug 29 16:16:38.413762 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3407/6643] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:16:38 2022] DELETE /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:16:38.469783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-486471848", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "8add81b1-22b5-4fdc-acc4-a74016328582"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:38.523097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] validate_networks() for [('8add81b1-22b5-4fdc-acc4-a74016328582', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:16:38.942446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:16:38.942867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:16:38.943340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:16:38.943751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:16:38.944197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:16:38.953222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.953797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.954187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.954915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.955369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.955794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.973211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Getting quotas for project f416d812b5734ed5857f18d76e572411. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:16:38.978495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Getting quotas for user bf3ff92a939c4f08bc18125e3b2c1123 and project f416d812b5734ed5857f18d76e572411. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:16:38.991504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:16:38.993821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:16:39.039024 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-58174ae5-8d6e-4d4d-a1bf-c2ec39166182 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573020 Aug 29 16:16:39.039678 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3237/6644] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:16:39.051641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc23224f-a112-4277-945d-0691ff3c6a1d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:39.052362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc23224f-a112-4277-945d-0691ff3c6a1d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:39.108461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bc23224f-a112-4277-945d-0691ff3c6a1d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:39.116371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc23224f-a112-4277-945d-0691ff3c6a1d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1217 microversion: 2.1 time: 0.068999 Aug 29 16:16:39.116948 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3408/6645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:39 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:40.137208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:40.138460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:40.146225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:40.146880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:40.147477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:40.148391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:40.148995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:40.149604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:40.286950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:40.297032 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2a45814-38fd-4d93-98cb-8b63c9681a9d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1277 microversion: 2.1 time: 0.164512 Aug 29 16:16:40.297655 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3238/6646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:40 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:40.315096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c4192642-67bc-42db-b887-f946c921ad80 req-1e15294d-3f93-44f7-899f-260fc3963aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a50ce3c-c377-468a-a3e2-c5eeaf29c43d", "name": "network-vif-deleted", "tag": "709f8535-440b-419a-ab00-4186c77f5be7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:40.323835 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:16:40.324318 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Aug 29 16:16:40.330529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4192642-67bc-42db-b887-f946c921ad80 req-1e15294d-3f93-44f7-899f-260fc3963aa0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:40.331257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4192642-67bc-42db-b887-f946c921ad80 req-1e15294d-3f93-44f7-899f-260fc3963aa0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:40.331885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c4192642-67bc-42db-b887-f946c921ad80 req-1e15294d-3f93-44f7-899f-260fc3963aa0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:40.351646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c4192642-67bc-42db-b887-f946c921ad80 req-1e15294d-3f93-44f7-899f-260fc3963aa0 service nova] Creating event network-vif-deleted:709f8535-440b-419a-ab00-4186c77f5be7 for instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d on n-h1-854882-3 Aug 29 16:16:40.357406 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c4192642-67bc-42db-b887-f946c921ad80 req-1e15294d-3f93-44f7-899f-260fc3963aa0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050645 Aug 29 16:16:40.358262 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3409/6647] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:41.318673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:41.319295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:41.326782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:41.327316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:41.327705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:41.328443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:41.328897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:41.329605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:41.561742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:41.569534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-63a25190-f5b6-485d-929e-3f267517a969 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1317 microversion: 2.1 time: 0.255009 Aug 29 16:16:41.570129 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3239/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:41 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:42.378660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2563d7f2-aced-4ab0-98b9-2593f1a0cdb1 req-d560b1b7-92c3-4de2-8f5b-b84a97faa91b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6619fb3-1ea9-4866-b5fb-82098700da45", "tag": "b12082d9-b9fd-4f7a-b95f-cc05a7141a3b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:42.389835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2563d7f2-aced-4ab0-98b9-2593f1a0cdb1 req-d560b1b7-92c3-4de2-8f5b-b84a97faa91b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:42.390248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2563d7f2-aced-4ab0-98b9-2593f1a0cdb1 req-d560b1b7-92c3-4de2-8f5b-b84a97faa91b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:42.390692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2563d7f2-aced-4ab0-98b9-2593f1a0cdb1 req-d560b1b7-92c3-4de2-8f5b-b84a97faa91b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:42.401251 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2563d7f2-aced-4ab0-98b9-2593f1a0cdb1 req-d560b1b7-92c3-4de2-8f5b-b84a97faa91b service nova] Creating event network-changed:b12082d9-b9fd-4f7a-b95f-cc05a7141a3b for instance f6619fb3-1ea9-4866-b5fb-82098700da45 on n-h1-854882-3 Aug 29 16:16:42.406523 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2563d7f2-aced-4ab0-98b9-2593f1a0cdb1 req-d560b1b7-92c3-4de2-8f5b-b84a97faa91b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033051 Aug 29 16:16:42.407107 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3410/6649] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:42.589700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:42.590341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:42.597728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:42.598207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:42.598641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:42.599323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:42.599777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:42.600197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:42.734160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:42.741984 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d26fa0a2-bec1-4b2e-a0d5-8ebe010f9bb6 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1317 microversion: 2.1 time: 0.156257 Aug 29 16:16:42.742550 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3240/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:42 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:43.763915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:43.764629 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:43.770838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.771331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.771779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:43.772475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.772936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.773374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:43.903570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:43.911318 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e5050741-74c5-45f7-81e1-882052d5b814 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1317 microversion: 2.1 time: 0.152512 Aug 29 16:16:43.911895 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3411/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:43 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:44.932469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:44.934382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:44.940440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:44.940919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:44.941356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:44.942072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:44.942525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:44.942948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:45.071530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:45.079102 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-941ea114-fe0e-484f-92b8-29c18a87f685 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1317 microversion: 2.1 time: 0.150637 Aug 29 16:16:45.079672 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3241/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:44 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:46.100031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:46.100587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:46.108149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.108656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.109112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.109862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.110335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.110781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.242996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:46.251443 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a24b8b88-e0e9-4f56-865e-1415d4298775 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1317 microversion: 2.1 time: 0.155562 Aug 29 16:16:46.252035 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3412/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:46 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:47.271620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:47.272232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:47.279258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:47.279735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:47.280168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:47.280852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:47.281300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:47.281751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:47.284398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:47.412196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:47.420623 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8bfc091-8db1-491d-a7e2-e1674302898d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1317 microversion: 2.1 time: 0.152781 Aug 29 16:16:47.421307 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3242/6654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:47 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:47.810180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3c6ecd9b-6f62-4a96-8819-b3bc96059c7b req-97be12a6-4273-43af-bfce-53fffb9e581a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6619fb3-1ea9-4866-b5fb-82098700da45", "name": "network-vif-plugged", "status": "completed", "tag": "b12082d9-b9fd-4f7a-b95f-cc05a7141a3b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:47.822429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3c6ecd9b-6f62-4a96-8819-b3bc96059c7b req-97be12a6-4273-43af-bfce-53fffb9e581a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:47.822942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3c6ecd9b-6f62-4a96-8819-b3bc96059c7b req-97be12a6-4273-43af-bfce-53fffb9e581a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:47.823395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3c6ecd9b-6f62-4a96-8819-b3bc96059c7b req-97be12a6-4273-43af-bfce-53fffb9e581a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:47.834612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3c6ecd9b-6f62-4a96-8819-b3bc96059c7b req-97be12a6-4273-43af-bfce-53fffb9e581a service nova] Creating event network-vif-plugged:b12082d9-b9fd-4f7a-b95f-cc05a7141a3b for instance f6619fb3-1ea9-4866-b5fb-82098700da45 on n-h1-854882-3 Aug 29 16:16:47.839775 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3c6ecd9b-6f62-4a96-8819-b3bc96059c7b req-97be12a6-4273-43af-bfce-53fffb9e581a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033752 Aug 29 16:16:47.840394 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3413/6655] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:48.441608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:48.442162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:48.449106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:48.449725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:48.450719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:48.451416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:48.451900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:48.452337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:48.582180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:48.589912 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c4de3e3e-6e86-470f-9db9-ff1167fd34f5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1317 microversion: 2.1 time: 0.152623 Aug 29 16:16:48.590489 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3243/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:48 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:49.609130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:49.613462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:49.614370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:49.620907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:49.621426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:49.621886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:49.622595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:49.623066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:49.623508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:49.757717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:49.765989 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77819022-90ba-4886-a9a0-a6cb66e157b5 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1507 microversion: 2.1 time: 0.159451 Aug 29 16:16:49.766575 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3414/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:49 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:49.787069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:49.787719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:49.789611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:49.790304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:49.797065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:49.797713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:49.798162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:49.798847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:49.799301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:49.799725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:49.933919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:49.941934 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55ceba54-99a5-42bc-9df1-7194454d7553 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1507 microversion: 2.1 time: 0.158808 Aug 29 16:16:49.942547 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3244/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:49 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:49.962408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:49.964780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:49.971402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:49.971906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:49.972363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:49.973074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:49.973617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:49.974067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.005042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:50.011506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Old instance type m1.heat2, new instance type m1.heat {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:16:50.018719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:16:50.019176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:16:50.019655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:16:50.020085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:16:50.020515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:16:50.083296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-517efa18-74f3-4d94-b31d-6461bb938e76 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "POST /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45/action" status: 202 len: 0 microversion: 2.1 time: 0.124828 Aug 29 16:16:50.083921 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3415/6659] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:16:49 2022] POST /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:16:50.092149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:50.092802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:50.098734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.099217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.099646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.100340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.100792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.101217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.242223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:50.250993 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d0c16015-7391-4d50-ae75-cbf628b5c262 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1514 microversion: 2.1 time: 0.162853 Aug 29 16:16:50.251713 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3245/6660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:50 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:51.273185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:51.273815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:51.280230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:51.280742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:51.281202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:51.281996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:51.282473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:51.282950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:51.413169 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:51.421906 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7261b37b-edc0-4949-96c9-536367f2c49a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1514 microversion: 2.1 time: 0.153631 Aug 29 16:16:51.422496 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3416/6661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:51 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:52.443329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:52.443880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:52.450789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:52.451253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:52.451689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:52.452364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:52.452813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:52.453236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:52.584785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:52.592621 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40f276b8-17ff-400c-86da-16647f151930 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.153283 Aug 29 16:16:52.593203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3246/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:52 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:53.613765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:53.614405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:53.621152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:53.621686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:53.622142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:53.622851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:53.623321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:53.623766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:53.751847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:53.754098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:53.761377 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a51daa41-7eb7-4fe6-a154-57878c6145c0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.151570 Aug 29 16:16:53.761965 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3417/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:53 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:54.782468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:54.783072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:54.789761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:54.790160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:54.790584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:54.791258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:54.791700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:54.792114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:54.925866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:54.933596 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f4557ed0-51d1-4017-9207-ca6dc5639b2d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.154967 Aug 29 16:16:54.934181 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3247/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:54 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:16:55.956701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:55.957262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:55.965293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:55.965832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:55.966288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:55.966996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:55.967466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:55.967909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:56.102702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:56.111033 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-19f70ded-e2a5-4b83-bb46-229d983a9769 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.158380 Aug 29 16:16:56.111611 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3418/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:55 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:57.132506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:57.133126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:57.140193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:57.140672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:57.141108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:57.141820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:57.142275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:57.142732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:57.271369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:57.279567 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7efc4abb-9a47-4354-9091-8289446693ba tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.150434 Aug 29 16:16:57.280138 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3248/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:57 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:58.300673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:58.301343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:58.308435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:58.308940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:58.309410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:58.310130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:58.310607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:58.311054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:58.441666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:58.449495 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b88b74ea-af1d-4992-b52b-161b2d8a9949 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.152808 Aug 29 16:16:58.450078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3419/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:58 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:59.471090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:59.471678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:59.478490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:59.478964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:59.479404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:59.480073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:59.480516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:59.480932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:59.614689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:59.622566 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b2db23a2-8709-4f4d-bce7-c0ecb5c37bea tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.155298 Aug 29 16:16:59.623151 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3249/6668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:59 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:00.642927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:00.643564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:00.646386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:00.651444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:00.651947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:00.652404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:00.653112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:00.653654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:00.654102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:00.790291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:00.798413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9bfc4d5e-ed8d-456b-8281-3acc9c9fa019 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.159388 Aug 29 16:17:00.798984 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3420/6669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:00 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:01.820255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:01.820806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:01.823767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:01.829219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:01.829822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:01.830261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:01.830953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:01.831406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:01.831830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:01.967741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:01.976671 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ccb2f298-5a79-4db9-84a8-57be68fd2347 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.160506 Aug 29 16:17:01.977278 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3250/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:01 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:03.001221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:03.001891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:03.008625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.009132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.009617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.010332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.010809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.011256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.140408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:03.148283 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f0acc80-259a-40ee-b060-049b8b2b104d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.151801 Aug 29 16:17:03.148903 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3421/6671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:02 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:04.170581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:04.171301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:04.178400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:04.178889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:04.179324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:04.180026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:04.180479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:04.180906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:04.317193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:04.325031 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ffa1a538-e055-418d-8fb1-1917e1d7571e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.159304 Aug 29 16:17:04.325643 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3251/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:04 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:05.347136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:05.347779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:05.354772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:05.355279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:05.355736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:05.356455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:05.356929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:05.358081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:05.485139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:05.493064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13d267be-7bc6-4bd0-85b3-3fd52100ac4d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.149849 Aug 29 16:17:05.493685 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3422/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:05 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:06.514258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:06.514873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:06.521742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:06.522222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:06.522649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:06.523325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:06.523774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:06.524195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:06.658736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:06.666499 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c03dea05-e2f4-4a32-8034-c835898bd067 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.156602 Aug 29 16:17:06.667073 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3252/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:06 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:07.688204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:07.688836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:07.695766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:07.696271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:07.696730 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:07.697527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:07.698009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:07.698456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:07.830798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:07.838564 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-47cf0fdf-c751-4c44-bf73-39fb563a584c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.155076 Aug 29 16:17:07.839144 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3423/6675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:07 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:08.860624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:08.861224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:08.868054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:08.868534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:08.868969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:08.869687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:08.870138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:08.870562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:09.009250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:09.016968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e0087ed-f019-4b58-aeaf-f79f95ca9a2e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.161010 Aug 29 16:17:09.017568 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3253/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:08 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:10.038139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:10.038782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:10.045852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:10.046357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:10.046864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:10.047581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:10.048058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:10.048506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:10.178958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:10.186813 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df4d0259-6a85-4412-a11d-56f9ec00e418 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.152648 Aug 29 16:17:10.188148 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3424/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:10 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:11.209123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:11.209801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:11.216479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:11.216956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:11.217489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:11.218815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:11.219301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:11.219723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:11.353950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:11.361621 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6de9b5c-a795-49c2-8420-538281e0c047 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.156356 Aug 29 16:17:11.362195 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3254/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:11 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:12.382505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:12.383133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:12.390077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:12.390567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:12.391011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:12.391709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:12.392173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:12.392613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:12.526933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:12.535511 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4a47cee-d884-4e62-8229-807b49aa6f3b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.156886 Aug 29 16:17:12.536114 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3425/6679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:12 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:17:13.556244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:13.556852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:13.564525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:13.564997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:13.565456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:13.566135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:13.566579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:13.566994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:13.709652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:13.717539 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-93445c98-bf76-4922-aaf6-eaf552cdca15 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.165274 Aug 29 16:17:13.718737 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3255/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:13 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:14.739472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:14.740100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:14.747105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:14.747594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:14.748040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:14.748744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:14.749890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:14.750332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:14.878097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:14.885781 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2833339d-db86-4cb8-ad38-91e5cbc315b3 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.150197 Aug 29 16:17:14.886352 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3426/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:14 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:15.907357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:15.907957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:15.914750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:15.915394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:15.915828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:15.916519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:15.916971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:15.917414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:16.057209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:16.065470 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-35548a8f-9356-4095-a137-5b14afbc3158 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.162669 Aug 29 16:17:16.066061 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3256/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:15 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:17.086265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:17.086893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:17.093913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.094411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.094858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.095564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.096027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.096466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.232274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:17.240598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c7bba54e-cf80-43ab-84eb-0cde411cf80c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.158217 Aug 29 16:17:17.241190 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3427/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:17 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:18.261986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:18.262603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:18.270192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:18.270674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:18.271109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.271793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:18.272242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:18.272665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.275213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=90 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:18.411764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:18.419407 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c854872-5eca-43b1-ae50-4cbc6fbefce4 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1519 microversion: 2.1 time: 0.161348 Aug 29 16:17:18.419990 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3257/6684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:18 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:19.145454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c1213275-9572-4544-8eba-a49c6451b38e req-a3c95b0a-7b5f-4bc5-9cdb-347a41bd8e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6619fb3-1ea9-4866-b5fb-82098700da45", "name": "network-vif-unplugged", "status": "completed", "tag": "b12082d9-b9fd-4f7a-b95f-cc05a7141a3b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:19.156410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c1213275-9572-4544-8eba-a49c6451b38e req-a3c95b0a-7b5f-4bc5-9cdb-347a41bd8e62 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:19.157013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c1213275-9572-4544-8eba-a49c6451b38e req-a3c95b0a-7b5f-4bc5-9cdb-347a41bd8e62 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:19.157472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c1213275-9572-4544-8eba-a49c6451b38e req-a3c95b0a-7b5f-4bc5-9cdb-347a41bd8e62 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:19.169611 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c1213275-9572-4544-8eba-a49c6451b38e req-a3c95b0a-7b5f-4bc5-9cdb-347a41bd8e62 service nova] Creating event network-vif-unplugged:b12082d9-b9fd-4f7a-b95f-cc05a7141a3b for instance f6619fb3-1ea9-4866-b5fb-82098700da45 on n-h2-854882-3 Aug 29 16:17:19.175758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-c1213275-9572-4544-8eba-a49c6451b38e req-a3c95b0a-7b5f-4bc5-9cdb-347a41bd8e62 service nova] Instance f6619fb3-1ea9-4866-b5fb-82098700da45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:17:19.187020 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c1213275-9572-4544-8eba-a49c6451b38e req-a3c95b0a-7b5f-4bc5-9cdb-347a41bd8e62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044972 Aug 29 16:17:19.187966 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3428/6685] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:19.440939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:19.441587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:19.451878 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:19.452377 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:19.453333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:19.454053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:19.454495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:19.454910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:19.588104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:19.596692 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a0fb04dd-9dfe-4605-be1b-fbe7c87e1d58 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1518 microversion: 2.1 time: 0.159727 Aug 29 16:17:19.597210 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3258/6686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:19 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:17:20.619230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:20.619943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:20.626587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.627083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.627531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.628232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.628695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.629133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.759076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:20.766777 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-88d8cc57-2c59-4707-a009-b197bb2db613 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1516 microversion: 2.1 time: 0.152743 Aug 29 16:17:20.767356 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3429/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:20 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:21.215838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4d63ed5f-544e-4d37-9115-321d3f2f88ea req-a46b26c6-9599-4e3c-8de7-4efdcbcb5b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6619fb3-1ea9-4866-b5fb-82098700da45", "tag": "b12082d9-b9fd-4f7a-b95f-cc05a7141a3b"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:21.226802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4d63ed5f-544e-4d37-9115-321d3f2f88ea req-a46b26c6-9599-4e3c-8de7-4efdcbcb5b71 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.227275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4d63ed5f-544e-4d37-9115-321d3f2f88ea req-a46b26c6-9599-4e3c-8de7-4efdcbcb5b71 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.227702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4d63ed5f-544e-4d37-9115-321d3f2f88ea req-a46b26c6-9599-4e3c-8de7-4efdcbcb5b71 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.239941 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4d63ed5f-544e-4d37-9115-321d3f2f88ea req-a46b26c6-9599-4e3c-8de7-4efdcbcb5b71 service nova] Creating event network-changed:b12082d9-b9fd-4f7a-b95f-cc05a7141a3b for instance f6619fb3-1ea9-4866-b5fb-82098700da45 on n-h2-854882-3 Aug 29 16:17:21.245309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-4d63ed5f-544e-4d37-9115-321d3f2f88ea req-a46b26c6-9599-4e3c-8de7-4efdcbcb5b71 service nova] Instance f6619fb3-1ea9-4866-b5fb-82098700da45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:17:21.256495 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4d63ed5f-544e-4d37-9115-321d3f2f88ea req-a46b26c6-9599-4e3c-8de7-4efdcbcb5b71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044465 Aug 29 16:17:21.257105 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3259/6688] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:21.788214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.788874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.796118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.796667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.797124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.797885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.798396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.798845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.961517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:21.969369 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-825baceb-30f4-4939-b257-8184f7f3f469 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1513 microversion: 2.1 time: 0.185204 Aug 29 16:17:21.969971 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3430/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:21.990527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:21.991146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.997220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.997720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.998149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.998822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.999265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:22.000185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:22.055651 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bb91a2b1-4ea7-42f9-9ac7-ea4e8161b29b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "POST /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45/action" status: 204 len: 0 microversion: 2.1 time: 0.069292 Aug 29 16:17:22.056299 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3260/6690] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:17:21 2022] POST /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:17:22.065806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:22.066480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:22.075238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:22.076150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:22.076995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:22.078978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:22.079856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:22.080717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:22.219105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:22.226990 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-20aa1a58-d6bc-4050-91a4-5616ea5e184b tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1513 microversion: 2.1 time: 0.166493 Aug 29 16:17:22.227586 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3431/6691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:22 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:23.251457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:23.252179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:23.259500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.259990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.260574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.261283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.261766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.262196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.327887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-236d58ac-2586-48b2-9b96-d65d9564ef6d req-7334536a-115f-49e3-add3-2369a1656505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6619fb3-1ea9-4866-b5fb-82098700da45", "name": "network-vif-plugged", "status": "completed", "tag": "b12082d9-b9fd-4f7a-b95f-cc05a7141a3b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:23.342014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-236d58ac-2586-48b2-9b96-d65d9564ef6d req-7334536a-115f-49e3-add3-2369a1656505 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.343034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-236d58ac-2586-48b2-9b96-d65d9564ef6d req-7334536a-115f-49e3-add3-2369a1656505 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.345614 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-236d58ac-2586-48b2-9b96-d65d9564ef6d req-7334536a-115f-49e3-add3-2369a1656505 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.360612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-236d58ac-2586-48b2-9b96-d65d9564ef6d req-7334536a-115f-49e3-add3-2369a1656505 service nova] Creating event network-vif-plugged:b12082d9-b9fd-4f7a-b95f-cc05a7141a3b for instance f6619fb3-1ea9-4866-b5fb-82098700da45 on n-h2-854882-3 Aug 29 16:17:23.366543 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-236d58ac-2586-48b2-9b96-d65d9564ef6d req-7334536a-115f-49e3-add3-2369a1656505 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043128 Aug 29 16:17:23.367286 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3432/6692] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:23.417055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:23.425436 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d1b293e-54a9-45f6-973e-052fd7de967d tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1505 microversion: 2.1 time: 0.180436 Aug 29 16:17:23.426011 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3261/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:23 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:23.446178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:23.446986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:23.453236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.454022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.454480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.455184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.455658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.456098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.589038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:23.597662 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d82291f-9f2e-4251-8eb3-f0d8d3c344f0 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1505 microversion: 2.1 time: 0.155668 Aug 29 16:17:23.598251 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3433/6694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:23 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:23.617982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:23.618703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:23.624768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.625247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.625730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.626417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.626874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.627296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.760836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:23.768976 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4342c197-6020-4c33-b571-bc10df9df09e tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1505 microversion: 2.1 time: 0.154820 Aug 29 16:17:23.769578 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3262/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:23 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:23.790704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:23.791229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:23.797318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.797853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.798311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.799024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.799501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.799955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.827203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:17:23.851666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:23.902615 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-614a2c3a-3d12-4de3-8bfd-5a1c95835fec tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 204 len: 0 microversion: 2.1 time: 0.115531 Aug 29 16:17:23.903501 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3434/6696] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:23 2022] DELETE /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:17:23.920239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:23.920742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:23.926850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.927326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.927760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.928441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.928894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.929317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.955027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:17:23.999145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.compute.api [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Instance is already in deleting state, ignoring this request Aug 29 16:17:24.000153 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a3e4221-7042-41a5-b3c9-a756419af660 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 204 len: 0 microversion: 2.1 time: 0.083720 Aug 29 16:17:24.000917 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3263/6697] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:23 2022] DELETE /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:17:24.010649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:24.011377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:24.017934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.018438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.018897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.019609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.020084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.020537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.153491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:24.161316 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4abfae07-0a02-4031-b0be-2de4611f1a86 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1511 microversion: 2.1 time: 0.155031 Aug 29 16:17:24.162229 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3435/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:24 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:25.182184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:25.182862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:25.191861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.191861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.191861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.191861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.192288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.192380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.334571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf3ff92a939c4f08bc18125e3b2c1123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f416d812b5734ed5857f18d76e572411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:25.342520 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f3d428c7-8f5f-4bf3-948e-568acde21b80 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 200 len: 1511 microversion: 2.1 time: 0.164579 Aug 29 16:17:25.343810 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3264/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:25 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:17:25.649914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9252dfb5-7981-402f-b6f3-8e407085cd85 req-c2f71d63-7b68-472c-bbe8-cdbc0846c459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6619fb3-1ea9-4866-b5fb-82098700da45", "name": "network-vif-deleted", "tag": "b12082d9-b9fd-4f7a-b95f-cc05a7141a3b"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:25.661154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9252dfb5-7981-402f-b6f3-8e407085cd85 req-c2f71d63-7b68-472c-bbe8-cdbc0846c459 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.661728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9252dfb5-7981-402f-b6f3-8e407085cd85 req-c2f71d63-7b68-472c-bbe8-cdbc0846c459 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.662167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9252dfb5-7981-402f-b6f3-8e407085cd85 req-c2f71d63-7b68-472c-bbe8-cdbc0846c459 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.679113 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9252dfb5-7981-402f-b6f3-8e407085cd85 req-c2f71d63-7b68-472c-bbe8-cdbc0846c459 service nova] Creating event network-vif-deleted:b12082d9-b9fd-4f7a-b95f-cc05a7141a3b for instance f6619fb3-1ea9-4866-b5fb-82098700da45 on n-h2-854882-3 Aug 29 16:17:25.683877 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9252dfb5-7981-402f-b6f3-8e407085cd85 req-c2f71d63-7b68-472c-bbe8-cdbc0846c459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037711 Aug 29 16:17:25.684566 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3436/6700] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:26.365023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:26.365668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: f6619fb3-1ea9-4866-b5fb-82098700da45] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:26.372708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.373213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.373677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.374859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.375314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.375739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.389556 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] HTTP exception thrown: Instance f6619fb3-1ea9-4866-b5fb-82098700da45 could not be found. Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Request method failure captured: Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 HTTP/1.1 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOYwTBoYXw90FcCjARMB4mcFBoC5UT81m2vAzRjs6hufFl7YbAsCBygLkkA5QDZh_vX_PDE5gXDud-f5qAvB5eJ7zfIbIyX9aZ1_C5nk_FPVulcyPHl_2ak2Itu4qGGAfar1QlTQIzOOlehcTZ9gh2Ybvy3r5xX7OoO76MOVC-X0yUg Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f416d812b5734ed5857f18d76e572411 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f416d812b5734ed5857f18d76e572411"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f416d812b5734ed5857f18d76e572411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f416d812b5734ed5857f18d76e572411", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f416d812b5734ed5857f18d76e572411"}]}] Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f416d812b5734ed5857f18d76e572411 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiskConfigTestJSON-930015439-project Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: bf3ff92a939c4f08bc18125e3b2c1123 Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiskConfigTestJSON-930015439-project Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance f6619fb3-1ea9-4866-b5fb-82098700da45 could not be found. Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'f6619fb3-1ea9-4866-b5fb-82098700da45'} Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6619fb3-1ea9-4866-b5fb-82098700da45 could not be found. Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6619fb3-1ea9-4866-b5fb-82098700da45 could not be found. Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.391925 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6619fb3-1ea9-4866-b5fb-82098700da45 could not be found. Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Returning 404 to user: Instance f6619fb3-1ea9-4866-b5fb-82098700da45 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-793e8aeb-39e7-4454-9fb7-b17436be066a tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45" status: 404 len: 111 microversion: 2.1 time: 0.032592 Aug 29 16:17:26.395969 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3265/6701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:26 2022] GET /compute/v2.1/servers/f6619fb3-1ea9-4866-b5fb-82098700da45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:26.402756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0031a615-2f35-4da8-907a-0924a713d512 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '.version_select at 0x7fb0eb532550>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:26.425534 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0031a615-2f35-4da8-907a-0924a713d512 tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963306667" status: 202 len: 0 microversion: 2.1 time: 0.026869 Aug 29 16:17:26.426133 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3437/6702] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 16:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963306667 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:17:27.330524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:27.331031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:27.336967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:27.337505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:27.337944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:27.338642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:27.339094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:27.339520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:27.352925 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] HTTP exception thrown: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Request method failure captured: Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: request: DELETE /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d HTTP/1.1 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOYwTBoYXw90FcCjARMB4mcFBoC5UT81m2vAzRjs6hufFl7YbAsCBygLkkA5QDZh_vX_PDE5gXDud-f5qAvB5eJ7zfIbIyX9aZ1_C5nk_FPVulcyPHl_2ak2Itu4qGGAfar1QlTQIzOOlehcTZ9gh2Ybvy3r5xX7OoO76MOVC-X0yUg Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: f416d812b5734ed5857f18d76e572411 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f416d812b5734ed5857f18d76e572411"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f416d812b5734ed5857f18d76e572411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f416d812b5734ed5857f18d76e572411", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f416d812b5734ed5857f18d76e572411"}]}] Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: f416d812b5734ed5857f18d76e572411 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerDiskConfigTestJSON-930015439-project Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: bf3ff92a939c4f08bc18125e3b2c1123 Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerDiskConfigTestJSON-930015439-project Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '3a50ce3c-c377-468a-a3e2-c5eeaf29c43d'} Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:27.354429 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Returning 404 to user: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25271bb1-d1f9-4a9f-9422-c55ec81eaa3c tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 404 len: 111 microversion: 2.1 time: 0.029818 Aug 29 16:17:27.358262 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3266/6703] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:27 2022] DELETE /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:27.365615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:27.366390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] [instance: 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:27.373023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:27.373880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:27.374825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:27.375525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:27.375991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:27.376427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:27.389163 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] HTTP exception thrown: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Request method failure captured: Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d HTTP/1.1 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOYwTBoYXw90FcCjARMB4mcFBoC5UT81m2vAzRjs6hufFl7YbAsCBygLkkA5QDZh_vX_PDE5gXDud-f5qAvB5eJ7zfIbIyX9aZ1_C5nk_FPVulcyPHl_2ak2Itu4qGGAfar1QlTQIzOOlehcTZ9gh2Ybvy3r5xX7OoO76MOVC-X0yUg Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: f416d812b5734ed5857f18d76e572411 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f416d812b5734ed5857f18d76e572411"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f416d812b5734ed5857f18d76e572411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f416d812b5734ed5857f18d76e572411", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f416d812b5734ed5857f18d76e572411"}]}] Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: f416d812b5734ed5857f18d76e572411 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-930015439 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerDiskConfigTestJSON-930015439-project Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: bf3ff92a939c4f08bc18125e3b2c1123 Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerDiskConfigTestJSON-930015439-project Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '3a50ce3c-c377-468a-a3e2-c5eeaf29c43d'} Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:27.391374 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] Returning 404 to user: Instance 3a50ce3c-c377-468a-a3e2-c5eeaf29c43d could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d14c8c28-a0bd-47b3-9e79-98f9ca9b12db tempest-ServerDiskConfigTestJSON-930015439 tempest-ServerDiskConfigTestJSON-930015439-project] 10.222.0.16 "GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d" status: 404 len: 111 microversion: 2.1 time: 0.032550 Aug 29 16:17:27.395659 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3438/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:27 2022] GET /compute/v2.1/servers/3a50ce3c-c377-468a-a3e2-c5eeaf29c43d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:35.807849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f14d64c0-467d-48c0-9e41-2ba2e35d1e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'create', calling method: .version_select at 0x7fb0e1feee50>, body: {"keypair": {"name": "tempest-keypair-227049464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc6JfnxlKIG6fgjEueDMhpYNHl+k9V/mAVsZmPNOg/vw95p1ClTiEhwZfPrLWoRR3LDRfy+KAnaSEwn581N4vKIrUtMZX47N4X1mVi8orLZiXoJEXZIp0OeViEr/jXsGQ=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:35.814149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=34 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:35.825496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f14d64c0-467d-48c0-9e41-2ba2e35d1e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:17:35.830593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f14d64c0-467d-48c0-9e41-2ba2e35d1e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for user 26f455ab6ad14c2db7727b826a2b32bc and project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:17:35.853616 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f14d64c0-467d-48c0-9e41-2ba2e35d1e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170567 Aug 29 16:17:35.854212 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3267/6705] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:17:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:37.511035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1914417955", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "693f1643-5ec7-477f-a719-895f9a42006f"}], "security_groups": [{"name": "tempest-securitygroup--1184454698"}], "key_name": "tempest-keypair-227049464", "user_data": "}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:37.521156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:37.521936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:37.628386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] validate_networks() for [('693f1643-5ec7-477f-a719-895f9a42006f', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:17:38.017932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:17:38.018402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:17:38.018889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:17:38.019517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:17:38.019945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:17:38.029349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:38.029911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:38.030384 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:38.031138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:38.031645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:38.032203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:38.049811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:17:38.055430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for user 26f455ab6ad14c2db7727b826a2b32bc and project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:17:38.069341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:17:38.071839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:17:38.120526 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-932519d0-60f9-44ce-8102-12c401c0360b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.613774 Aug 29 16:17:38.127646 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3439/6706] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:17:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:17:38.130934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:38.138203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57b71286-b09f-4d25-bd68-3620b081d324 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:38.138830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57b71286-b09f-4d25-bd68-3620b081d324 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:38.205857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57b71286-b09f-4d25-bd68-3620b081d324 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:38.214806 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57b71286-b09f-4d25-bd68-3620b081d324 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1238 microversion: 2.1 time: 0.085136 Aug 29 16:17:38.245874 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3268/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:38 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:39.246402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:39.247637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:39.274006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:39.274913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:39.278748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:39.278748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:39.278748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:39.278748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:39.352666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:39.363316 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7040da1f-c121-4cac-b036-86df6f29daac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1308 microversion: 2.1 time: 0.125316 Aug 29 16:17:39.364492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3440/6708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:39 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:40.387815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:40.388584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:40.396968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:40.397621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:40.398731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:40.399530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:40.400060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:40.401328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:40.622611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:40.631028 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9c692e48-1bba-4ced-9963-51572e95f74d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1364 microversion: 2.1 time: 0.249102 Aug 29 16:17:40.631732 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3269/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:40 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:40.711900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-fb53d4de-0bd2-4a90-8c0b-b512f2e2b732 req-0811d18d-16bf-45ec-a927-313fcfdfdaac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b54362b-b11c-49ab-8ff3-ffa5540603ca", "tag": "bf440771-d203-4c9f-ba0c-50ecf6887738"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:40.729449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fb53d4de-0bd2-4a90-8c0b-b512f2e2b732 req-0811d18d-16bf-45ec-a927-313fcfdfdaac service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:40.730293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fb53d4de-0bd2-4a90-8c0b-b512f2e2b732 req-0811d18d-16bf-45ec-a927-313fcfdfdaac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:40.730963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-fb53d4de-0bd2-4a90-8c0b-b512f2e2b732 req-0811d18d-16bf-45ec-a927-313fcfdfdaac service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:40.743516 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-fb53d4de-0bd2-4a90-8c0b-b512f2e2b732 req-0811d18d-16bf-45ec-a927-313fcfdfdaac service nova] Creating event network-changed:bf440771-d203-4c9f-ba0c-50ecf6887738 for instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca on n-h1-854882-3 Aug 29 16:17:40.749894 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-fb53d4de-0bd2-4a90-8c0b-b512f2e2b732 req-0811d18d-16bf-45ec-a927-313fcfdfdaac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046823 Aug 29 16:17:40.751159 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3441/6710] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:41.653225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:41.653863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:41.662231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:41.662737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:41.663155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:41.663845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:41.664302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:41.664730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:41.795388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:41.803518 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7b587faa-fa6e-41d0-939e-14884bde3a6b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1364 microversion: 2.1 time: 0.155292 Aug 29 16:17:41.804090 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3270/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:41 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:42.825855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:42.826581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:42.832865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:42.833371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:42.833853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:42.834571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:42.835047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:42.835496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:42.970161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:42.979226 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2cefff69-9c2d-4742-add5-6c2d9dbfc2e7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1364 microversion: 2.1 time: 0.157865 Aug 29 16:17:42.979811 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3442/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:42 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:44.000700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:44.001312 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:44.008177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:44.008655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:44.009084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:44.009808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:44.010260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:44.010678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:44.148514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:44.158208 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24eaee5b-956d-4c28-9cb1-12f94a6cfa05 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1364 microversion: 2.1 time: 0.161455 Aug 29 16:17:44.158996 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3271/6713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:43 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:45.178625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:45.179919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:45.188557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:45.189216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:45.189799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:45.190660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:45.191313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:45.191757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:45.322731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:45.333357 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-972f1da3-42a8-4fe2-9adb-6fa24dae7387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1364 microversion: 2.1 time: 0.158646 Aug 29 16:17:45.333970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3443/6714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:45 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:46.085881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b0a03760-b573-4369-ac3a-5e70939cdd65 req-a8ad4dbf-f8e2-4034-9d62-1700643fa5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b54362b-b11c-49ab-8ff3-ffa5540603ca", "name": "network-vif-plugged", "status": "completed", "tag": "bf440771-d203-4c9f-ba0c-50ecf6887738"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:46.097270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b0a03760-b573-4369-ac3a-5e70939cdd65 req-a8ad4dbf-f8e2-4034-9d62-1700643fa5f0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:46.097792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b0a03760-b573-4369-ac3a-5e70939cdd65 req-a8ad4dbf-f8e2-4034-9d62-1700643fa5f0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:46.098225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b0a03760-b573-4369-ac3a-5e70939cdd65 req-a8ad4dbf-f8e2-4034-9d62-1700643fa5f0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:46.109924 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b0a03760-b573-4369-ac3a-5e70939cdd65 req-a8ad4dbf-f8e2-4034-9d62-1700643fa5f0 service nova] Creating event network-vif-plugged:bf440771-d203-4c9f-ba0c-50ecf6887738 for instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca on n-h1-854882-3 Aug 29 16:17:46.114850 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b0a03760-b573-4369-ac3a-5e70939cdd65 req-a8ad4dbf-f8e2-4034-9d62-1700643fa5f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 Aug 29 16:17:46.115774 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3272/6715] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:46.354366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:46.354977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:46.362515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:46.363031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:46.363485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:46.364219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:46.364695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:46.365144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:46.505662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:46.513498 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-efcd4b33-8c0c-4c70-a295-76391b7884fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1364 microversion: 2.1 time: 0.163151 Aug 29 16:17:46.514079 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3444/6716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:46 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:47.536368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:47.537074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:47.543366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:47.543847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:47.544319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:47.545016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:47.545481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:47.545903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:47.681164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:47.689068 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42bd446a-9a83-4ec5-a7f2-68914232a851 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1551 microversion: 2.1 time: 0.158340 Aug 29 16:17:47.689687 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3273/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:47 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:47.709942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:47.710443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:47.717182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:47.717713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:47.718167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:47.719403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:47.719874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:47.720312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:47.800015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-683b1ba7-376c-46c1-ad45-d0a9237ea26b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093858 Aug 29 16:17:47.800611 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3445/6718] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 16:17:47 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:48.742636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-9efebb06-8a78-488e-8cfd-04337a4e6719 req-cfcd1f3a-f2f8-4e56-b628-5d78297c746e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b54362b-b11c-49ab-8ff3-ffa5540603ca", "tag": "bf440771-d203-4c9f-ba0c-50ecf6887738"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:48.747508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:48.754646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9efebb06-8a78-488e-8cfd-04337a4e6719 req-cfcd1f3a-f2f8-4e56-b628-5d78297c746e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:48.755125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9efebb06-8a78-488e-8cfd-04337a4e6719 req-cfcd1f3a-f2f8-4e56-b628-5d78297c746e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:48.755559 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-9efebb06-8a78-488e-8cfd-04337a4e6719 req-cfcd1f3a-f2f8-4e56-b628-5d78297c746e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:48.766839 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-9efebb06-8a78-488e-8cfd-04337a4e6719 req-cfcd1f3a-f2f8-4e56-b628-5d78297c746e service nova] Creating event network-changed:bf440771-d203-4c9f-ba0c-50ecf6887738 for instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca on n-h1-854882-3 Aug 29 16:17:48.771889 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-9efebb06-8a78-488e-8cfd-04337a4e6719 req-cfcd1f3a-f2f8-4e56-b628-5d78297c746e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032959 Aug 29 16:17:48.772495 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3274/6719] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:18:24.894645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:24.895355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:24.897238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:24.897886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=32 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:24.902656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:24.903280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:24.912065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:24.912556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:24.913002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:24.913746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:24.914214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:24.914651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.048313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:25.056244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa411546-ef14-4374-8473-9cc7d3e8008e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1669 microversion: 2.1 time: 0.162596 Aug 29 16:18:25.056820 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3446/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:24 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:25.075186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:25.075982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=28 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:25.081842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:25.082546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:25.090079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.090560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.090998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.091688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.092139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.092566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.223810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:25.231534 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24e8c024-1901-4901-9117-f0238ef92973 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1669 microversion: 2.1 time: 0.158625 Aug 29 16:18:25.232116 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3275/6721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:25 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:25.251615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:25.252287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:25.258360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.258859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.259313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.260024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.260495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.260939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.390660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:25.399154 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe041489-20ac-4320-9714-39a80c30c8d5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1669 microversion: 2.1 time: 0.151571 Aug 29 16:18:25.399736 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3447/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:25 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:25.426836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:25.429015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:25.434936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.435417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.435856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.436799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.437254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.437709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.467212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:25.472944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:18:25.479324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:18:25.479747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:18:25.480222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:18:25.480630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:18:25.481040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:18:25.543005 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4a031740-48af-4b45-ad90-6cf5de3b82b7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca/action" status: 202 len: 0 microversion: 2.1 time: 0.120156 Aug 29 16:18:25.543810 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3276/6723] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:18:25 2022] POST /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:18:25.551866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:25.552493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:25.558617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.559121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.559580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.560302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.560802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.561488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.736127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:25.748701 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d06d69c-5ecc-418a-ac96-07e1fe338d4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1678 microversion: 2.1 time: 0.200623 Aug 29 16:18:25.749288 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3448/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:25 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:26.770981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:26.771597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:26.778395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:26.778884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:26.779319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:26.780017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:26.780472 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:26.780904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:26.983786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:26.991647 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-71fb5bd7-d099-4196-bba8-50f130564e52 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1678 microversion: 2.1 time: 0.224634 Aug 29 16:18:26.992231 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3277/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:26 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:28.013171 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:28.013841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:28.020734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.021243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.021736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.022453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.022930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.023378 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.151264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:28.159673 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-76bfa172-4535-4898-a1f6-4769c9bb669d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.150346 Aug 29 16:18:28.160259 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3449/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:28 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:29.180616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:29.181232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:29.188797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:29.189276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:29.189731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:29.190419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:29.190867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:29.191285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:29.318076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:29.325705 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-51b60101-c616-4a6d-86e0-26c8ca7e26da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.149036 Aug 29 16:18:29.326277 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3278/6727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:29 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:30.348168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:30.348804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:30.355727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:30.356225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:30.356678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:30.357398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:30.357878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:30.358322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:30.495989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:30.504010 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d5813899-68cc-4e9a-a09e-ddf1b6f3a9a9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.160426 Aug 29 16:18:30.504604 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3450/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:30 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:31.525684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:31.526306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:31.534987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:31.535483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:31.535925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:31.536635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:31.537084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:31.537805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:31.676057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:31.683668 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-57c8138f-7a9a-42cb-acb1-30381bfe6f12 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.161986 Aug 29 16:18:31.684243 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3279/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:31 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:32.706380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:32.707018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:32.713903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:32.714414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:32.714874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:32.715586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:32.716373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:32.716828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:32.849105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:32.856894 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d0d5d47e-13b7-4d1d-aaea-1a1246422828 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.155068 Aug 29 16:18:32.857489 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3451/6730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:32 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:33.877599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:33.878135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:33.885246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:33.885777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:33.886208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:33.886898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:33.887354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:33.887779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:34.019378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:34.027058 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fa52539c-234d-4b24-80ec-d9f094f7e023 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.153458 Aug 29 16:18:34.027628 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3280/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:33 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:35.048872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:35.049545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:35.057209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:35.057793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:35.058275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:35.059089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:35.059617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:35.060113 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:35.194173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:35.203329 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4dc22f61-1db3-4bd6-99fb-759191f1e56f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.159009 Aug 29 16:18:35.204381 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3452/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:35 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:36.224858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:36.225522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:36.232508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:36.232990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:36.233447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:36.234144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:36.235277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:36.235706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:36.367599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:36.375127 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aaba91de-7d2d-4edf-a516-5d9138629ddc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.154377 Aug 29 16:18:36.375747 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3281/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:36 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:37.396743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:37.397375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:37.404249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:37.404743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:37.405195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:37.405930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:37.406997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:37.407442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:37.535443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:37.543235 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-002fa691-c88c-42ad-ab34-9dfc74029f45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.150472 Aug 29 16:18:37.543815 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3453/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:37 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:38.565025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:38.565693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:38.574341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:38.574829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:38.575264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:38.575953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:38.576404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:38.576827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:38.705127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:38.712983 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-528ec4b7-ca53-468f-a59b-44e3f09287fe tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1683 microversion: 2.1 time: 0.152777 Aug 29 16:18:38.713594 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3282/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:38 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:39.680402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b7e1e62a-7a57-485d-8d72-2988443afc23 req-74faeec1-b249-4ec2-a18e-2ecee0be9267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b54362b-b11c-49ab-8ff3-ffa5540603ca", "name": "network-vif-unplugged", "status": "completed", "tag": "bf440771-d203-4c9f-ba0c-50ecf6887738"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:39.692279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7e1e62a-7a57-485d-8d72-2988443afc23 req-74faeec1-b249-4ec2-a18e-2ecee0be9267 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:39.693007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7e1e62a-7a57-485d-8d72-2988443afc23 req-74faeec1-b249-4ec2-a18e-2ecee0be9267 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:39.693532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b7e1e62a-7a57-485d-8d72-2988443afc23 req-74faeec1-b249-4ec2-a18e-2ecee0be9267 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:39.706536 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b7e1e62a-7a57-485d-8d72-2988443afc23 req-74faeec1-b249-4ec2-a18e-2ecee0be9267 service nova] Creating event network-vif-unplugged:bf440771-d203-4c9f-ba0c-50ecf6887738 for instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca on n-h2-854882-3 Aug 29 16:18:39.712016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-b7e1e62a-7a57-485d-8d72-2988443afc23 req-74faeec1-b249-4ec2-a18e-2ecee0be9267 service nova] Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:18:39.722769 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b7e1e62a-7a57-485d-8d72-2988443afc23 req-74faeec1-b249-4ec2-a18e-2ecee0be9267 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046274 Aug 29 16:18:39.723384 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3454/6736] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:18:39.734055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:39.734665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:39.741833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:39.742316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:39.742749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:39.743439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:39.743884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:39.744304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:39.882288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:39.890537 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-330323ba-0294-442a-b78d-44132843b3d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1682 microversion: 2.1 time: 0.160351 Aug 29 16:18:39.891133 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3283/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:39 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:40.914534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:40.915261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:40.921496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:40.922001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:40.922484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:40.923813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:40.924285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:40.924731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:41.069147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:41.077030 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-126e359b-0007-4398-be72-1215a9f5bc72 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1682 microversion: 2.1 time: 0.167973 Aug 29 16:18:41.077635 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3455/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:40 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:41.753606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-05f9d3ac-6d26-4b44-914f-f097821100e9 req-9f3fd7fd-e366-448e-9b8f-948e50756396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b54362b-b11c-49ab-8ff3-ffa5540603ca", "tag": "bf440771-d203-4c9f-ba0c-50ecf6887738"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:41.763741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05f9d3ac-6d26-4b44-914f-f097821100e9 req-9f3fd7fd-e366-448e-9b8f-948e50756396 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:41.764208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05f9d3ac-6d26-4b44-914f-f097821100e9 req-9f3fd7fd-e366-448e-9b8f-948e50756396 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:41.764627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-05f9d3ac-6d26-4b44-914f-f097821100e9 req-9f3fd7fd-e366-448e-9b8f-948e50756396 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:41.776286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-05f9d3ac-6d26-4b44-914f-f097821100e9 req-9f3fd7fd-e366-448e-9b8f-948e50756396 service nova] Creating event network-changed:bf440771-d203-4c9f-ba0c-50ecf6887738 for instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca on n-h2-854882-3 Aug 29 16:18:41.781336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-05f9d3ac-6d26-4b44-914f-f097821100e9 req-9f3fd7fd-e366-448e-9b8f-948e50756396 service nova] Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:18:41.793145 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-05f9d3ac-6d26-4b44-914f-f097821100e9 req-9f3fd7fd-e366-448e-9b8f-948e50756396 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043321 Aug 29 16:18:41.793718 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3284/6739] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:42.099325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:42.100587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:42.107807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:42.108314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:42.108770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:42.109518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:42.110020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:42.110460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:42.316703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:42.325262 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-60dfc9b6-882b-4cf3-a6f2-3c41495cd768 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1680 microversion: 2.1 time: 0.229882 Aug 29 16:18:42.325890 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3456/6740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:42 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:43.348588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:43.349310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:43.355403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:43.355873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:43.356297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:43.356974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:43.357450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:43.357873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:43.489434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:43.498134 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b50169cb-b513-46e4-bb32-cb4aa139fdd1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1677 microversion: 2.1 time: 0.155003 Aug 29 16:18:43.498642 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3285/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:43 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:43.519461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:43.520096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:43.527005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:43.527504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:43.527952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:43.528657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:43.529125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:43.529589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:43.589047 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e4de6ef4-b163-4f0d-93dd-6a33c4ad9896 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca/action" status: 204 len: 0 microversion: 2.1 time: 0.073434 Aug 29 16:18:43.590238 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3457/6742] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:18:43 2022] POST /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:18:43.598944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:43.600160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:43.606487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:43.606973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:43.607405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:43.608104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:43.608554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:43.608978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:43.819921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:43.827644 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cdc389f7-04e0-4ea3-a7d0-f579b93cc061 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1677 microversion: 2.1 time: 0.233095 Aug 29 16:18:43.828210 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3286/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:43 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:44.850030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:44.850785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:44.857776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:44.858273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:44.858722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:44.859425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:44.860441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:44.860885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:45.003660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:45.011609 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4cd166c6-d86e-4806-82a0-3a4a2a7bd1b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1677 microversion: 2.1 time: 0.165822 Aug 29 16:18:45.012217 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3458/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:44 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:18:45.645647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e9946975-24bd-4fd5-9942-8afb9d09112f req-c09d276e-7de8-49c7-bfc9-05740d51c0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b54362b-b11c-49ab-8ff3-ffa5540603ca", "name": "network-vif-plugged", "status": "completed", "tag": "bf440771-d203-4c9f-ba0c-50ecf6887738"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:45.656336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e9946975-24bd-4fd5-9942-8afb9d09112f req-c09d276e-7de8-49c7-bfc9-05740d51c0aa service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:45.657321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e9946975-24bd-4fd5-9942-8afb9d09112f req-c09d276e-7de8-49c7-bfc9-05740d51c0aa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:45.657774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e9946975-24bd-4fd5-9942-8afb9d09112f req-c09d276e-7de8-49c7-bfc9-05740d51c0aa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:45.928147 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e9946975-24bd-4fd5-9942-8afb9d09112f req-c09d276e-7de8-49c7-bfc9-05740d51c0aa service nova] Creating event network-vif-plugged:bf440771-d203-4c9f-ba0c-50ecf6887738 for instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca on n-h2-854882-3 Aug 29 16:18:45.933155 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e9946975-24bd-4fd5-9942-8afb9d09112f req-c09d276e-7de8-49c7-bfc9-05740d51c0aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291308 Aug 29 16:18:45.933814 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3287/6745] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:46.034277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:46.034917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:46.042081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.042582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.043041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.043758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.044236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.044681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.174977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:46.182957 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-81d55a9b-a723-43a1-a986-af894c87447e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1669 microversion: 2.1 time: 0.153175 Aug 29 16:18:46.183475 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3459/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:46 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:46.204379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:46.205074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:46.211188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.211665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.212094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.212777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.213229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.213674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.343908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:46.352140 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-42b206d2-049c-4ccc-a33e-69906d056843 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1669 microversion: 2.1 time: 0.152514 Aug 29 16:18:46.352701 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3288/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:46 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:46.372069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:46.372713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:46.378839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.379348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.379806 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.380639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.381119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.381767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.512741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:46.521172 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eda84756-fb0c-460a-86b3-83a76dd62bb3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1669 microversion: 2.1 time: 0.153007 Aug 29 16:18:46.521773 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3460/6748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:46 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:46.541238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:46.541758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:46.547882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.548355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.548785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.549500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.549955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.550379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.575307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:18:46.620249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:46.653461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dba43a58-c278-4d60-b3a9-94a9d7a26e37 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 204 len: 0 microversion: 2.1 time: 0.115636 Aug 29 16:18:46.654221 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3289/6749] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:18:46 2022] DELETE /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:18:46.662392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:46.663043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:46.669060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.669616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.670075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.670791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.671266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.671716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.799414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:46.801899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:46.809703 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-acf1bd20-1a5b-4c00-80f1-28ccc70de4c6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1675 microversion: 2.1 time: 0.151164 Aug 29 16:18:46.810361 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3461/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:46 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:47.833849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:47.834465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:47.840298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:47.840778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:47.841200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:47.841904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:47.842346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:47.842756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:47.970990 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:47.978812 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-48abbafd-9209-42cf-894a-04322b2f9654 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1675 microversion: 2.1 time: 0.150043 Aug 29 16:18:47.979377 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3290/6751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:47 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:48.817965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-391ef5b3-f7ce-4b90-8903-1d29f6a25394 req-44ea8dae-71e0-425a-af8a-001a748231f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b54362b-b11c-49ab-8ff3-ffa5540603ca", "name": "network-vif-deleted", "tag": "bf440771-d203-4c9f-ba0c-50ecf6887738"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:48.831902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-391ef5b3-f7ce-4b90-8903-1d29f6a25394 req-44ea8dae-71e0-425a-af8a-001a748231f8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:48.832412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-391ef5b3-f7ce-4b90-8903-1d29f6a25394 req-44ea8dae-71e0-425a-af8a-001a748231f8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:48.832844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-391ef5b3-f7ce-4b90-8903-1d29f6a25394 req-44ea8dae-71e0-425a-af8a-001a748231f8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:48.847703 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-391ef5b3-f7ce-4b90-8903-1d29f6a25394 req-44ea8dae-71e0-425a-af8a-001a748231f8 service nova] Creating event network-vif-deleted:bf440771-d203-4c9f-ba0c-50ecf6887738 for instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca on n-h2-854882-3 Aug 29 16:18:48.852785 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-391ef5b3-f7ce-4b90-8903-1d29f6a25394 req-44ea8dae-71e0-425a-af8a-001a748231f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039657 Aug 29 16:18:48.853474 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3462/6752] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:49.001014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:49.002304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:49.009240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:49.010574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:49.011192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:49.012081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:49.012614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:49.013008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:49.046567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:49.047052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:49.048088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:49.048545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lazy-loading 'fault' on Instance uuid 5b54362b-b11c-49ab-8ff3-ffa5540603ca {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:18:49.093632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:49.100826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-54fe4796-2c3d-4e46-a796-a5e9e9d25923 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 200 len: 1328 microversion: 2.1 time: 0.104465 Aug 29 16:18:49.101439 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3291/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:48 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:50.123858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:50.124505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:50.132008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:50.132516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:50.132970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:50.133766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:50.134264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:50.134712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:50.148793 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca HTTP/1.1 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '5b54362b-b11c-49ab-8ff3-ffa5540603ca'} Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:50.150518 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7ca7735f-1f93-4f62-aa74-6e16dba59ae0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 404 len: 111 microversion: 2.1 time: 0.032469 Aug 29 16:18:50.155387 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3463/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:50 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:18:50.164944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:50.165608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:50.172769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:50.173314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:50.173771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:50.174454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:50.174900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:50.175319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:50.189335 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca HTTP/1.1 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5b54362b-b11c-49ab-8ff3-ffa5540603ca'} Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:50.191020 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5bde015d-de0b-400d-8a21-cabcfe925edd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 404 len: 111 microversion: 2.1 time: 0.031313 Aug 29 16:18:50.194993 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3292/6755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:50 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:18:50.240770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2106739198", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "693f1643-5ec7-477f-a719-895f9a42006f"}], "security_groups": [{"name": "tempest-securitygroup--1184454698"}], "key_name": "tempest-keypair-227049464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:50.345357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] validate_networks() for [('693f1643-5ec7-477f-a719-895f9a42006f', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:18:50.725589 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:18:50.726040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:18:50.726573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:18:50.727008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:18:50.727441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:18:50.736889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:50.737413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:50.737883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:50.738635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:50.739186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:50.739636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:50.757065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:18:50.762377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for user 26f455ab6ad14c2db7727b826a2b32bc and project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:18:50.774782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:18:50.777082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:18:50.823284 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9dd9400-c5a9-470e-9fb5-ce414d58b1f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.586301 Aug 29 16:18:50.823931 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3464/6756] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:18:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:18:50.834785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3fd33cfb-0f1a-47fe-9bf5-024ef9786e0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:50.835532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3fd33cfb-0f1a-47fe-9bf5-024ef9786e0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:50.891573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3fd33cfb-0f1a-47fe-9bf5-024ef9786e0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:50.899267 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3fd33cfb-0f1a-47fe-9bf5-024ef9786e0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1238 microversion: 2.1 time: 0.068386 Aug 29 16:18:50.899843 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3293/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:50 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:51.921222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:51.921964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:51.932018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:51.932619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:51.933178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:51.934075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:51.934732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:51.935248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:52.000955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:52.008875 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-481b640a-f677-41b6-9beb-f0d33c4d9e24 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1296 microversion: 2.1 time: 0.092504 Aug 29 16:18:52.009493 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3465/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:51 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:53.030955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:53.031729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:53.039438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:53.039923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:53.040358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:53.041058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:53.041673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:53.042103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:53.181754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-40dcc3fa-c678-4834-ae64-48f21a9a499f req-5540ca9c-53de-41f9-b092-a9baa19b8679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d24031-b220-4182-9202-3d71a16d2a52", "tag": "70b35cee-a173-47a1-9a01-b0abd4427db0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:53.195940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-40dcc3fa-c678-4834-ae64-48f21a9a499f req-5540ca9c-53de-41f9-b092-a9baa19b8679 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:53.196527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-40dcc3fa-c678-4834-ae64-48f21a9a499f req-5540ca9c-53de-41f9-b092-a9baa19b8679 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:53.197071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-40dcc3fa-c678-4834-ae64-48f21a9a499f req-5540ca9c-53de-41f9-b092-a9baa19b8679 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:53.209243 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-40dcc3fa-c678-4834-ae64-48f21a9a499f req-5540ca9c-53de-41f9-b092-a9baa19b8679 service nova] Creating event network-changed:70b35cee-a173-47a1-9a01-b0abd4427db0 for instance 19d24031-b220-4182-9202-3d71a16d2a52 on n-h1-854882-3 Aug 29 16:18:53.214729 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-40dcc3fa-c678-4834-ae64-48f21a9a499f req-5540ca9c-53de-41f9-b092-a9baa19b8679 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036623 Aug 29 16:18:53.215442 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3466/6759] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:18:53.286752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:53.294893 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6ed15265-e70a-4307-b8f4-ff1a6cc3e5a2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1364 microversion: 2.1 time: 0.267841 Aug 29 16:18:53.295560 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3294/6760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:53 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:54.317908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:54.318638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:54.325778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:54.326292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:54.326753 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:54.327468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:54.327945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:54.328396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:54.457441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:54.465377 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-46e54c32-e7ef-46fb-b468-1af12a41973a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1364 microversion: 2.1 time: 0.152357 Aug 29 16:18:54.466001 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3467/6761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:54 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:55.486802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:55.487324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:55.489815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:55.496896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:55.497496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:55.497941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:55.498652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:55.499135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:55.499565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:55.629136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:55.636932 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-72c8868d-9d28-4f18-917d-44bb068e182b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1364 microversion: 2.1 time: 0.154385 Aug 29 16:18:55.637495 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3295/6762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:55 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:56.658466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:56.659136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:56.662040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:56.667744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:56.668255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:56.668715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:56.669474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:56.669948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:56.670424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:56.805156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:56.813135 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb4e1a24-4c09-4f07-a06a-3764f99eb2b6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1364 microversion: 2.1 time: 0.159310 Aug 29 16:18:56.813748 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3468/6763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:56 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:18:57.834537 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:57.835081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:57.842034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:57.842517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:57.842952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:57.844158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:57.844617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:57.845039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:57.981096 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:57.989547 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8608aaa0-5312-4140-8a5a-3633d640caa2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1364 microversion: 2.1 time: 0.159017 Aug 29 16:18:57.990157 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3296/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:57 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:58.350397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5d01e9df-2dc8-4ca3-9870-d5423162830c req-f3466f9b-36c9-4b59-9872-e5f26e67d049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d24031-b220-4182-9202-3d71a16d2a52", "name": "network-vif-plugged", "status": "completed", "tag": "70b35cee-a173-47a1-9a01-b0abd4427db0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:58.361211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5d01e9df-2dc8-4ca3-9870-d5423162830c req-f3466f9b-36c9-4b59-9872-e5f26e67d049 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:58.361870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5d01e9df-2dc8-4ca3-9870-d5423162830c req-f3466f9b-36c9-4b59-9872-e5f26e67d049 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:58.362380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5d01e9df-2dc8-4ca3-9870-d5423162830c req-f3466f9b-36c9-4b59-9872-e5f26e67d049 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:58.375087 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5d01e9df-2dc8-4ca3-9870-d5423162830c req-f3466f9b-36c9-4b59-9872-e5f26e67d049 service nova] Creating event network-vif-plugged:70b35cee-a173-47a1-9a01-b0abd4427db0 for instance 19d24031-b220-4182-9202-3d71a16d2a52 on n-h1-854882-3 Aug 29 16:18:58.380008 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5d01e9df-2dc8-4ca3-9870-d5423162830c req-f3466f9b-36c9-4b59-9872-e5f26e67d049 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Aug 29 16:18:58.381097 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3469/6765] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:59.010922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:59.011541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:59.018847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:59.019331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:59.019794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:59.020460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:59.020914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:59.021341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:59.154462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:59.163015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb70215b-4322-4a41-8f17-f45d6f43677e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1364 microversion: 2.1 time: 0.156014 Aug 29 16:18:59.163680 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3297/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:59 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:00.184970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:00.185655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:00.193127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:00.193878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:00.194332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:00.195035 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:00.195504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:00.195941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:00.327133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:00.335413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-337fd202-707f-4ee7-a5cc-95ac9106302a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1552 microversion: 2.1 time: 0.154814 Aug 29 16:19:00.335991 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3470/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:00 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:00.356792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:00.357276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:00.364228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:00.364709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:00.365146 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:00.365892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:00.366373 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:00.366800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:00.443373 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c1b617d3-05ad-45f7-a01b-7e620e85ebb9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090473 Aug 29 16:19:00.443983 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3298/6768] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 16:19:00 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:19:01.405815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e3298917-e583-4e8e-b1f4-155fd191f219 req-44e5eb35-f3df-4d8b-939a-a2d83a88697c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d24031-b220-4182-9202-3d71a16d2a52", "tag": "70b35cee-a173-47a1-9a01-b0abd4427db0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:01.411273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:01.411960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:01.420266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e3298917-e583-4e8e-b1f4-155fd191f219 req-44e5eb35-f3df-4d8b-939a-a2d83a88697c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:01.420765 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e3298917-e583-4e8e-b1f4-155fd191f219 req-44e5eb35-f3df-4d8b-939a-a2d83a88697c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:01.421214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e3298917-e583-4e8e-b1f4-155fd191f219 req-44e5eb35-f3df-4d8b-939a-a2d83a88697c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:01.431987 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e3298917-e583-4e8e-b1f4-155fd191f219 req-44e5eb35-f3df-4d8b-939a-a2d83a88697c service nova] Creating event network-changed:70b35cee-a173-47a1-9a01-b0abd4427db0 for instance 19d24031-b220-4182-9202-3d71a16d2a52 on n-h1-854882-3 Aug 29 16:19:01.437445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e3298917-e583-4e8e-b1f4-155fd191f219 req-44e5eb35-f3df-4d8b-939a-a2d83a88697c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035428 Aug 29 16:19:01.438622 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3471/6769] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:19:34.571706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:34.573841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:34.574663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:34.579139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6b6bd14-a3ff-47d9-96b0-8a9a83755de5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:34.586876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6b6bd14-a3ff-47d9-96b0-8a9a83755de5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:34.587355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6b6bd14-a3ff-47d9-96b0-8a9a83755de5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:34.587789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6b6bd14-a3ff-47d9-96b0-8a9a83755de5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:34.610044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a6b6bd14-a3ff-47d9-96b0-8a9a83755de5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Going to try to stop instance {{(pid=130001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:19:34.652958 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6b6bd14-a3ff-47d9-96b0-8a9a83755de5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action" status: 202 len: 0 microversion: 2.1 time: 0.082037 Aug 29 16:19:34.653581 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3299/6770] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:19:34 2022] POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:19:34.663411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:34.664243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:34.666980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=7 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:34.667832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=37 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:34.673417 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:34.674013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:34.674467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:34.675270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:34.675746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:34.676192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:34.818054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:34.826122 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ea38b149-07c0-457e-8192-f70a0b231679 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.167976 Aug 29 16:19:34.826697 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3472/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:34 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:35.849369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:35.850030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:35.856186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:35.856659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:35.857094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:35.857810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:35.858261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:35.858688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:35.991872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:36.000256 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac2b4b93-2641-4b4b-ad8e-c779365cd36a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.156049 Aug 29 16:19:36.000834 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3300/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:35 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:37.021268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:37.021963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:37.028750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:37.029249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:37.029741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:37.030955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:37.031430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:37.031871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:37.164223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:37.171976 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d41caeea-200d-4d8b-90c3-1729b71f1f47 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.154563 Aug 29 16:19:37.172567 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3473/6773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:37 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:38.192349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:38.193076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:38.200057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:38.200532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:38.200963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:38.201682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:38.202136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:38.202558 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:38.338255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:38.346432 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-461928a2-1556-42c9-99e8-10a3989b71b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.158022 Aug 29 16:19:38.347010 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3301/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:38 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:39.368337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:39.368970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:39.376520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.377029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.377729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.378450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.378929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.379374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.514810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:39.522694 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5274eb51-adb2-498d-98fc-9c989860c387 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.158249 Aug 29 16:19:39.523270 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3474/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:39 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:40.544544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:40.545353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:40.552102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:40.552590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:40.553026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:40.553756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:40.554214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:40.554640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:40.686820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:40.694551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4995584f-7828-4843-8a33-e0268dc674b4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.154219 Aug 29 16:19:40.695135 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3302/6776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:40 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:41.715866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:41.716506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:41.724214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:41.724721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:41.725177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:41.725920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:41.726396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:41.726842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:41.854862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:41.863137 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-35b23223-3555-4227-9800-4043212a4487 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.151253 Aug 29 16:19:41.863720 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3475/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:41 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:19:42.884967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:42.885514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:42.892902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:42.893375 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:42.893827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:42.894502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:42.894946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:42.895360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:43.026182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:43.033963 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bf948caa-67d0-432f-9224-3847fe778a9b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.152879 Aug 29 16:19:43.034538 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3303/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:42 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:44.055818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:44.056476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:44.064497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:44.065007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:44.065495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:44.066215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:44.066694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:44.067142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:44.194733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:44.202794 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-071c857e-8b1a-4004-ab6e-3be89a48cbaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.150912 Aug 29 16:19:44.203386 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3476/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:44 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:45.224274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:45.224897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:45.231915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.232400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.232835 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.233555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.234011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.234436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.365695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:45.373530 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2da57a07-a108-4753-9010-40d98ac0d39c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1657 microversion: 2.1 time: 0.153198 Aug 29 16:19:45.374728 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3304/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:45 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:45.394675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:45.396941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:45.403938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.404907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.405365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.406106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.406579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.407019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.435072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:45.441696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Old instance type m1.heat2, new instance type m1.heat {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:19:45.448066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:19:45.448504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:19:45.449000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:19:45.449449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:19:45.449883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:19:45.512812 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-271af5e7-0df4-46b4-a151-be257f4653b0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action" status: 202 len: 0 microversion: 2.1 time: 0.122127 Aug 29 16:19:45.513460 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3477/6781] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:19:45 2022] POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:19:45.521453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:45.522077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:45.527855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.528336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.528768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.529477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.529971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.530393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.675703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:45.683858 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9d95993d-2b3a-40ae-9b20-48102536d354 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.166226 Aug 29 16:19:45.684439 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3305/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:45 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:46.705599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:46.706142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:46.713078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:46.713616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:46.714066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:46.714779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:46.715242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:46.715675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:46.849202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:46.857238 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-89dbaf31-ce83-4837-b69c-f33c2332b45e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1680 microversion: 2.1 time: 0.156637 Aug 29 16:19:46.857873 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3478/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:46 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:47.878380 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:47.878944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:47.885752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:47.886239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:47.886682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:47.887370 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:47.887829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:47.888253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:48.017944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:48.025680 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e10eaf8d-e41e-4ab2-ba0c-2f4c07246656 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1685 microversion: 2.1 time: 0.151309 Aug 29 16:19:48.026258 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3306/6784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:47 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:49.047825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:49.048445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:49.055492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:49.056000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:49.056456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:49.057178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:49.057684 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:49.058133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:49.194251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:49.209334 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2b02de0a-7755-4f43-a366-cec9093e76fc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1685 microversion: 2.1 time: 0.166111 Aug 29 16:19:49.210002 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3479/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:49 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:49.844460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a42e7cad-b3f3-4ab6-b09f-d76ea47cfbd2 req-ef21aadc-f18a-480b-8308-f70c6ed429d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d24031-b220-4182-9202-3d71a16d2a52", "name": "network-vif-unplugged", "status": "completed", "tag": "70b35cee-a173-47a1-9a01-b0abd4427db0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:49.854061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a42e7cad-b3f3-4ab6-b09f-d76ea47cfbd2 req-ef21aadc-f18a-480b-8308-f70c6ed429d1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:49.854545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a42e7cad-b3f3-4ab6-b09f-d76ea47cfbd2 req-ef21aadc-f18a-480b-8308-f70c6ed429d1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:49.854978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a42e7cad-b3f3-4ab6-b09f-d76ea47cfbd2 req-ef21aadc-f18a-480b-8308-f70c6ed429d1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:49.869928 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a42e7cad-b3f3-4ab6-b09f-d76ea47cfbd2 req-ef21aadc-f18a-480b-8308-f70c6ed429d1 service nova] Creating event network-vif-unplugged:70b35cee-a173-47a1-9a01-b0abd4427db0 for instance 19d24031-b220-4182-9202-3d71a16d2a52 on n-h2-854882-3 Aug 29 16:19:49.875912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-a42e7cad-b3f3-4ab6-b09f-d76ea47cfbd2 req-ef21aadc-f18a-480b-8308-f70c6ed429d1 service nova] Instance 19d24031-b220-4182-9202-3d71a16d2a52 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:19:49.887615 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a42e7cad-b3f3-4ab6-b09f-d76ea47cfbd2 req-ef21aadc-f18a-480b-8308-f70c6ed429d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111458 Aug 29 16:19:49.888238 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3307/6786] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:19:50.232358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:50.233624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:50.241195 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:50.241734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:50.242189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:50.242916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:50.243391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:50.243834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:50.758217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:50.766592 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c9f16613-2cc8-40ec-8872-0cf9d3f8f264 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1684 microversion: 2.1 time: 0.538321 Aug 29 16:19:50.767180 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3480/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:50 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1684 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:51.789591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:51.790220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:51.797868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:51.798353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:51.798791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:51.799482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:51.799939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:51.800369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:51.910261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b9c8c53f-e46d-4df7-8890-2b85caf845d8 req-3ae14d0a-6ffe-4309-ba0c-b24feef349e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d24031-b220-4182-9202-3d71a16d2a52", "tag": "70b35cee-a173-47a1-9a01-b0abd4427db0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:51.921620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b9c8c53f-e46d-4df7-8890-2b85caf845d8 req-3ae14d0a-6ffe-4309-ba0c-b24feef349e8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:51.922126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b9c8c53f-e46d-4df7-8890-2b85caf845d8 req-3ae14d0a-6ffe-4309-ba0c-b24feef349e8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:51.922638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b9c8c53f-e46d-4df7-8890-2b85caf845d8 req-3ae14d0a-6ffe-4309-ba0c-b24feef349e8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:51.934461 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b9c8c53f-e46d-4df7-8890-2b85caf845d8 req-3ae14d0a-6ffe-4309-ba0c-b24feef349e8 service nova] Creating event network-changed:70b35cee-a173-47a1-9a01-b0abd4427db0 for instance 19d24031-b220-4182-9202-3d71a16d2a52 on n-h2-854882-3 Aug 29 16:19:51.937302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:51.940524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-b9c8c53f-e46d-4df7-8890-2b85caf845d8 req-3ae14d0a-6ffe-4309-ba0c-b24feef349e8 service nova] Instance 19d24031-b220-4182-9202-3d71a16d2a52 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:19:51.945307 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ca6c9af-7d16-42df-a53e-e9b4ac89c320 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1682 microversion: 2.1 time: 0.160062 Aug 29 16:19:51.945992 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3308/6788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:51 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:51.961857 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b9c8c53f-e46d-4df7-8890-2b85caf845d8 req-3ae14d0a-6ffe-4309-ba0c-b24feef349e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055246 Aug 29 16:19:51.962491 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3481/6789] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:19:52.966975 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:52.968097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:52.974936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:52.975420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:52.975854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:52.976548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:52.976997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:52.977512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:53.109116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:53.116879 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee4316d1-fba0-472a-9bfc-9124f876611f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1678 microversion: 2.1 time: 0.153857 Aug 29 16:19:53.117507 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3309/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:52 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:53.139339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:53.139975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:53.146132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:53.146630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:53.147077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:53.147780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:53.148246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:53.148685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:53.206770 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e901b141-473f-49e9-8a15-e1d5beb4b8a8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action" status: 204 len: 0 microversion: 2.1 time: 0.073055 Aug 29 16:19:53.207455 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3482/6791] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:19:53 2022] POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:19:53.215614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:53.216237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:53.222304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:53.222780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:53.223268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:53.223891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:53.224344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:53.224774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:53.441735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:53.449467 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-50d635c7-ebc2-4a12-9979-d692cd600b31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1678 microversion: 2.1 time: 0.237767 Aug 29 16:19:53.450050 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3310/6792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:53 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:54.473661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:54.474396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:54.480786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.481291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.482131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.482864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.483394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.484122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.641284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:54.649269 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e9db5bb5-4dc4-4451-821c-feaacb04e6f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1657 microversion: 2.1 time: 0.180954 Aug 29 16:19:54.649894 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3483/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:54 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1657 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:54.670294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:54.670919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:54.677707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.678193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.678634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.679324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.679784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.680213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.808465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:54.816897 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6d97cf80-c183-41a4-a2a0-be40c8b99191 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1657 microversion: 2.1 time: 0.150469 Aug 29 16:19:54.817504 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3311/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:54 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:54.838782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-55267313-da52-486a-8eaf-0a87d00d650a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:54.844736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55267313-da52-486a-8eaf-0a87d00d650a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.845229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55267313-da52-486a-8eaf-0a87d00d650a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.845711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-55267313-da52-486a-8eaf-0a87d00d650a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.866996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-55267313-da52-486a-8eaf-0a87d00d650a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Going to try to start instance {{(pid=130002) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:19:54.908237 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-55267313-da52-486a-8eaf-0a87d00d650a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action" status: 202 len: 0 microversion: 2.1 time: 0.073096 Aug 29 16:19:54.909115 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3484/6795] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:19:54 2022] POST /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:19:54.917513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:54.918220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:54.924825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.925313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.925893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.927145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.927604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.928029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:55.059758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:55.068450 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ad40a07b-a1b6-49a4-ba5b-20da36f941a6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1666 microversion: 2.1 time: 0.155012 Aug 29 16:19:55.069033 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3312/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:54 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:56.054347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6dc2443e-1e5a-42f1-9c7f-97fed19094f7 req-8087820e-9673-4642-9279-eaca1ead9b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d24031-b220-4182-9202-3d71a16d2a52", "name": "network-vif-plugged", "status": "completed", "tag": "70b35cee-a173-47a1-9a01-b0abd4427db0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:56.065046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6dc2443e-1e5a-42f1-9c7f-97fed19094f7 req-8087820e-9673-4642-9279-eaca1ead9b74 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.065686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6dc2443e-1e5a-42f1-9c7f-97fed19094f7 req-8087820e-9673-4642-9279-eaca1ead9b74 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.066210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6dc2443e-1e5a-42f1-9c7f-97fed19094f7 req-8087820e-9673-4642-9279-eaca1ead9b74 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.087784 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6dc2443e-1e5a-42f1-9c7f-97fed19094f7 req-8087820e-9673-4642-9279-eaca1ead9b74 service nova] Creating event network-vif-plugged:70b35cee-a173-47a1-9a01-b0abd4427db0 for instance 19d24031-b220-4182-9202-3d71a16d2a52 on n-h2-854882-3 Aug 29 16:19:56.090034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:56.090665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:56.093719 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6dc2443e-1e5a-42f1-9c7f-97fed19094f7 req-8087820e-9673-4642-9279-eaca1ead9b74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113284 Aug 29 16:19:56.094528 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3485/6797] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:19:56.098135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.098623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.099062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.099775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.100273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.100682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.234140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:56.242013 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e2bbf299-7100-44f5-b447-5160938fc968 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1670 microversion: 2.1 time: 0.156476 Aug 29 16:19:56.242590 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3313/6798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:56 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:19:56.263310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:56.264677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:56.270872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.271371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.271823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.272529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.273001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.273479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.277540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:56.300771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:19:56.374980 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-434c73b3-4724-48f4-957d-a893e1f8e35e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 204 len: 0 microversion: 2.1 time: 0.115530 Aug 29 16:19:56.375578 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3486/6799] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:19:56 2022] DELETE /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:19:56.384335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:56.384958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:56.391515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.391997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.392433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.393119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.393633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.394062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.525514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:56.528987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:56.534174 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aca81ab0-8cd7-4f0d-8d0c-bb1516f10f2a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1676 microversion: 2.1 time: 0.153759 Aug 29 16:19:56.534750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3314/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:56 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:57.556587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:57.557430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:57.564716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:57.565226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:57.565703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:57.566435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:57.566922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:57.567362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:57.700936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:57.709428 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51659643-0008-4135-ab7d-cdc686c6ce3a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1676 microversion: 2.1 time: 0.157175 Aug 29 16:19:57.710011 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3487/6801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:57 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:58.601947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f8add0ae-3e1d-49b7-b2e2-809dcab9122c req-1f912059-39c3-46e8-8b8c-f5f6cca095af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d24031-b220-4182-9202-3d71a16d2a52", "name": "network-vif-deleted", "tag": "70b35cee-a173-47a1-9a01-b0abd4427db0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:58.615947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f8add0ae-3e1d-49b7-b2e2-809dcab9122c req-1f912059-39c3-46e8-8b8c-f5f6cca095af service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:58.616512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f8add0ae-3e1d-49b7-b2e2-809dcab9122c req-1f912059-39c3-46e8-8b8c-f5f6cca095af service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:58.617024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f8add0ae-3e1d-49b7-b2e2-809dcab9122c req-1f912059-39c3-46e8-8b8c-f5f6cca095af service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:58.631586 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f8add0ae-3e1d-49b7-b2e2-809dcab9122c req-1f912059-39c3-46e8-8b8c-f5f6cca095af service nova] Creating event network-vif-deleted:70b35cee-a173-47a1-9a01-b0abd4427db0 for instance 19d24031-b220-4182-9202-3d71a16d2a52 on n-h2-854882-3 Aug 29 16:19:58.637286 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f8add0ae-3e1d-49b7-b2e2-809dcab9122c req-1f912059-39c3-46e8-8b8c-f5f6cca095af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040792 Aug 29 16:19:58.638119 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3315/6802] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:19:58.732015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:58.736957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:58.751099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:58.751657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:58.752121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:58.753360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:58.753502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:58.753953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:58.793855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:58.794800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:58.795803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:58.796325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lazy-loading 'fault' on Instance uuid 19d24031-b220-4182-9202-3d71a16d2a52 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:19:58.846655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:58.853862 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4a9efa44-ee53-41c0-ad46-6d0fa59a8c08 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 200 len: 1328 microversion: 2.1 time: 0.126922 Aug 29 16:19:58.854444 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3488/6803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:58 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 1328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:59.877042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:59.877791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:59.884750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:59.885231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:59.885722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:59.886438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:59.886872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:59.887297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:59.903033 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 HTTP/1.1 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '19d24031-b220-4182-9202-3d71a16d2a52'} Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:59.905356 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:19:59.910434 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-de16d9cb-e346-4994-9641-f629c20ff70e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 404 len: 111 microversion: 2.1 time: 0.035021 Aug 29 16:19:59.911414 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3316/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:59 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:19:59.922299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:59.922930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:59.929776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:59.930267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:59.930713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:59.931412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:59.931878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:59.932316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:59.946161 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 HTTP/1.1 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '19d24031-b220-4182-9202-3d71a16d2a52'} Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:59.947801 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff1b75c6-4479-4d39-83e6-009e50cc3493 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 404 len: 111 microversion: 2.1 time: 0.030956 Aug 29 16:19:59.952739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3489/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:59 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:19:59.997081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1614302503", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "693f1643-5ec7-477f-a719-895f9a42006f"}], "security_groups": [{"name": "tempest-securitygroup--1184454698"}], "key_name": "tempest-keypair-227049464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:00.100597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] validate_networks() for [('693f1643-5ec7-477f-a719-895f9a42006f', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:20:00.493737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:20:00.494161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:20:00.494637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:20:00.495050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:20:00.495463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:20:00.506466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:00.506946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:00.507383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:00.508109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:00.508563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:00.509068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:00.525666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:20:00.530866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for user 26f455ab6ad14c2db7727b826a2b32bc and project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:20:00.544553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:20:00.547382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:20:00.593028 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3cb1639-3701-406f-9a5f-d39542577690 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.599947 Aug 29 16:20:00.593891 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3317/6806] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:19:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:20:00.604935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7743bbb5-8e1d-4e85-83fe-d486d7fc8239 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:00.605618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7743bbb5-8e1d-4e85-83fe-d486d7fc8239 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:00.661573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7743bbb5-8e1d-4e85-83fe-d486d7fc8239 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:00.668500 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7743bbb5-8e1d-4e85-83fe-d486d7fc8239 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1238 microversion: 2.1 time: 0.067704 Aug 29 16:20:00.669093 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3490/6807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:00 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:01.690889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:01.691526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:01.698921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:01.699498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:01.700129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:01.700905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:01.701599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:01.703001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:01.782598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:01.790257 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6195be87-5290-4880-837c-c88117017e9d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1308 microversion: 2.1 time: 0.104065 Aug 29 16:20:01.790755 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3318/6808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:01 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:02.813242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:02.813923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:02.821936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:02.822382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:02.822842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:02.823563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:02.824040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:02.824486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:03.003964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:03.012426 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7cbdcd3d-d0fb-4d0d-be13-a956adb57917 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1364 microversion: 2.1 time: 0.203887 Aug 29 16:20:03.013007 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3491/6809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:02 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:03.057287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d7afe152-df1d-4c48-b051-bdbea6b65816 req-854648ea-faca-4a67-96b6-9f19de9cd8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:03.067017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d7afe152-df1d-4c48-b051-bdbea6b65816 req-854648ea-faca-4a67-96b6-9f19de9cd8f9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:03.067497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d7afe152-df1d-4c48-b051-bdbea6b65816 req-854648ea-faca-4a67-96b6-9f19de9cd8f9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:03.067922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d7afe152-df1d-4c48-b051-bdbea6b65816 req-854648ea-faca-4a67-96b6-9f19de9cd8f9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:03.078930 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d7afe152-df1d-4c48-b051-bdbea6b65816 req-854648ea-faca-4a67-96b6-9f19de9cd8f9 service nova] Creating event network-changed:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h1-854882-3 Aug 29 16:20:03.083733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d7afe152-df1d-4c48-b051-bdbea6b65816 req-854648ea-faca-4a67-96b6-9f19de9cd8f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132028 Aug 29 16:20:03.084389 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3319/6810] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:20:04.034464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:04.035131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:04.042030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:04.042528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:04.042980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:04.043678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:04.044144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:04.044581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:04.177724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:04.185994 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8578cd4b-c8b7-4658-80be-b745b77c23f0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1364 microversion: 2.1 time: 0.155122 Aug 29 16:20:04.186578 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3492/6811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:04 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:05.210933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:05.212859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:05.215615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:05.222786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:05.223284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:05.223725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:05.224435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:05.224890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:05.225319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:05.365466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:05.373576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c8c79642-24d6-4a88-8450-6f55e736b322 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1364 microversion: 2.1 time: 0.169006 Aug 29 16:20:05.374219 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3320/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:05 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:06.395145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:06.395783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:06.398200 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:20:06.398351 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:20:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 (ip 10.222.0.16) !!! Aug 29 16:20:06.401013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:06.412257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:06.412770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:06.413230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:06.413986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:06.414462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:06.414908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:06.551728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:06.559879 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4d87c26-2680-49d7-a21f-a24d82f048a3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1364 microversion: 2.1 time: 0.168680 Aug 29 16:20:06.561607 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3493/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:06 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:07.582812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:07.583425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:07.590369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:07.590849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:07.591287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:07.591972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:07.592422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:07.592846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:07.725362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:07.738717 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-200ff5ab-cd5f-4459-b304-e08b0354f353 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1364 microversion: 2.1 time: 0.159614 Aug 29 16:20:07.739295 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3321/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:07 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:08.651272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-92e4aa76-5bd2-44e4-ae43-432a187b6203 req-4b38ef3b-70a4-40e7-ab21-7f97a29c4af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "name": "network-vif-plugged", "status": "completed", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:08.662833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92e4aa76-5bd2-44e4-ae43-432a187b6203 req-4b38ef3b-70a4-40e7-ab21-7f97a29c4af5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:08.663562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92e4aa76-5bd2-44e4-ae43-432a187b6203 req-4b38ef3b-70a4-40e7-ab21-7f97a29c4af5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:08.664133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-92e4aa76-5bd2-44e4-ae43-432a187b6203 req-4b38ef3b-70a4-40e7-ab21-7f97a29c4af5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:08.677106 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-92e4aa76-5bd2-44e4-ae43-432a187b6203 req-4b38ef3b-70a4-40e7-ab21-7f97a29c4af5 service nova] Creating event network-vif-plugged:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h1-854882-3 Aug 29 16:20:08.682157 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-92e4aa76-5bd2-44e4-ae43-432a187b6203 req-4b38ef3b-70a4-40e7-ab21-7f97a29c4af5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034593 Aug 29 16:20:08.682756 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3494/6815] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:08.760194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:08.760963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:08.767977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:08.768465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:08.768903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:08.769627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:08.770088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:08.770534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:08.932125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:08.940082 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e4e43cf8-3e89-4355-9ea0-4bd884b29073 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1364 microversion: 2.1 time: 0.183905 Aug 29 16:20:08.940687 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3322/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:08 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:09.964040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:09.964755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:09.971057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:09.971553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:09.972001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:09.972699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:09.973167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:09.973639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:10.103264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:10.111801 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-48fd105b-8b23-4e2d-a3d8-dbb9ed74a8ec tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1552 microversion: 2.1 time: 0.152932 Aug 29 16:20:10.112412 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3495/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:09 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:10.132715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:10.133220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:10.139662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:10.140129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:10.140555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:10.141237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:10.141714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:10.142132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:10.219194 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b0066d5-1d19-4cf8-bccf-908fa3df5525 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090325 Aug 29 16:20:10.219823 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3323/6818] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 16:20:10 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:11.457041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-2ea66616-ab6d-4d6b-9c0b-eb978c9fb58a req-a078808c-c88a-44dd-b901-f1dfe07e1228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:11.462323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:11.469048 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2ea66616-ab6d-4d6b-9c0b-eb978c9fb58a req-a078808c-c88a-44dd-b901-f1dfe07e1228 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:11.470096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2ea66616-ab6d-4d6b-9c0b-eb978c9fb58a req-a078808c-c88a-44dd-b901-f1dfe07e1228 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:11.470096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-2ea66616-ab6d-4d6b-9c0b-eb978c9fb58a req-a078808c-c88a-44dd-b901-f1dfe07e1228 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:11.481049 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-2ea66616-ab6d-4d6b-9c0b-eb978c9fb58a req-a078808c-c88a-44dd-b901-f1dfe07e1228 service nova] Creating event network-changed:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h1-854882-3 Aug 29 16:20:11.486806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-2ea66616-ab6d-4d6b-9c0b-eb978c9fb58a req-a078808c-c88a-44dd-b901-f1dfe07e1228 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033266 Aug 29 16:20:11.487591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3496/6819] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:44.549466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.550240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.552119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.552872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=36 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.557613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:44.559849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:44.567660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:44.568134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:44.568564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:44.569238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:44.569723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:44.570141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:44.598720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:44.604376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Old instance type m1.heat2, new instance type m1.heat {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:20:44.611725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:20:44.612152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:20:44.612629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:20:44.613039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:20:44.613584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:20:44.674170 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d396aec8-cd11-4683-8e1e-f9dd3e4923df tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717/action" status: 202 len: 0 microversion: 2.1 time: 0.126011 Aug 29 16:20:44.674776 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3324/6820] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:20:44 2022] POST /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:20:44.683703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:44.684424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:44.688046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=7 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.688829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.693957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:44.694523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:44.695067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:44.695891 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:44.696624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:44.697070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:44.879328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:44.887481 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51fb3035-0889-44ed-aa59-87885f62e48a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1679 microversion: 2.1 time: 0.208211 Aug 29 16:20:44.888246 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3497/6821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:44 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:45.910104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:45.910717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:45.916802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:45.917283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:45.917761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:45.918431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:45.918887 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:45.919309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:46.143264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:46.151052 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e63f719d-ff35-4d8b-a493-b47893d700d2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1679 microversion: 2.1 time: 0.245828 Aug 29 16:20:46.151634 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3325/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:45 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:47.172135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:47.172902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:47.179946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:47.180464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:47.180899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:47.181631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:47.182100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:47.182539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:47.312087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:47.320471 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95832e83-01c6-43c6-892b-e62fce2a1f23 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.152309 Aug 29 16:20:47.321047 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3498/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:47 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:48.342207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:48.342829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:48.349899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:48.350385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:48.350825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:48.351514 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:48.351971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:48.352400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:48.485656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:48.493292 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-834f609a-af75-4158-915b-154f570ce4e8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.155042 Aug 29 16:20:48.493898 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3326/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:48 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:49.516307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:49.517574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:49.524476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:49.524976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:49.525457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:49.526166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:49.526636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:49.527078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:49.668922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:49.677340 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-26ef1b20-7cbd-453e-b11e-43eb6faf85d0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.165069 Aug 29 16:20:49.677957 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3499/6825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:49 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:50.698458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:50.698978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:50.706014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:50.706491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:50.706923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:50.707605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:50.708050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:50.708468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:50.842371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:50.849944 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-46bcb87b-d33b-4683-b52f-7c2cc27d01be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.155579 Aug 29 16:20:50.850512 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3327/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:50 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:51.871761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:51.872329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:51.879731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:51.880237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:51.880692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:51.881412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:51.881893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:51.882332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:52.011372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:52.020092 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-961790b6-ca66-4b2c-adc8-bd68fb238982 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.152389 Aug 29 16:20:52.020679 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3500/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:51 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:53.040334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:53.040963 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:53.047891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:53.048911 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:53.049354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:53.050072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:53.050524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:53.050946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:53.184461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:53.192683 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-407ca601-7c30-4a21-a871-9382f8343fac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.156458 Aug 29 16:20:53.193320 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3328/6828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:53 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:54.213196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:54.213858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:54.220441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:54.220935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:54.221411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:54.222137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:54.222603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:54.223043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:54.355264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:54.363457 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92125bf7-9622-486d-8caa-4020f388f150 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.154151 Aug 29 16:20:54.364033 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3501/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:54 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:55.384179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:55.384792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:55.391716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:55.392202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:55.392639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:55.393325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:55.393798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:55.394221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:55.528215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:55.536901 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c15ae910-c468-46fa-aadc-b459f0cfef99 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.156878 Aug 29 16:20:55.537572 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3329/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:55 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:56.558644 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:56.559284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:56.567233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:56.567678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:56.568161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:56.568875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:56.569344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:56.569814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:56.698623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:56.707171 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3cce5b90-2838-45ad-b6e6-56597aae6d31 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.152407 Aug 29 16:20:56.707754 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3502/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:56 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:57.728495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:57.729111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:57.736026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:57.736509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:57.736942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:57.737655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:57.738106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:57.738528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:57.870064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:57.878438 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5a8d98c5-2d6c-482a-bbb2-1d2f008cdd66 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.153888 Aug 29 16:20:57.879012 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3330/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:57 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:58.900085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:58.900719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:58.907603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:58.908097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:58.908549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:58.909245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:58.909746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:58.910183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:59.038251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:59.045854 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e6bb79c-b3e6-4fdd-800c-ed3669dbcafb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.149673 Aug 29 16:20:59.046420 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3503/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:58 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:00.067262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:00.067884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:00.074727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:00.075201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:00.075640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:00.076331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:00.076788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:00.077215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:00.207604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:00.215500 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1e9604f-a652-4ec7-85b0-621afd9bdffa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.152621 Aug 29 16:21:00.216081 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3331/6834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:00 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:01.242832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:01.243468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:01.250349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:01.251039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:01.251473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:01.252179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:01.252649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:01.253094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:01.384506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:01.392971 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a4adf02-f77f-4bd5-a96d-da9f9684ee83 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.154073 Aug 29 16:21:01.393574 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3504/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:01 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:02.413223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:02.413862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:02.420703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:02.421183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:02.421655 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:02.422356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:02.422812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:02.423242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:02.614724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:02.622504 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-50d06536-28d2-4d38-b150-e0029f9cfda7 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1684 microversion: 2.1 time: 0.213209 Aug 29 16:21:02.623078 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3332/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:02 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1684 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:03.643547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:03.644286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:03.650769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:03.651272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:03.651727 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:03.652441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:03.652914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:03.653358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:03.897860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:03.905683 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2200d45c-9776-457b-a7d0-0dd10083486a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1683 microversion: 2.1 time: 0.266233 Aug 29 16:21:03.906268 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3505/6837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:03 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1683 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:04.084180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-039c571c-b75d-4dc0-bf24-cd88afd6a9c2 req-317f9a64-cbb2-4c05-94d0-413ec7f88c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "name": "network-vif-unplugged", "status": "completed", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:04.094634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-039c571c-b75d-4dc0-bf24-cd88afd6a9c2 req-317f9a64-cbb2-4c05-94d0-413ec7f88c6a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.095104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-039c571c-b75d-4dc0-bf24-cd88afd6a9c2 req-317f9a64-cbb2-4c05-94d0-413ec7f88c6a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.095530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-039c571c-b75d-4dc0-bf24-cd88afd6a9c2 req-317f9a64-cbb2-4c05-94d0-413ec7f88c6a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:04.107423 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-039c571c-b75d-4dc0-bf24-cd88afd6a9c2 req-317f9a64-cbb2-4c05-94d0-413ec7f88c6a service nova] Creating event network-vif-unplugged:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h2-854882-3 Aug 29 16:21:04.113358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-039c571c-b75d-4dc0-bf24-cd88afd6a9c2 req-317f9a64-cbb2-4c05-94d0-413ec7f88c6a service nova] Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:04.124102 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-039c571c-b75d-4dc0-bf24-cd88afd6a9c2 req-317f9a64-cbb2-4c05-94d0-413ec7f88c6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043818 Aug 29 16:21:04.124883 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3333/6838] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:04.927361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:04.928005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:04.935436 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.935956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.936413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:04.937125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.937642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.938097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:05.111612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:05.119920 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-885eff03-b063-4040-b950-d91d015326b8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1683 microversion: 2.1 time: 0.196493 Aug 29 16:21:05.120503 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3506/6839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:04 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1683 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:06.143539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:06.144240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:06.150384 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.150856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.151287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:06.151958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.152864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.152864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:06.162421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0d420a8f-e7a4-46f9-b854-e2fd3bd66cb6 req-8df3de02-428d-4ca5-aef5-3220c803b0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:06.172772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0d420a8f-e7a4-46f9-b854-e2fd3bd66cb6 req-8df3de02-428d-4ca5-aef5-3220c803b0e2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.173275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0d420a8f-e7a4-46f9-b854-e2fd3bd66cb6 req-8df3de02-428d-4ca5-aef5-3220c803b0e2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.173757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0d420a8f-e7a4-46f9-b854-e2fd3bd66cb6 req-8df3de02-428d-4ca5-aef5-3220c803b0e2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:06.185549 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0d420a8f-e7a4-46f9-b854-e2fd3bd66cb6 req-8df3de02-428d-4ca5-aef5-3220c803b0e2 service nova] Creating event network-changed:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h2-854882-3 Aug 29 16:21:06.191578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-0d420a8f-e7a4-46f9-b854-e2fd3bd66cb6 req-8df3de02-428d-4ca5-aef5-3220c803b0e2 service nova] Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:06.202689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0d420a8f-e7a4-46f9-b854-e2fd3bd66cb6 req-8df3de02-428d-4ca5-aef5-3220c803b0e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043978 Aug 29 16:21:06.203305 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3507/6840] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:21:06.385768 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:06.395172 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-330848bb-8412-4e7c-b9c4-10e0db2daa6e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1681 microversion: 2.1 time: 0.256910 Aug 29 16:21:06.395965 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3334/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:06 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:07.419531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:07.420246 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:07.427047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.427541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.427988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.428687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.429150 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.429621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.617969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:07.625621 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b0356225-f992-48e1-a034-c42ee2846042 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1678 microversion: 2.1 time: 0.211285 Aug 29 16:21:07.626188 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3508/6842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:07 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:07.646136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:07.646675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:07.653466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.653950 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.654393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.655108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.655564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.655986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.696222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.696628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.697057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.697808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.698260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.698683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.718667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:07.724282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for user 26f455ab6ad14c2db7727b826a2b32bc and project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:07.827167 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-025d3c22-d90e-40ff-91a5-f8a697a2e0aa tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717/action" status: 202 len: 0 microversion: 2.1 time: 0.184699 Aug 29 16:21:07.827791 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3335/6843] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:21:07 2022] POST /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:21:07.836607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:07.837247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:07.843454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.843955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.845058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.845810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.846278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.846831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.047673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:08.055583 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e68291b3-15a8-4779-9db6-1dfc6ea35de3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1677 microversion: 2.1 time: 0.222920 Aug 29 16:21:08.056175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3509/6844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:07 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:08.397841 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ff0e0288-bfc1-4e57-980f-092e992664f9 req-d20da115-75a4-4a1d-9298-d5c1338ba893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "name": "network-vif-plugged", "status": "completed", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:08.408847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ff0e0288-bfc1-4e57-980f-092e992664f9 req-d20da115-75a4-4a1d-9298-d5c1338ba893 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.409609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ff0e0288-bfc1-4e57-980f-092e992664f9 req-d20da115-75a4-4a1d-9298-d5c1338ba893 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.410352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ff0e0288-bfc1-4e57-980f-092e992664f9 req-d20da115-75a4-4a1d-9298-d5c1338ba893 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.423688 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ff0e0288-bfc1-4e57-980f-092e992664f9 req-d20da115-75a4-4a1d-9298-d5c1338ba893 service nova] Creating event network-vif-plugged:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h2-854882-3 Aug 29 16:21:08.426717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:08.431549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-ff0e0288-bfc1-4e57-980f-092e992664f9 req-d20da115-75a4-4a1d-9298-d5c1338ba893 service nova] Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:08.444054 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ff0e0288-bfc1-4e57-980f-092e992664f9 req-d20da115-75a4-4a1d-9298-d5c1338ba893 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050622 Aug 29 16:21:08.444660 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3336/6845] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:09.076869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:09.077547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:09.084495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.084999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.085483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.086196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.086673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.087121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.214409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:09.222647 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-15465b1e-fd20-4693-97d0-656deb7e7676 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1677 microversion: 2.1 time: 0.149674 Aug 29 16:21:09.223230 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3510/6846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:09 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:10.246532 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:10.247203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:10.255513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.256013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.256454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.257150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.257664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.258090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.399526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:10.407307 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-553ee029-ef6e-4c79-9e34-a34169a44fae tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1677 microversion: 2.1 time: 0.166817 Aug 29 16:21:10.408058 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3337/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:10 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:10.929919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9417787a-b9f0-4e05-9249-7b80ae079d61 req-23bcb136-57aa-4e2e-8d4c-1f5b788db349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "name": "network-vif-unplugged", "status": "completed", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:10.941342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9417787a-b9f0-4e05-9249-7b80ae079d61 req-23bcb136-57aa-4e2e-8d4c-1f5b788db349 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.941995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9417787a-b9f0-4e05-9249-7b80ae079d61 req-23bcb136-57aa-4e2e-8d4c-1f5b788db349 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.942570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9417787a-b9f0-4e05-9249-7b80ae079d61 req-23bcb136-57aa-4e2e-8d4c-1f5b788db349 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.954919 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9417787a-b9f0-4e05-9249-7b80ae079d61 req-23bcb136-57aa-4e2e-8d4c-1f5b788db349 service nova] Creating event network-vif-unplugged:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h1-854882-3 Aug 29 16:21:10.960288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-9417787a-b9f0-4e05-9249-7b80ae079d61 req-23bcb136-57aa-4e2e-8d4c-1f5b788db349 service nova] Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:10.971488 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9417787a-b9f0-4e05-9249-7b80ae079d61 req-23bcb136-57aa-4e2e-8d4c-1f5b788db349 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045256 Aug 29 16:21:10.972391 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3511/6848] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:11.429055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:11.429699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:11.436782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.437257 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.437713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.438433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.438880 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.439298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.647526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:11.655460 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2e51d71c-b05b-4af6-86a6-f7e62181970d tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1677 microversion: 2.1 time: 0.231252 Aug 29 16:21:11.656046 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3338/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:11 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:12.678814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:12.679470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:12.685962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.686467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.686923 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:12.687638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.688115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.688561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:12.821795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:12.829469 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93530de2-c2f4-4e9a-b81e-9ff6beb1fd0b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1677 microversion: 2.1 time: 0.155924 Aug 29 16:21:12.830041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3512/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:12 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:13.005297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-26002959-3841-42b6-b217-43c6ff22854e req-fc77b0f1-76d1-4d32-a567-4b3abb2644dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:13.015605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26002959-3841-42b6-b217-43c6ff22854e req-fc77b0f1-76d1-4d32-a567-4b3abb2644dd service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.016108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26002959-3841-42b6-b217-43c6ff22854e req-fc77b0f1-76d1-4d32-a567-4b3abb2644dd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.016538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-26002959-3841-42b6-b217-43c6ff22854e req-fc77b0f1-76d1-4d32-a567-4b3abb2644dd service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.028485 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-26002959-3841-42b6-b217-43c6ff22854e req-fc77b0f1-76d1-4d32-a567-4b3abb2644dd service nova] Creating event network-changed:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h1-854882-3 Aug 29 16:21:13.033743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-26002959-3841-42b6-b217-43c6ff22854e req-fc77b0f1-76d1-4d32-a567-4b3abb2644dd service nova] Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:13.045002 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-26002959-3841-42b6-b217-43c6ff22854e req-fc77b0f1-76d1-4d32-a567-4b3abb2644dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043504 Aug 29 16:21:13.045638 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3339/6851] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:13.852026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:13.852561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:13.859580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.860087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.860545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.861269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.861774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.862224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.998368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:14.006068 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a89a381c-c695-4e3e-8a16-9ccc54df7fcc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1670 microversion: 2.1 time: 0.158108 Aug 29 16:21:14.006664 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3513/6852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:13 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:14.027826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.028521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.035389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.035860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.036286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.036966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.037441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.037860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.165803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:14.173684 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-04c40b5a-5862-4ed8-bc28-5f0bab5b91fd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1670 microversion: 2.1 time: 0.150777 Aug 29 16:21:14.174267 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3340/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:14 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:14.194301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.194944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.200917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.201478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.201945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.202658 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.203135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.203590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.208279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=100 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:14.337697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:14.345465 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-79524974-b2fc-46dd-88d6-30376a894187 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1670 microversion: 2.1 time: 0.155617 Aug 29 16:21:14.346040 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3514/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:14 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:14.365686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.366126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.372004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.372482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.372920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.373640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.374095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.374520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.407399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:21:14.485523 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bb87cb4d-433b-42d6-82a7-6a84070af79a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 204 len: 0 microversion: 2.1 time: 0.123222 Aug 29 16:21:14.486210 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3341/6855] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:21:14 2022] DELETE /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:21:14.495099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.495734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.501823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.502324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.503349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.504086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.504591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.505559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.640007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:14.648272 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af1f686b-1dbe-4b89-8d0b-f7dfd0dbef96 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1676 microversion: 2.1 time: 0.157038 Aug 29 16:21:14.661557 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3515/6856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:14 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:15.670555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:15.671259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:15.674215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:15.679826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:15.680302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:15.680735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:15.681440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:15.681895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:15.682316 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:15.910453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:15.918121 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-99941bc5-4b70-43ec-8379-509218b199be tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1676 microversion: 2.1 time: 0.251790 Aug 29 16:21:15.918703 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3342/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:15 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1676 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:16.644834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b43d8180-2c3c-4d16-8bc4-2bd5591c26f4 req-575294f1-7a65-4a75-87dc-66e7244aa816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13ea45f-79a4-40d1-b49f-ea8483a00717", "name": "network-vif-deleted", "tag": "6dfd6615-dbdd-40b6-a763-e55e8e52e093"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:16.657360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=39 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:16.662731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b43d8180-2c3c-4d16-8bc4-2bd5591c26f4 req-575294f1-7a65-4a75-87dc-66e7244aa816 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.663264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b43d8180-2c3c-4d16-8bc4-2bd5591c26f4 req-575294f1-7a65-4a75-87dc-66e7244aa816 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.663683 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b43d8180-2c3c-4d16-8bc4-2bd5591c26f4 req-575294f1-7a65-4a75-87dc-66e7244aa816 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.675692 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b43d8180-2c3c-4d16-8bc4-2bd5591c26f4 req-575294f1-7a65-4a75-87dc-66e7244aa816 service nova] Creating event network-vif-deleted:6dfd6615-dbdd-40b6-a763-e55e8e52e093 for instance a13ea45f-79a4-40d1-b49f-ea8483a00717 on n-h1-854882-3 Aug 29 16:21:16.681189 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b43d8180-2c3c-4d16-8bc4-2bd5591c26f4 req-575294f1-7a65-4a75-87dc-66e7244aa816 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040785 Aug 29 16:21:16.681841 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3516/6858] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:16.940471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:16.941092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:16.948101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.948795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.949235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.949960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.950417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.950856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.983810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.984289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.984748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.985195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lazy-loading 'fault' on Instance uuid a13ea45f-79a4-40d1-b49f-ea8483a00717 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:21:17.027759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:17.036870 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e0d48e00-2c7e-4145-a1a4-f6e7fdf2f60b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 200 len: 1328 microversion: 2.1 time: 0.100273 Aug 29 16:21:17.037478 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3343/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:16 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:18.060051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:18.060779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:18.067018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:18.067521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:18.067976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:18.068688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:18.069161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:18.069641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:18.082749 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 HTTP/1.1 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'a13ea45f-79a4-40d1-b49f-ea8483a00717'} Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:18.084366 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8bfef2d-30b1-4f93-b980-d47037bf3ad0 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 404 len: 111 microversion: 2.1 time: 0.031421 Aug 29 16:21:18.088857 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3517/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:18 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:21:18.103192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:18.103804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:18.105698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:18.112608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:18.113088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:18.113553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:18.114230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:18.114680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:18.115098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:18.128102 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 HTTP/1.1 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a13ea45f-79a4-40d1-b49f-ea8483a00717'} Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:18.129758 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb513b72-0ce6-49a8-bfd1-1ce960bad90f tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 404 len: 111 microversion: 2.1 time: 0.031864 Aug 29 16:21:18.134166 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3344/6861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:18 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:21:18.182312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-407786109", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "693f1643-5ec7-477f-a719-895f9a42006f"}], "security_groups": [{"name": "tempest-securitygroup--1184454698"}], "key_name": "tempest-keypair-227049464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:18.285864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] validate_networks() for [('693f1643-5ec7-477f-a719-895f9a42006f', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:21:19.009869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:21:19.010314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:21:19.010813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:21:19.011243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:21:19.011677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:21:19.020673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:19.021175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:19.021689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:19.022441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:19.022910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:19.023354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:19.040666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:19.045953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for user 26f455ab6ad14c2db7727b826a2b32bc and project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:19.059562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:21:19.062209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:21:19.115040 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-731874de-cf9f-474f-9b3e-7a829fe006b5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.936654 Aug 29 16:21:19.115698 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3518/6862] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:21:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:21:19.126495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd53ae84-8494-496b-b428-4254dd686447 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:19.127110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fd53ae84-8494-496b-b428-4254dd686447 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:19.181834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fd53ae84-8494-496b-b428-4254dd686447 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:19.190660 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fd53ae84-8494-496b-b428-4254dd686447 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1237 microversion: 2.1 time: 0.067347 Aug 29 16:21:19.191226 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3345/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:19 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:20.216138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:20.217160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:20.227850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:20.228619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:20.229315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:20.230455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:20.231205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:20.231898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:20.297618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:20.306961 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2ed48b80-7676-48ce-8b7c-9378374e0999 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1295 microversion: 2.1 time: 0.098507 Aug 29 16:21:20.307611 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3519/6864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:20 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:21.328398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:21.329103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:21.336255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:21.336774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:21.337211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:21.337943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:21.338424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:21.338854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:21.469680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-aba0e2c9-3b54-4d4d-aa4f-50b52349535a req-730aa67e-32db-4e1a-85df-b2b2b88241dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:21.480680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aba0e2c9-3b54-4d4d-aa4f-50b52349535a req-730aa67e-32db-4e1a-85df-b2b2b88241dc service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:21.481176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aba0e2c9-3b54-4d4d-aa4f-50b52349535a req-730aa67e-32db-4e1a-85df-b2b2b88241dc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:21.481655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-aba0e2c9-3b54-4d4d-aa4f-50b52349535a req-730aa67e-32db-4e1a-85df-b2b2b88241dc service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:21.494747 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-aba0e2c9-3b54-4d4d-aa4f-50b52349535a req-730aa67e-32db-4e1a-85df-b2b2b88241dc service nova] Creating event network-changed:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h1-854882-3 Aug 29 16:21:21.499903 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-aba0e2c9-3b54-4d4d-aa4f-50b52349535a req-730aa67e-32db-4e1a-85df-b2b2b88241dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033978 Aug 29 16:21:21.500713 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3520/6865] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:21:21.569941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:21.578664 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-55adf63c-ee9a-4a7d-8c8e-0a825f771bf3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1363 microversion: 2.1 time: 0.254286 Aug 29 16:21:21.579254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3346/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:21 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:22.602043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:22.602724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:22.609088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:22.609698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:22.610156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:22.610876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:22.611353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:22.611802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:22.741799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:22.749541 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-538b2d0f-e00f-4b89-993a-e8d26fa70d36 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1363 microversion: 2.1 time: 0.153229 Aug 29 16:21:22.750115 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3521/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:22 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:23.770846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:23.771459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:23.778321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:23.778799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:23.779230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:23.779906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:23.780359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:23.780776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:23.910401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:23.918015 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-25793e0e-257a-442f-bbfe-72c4f1bd6e98 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1363 microversion: 2.1 time: 0.151069 Aug 29 16:21:23.918589 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3347/6868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:23 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:24.941021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:24.941673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:24.948952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:24.950129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:24.950612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:24.951530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:24.952036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:24.953711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:25.090568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:25.098410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f7b510c0-8480-4f0c-befa-3c1b0afd846a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1363 microversion: 2.1 time: 0.161759 Aug 29 16:21:25.098988 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3522/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:24 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:26.120202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:26.120824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:26.127643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:26.128127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:26.128563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:26.129254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:26.129740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:26.130170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:26.265117 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:26.272761 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d78addb-44c9-441c-9530-a01f635bca45 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1363 microversion: 2.1 time: 0.156512 Aug 29 16:21:26.273343 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3348/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:26 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:26.957745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-877bd1f7-24f6-476e-bf3d-ead95fa9a973 req-e46f785d-e17b-4fef-a5bb-66549b9e338d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "name": "network-vif-plugged", "status": "completed", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:26.968123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-877bd1f7-24f6-476e-bf3d-ead95fa9a973 req-e46f785d-e17b-4fef-a5bb-66549b9e338d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:26.968613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-877bd1f7-24f6-476e-bf3d-ead95fa9a973 req-e46f785d-e17b-4fef-a5bb-66549b9e338d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:26.969057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-877bd1f7-24f6-476e-bf3d-ead95fa9a973 req-e46f785d-e17b-4fef-a5bb-66549b9e338d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:26.979890 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-877bd1f7-24f6-476e-bf3d-ead95fa9a973 req-e46f785d-e17b-4fef-a5bb-66549b9e338d service nova] Creating event network-vif-plugged:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h1-854882-3 Aug 29 16:21:26.984844 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-877bd1f7-24f6-476e-bf3d-ead95fa9a973 req-e46f785d-e17b-4fef-a5bb-66549b9e338d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031510 Aug 29 16:21:26.985464 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3523/6871] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:27.294758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:27.295509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:27.302831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:27.303302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:27.303732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:27.304407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:27.304851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:27.305270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:27.433543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:27.442076 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-613d23fb-c891-45b1-89d2-9f550919dc53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1363 microversion: 2.1 time: 0.151196 Aug 29 16:21:27.442639 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3349/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:27 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:28.464979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:28.465720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:28.472421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:28.472914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:28.473360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:28.474077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:28.474545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:28.474982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:28.611610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:28.620005 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c075bf08-1ee3-4ec4-9871-8f0119d6a3e9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1550 microversion: 2.1 time: 0.160199 Aug 29 16:21:28.620582 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3524/6873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:28 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:28.640979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:28.641507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:28.648360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:28.648839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:28.649283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:28.650005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:28.650454 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:28.650907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:28.731659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3bcc2b98-44db-49d0-ba92-6e78155cb972 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094635 Aug 29 16:21:28.732272 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3350/6874] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 16:21:28 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:29.673812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4c2273c1-31fe-471e-8d47-5b8ba0fced1b req-61dda25b-5330-4aec-8004-b76443b5be4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:29.678700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:29.679387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:29.687426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c2273c1-31fe-471e-8d47-5b8ba0fced1b req-61dda25b-5330-4aec-8004-b76443b5be4d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:29.687928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c2273c1-31fe-471e-8d47-5b8ba0fced1b req-61dda25b-5330-4aec-8004-b76443b5be4d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:29.688385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c2273c1-31fe-471e-8d47-5b8ba0fced1b req-61dda25b-5330-4aec-8004-b76443b5be4d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:29.699572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4c2273c1-31fe-471e-8d47-5b8ba0fced1b req-61dda25b-5330-4aec-8004-b76443b5be4d service nova] Creating event network-changed:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h1-854882-3 Aug 29 16:21:29.704653 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4c2273c1-31fe-471e-8d47-5b8ba0fced1b req-61dda25b-5330-4aec-8004-b76443b5be4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034535 Aug 29 16:21:29.705255 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3525/6875] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:05.930888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:05.932982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=21 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:05.933680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:05.938633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:05.939249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:05.946726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:05.947205 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:05.947638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:05.948326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:05.948779 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:05.949202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:06.083299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:06.091494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b80970f1-bf8a-4c07-99c0-544cffbd6919 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1668 microversion: 2.1 time: 0.161147 Aug 29 16:22:06.092218 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3351/6876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:05 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:06.109937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:06.110818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=46 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:06.116296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfb701cc-f5fe-4acc-bc58-60b36ba1e736"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:06.118734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:06.126514 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:06.127017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:06.127465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:06.128177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:06.128643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:06.129078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:06.367229 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-891e536b-98e7-44ce-9bde-9e25814c1094 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259200 Aug 29 16:22:06.367856 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3526/6877] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:22:06 2022] POST /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:17.073544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:17.075838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:17.078268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:17.079083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:17.085052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:17.085564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:17.086651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:17.087345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:17.087797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:17.088251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:17.116116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:17.122061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Old instance type m1.heat2, new instance type m1.heat {{(pid=130001) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:22:17.128890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:22:17.129310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:22:17.129810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:22:17.130222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:22:17.130637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:22:17.192483 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8d07c6ea-27ac-41e3-86fa-e06589a2fe1a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/action" status: 202 len: 0 microversion: 2.1 time: 0.123518 Aug 29 16:22:17.193103 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3352/6878] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:22:17 2022] POST /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:22:17.200142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:17.200966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:17.205217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:17.206103 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:17.214196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:17.214632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:17.215255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:17.216044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:17.216546 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:17.217017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:17.376071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:17.385472 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3d9c61a-0123-4178-a232-ecb2f33479ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1723 microversion: 2.1 time: 0.187220 Aug 29 16:22:17.386057 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3527/6879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:17 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:18.406453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:18.407061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:18.414310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:18.414785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:18.415231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:18.415886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:18.416332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:18.416749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:18.549353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:18.558245 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b81fd299-893e-4bce-b6ad-786ce7cb1867 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1723 microversion: 2.1 time: 0.155672 Aug 29 16:22:18.558825 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3353/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:18 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:19.580194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:19.580837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:19.588266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:19.588770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:19.589245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:19.589965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:19.590438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:19.590884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:19.720389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:19.729305 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1a38eb45-910e-4ac9-9b31-58936c3e5915 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.152969 Aug 29 16:22:19.729869 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3528/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:19 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:20.750566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:20.751189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:20.758531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:20.759006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:20.759439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:20.760125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:20.760576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:20.761000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:20.895576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:20.903769 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1afb0e92-73cc-44cd-8e19-37b6320b51ba tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.157170 Aug 29 16:22:20.904342 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3354/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:20 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:22:21.925381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:21.925952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:21.933219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:21.933747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:21.934196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:21.935161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:21.935627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:21.936060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:22.068149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:22.077060 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4698fc42-ea4a-42f6-a230-378dc4d2f3b2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.155626 Aug 29 16:22:22.077663 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3529/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:21 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:23.100133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:23.100763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:23.108078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:23.108562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:23.109021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:23.109721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:23.110178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:23.110611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:23.238248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:23.247253 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16386dad-f5aa-411c-ad4a-ba4c83d0abc3 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.151145 Aug 29 16:22:23.247840 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3355/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:23 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:24.268418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:24.269079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:24.276101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:24.276604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:24.277055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:24.277869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:24.278337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:24.278780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:24.408096 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:24.416795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0364d65f-a43f-4cbb-81c5-95aeafd20047 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.152539 Aug 29 16:22:24.417369 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3530/6885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:24 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:25.438388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:25.439014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:25.446673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:25.447167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:25.447610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:25.448307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:25.448762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:25.449229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:25.579180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:25.587968 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cf2b3767-8745-4574-a2fd-43f3d74585bb tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.153681 Aug 29 16:22:25.588548 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3356/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:25 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:26.610184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:26.610757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:26.617667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:26.618173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:26.618636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:26.619349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:26.619825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:26.620278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:26.760456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:26.769688 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f0278fe-541a-41c2-bf3d-35f32448ea4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.163451 Aug 29 16:22:26.770264 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3531/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:26 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:27.791895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:27.792432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:27.799817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:27.800292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:27.800723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:27.801418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:27.801875 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:27.802293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:27.941764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:27.950535 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a7af58f-a960-41b9-9082-c305eefa03ab tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.163142 Aug 29 16:22:27.951113 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3357/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:27 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:28.971267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:28.971899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:28.979353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:28.979857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:28.980309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:28.981016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:28.981520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:28.981966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:29.111772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:29.120800 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d880bc11-5a3c-4361-b058-c770f5e10184 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.153491 Aug 29 16:22:29.121378 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3532/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:28 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:30.142601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:30.143227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:30.150118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:30.150604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:30.151042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:30.151737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:30.152193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:30.152627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:30.282888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:30.291233 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9259ee9e-5ed9-4054-b095-ea6c75ab7822 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.152574 Aug 29 16:22:30.291829 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3358/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:30 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:31.313143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:31.313809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:31.321126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:31.321650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:31.322106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:31.322811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:31.323280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:31.323719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:31.455457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:31.464480 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ef5f567a-d609-41fc-90ac-ef084cabaa90 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.155597 Aug 29 16:22:31.465058 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3533/6891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:31 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:32.485932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:32.486551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:32.493968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.494448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.494883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:32.495568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.496018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.496437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:32.640541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:32.649237 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dfd9e7e6-64b2-41f2-bc7d-4e194fc29aea tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1728 microversion: 2.1 time: 0.167096 Aug 29 16:22:32.649876 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3359/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:32 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:33.670717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:33.671353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:33.678382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:33.678826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:33.679296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:33.680056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:33.680580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:33.681025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:33.876641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:33.885049 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-894b3383-78d2-4916-a980-50820809d745 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1727 microversion: 2.1 time: 0.218316 Aug 29 16:22:33.885674 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3534/6893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:33 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:34.220493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1c10aeef-d86d-469a-8173-af23119fd149 req-f98eaad7-b9f9-436b-9b4d-9159ee87ce9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "name": "network-vif-unplugged", "status": "completed", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:34.232056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c10aeef-d86d-469a-8173-af23119fd149 req-f98eaad7-b9f9-436b-9b4d-9159ee87ce9d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:34.232525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c10aeef-d86d-469a-8173-af23119fd149 req-f98eaad7-b9f9-436b-9b4d-9159ee87ce9d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:34.232959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1c10aeef-d86d-469a-8173-af23119fd149 req-f98eaad7-b9f9-436b-9b4d-9159ee87ce9d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:34.245653 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1c10aeef-d86d-469a-8173-af23119fd149 req-f98eaad7-b9f9-436b-9b4d-9159ee87ce9d service nova] Creating event network-vif-unplugged:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h2-854882-3 Aug 29 16:22:34.251535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-1c10aeef-d86d-469a-8173-af23119fd149 req-f98eaad7-b9f9-436b-9b4d-9159ee87ce9d service nova] Instance 21f0a33d-978a-41c4-9656-aa355e13516e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:22:34.262580 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1c10aeef-d86d-469a-8173-af23119fd149 req-f98eaad7-b9f9-436b-9b4d-9159ee87ce9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046043 Aug 29 16:22:34.263203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3360/6894] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:22:34.907976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:34.908617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:34.916028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:34.916536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:34.917669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:34.918486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:34.918967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:34.919414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:35.128512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:35.136991 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff706dae-0d19-492a-8942-ff2fe9d67002 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1727 microversion: 2.1 time: 0.233164 Aug 29 16:22:35.137817 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3535/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:34 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:36.210624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:36.211359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:36.217651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.218227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.218946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:36.220154 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.220716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.221167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:36.305075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c553750f-c62c-436c-bfb1-67f97bd57217 req-9b76a3ce-fb33-4747-9514-878916f5f84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:36.317886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c553750f-c62c-436c-bfb1-67f97bd57217 req-9b76a3ce-fb33-4747-9514-878916f5f84b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.318399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c553750f-c62c-436c-bfb1-67f97bd57217 req-9b76a3ce-fb33-4747-9514-878916f5f84b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.318908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c553750f-c62c-436c-bfb1-67f97bd57217 req-9b76a3ce-fb33-4747-9514-878916f5f84b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:36.332321 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c553750f-c62c-436c-bfb1-67f97bd57217 req-9b76a3ce-fb33-4747-9514-878916f5f84b service nova] Creating event network-changed:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h2-854882-3 Aug 29 16:22:36.339052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-c553750f-c62c-436c-bfb1-67f97bd57217 req-9b76a3ce-fb33-4747-9514-878916f5f84b service nova] Instance 21f0a33d-978a-41c4-9656-aa355e13516e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:22:36.350242 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c553750f-c62c-436c-bfb1-67f97bd57217 req-9b76a3ce-fb33-4747-9514-878916f5f84b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049720 Aug 29 16:22:36.351042 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3536/6896] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:22:36.365552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:36.376226 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ad35a24-f792-4881-bc53-1fe871a1ec92 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.220704 Aug 29 16:22:36.376838 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3361/6897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:36 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:37.400707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:37.401471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:37.407855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.408362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.408815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.409561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.410037 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.410483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.550657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:37.560216 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f4796fb5-0a48-4309-9456-a94c550d11e2 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.165309 Aug 29 16:22:37.560814 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3537/6898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:37 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:38.582254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:38.583057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:38.590654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.591136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.591573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.592265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.592724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.593298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.739982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:38.748448 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cfb7ff1a-fcad-4daa-add8-80c0362671dd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.170191 Aug 29 16:22:38.749122 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3362/6899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:38 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:39.771180 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:39.771884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:39.779894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:39.780408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:39.780871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:39.781619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:39.782105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:39.782552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:39.918570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:39.926975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92d0856f-d308-4812-97f1-b012788e9e53 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.159775 Aug 29 16:22:39.928068 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3538/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:39 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:40.949578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:40.950227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:40.956736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:40.957224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:40.957705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:40.958405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:40.958868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:40.959305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:41.090636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:41.099089 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1c673b81-0944-438e-901e-29996d674b69 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.153751 Aug 29 16:22:41.099816 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3363/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:40 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:42.122303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:42.122946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:42.129904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:42.130410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:42.130868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:42.131581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:42.132720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:42.133170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:42.265437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:42.274399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-77fe8b14-04b1-4d9a-a736-6050ddd3b9dc tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.155969 Aug 29 16:22:42.274991 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3539/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:42 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:43.294721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:43.295339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:43.302270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:43.302729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:43.303164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:43.303882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:43.304335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:43.304756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:43.438061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:43.446764 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c460b7ee-d251-4990-964b-7ab74e9ea424 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.155999 Aug 29 16:22:43.447344 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3364/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:43 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:44.468838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:44.469506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:44.476348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:44.476841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:44.477291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:44.478012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:44.478478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:44.478913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:44.609243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:44.618088 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1feb2e8d-dbd7-4459-8dbc-03c882f38928 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.153132 Aug 29 16:22:44.618606 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3540/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:44 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:45.639032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:45.639654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:45.646531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:45.647009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:45.647444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:45.648129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:45.648581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:45.649002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:45.780192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:45.789072 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2320b9da-f5b1-47de-aa46-6089e174920b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.153996 Aug 29 16:22:45.789696 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3365/6905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:45 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:46.811067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:46.811634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:46.818635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:46.819222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:46.819663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:46.820393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:46.821018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:46.821973 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:46.971154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:46.983633 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bcd9a137-a9ac-4b0f-be6e-ca6797fbb146 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1725 microversion: 2.1 time: 0.176794 Aug 29 16:22:46.984837 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3541/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:46 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:48.006727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:48.007352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:48.010264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=33 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:48.015806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.016290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.016728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.017449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.017915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.018343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.021129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:48.154391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:48.162813 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d3cab251-e45b-48a0-90ba-ffe0453733cd tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1722 microversion: 2.1 time: 0.160118 Aug 29 16:22:48.164033 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3366/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:48 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:48.183958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:48.184798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:48.187632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=31 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:48.192908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.193428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.193886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.194594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.195067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.195512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.199645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=89 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:48.233374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.233905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.234363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.235106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.235601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.236052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.256283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:22:48.261510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Getting quotas for user 26f455ab6ad14c2db7727b826a2b32bc and project 65d92a43d3cd4a6d952e95d1cee77d69. Resources: {'cores', 'ram'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:22:48.361778 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3e00ca86-70bc-4a1b-a5a3-380e837b02de tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "POST /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/action" status: 202 len: 0 microversion: 2.1 time: 0.181494 Aug 29 16:22:48.362394 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3542/6908] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:22:48 2022] POST /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:22:48.371717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:48.372336 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:48.378704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.379308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.379699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.380709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.381207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.382232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.535436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:48.544374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-10338e60-50c2-4f96-a4f4-68ac0be8d1f4 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.177534 Aug 29 16:22:48.544977 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3367/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:48 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:48.896622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6a68fd2a-b765-4c72-9c4e-8856fee7f25d req-e21634fa-d725-42c6-b863-c85f3d6aca98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "name": "network-vif-plugged", "status": "completed", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:48.909711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6a68fd2a-b765-4c72-9c4e-8856fee7f25d req-e21634fa-d725-42c6-b863-c85f3d6aca98 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.910220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6a68fd2a-b765-4c72-9c4e-8856fee7f25d req-e21634fa-d725-42c6-b863-c85f3d6aca98 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.910686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6a68fd2a-b765-4c72-9c4e-8856fee7f25d req-e21634fa-d725-42c6-b863-c85f3d6aca98 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.923324 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6a68fd2a-b765-4c72-9c4e-8856fee7f25d req-e21634fa-d725-42c6-b863-c85f3d6aca98 service nova] Creating event network-vif-plugged:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h2-854882-3 Aug 29 16:22:48.929813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-6a68fd2a-b765-4c72-9c4e-8856fee7f25d req-e21634fa-d725-42c6-b863-c85f3d6aca98 service nova] Instance 21f0a33d-978a-41c4-9656-aa355e13516e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:22:48.942949 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6a68fd2a-b765-4c72-9c4e-8856fee7f25d req-e21634fa-d725-42c6-b863-c85f3d6aca98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050251 Aug 29 16:22:48.943582 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3543/6910] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:49.565750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:49.566359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:49.573333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:49.573844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:49.574268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:49.574942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:49.575389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:49.575947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:49.705133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:49.713874 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a9ccd8d2-d0ea-4f92-b97e-482b79efa936 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.152013 Aug 29 16:22:49.714463 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3368/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:49 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:50.735416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:50.736300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:50.743604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:50.744107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:50.744617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:50.745499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:50.753860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:50.754412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:50.889515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:50.898855 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e67c887-0106-46dd-aa49-5111dcbf8e42 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.167667 Aug 29 16:22:50.899469 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3544/6912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:50 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:51.920186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:51.920738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:51.927735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:51.928221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:51.929155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:51.929876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:51.930332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:51.930761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:52.070633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:52.079244 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c575eb33-8e6a-46fc-b98c-1c4cdd3247e6 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.163177 Aug 29 16:22:52.079839 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3369/6913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:51 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:53.100717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:53.101333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:53.108810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:53.109312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:53.109974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:53.110696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:53.111232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:53.111609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:53.248166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:53.257104 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-06b725df-1dee-4f9a-b7df-f5567f98b763 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.160254 Aug 29 16:22:53.257803 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3545/6914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:53 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:53.425226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-3a349af7-5e63-480d-9181-0a4e0b55e081 req-fabdf677-cbe9-42a5-83ad-5c2227e57c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "name": "network-vif-unplugged", "status": "completed", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:53.437268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3a349af7-5e63-480d-9181-0a4e0b55e081 req-fabdf677-cbe9-42a5-83ad-5c2227e57c51 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:53.437775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3a349af7-5e63-480d-9181-0a4e0b55e081 req-fabdf677-cbe9-42a5-83ad-5c2227e57c51 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:53.438223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-3a349af7-5e63-480d-9181-0a4e0b55e081 req-fabdf677-cbe9-42a5-83ad-5c2227e57c51 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:53.450737 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-3a349af7-5e63-480d-9181-0a4e0b55e081 req-fabdf677-cbe9-42a5-83ad-5c2227e57c51 service nova] Creating event network-vif-unplugged:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h1-854882-3 Aug 29 16:22:53.456061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [req-3a349af7-5e63-480d-9181-0a4e0b55e081 req-fabdf677-cbe9-42a5-83ad-5c2227e57c51 service nova] Instance 21f0a33d-978a-41c4-9656-aa355e13516e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:22:53.467530 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-3a349af7-5e63-480d-9181-0a4e0b55e081 req-fabdf677-cbe9-42a5-83ad-5c2227e57c51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045961 Aug 29 16:22:53.468165 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3370/6915] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:54.278361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:54.279052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.286008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.286520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.286981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.287703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.288177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.288623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.422231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.431117 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71c54200-5198-43d2-b53e-09bff444f309 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.156831 Aug 29 16:22:54.431704 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3546/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:54 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:55.453179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:55.453971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:55.461278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.461786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.462223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.462925 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.463400 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.463823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.515635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0740e328-fe32-4624-aafa-53986dc5baca req-36f2226a-8445-4e30-b4e4-398bb505735b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:55.524536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0740e328-fe32-4624-aafa-53986dc5baca req-36f2226a-8445-4e30-b4e4-398bb505735b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.525181 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0740e328-fe32-4624-aafa-53986dc5baca req-36f2226a-8445-4e30-b4e4-398bb505735b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.525648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0740e328-fe32-4624-aafa-53986dc5baca req-36f2226a-8445-4e30-b4e4-398bb505735b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.542289 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0740e328-fe32-4624-aafa-53986dc5baca req-36f2226a-8445-4e30-b4e4-398bb505735b service nova] Creating event network-changed:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h1-854882-3 Aug 29 16:22:55.548311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-0740e328-fe32-4624-aafa-53986dc5baca req-36f2226a-8445-4e30-b4e4-398bb505735b service nova] Instance 21f0a33d-978a-41c4-9656-aa355e13516e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:22:55.560204 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0740e328-fe32-4624-aafa-53986dc5baca req-36f2226a-8445-4e30-b4e4-398bb505735b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051596 Aug 29 16:22:55.560803 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3547/6917] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:22:55.659797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:55.669855 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9037bb78-cc39-4106-a140-35ab39473ac5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.221051 Aug 29 16:22:55.682568 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3371/6918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:55 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:56.696538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:56.697179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:56.703793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:56.704292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:56.704747 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:56.705486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:56.705964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:56.706404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:56.841472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:56.849930 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f8845f36-4bf5-4523-bc33-25a4f8d660da tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.159079 Aug 29 16:22:56.850462 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3548/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:56 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:57.872723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:57.873734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:57.881705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:57.882195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:57.882656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:57.883391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:57.883844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:57.884269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:58.020214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:58.029298 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e83c04ab-2230-469b-91f5-2e4e99db3bda tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.161597 Aug 29 16:22:58.029943 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3372/6920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:57 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:59.051849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:59.052525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:59.057251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:59.061944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:59.062459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:59.062920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:59.063641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:59.064120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:59.064596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:59.200389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:59.208688 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d73c5014-6b42-40be-938b-00718ae6c28b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.161399 Aug 29 16:22:59.209291 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3549/6921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:59 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:00.230033 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:00.231164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:00.238259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:00.238736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:00.239169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:00.239855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:00.240301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:00.240782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:00.370283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:00.378611 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ee27cbb7-8a6b-4409-82a3-1c515845085b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.152598 Aug 29 16:23:00.379353 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3373/6922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:00 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:01.400653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:01.401331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:01.408239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:01.408740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:01.409190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:01.409925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:01.410394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:01.410832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:01.548161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:01.558399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba37e757-d16f-413f-99db-705e800c5453 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.162175 Aug 29 16:23:01.559059 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3550/6923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:01 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:02.582715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:02.583439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:02.590856 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:02.591344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:02.591786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:02.592476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:02.592929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:02.593354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:02.725016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:02.733481 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-52b73dd2-41f6-43fe-a9d7-d39643c8db63 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.154685 Aug 29 16:23:02.734074 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3374/6924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:02 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:03.754544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:03.755189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:03.762080 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:03.762584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:03.763042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:03.763754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:03.764231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:03.764677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:03.898887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:03.907138 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d23ab273-0000-4ce0-bedc-eec5dc2896b1 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.156579 Aug 29 16:23:03.907718 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3551/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:03 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:04.928294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:04.928931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:04.936035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.936511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.936939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:04.937647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.938097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.938516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.073284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:05.081578 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-05437e05-2086-4ab9-811b-d7a89cfea9d8 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.157254 Aug 29 16:23:05.082149 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3375/6926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:04 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:06.104870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:06.105566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:06.112576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:06.113084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:06.113579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:06.114302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:06.114779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:06.115228 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:06.251057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:06.259415 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1489f5e7-43a5-40b8-bb11-71d8b351d8a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1721 microversion: 2.1 time: 0.159839 Aug 29 16:23:06.259991 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3552/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:06 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:07.280149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:07.280769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:07.287676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.288155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.288587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.289807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.290258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.290684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.417108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:07.425267 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c9b70624-f099-4c1d-9810-84b2acbe9b40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1714 microversion: 2.1 time: 0.149097 Aug 29 16:23:07.425868 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3376/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:07 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:07.446200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:07.446834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:07.453777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.454276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.454728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.455437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.455912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.456385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.604325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:07.612677 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2d67cf8-4f7e-4588-beb7-1f6466e260e5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1714 microversion: 2.1 time: 0.170284 Aug 29 16:23:07.613304 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3553/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:07 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1714 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:07.633283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:07.633871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:07.639973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.640587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.640898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.641621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.642080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.642506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.776241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:07.784557 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-12d23599-d481-4065-a020-228bb1a2f7a5 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1714 microversion: 2.1 time: 0.155277 Aug 29 16:23:07.785140 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3377/6930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:07 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:07.805663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:07.806102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:07.812372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.812895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.813351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.814125 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.814597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.815044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.840402 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:23:07.890188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:07.923709 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cfe2e97c-eb41-4858-8259-2a7a21e8583b tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 204 len: 0 microversion: 2.1 time: 0.121963 Aug 29 16:23:07.925548 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3554/6931] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:07 2022] DELETE /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:23:07.933615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:07.934732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:07.941026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.941546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.941979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.942664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.943110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.943530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:08.075079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:08.083341 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb2b1c6f-a99c-47bf-a0c7-ba3ec3e80531 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1720 microversion: 2.1 time: 0.153696 Aug 29 16:23:08.083921 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3378/6932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:07 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:09.106566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:09.107296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:09.114153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:09.114654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:09.115107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:09.115812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:09.116278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:09.116719 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:09.249543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:09.257869 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-051262e8-eaff-408c-af41-45b81326a064 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1720 microversion: 2.1 time: 0.156176 Aug 29 16:23:09.258454 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3555/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:09 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:09.627586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-57ca8b20-cbf4-4e09-859a-4802f5351fc8 req-7dec658b-d6c9-48f5-8453-53856b0025ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "name": "network-vif-plugged", "status": "completed", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:09.651571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-57ca8b20-cbf4-4e09-859a-4802f5351fc8 req-7dec658b-d6c9-48f5-8453-53856b0025ca service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:09.652966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-57ca8b20-cbf4-4e09-859a-4802f5351fc8 req-7dec658b-d6c9-48f5-8453-53856b0025ca service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:09.654398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-57ca8b20-cbf4-4e09-859a-4802f5351fc8 req-7dec658b-d6c9-48f5-8453-53856b0025ca service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:09.672842 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-57ca8b20-cbf4-4e09-859a-4802f5351fc8 req-7dec658b-d6c9-48f5-8453-53856b0025ca service nova] Creating event network-vif-plugged:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h1-854882-3 Aug 29 16:23:09.678600 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-57ca8b20-cbf4-4e09-859a-4802f5351fc8 req-7dec658b-d6c9-48f5-8453-53856b0025ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057821 Aug 29 16:23:09.679662 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3379/6934] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:10.279527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:10.280314 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:10.287362 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:10.287864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:10.288311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:10.289757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:10.290549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:10.290991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:10.379830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:10.389838 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2db5753b-5f09-409a-8870-2ee24dcd0caf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1652 microversion: 2.1 time: 0.114351 Aug 29 16:23:10.390455 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3556/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:10 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1652 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:10.782972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-93a86f53-2c0e-4e41-8e7a-612972eae45e req-825f34fb-da64-4e1e-b6ac-97cf2609614f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f0a33d-978a-41c4-9656-aa355e13516e", "name": "network-vif-deleted", "tag": "43799518-849b-46b5-99b9-4061d27bd8b3"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:10.794873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-93a86f53-2c0e-4e41-8e7a-612972eae45e req-825f34fb-da64-4e1e-b6ac-97cf2609614f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:10.795421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-93a86f53-2c0e-4e41-8e7a-612972eae45e req-825f34fb-da64-4e1e-b6ac-97cf2609614f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:10.795980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-93a86f53-2c0e-4e41-8e7a-612972eae45e req-825f34fb-da64-4e1e-b6ac-97cf2609614f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:10.813055 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-93a86f53-2c0e-4e41-8e7a-612972eae45e req-825f34fb-da64-4e1e-b6ac-97cf2609614f service nova] Creating event network-vif-deleted:43799518-849b-46b5-99b9-4061d27bd8b3 for instance 21f0a33d-978a-41c4-9656-aa355e13516e on n-h1-854882-3 Aug 29 16:23:10.818266 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-93a86f53-2c0e-4e41-8e7a-612972eae45e req-825f34fb-da64-4e1e-b6ac-97cf2609614f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040986 Aug 29 16:23:10.821587 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3380/6936] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:11.412363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:11.413770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:11.421313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.421868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.422494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.423410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.423888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.424336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.492616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:11.501354 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cad324e9-f415-48b5-b288-834b9cb55841 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1368 microversion: 2.1 time: 0.092910 Aug 29 16:23:11.501971 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3557/6937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:11 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:12.525157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:12.525910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:12.532078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:12.532565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:12.533000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:12.533744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:12.534201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:12.534620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:12.598553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:12.606991 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-77396887-4d2d-4b2f-a90d-70c2c3d410f9 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1368 microversion: 2.1 time: 0.087507 Aug 29 16:23:12.607561 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3381/6938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:12 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:13.628054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:13.628716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:13.635668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:13.636167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:13.636613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:13.637317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:13.637811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:13.638251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:13.700344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:13.709059 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e78bc49c-21e6-47fd-9cb6-a413544515ac tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1368 microversion: 2.1 time: 0.084892 Aug 29 16:23:13.709839 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3558/6939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:13 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:14.731237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:14.731861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:14.738737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:14.739224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:14.739661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:14.740367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:14.740825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:14.741255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:14.809930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26f455ab6ad14c2db7727b826a2b32bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d92a43d3cd4a6d952e95d1cee77d69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:14.818598 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4cb8d88e-d4f8-4878-b305-d037f246ae6a tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 200 len: 1368 microversion: 2.1 time: 0.091292 Aug 29 16:23:14.819204 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3382/6940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:14 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:15.839541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:15.840100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:15.847022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.847646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.848105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.848813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.849285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.849754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.863018 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e HTTP/1.1 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '21f0a33d-978a-41c4-9656-aa355e13516e'} Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:15.864650 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-54b9e00e-8d91-4251-9b84-0ae7ae43b422 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 404 len: 111 microversion: 2.1 time: 0.030869 Aug 29 16:23:15.869604 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3559/6941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:15 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:15.925992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:15.928208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:15.935843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.936321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.936758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.937478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.937931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.938353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.951296 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/os-volume_attachments HTTP/1.1 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'server_id': '21f0a33d-978a-41c4-9656-aa355e13516e'} Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:15.952953 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-98a31bd0-c727-4e88-8966-635b0cee9535 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032515 Aug 29 16:23:15.957808 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3383/6942] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:23:15 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:19.266702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.267270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.270538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:19.276286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.276798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.277255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.278016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.278498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.278941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.298043 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e HTTP/1.1 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '21f0a33d-978a-41c4-9656-aa355e13516e'} Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.299651 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2e466028-f996-4a4e-896f-99eaf0427f40 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 404 len: 111 microversion: 2.1 time: 0.038359 Aug 29 16:23:19.303741 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3560/6943] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:19 2022] DELETE /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:23:19.310904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.311525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 21f0a33d-978a-41c4-9656-aa355e13516e] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.314755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=36 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:19.320329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.320926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.321239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.321973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.322428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.322850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.325815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=94 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:19.338291 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e HTTP/1.1 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '21f0a33d-978a-41c4-9656-aa355e13516e'} Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.339862 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 21f0a33d-978a-41c4-9656-aa355e13516e could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-491a4886-6105-47bb-9011-1bac1d92a297 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e" status: 404 len: 111 microversion: 2.1 time: 0.034592 Aug 29 16:23:19.344680 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3384/6944] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:19 2022] GET /compute/v2.1/servers/21f0a33d-978a-41c4-9656-aa355e13516e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:23:19.351947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.352464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.358674 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.359183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.359635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.360343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.360815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.361257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.375330 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 HTTP/1.1 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'a13ea45f-79a4-40d1-b49f-ea8483a00717'} Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.376895 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e53fc7f3-f519-4ab6-9e2a-37de71b06e4e tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 404 len: 111 microversion: 2.1 time: 0.030900 Aug 29 16:23:19.380646 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3561/6945] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:19 2022] DELETE /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:19.387555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.388253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: a13ea45f-79a4-40d1-b49f-ea8483a00717] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.394300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.394784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.395225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.395917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.396372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.396802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.411198 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 HTTP/1.1 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'a13ea45f-79a4-40d1-b49f-ea8483a00717'} Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.412739 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance a13ea45f-79a4-40d1-b49f-ea8483a00717 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c3ceaa81-e8f1-490c-bf47-71f3eb3c4eaf tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717" status: 404 len: 111 microversion: 2.1 time: 0.031338 Aug 29 16:23:19.417595 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3385/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:19 2022] GET /compute/v2.1/servers/a13ea45f-79a4-40d1-b49f-ea8483a00717 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:19.423405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.423927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.430571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.431071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.431521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.432233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.432703 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.433141 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.446874 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 HTTP/1.1 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '19d24031-b220-4182-9202-3d71a16d2a52'} Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.448452 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a8eb4311-ba00-400c-88f7-d9dd5f995b0c tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 404 len: 111 microversion: 2.1 time: 0.030428 Aug 29 16:23:19.452768 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3562/6947] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:19 2022] DELETE /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:23:19.458656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.459303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 19d24031-b220-4182-9202-3d71a16d2a52] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.465517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.465999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.466441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.467134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.467586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.468003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.482336 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 HTTP/1.1 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '19d24031-b220-4182-9202-3d71a16d2a52'} Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.484184 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 19d24031-b220-4182-9202-3d71a16d2a52 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-52006c29-16f9-4076-8623-2d37bae93566 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52" status: 404 len: 111 microversion: 2.1 time: 0.031237 Aug 29 16:23:19.488612 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3386/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:19 2022] GET /compute/v2.1/servers/19d24031-b220-4182-9202-3d71a16d2a52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:19.498493 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.499097 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.505697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.506335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.506938 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.507794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.508364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.508929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.524641 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca HTTP/1.1 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '5b54362b-b11c-49ab-8ff3-ffa5540603ca'} Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.526424 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.530675 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.531548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.532493 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d57cbf0e-9b44-4878-ace4-7fc93ab939ed tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 404 len: 111 microversion: 2.1 time: 0.038604 Aug 29 16:23:19.533158 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3563/6949] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:19 2022] DELETE /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:19.542648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.543277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [instance: 5b54362b-b11c-49ab-8ff3-ffa5540603ca] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.549515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.550003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.550452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.551186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.551672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.552100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.571356 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] HTTP exception thrown: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Request method failure captured: Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca HTTP/1.1 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOafPT2jz27Cal9w_hYcz3X8B5GeR1JuIA4S-Rn7T5N66sdxSxQH7GS7AS3SN5fj75F-YTa6UMm8Q6Aq8m3AZsOASjK6C_HgDKIxJJtrSOU2LK0IDiu0Z4a0IZ4rRtiLJcgVSU2YIVzchN52uvief7cGtzPiUdZuYASjQM3YvqitYCA Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65d92a43d3cd4a6d952e95d1cee77d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65d92a43d3cd4a6d952e95d1cee77d69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65d92a43d3cd4a6d952e95d1cee77d69"}]}] Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 65d92a43d3cd4a6d952e95d1cee77d69 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2030524196 Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 26f455ab6ad14c2db7727b826a2b32bc Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServerActionsTestJSON-2030524196-project Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5b54362b-b11c-49ab-8ff3-ffa5540603ca'} Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:19.575746 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Returning 404 to user: Instance 5b54362b-b11c-49ab-8ff3-ffa5540603ca could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f9929864-d6e0-44dd-bd9a-c91ea4024215 tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca" status: 404 len: 111 microversion: 2.1 time: 0.039720 Aug 29 16:23:19.583181 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3387/6950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:19 2022] GET /compute/v2.1/servers/5b54362b-b11c-49ab-8ff3-ffa5540603ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:19.589472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fd69d995-9080-4ec9-83b9-97bc057bafde tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] Calling method '.version_select at 0x7fb0eb715700>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.593977 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd69d995-9080-4ec9-83b9-97bc057bafde tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [c9a61e61-af61-4c98-869c-d6306036732e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:23:20.602058 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd69d995-9080-4ec9-83b9-97bc057bafde tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] [c9a61e61-af61-4c98-869c-d6306036732e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52214. Aug 29 16:23:20.622302 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fd69d995-9080-4ec9-83b9-97bc057bafde tempest-ServerActionsTestJSON-2030524196 tempest-ServerActionsTestJSON-2030524196-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227049464" status: 202 len: 0 microversion: 2.1 time: 1.037259 Aug 29 16:23:20.622898 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3564/6951] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 16:23:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227049464 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:23:29.934652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:29.936027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=7 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:30.072526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-810478199", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "fe7be7fc-8cb0-4158-aa7e-c19ceeb1247f"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:30.129586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] validate_networks() for [('fe7be7fc-8cb0-4158-aa7e-c19ceeb1247f', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:23:30.572820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:23:30.573240 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:23:30.573750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:23:30.574156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:23:30.574597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:23:30.583482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:30.583956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:30.584390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:30.585116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:30.586134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:30.586560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:30.604024 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Getting quotas for project 355a0e654a9f48558ccf4099ea929f86. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:23:30.609206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Getting quotas for user 92e7fdc4bd894d9eb9ee25e461be8103 and project 355a0e654a9f48558ccf4099ea929f86. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:23:30.623426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:23:30.624579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:23:30.673155 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c8ddccfe-ba11-4a7f-8943-ffeac5b29804 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744751 Aug 29 16:23:30.673923 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3388/6952] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:23:30.683022 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=34 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:30.683870 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:30.688448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dd2703ee-138f-4259-8da3-72c940dd5c81 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:30.689122 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dd2703ee-138f-4259-8da3-72c940dd5c81 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:30.752559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-dd2703ee-138f-4259-8da3-72c940dd5c81 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:30.760673 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dd2703ee-138f-4259-8da3-72c940dd5c81 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1216 microversion: 2.1 time: 0.079530 Aug 29 16:23:30.761591 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3565/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:30 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:31.782646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:31.783898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:31.791903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:31.792648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:31.793244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:31.794210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:31.794820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:31.795399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:31.911425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:31.922231 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ce34ab8d-fcc6-4cce-b797-c1f878b8941a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1286 microversion: 2.1 time: 0.144359 Aug 29 16:23:31.922819 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3389/6954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:31 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:32.944318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:32.946044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:32.952969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:32.953506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:32.953963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:32.954888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:32.955367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:32.955825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:33.108166 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:33.117201 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a65531e8-7b9b-4f70-ac7d-a749bbe323f5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1316 microversion: 2.1 time: 0.176891 Aug 29 16:23:33.118568 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3566/6955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:32 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:33.158209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-afc59428-5324-4c10-83a8-2101938d012f req-b17efba2-e476-414e-8cee-5338eeab7167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf", "tag": "5e1e5a8c-0c85-4ac0-9a65-8b4efcf5d6de"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:33.169769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-afc59428-5324-4c10-83a8-2101938d012f req-b17efba2-e476-414e-8cee-5338eeab7167 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:33.170391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-afc59428-5324-4c10-83a8-2101938d012f req-b17efba2-e476-414e-8cee-5338eeab7167 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:33.170831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-afc59428-5324-4c10-83a8-2101938d012f req-b17efba2-e476-414e-8cee-5338eeab7167 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:33.183818 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-afc59428-5324-4c10-83a8-2101938d012f req-b17efba2-e476-414e-8cee-5338eeab7167 service nova] Creating event network-changed:5e1e5a8c-0c85-4ac0-9a65-8b4efcf5d6de for instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf on n-h1-854882-3 Aug 29 16:23:33.189182 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-afc59428-5324-4c10-83a8-2101938d012f req-b17efba2-e476-414e-8cee-5338eeab7167 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034656 Aug 29 16:23:33.190415 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3390/6956] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:34.139157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:34.139787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:34.146689 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.147184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.148277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:34.148982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.149468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.149910 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:34.283897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:34.291693 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-38f2ecb2-ad2b-4616-a9a2-3a4b64ae9d19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1316 microversion: 2.1 time: 0.156483 Aug 29 16:23:34.292283 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3567/6957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:34 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:35.313970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:35.314679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:35.321642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:35.322122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:35.322554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:35.323242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:35.323689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:35.324107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:35.470196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:35.477865 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a82b9997-9725-4211-88a9-d360fefe09c5 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1316 microversion: 2.1 time: 0.169444 Aug 29 16:23:35.478442 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3391/6958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:35 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:36.498475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:36.499252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:36.506425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.507443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.507907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.508637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.509158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.509635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.640651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:36.649145 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cdffb7a1-8628-452a-89c6-40ae5fcbc388 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1316 microversion: 2.1 time: 0.154606 Aug 29 16:23:36.649760 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3568/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:36 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:37.670627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:37.671374 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:37.678306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.678759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.679262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.680054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.680786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.681293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.811731 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-23a601d7-dacf-4176-b019-916df4f8ce8d req-90209a08-e437-4aa0-bc80-7273cd440334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf", "name": "network-vif-plugged", "status": "completed", "tag": "5e1e5a8c-0c85-4ac0-9a65-8b4efcf5d6de"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:37.818258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:37.832034 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5ab4bdd-1547-4834-b1d0-3cbfcdf836cb tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1316 microversion: 2.1 time: 0.165244 Aug 29 16:23:37.833003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-23a601d7-dacf-4176-b019-916df4f8ce8d req-90209a08-e437-4aa0-bc80-7273cd440334 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.833263 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3392/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:37 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:37.833839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-23a601d7-dacf-4176-b019-916df4f8ce8d req-90209a08-e437-4aa0-bc80-7273cd440334 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.834443 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-23a601d7-dacf-4176-b019-916df4f8ce8d req-90209a08-e437-4aa0-bc80-7273cd440334 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.847780 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-23a601d7-dacf-4176-b019-916df4f8ce8d req-90209a08-e437-4aa0-bc80-7273cd440334 service nova] Creating event network-vif-plugged:5e1e5a8c-0c85-4ac0-9a65-8b4efcf5d6de for instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf on n-h1-854882-3 Aug 29 16:23:37.852969 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-23a601d7-dacf-4176-b019-916df4f8ce8d req-90209a08-e437-4aa0-bc80-7273cd440334 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047186 Aug 29 16:23:37.853809 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3569/6961] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:23:38.854020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:38.854642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:38.861483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:38.861968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:38.862420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:38.863107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:38.863556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:38.863984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:38.996636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:39.004803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c28deaec-a1f1-4611-b30c-7a17ad892a9d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1316 microversion: 2.1 time: 0.154694 Aug 29 16:23:39.005421 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3393/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:38 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:40.027439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:40.028162 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:40.035191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.035686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.036135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.036833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.037299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.037769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.175069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:40.182752 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8c85dca6-b703-407c-9f76-786fdc269c78 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1504 microversion: 2.1 time: 0.160121 Aug 29 16:23:40.183338 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3570/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:40 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:40.242204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-301366264", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "fe7be7fc-8cb0-4158-aa7e-c19ceeb1247f"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:40.295486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] validate_networks() for [('fe7be7fc-8cb0-4158-aa7e-c19ceeb1247f', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:23:40.594497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:40.616223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:40.668847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:23:40.669283 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:23:40.669790 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:23:40.670210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:23:40.670631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:23:40.681022 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.681547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.681989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.682720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.683171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.683594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.700885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Getting quotas for project 355a0e654a9f48558ccf4099ea929f86. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:23:40.709061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Getting quotas for user 92e7fdc4bd894d9eb9ee25e461be8103 and project 355a0e654a9f48558ccf4099ea929f86. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:23:40.728499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:23:40.730844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:23:40.773300 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31d2f1d5-abdf-46b9-a596-310d0d178d93 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534898 Aug 29 16:23:40.774671 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3394/6964] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:23:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:23:40.785102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ade164bd-cedf-4627-86aa-4fdef829157a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:40.785740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ade164bd-cedf-4627-86aa-4fdef829157a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:40.787769 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:40.843146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ade164bd-cedf-4627-86aa-4fdef829157a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:40.850079 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ade164bd-cedf-4627-86aa-4fdef829157a tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1216 microversion: 2.1 time: 0.068825 Aug 29 16:23:40.850658 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3571/6965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:40 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:41.871136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:41.871777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:41.878840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:41.879311 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:41.879740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:41.880424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:41.880870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:41.881287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:41.950089 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:41.957773 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-00d10cdb-1472-498c-bd7a-5def89bf9ea6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1274 microversion: 2.1 time: 0.091498 Aug 29 16:23:41.958363 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3395/6966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:41 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:42.981319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:42.982009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:42.990845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:42.991361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:42.991818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:42.993205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:42.993788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:42.994282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:43.025823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b89fc890-ffde-4362-ae85-491f21877b38 req-c262a330-96b0-4c75-a5c3-3aeaf0232c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91143ad-9d10-4437-a5bb-e8907cee1f79", "tag": "ba659fd5-7ea3-4207-893e-d9db675f55f1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:43.038261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b89fc890-ffde-4362-ae85-491f21877b38 req-c262a330-96b0-4c75-a5c3-3aeaf0232c1f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:43.039197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b89fc890-ffde-4362-ae85-491f21877b38 req-c262a330-96b0-4c75-a5c3-3aeaf0232c1f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:43.040474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b89fc890-ffde-4362-ae85-491f21877b38 req-c262a330-96b0-4c75-a5c3-3aeaf0232c1f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:43.052628 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b89fc890-ffde-4362-ae85-491f21877b38 req-c262a330-96b0-4c75-a5c3-3aeaf0232c1f service nova] Creating event network-changed:ba659fd5-7ea3-4207-893e-d9db675f55f1 for instance d91143ad-9d10-4437-a5bb-e8907cee1f79 on n-h2-854882-3 Aug 29 16:23:43.057594 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b89fc890-ffde-4362-ae85-491f21877b38 req-c262a330-96b0-4c75-a5c3-3aeaf0232c1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043539 Aug 29 16:23:43.058446 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3396/6967] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:43.255410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:43.263772 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-71ec4ea1-c3d2-4558-9d2f-52b36e553ce7 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1316 microversion: 2.1 time: 0.286707 Aug 29 16:23:43.264360 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3572/6968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:42 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:44.285509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:44.286220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:44.293082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:44.293598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:44.294035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:44.294738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:44.295192 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:44.295618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:44.757794 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:44.765953 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-24d6d492-4a61-4e95-b39b-3f10c62a5cd3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1316 microversion: 2.1 time: 0.485520 Aug 29 16:23:44.766533 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3397/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:44 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:45.787439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:45.788051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:45.796034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:45.796534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:45.796990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:45.797734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:45.798207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:45.798649 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:45.928189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:45.936653 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-be59c6f7-129e-4772-a4e0-94c1188c8ce3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1316 microversion: 2.1 time: 0.153160 Aug 29 16:23:45.942376 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3573/6970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:45 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:46.962908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:46.963631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:46.966747 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:23:46.966891 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:23:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 (ip 10.222.0.16) !!! Aug 29 16:23:46.973740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:46.974233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:46.974672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:46.975371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:46.975830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:46.976258 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:47.129681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-ab038ef7-a394-4ae0-899e-8f970f998de1 req-eddcff66-a225-4c83-a62e-bfb3ca704b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91143ad-9d10-4437-a5bb-e8907cee1f79", "name": "network-vif-plugged", "status": "completed", "tag": "ba659fd5-7ea3-4207-893e-d9db675f55f1"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:47.143808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ab038ef7-a394-4ae0-899e-8f970f998de1 req-eddcff66-a225-4c83-a62e-bfb3ca704b40 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:47.144603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ab038ef7-a394-4ae0-899e-8f970f998de1 req-eddcff66-a225-4c83-a62e-bfb3ca704b40 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:47.145229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-ab038ef7-a394-4ae0-899e-8f970f998de1 req-eddcff66-a225-4c83-a62e-bfb3ca704b40 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:47.157047 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-ab038ef7-a394-4ae0-899e-8f970f998de1 req-eddcff66-a225-4c83-a62e-bfb3ca704b40 service nova] Creating event network-vif-plugged:ba659fd5-7ea3-4207-893e-d9db675f55f1 for instance d91143ad-9d10-4437-a5bb-e8907cee1f79 on n-h2-854882-3 Aug 29 16:23:47.162516 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-ab038ef7-a394-4ae0-899e-8f970f998de1 req-eddcff66-a225-4c83-a62e-bfb3ca704b40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036945 Aug 29 16:23:47.163341 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3574/6971] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:47.174346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:47.183130 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fc5ed0fa-8e0c-4d02-bf2a-ab51ef0d72c1 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1316 microversion: 2.1 time: 0.224262 Aug 29 16:23:47.183775 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3398/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:46 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:48.205580 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:48.206331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:48.214257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:48.214767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:48.215224 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:48.215944 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:48.216415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:48.216865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:48.400211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:48.407975 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e4946cc0-2425-4409-aa60-1bcab723391d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1316 microversion: 2.1 time: 0.208121 Aug 29 16:23:48.408556 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3575/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:48 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:49.428729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:49.429341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:49.437067 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.437585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.438015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:49.438694 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.439136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.439551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:49.574171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:49.581872 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fe4629f3-a445-40f8-823a-42c801909ef3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1504 microversion: 2.1 time: 0.157071 Aug 29 16:23:49.582445 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3399/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:49 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:49.601562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:49.602106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:49.608952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.609487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.609943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:49.610656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.611127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.611570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:49.637219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:23:49.712170 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b1267043-ef3c-4dd8-bd00-31ebc921befe tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 204 len: 0 microversion: 2.1 time: 0.114099 Aug 29 16:23:49.712796 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3576/6975] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:49 2022] DELETE /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:23:49.721535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:49.722156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:49.728129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.728610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.729047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:49.729792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.730242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.730663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:49.857967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:49.865837 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dff6c362-7924-400a-a621-12e9c5f31db3 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1510 microversion: 2.1 time: 0.148147 Aug 29 16:23:49.866430 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3400/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:49 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:50.889117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:50.889836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:50.892652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:50.902651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:50.903192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:50.903651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:50.904366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:50.904840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:50.905286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:51.077206 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:51.085119 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-301b6393-f018-437f-961f-0bd26e55c620 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 200 len: 1510 microversion: 2.1 time: 0.200360 Aug 29 16:23:51.085738 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3577/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:50 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:51.479894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2a4195cf-8ea7-49f2-8da7-2ea941bdb127 req-bdf4ed0a-37b6-4f91-bc6b-5921a84aa44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91143ad-9d10-4437-a5bb-e8907cee1f79", "name": "network-vif-deleted", "tag": "ba659fd5-7ea3-4207-893e-d9db675f55f1"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:51.497290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:51.498226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:51.500935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2a4195cf-8ea7-49f2-8da7-2ea941bdb127 req-bdf4ed0a-37b6-4f91-bc6b-5921a84aa44f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:51.501814 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2a4195cf-8ea7-49f2-8da7-2ea941bdb127 req-bdf4ed0a-37b6-4f91-bc6b-5921a84aa44f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:51.502600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2a4195cf-8ea7-49f2-8da7-2ea941bdb127 req-bdf4ed0a-37b6-4f91-bc6b-5921a84aa44f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:51.523766 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2a4195cf-8ea7-49f2-8da7-2ea941bdb127 req-bdf4ed0a-37b6-4f91-bc6b-5921a84aa44f service nova] Creating event network-vif-deleted:ba659fd5-7ea3-4207-893e-d9db675f55f1 for instance d91143ad-9d10-4437-a5bb-e8907cee1f79 on n-h2-854882-3 Aug 29 16:23:51.530825 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2a4195cf-8ea7-49f2-8da7-2ea941bdb127 req-bdf4ed0a-37b6-4f91-bc6b-5921a84aa44f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054871 Aug 29 16:23:51.532647 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3401/6978] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:52.106273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:52.106908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.113781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.114287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.114740 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.115452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.115925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.116370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.129700 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] HTTP exception thrown: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Request method failure captured: Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 HTTP/1.1 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOgBmQsI3Sw8d7gZLl5MBy7_3LyvIldYDV37rLuxtRKM6M2ytKnWPbYbcHnIMmsWOdCstYDosZ7UMnBp1MNEy2IvMJ0wZgR74NOWBRwXhnRhYagqiw7Ao2QyfdNrNwUeVdyI72AM9njk4uuu8CpEHfWAELQZAHFWuZf4YcR6DciytM8 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_355a0e654a9f48558ccf4099ea929f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}] Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 92e7fdc4bd894d9eb9ee25e461be8103 Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'd91143ad-9d10-4437-a5bb-e8907cee1f79'} Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:52.131349 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Returning 404 to user: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-129bedc3-ab53-40d8-88b6-6e3116091dab tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 404 len: 111 microversion: 2.1 time: 0.030490 Aug 29 16:23:52.136480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3578/6979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:52 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:52.142840 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:52.143545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.150427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.150905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.151340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.152030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.152483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.152915 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.283467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:52.291351 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e64ec037-d74a-4351-a730-bd853207aa48 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1504 microversion: 2.1 time: 0.152795 Aug 29 16:23:52.291934 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3402/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:52 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:52.311779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f6c9424-d420-4440-82ba-141271108457 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:52.314202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9f6c9424-d420-4440-82ba-141271108457 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: b6558176-8aae-4103-8c55-3a277d3f0991] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.319721 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-9f6c9424-d420-4440-82ba-141271108457 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] HTTP exception thrown: Instance b6558176-8aae-4103-8c55-3a277d3f0991 could not be found. Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f6c9424-d420-4440-82ba-141271108457 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Request method failure captured: Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/b6558176-8aae-4103-8c55-3a277d3f0991/action HTTP/1.1 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 32 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOgBmQsI3Sw8d7gZLl5MBy7_3LyvIldYDV37rLuxtRKM6M2ytKnWPbYbcHnIMmsWOdCstYDosZ7UMnBp1MNEy2IvMJ0wZgR74NOWBRwXhnRhYagqiw7Ao2QyfdNrNwUeVdyI72AM9njk4uuu8CpEHfWAELQZAHFWuZf4YcR6DciytM8 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_355a0e654a9f48558ccf4099ea929f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}] Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 92e7fdc4bd894d9eb9ee25e461be8103 Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: {"resize": {"flavorRef": "452"}} Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance b6558176-8aae-4103-8c55-3a277d3f0991 could not be found. Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b6558176-8aae-4103-8c55-3a277d3f0991', 'body': {'resize': {'flavorRef': '452'}}} Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6558176-8aae-4103-8c55-3a277d3f0991 could not be found. Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:52.321823 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6558176-8aae-4103-8c55-3a277d3f0991 could not be found. Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6558176-8aae-4103-8c55-3a277d3f0991 could not be found. Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9f6c9424-d420-4440-82ba-141271108457 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Returning 404 to user: Instance b6558176-8aae-4103-8c55-3a277d3f0991 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9f6c9424-d420-4440-82ba-141271108457 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "POST /compute/v2.1/servers/b6558176-8aae-4103-8c55-3a277d3f0991/action" status: 404 len: 111 microversion: 2.1 time: 0.015759 Aug 29 16:23:52.326216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3579/6981] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:23:52 2022] POST /compute/v2.1/servers/b6558176-8aae-4103-8c55-3a277d3f0991/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:52.331471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:52.332084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.338644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.339115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.339545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.340221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.340665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.341085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.470590 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:52.478237 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c1856d23-2f8a-4106-ae0e-c4d69a11cd7b tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1504 microversion: 2.1 time: 0.150539 Aug 29 16:23:52.478804 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3403/6982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:52 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:23:52.499151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:52.499790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.506929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.507439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.508552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.509276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.509784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.510261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.639587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:52.647499 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-24d308f1-7390-440f-bdf3-6b3903a729cf tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1504 microversion: 2.1 time: 0.152293 Aug 29 16:23:52.648072 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3580/6983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:52 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:52.667753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f8f18c99-52f6-4352-a25e-3f8a1be5b56d"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:52.670034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.676744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.677223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.677702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.678391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.678849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.679269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.712540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:52.717661 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] HTTP exception thrown: Flavor f8f18c99-52f6-4352-a25e-3f8a1be5b56d could not be found. Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Request method failure captured: Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: request: POST /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf/action HTTP/1.1 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 65 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOgBmQsI3Sw8d7gZLl5MBy7_3LyvIldYDV37rLuxtRKM6M2ytKnWPbYbcHnIMmsWOdCstYDosZ7UMnBp1MNEy2IvMJ0wZgR74NOWBRwXhnRhYagqiw7Ao2QyfdNrNwUeVdyI72AM9njk4uuu8CpEHfWAELQZAHFWuZf4YcR6DciytM8 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_355a0e654a9f48558ccf4099ea929f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}] Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 92e7fdc4bd894d9eb9ee25e461be8103 Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: {"resize": {"flavorRef": "f8f18c99-52f6-4352-a25e-3f8a1be5b56d"}} Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: exception: Flavor f8f18c99-52f6-4352-a25e-3f8a1be5b56d could not be found. Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf', 'body': {'resize': {'flavorRef': 'f8f18c99-52f6-4352-a25e-3f8a1be5b56d'}}} Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:52.719589 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f8f18c99-52f6-4352-a25e-3f8a1be5b56d could not be found. Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f8f18c99-52f6-4352-a25e-3f8a1be5b56d could not be found. Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f8f18c99-52f6-4352-a25e-3f8a1be5b56d could not be found. Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Returning 400 to user: Flavor f8f18c99-52f6-4352-a25e-3f8a1be5b56d could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e80d0300-527c-4d65-a46d-df4da17cab19 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "POST /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf/action" status: 400 len: 107 microversion: 2.1 time: 0.057385 Aug 29 16:23:52.724690 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3404/6984] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:23:52 2022] POST /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf/action => generated 107 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:23:52.732012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:52.732656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.738810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.739315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.739767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.740555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.741031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.741508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.873060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:52.880831 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2558893d-7aa7-474f-b791-1ad72fbda8b6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1504 microversion: 2.1 time: 0.152661 Aug 29 16:23:52.881427 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3581/6985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:52 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:52.901897 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:52.902563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.908522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.908994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.909449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.910135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.910578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.910994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.038361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:53.046672 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9b210d33-523d-408d-881b-6f2ae8777520 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1504 microversion: 2.1 time: 0.148676 Aug 29 16:23:53.047236 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3405/6986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:52 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:53.067430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a5a11723-321c-4e1a-9642-0375a73ef910 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a5a11723-321c-4e1a-9642-0375a73ef910 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Request method failure captured: Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: request: POST /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf/action HTTP/1.1 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 29 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOgBmQsI3Sw8d7gZLl5MBy7_3LyvIldYDV37rLuxtRKM6M2ytKnWPbYbcHnIMmsWOdCstYDosZ7UMnBp1MNEy2IvMJ0wZgR74NOWBRwXhnRhYagqiw7Ao2QyfdNrNwUeVdyI72AM9njk4uuu8CpEHfWAELQZAHFWuZf4YcR6DciytM8 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_355a0e654a9f48558ccf4099ea929f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}] Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 92e7fdc4bd894d9eb9ee25e461be8103 Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: {"resize": {"flavorRef": ""}} Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf', 'body': {'resize': {'flavorRef': ''}}} Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise error Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi '' Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.075945 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a5a11723-321c-4e1a-9642-0375a73ef910 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a5a11723-321c-4e1a-9642-0375a73ef910 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "POST /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf/action" status: 400 len: 113 microversion: 2.1 time: 0.013992 Aug 29 16:23:53.080617 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3582/6987] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:23:53 2022] POST /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf/action => generated 113 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:23:53.085947 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:53.086560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:53.092516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.092989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.093442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.094124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.094569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.094989 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.308807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:53.316733 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d72bfa0-db42-4dbc-882c-5d1af6272890 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1504 microversion: 2.1 time: 0.234524 Aug 29 16:23:53.317309 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3406/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:53 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:53.340717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:53.341233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:53.348377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.348881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.349337 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.350071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.350544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.350992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.364830 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] HTTP exception thrown: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Request method failure captured: Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 HTTP/1.1 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOgBmQsI3Sw8d7gZLl5MBy7_3LyvIldYDV37rLuxtRKM6M2ytKnWPbYbcHnIMmsWOdCstYDosZ7UMnBp1MNEy2IvMJ0wZgR74NOWBRwXhnRhYagqiw7Ao2QyfdNrNwUeVdyI72AM9njk4uuu8CpEHfWAELQZAHFWuZf4YcR6DciytM8 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_355a0e654a9f48558ccf4099ea929f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}] Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 92e7fdc4bd894d9eb9ee25e461be8103 Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'd91143ad-9d10-4437-a5bb-e8907cee1f79'} Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:53.366428 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Returning 404 to user: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a9fc0780-d5f7-404b-bc3a-60ffec41ac26 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 404 len: 111 microversion: 2.1 time: 0.032096 Aug 29 16:23:53.371513 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3583/6989] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:53 2022] DELETE /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:53.376409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:53.377050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: d91143ad-9d10-4437-a5bb-e8907cee1f79] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:53.383071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.383544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.383981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.384653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.385098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.385544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.399529 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] HTTP exception thrown: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Request method failure captured: Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 HTTP/1.1 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOgBmQsI3Sw8d7gZLl5MBy7_3LyvIldYDV37rLuxtRKM6M2ytKnWPbYbcHnIMmsWOdCstYDosZ7UMnBp1MNEy2IvMJ0wZgR74NOWBRwXhnRhYagqiw7Ao2QyfdNrNwUeVdyI72AM9njk4uuu8CpEHfWAELQZAHFWuZf4YcR6DciytM8 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_355a0e654a9f48558ccf4099ea929f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}] Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 92e7fdc4bd894d9eb9ee25e461be8103 Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd91143ad-9d10-4437-a5bb-e8907cee1f79'} Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:53.401079 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Returning 404 to user: Instance d91143ad-9d10-4437-a5bb-e8907cee1f79 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d1d2135-5772-448c-8a29-5a517a3303e6 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79" status: 404 len: 111 microversion: 2.1 time: 0.029897 Aug 29 16:23:53.405574 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3407/6990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:53 2022] GET /compute/v2.1/servers/d91143ad-9d10-4437-a5bb-e8907cee1f79 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:53.410812 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:53.411330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:53.417990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.418486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.418939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.419646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.420116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.420555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.445846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:23:53.494987 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:53.522465 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bac9ebbe-182c-465b-a3c7-6c721f269985 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 204 len: 0 microversion: 2.1 time: 0.115118 Aug 29 16:23:53.525481 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3584/6991] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:53 2022] DELETE /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:23:53.532971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:53.533668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:53.541435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.541843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.542279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.542976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.543429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.543854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.672213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:53.676553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=100 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:53.681736 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b13d72ee-528d-4796-b522-089fadaed03d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1510 microversion: 2.1 time: 0.153729 Aug 29 16:23:53.682300 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3408/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:53 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:23:54.703316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:54.703965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:54.711347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:54.711849 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:54.712306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:54.713017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:54.713526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:54.713975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:54.846804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e7fdc4bd894d9eb9ee25e461be8103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a0e654a9f48558ccf4099ea929f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:54.855285 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4698d2c7-da16-437a-ac8a-919d2faf415d tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 200 len: 1510 microversion: 2.1 time: 0.156385 Aug 29 16:23:54.855864 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3585/6993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:54 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:55.365322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8d115100-247f-4d67-aaa1-d198bc72ec9f req-c69e83ce-c5ac-430c-83d4-d3740de841de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf", "name": "network-vif-deleted", "tag": "5e1e5a8c-0c85-4ac0-9a65-8b4efcf5d6de"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:55.377491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d115100-247f-4d67-aaa1-d198bc72ec9f req-c69e83ce-c5ac-430c-83d4-d3740de841de service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:55.378250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d115100-247f-4d67-aaa1-d198bc72ec9f req-c69e83ce-c5ac-430c-83d4-d3740de841de service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:55.378690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d115100-247f-4d67-aaa1-d198bc72ec9f req-c69e83ce-c5ac-430c-83d4-d3740de841de service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.391768 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8d115100-247f-4d67-aaa1-d198bc72ec9f req-c69e83ce-c5ac-430c-83d4-d3740de841de service nova] Creating event network-vif-deleted:5e1e5a8c-0c85-4ac0-9a65-8b4efcf5d6de for instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf on n-h1-854882-3 Aug 29 16:23:55.398001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8d115100-247f-4d67-aaa1-d198bc72ec9f req-c69e83ce-c5ac-430c-83d4-d3740de841de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036359 Aug 29 16:23:55.399833 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3409/6994] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:55.876421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:55.877060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] [instance: c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:55.884185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:55.884920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:55.885394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.886143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:55.886619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:55.887069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.903121 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] HTTP exception thrown: Instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf could not be found. Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Request method failure captured: Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf HTTP/1.1 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOgBmQsI3Sw8d7gZLl5MBy7_3LyvIldYDV37rLuxtRKM6M2ytKnWPbYbcHnIMmsWOdCstYDosZ7UMnBp1MNEy2IvMJ0wZgR74NOWBRwXhnRhYagqiw7Ao2QyfdNrNwUeVdyI72AM9njk4uuu8CpEHfWAELQZAHFWuZf4YcR6DciytM8 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/355a0e654a9f48558ccf4099ea929f86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_355a0e654a9f48558ccf4099ea929f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/355a0e654a9f48558ccf4099ea929f86"}]}] Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 355a0e654a9f48558ccf4099ea929f86 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835162637 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 92e7fdc4bd894d9eb9ee25e461be8103 Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-ServersNegativeTestJSON-1835162637-project Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf could not be found. Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf'} Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf could not be found. Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf could not be found. Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:55.905282 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf could not be found. Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] Returning 404 to user: Instance c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d6e76d1-ccdc-40ee-979d-cbac68aa43c0 tempest-ServersNegativeTestJSON-1835162637 tempest-ServersNegativeTestJSON-1835162637-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf" status: 404 len: 111 microversion: 2.1 time: 0.034544 Aug 29 16:23:55.909291 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3586/6995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:55 2022] GET /compute/v2.1/servers/c4ddd3ad-a30d-4b22-8bf6-fac88c7495bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:24:26.312578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.313321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.510670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8232a4e7-553b-436f-aed6-2f8b97a59e90 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: .version_select at 0x7fb0e211bd30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1842302395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDNVzb6qzOhBQjHDFw+HOcc61R4n54a+fRonb2dlOq33Nvg/aOTtJvWt4pWNQwfAe0wbvDDmNr50z1YVvUwRMUVnLsQYf2fa97VP81mOi+uDKnJDYNMF9W8jCBfEuGTpg=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:26.530134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8232a4e7-553b-436f-aed6-2f8b97a59e90 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for project 8445c72633d149218d47aaf80e16ae99. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:24:26.536168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-8232a4e7-553b-436f-aed6-2f8b97a59e90 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for user 8ca581ef43c64b32b74341b6dd402200 and project 8445c72633d149218d47aaf80e16ae99. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:24:26.566506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8232a4e7-553b-436f-aed6-2f8b97a59e90 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.256162 Aug 29 16:24:26.567721 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3410/6996] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:24:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:26.622659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1818120257", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1842302395", "networks": [{"uuid": "dd21d1c9-ad25-4d61-81ef-ebcdd67535f6"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:26.632542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.632883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.945931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] validate_networks() for [('dd21d1c9-ad25-4d61-81ef-ebcdd67535f6', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:24:27.355142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:24:27.355581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:24:27.356077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:24:27.356504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:24:27.356935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:24:27.371843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:27.372343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:27.372795 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:27.373620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:27.374091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:27.374538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:27.393028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for project 8445c72633d149218d47aaf80e16ae99. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:24:27.405851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for user 8ca581ef43c64b32b74341b6dd402200 and project 8445c72633d149218d47aaf80e16ae99. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:24:27.419687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:24:27.422130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:24:27.476084 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8edb3961-5763-4c86-88de-14485521c2e0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857028 Aug 29 16:24:27.481164 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3587/6997] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:24:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:24:27.490126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-955179c3-b467-4243-bc00-fc255c537a3f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:27.491418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-955179c3-b467-4243-bc00-fc255c537a3f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:27.556508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-955179c3-b467-4243-bc00-fc255c537a3f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:27.564993 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-955179c3-b467-4243-bc00-fc255c537a3f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1263 microversion: 2.1 time: 0.081382 Aug 29 16:24:27.575120 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3411/6998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:27 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:28.589717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:28.590498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:28.599183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:28.599680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:28.600136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:28.601456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:28.607025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:28.607829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:28.704755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:28.713509 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d3f8ad7-f415-479f-9e8b-e58a9306fd15 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1323 microversion: 2.1 time: 0.131592 Aug 29 16:24:28.714097 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3588/6999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:28 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1323 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:29.736792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:29.738498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:29.747193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:29.748307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:29.748951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:29.749991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:29.750644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:29.751285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:29.988274 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:29.997588 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5671c5f9-f09c-4293-a914-be5236f055e7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1363 microversion: 2.1 time: 0.264955 Aug 29 16:24:29.998253 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3412/7000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:29 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:30.552219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9bcd0a90-57d6-43fa-8ed3-24e54aacdd2c req-41be0159-6dce-4f72-8ceb-81f386456bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea3eba3-be4d-42da-a71c-c302bc4e5ebf", "tag": "75a1d73f-4774-4e8f-a747-661ed0364e5a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:30.570533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9bcd0a90-57d6-43fa-8ed3-24e54aacdd2c req-41be0159-6dce-4f72-8ceb-81f386456bfa service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:30.571427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9bcd0a90-57d6-43fa-8ed3-24e54aacdd2c req-41be0159-6dce-4f72-8ceb-81f386456bfa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:30.572231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9bcd0a90-57d6-43fa-8ed3-24e54aacdd2c req-41be0159-6dce-4f72-8ceb-81f386456bfa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:30.589138 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9bcd0a90-57d6-43fa-8ed3-24e54aacdd2c req-41be0159-6dce-4f72-8ceb-81f386456bfa service nova] Creating event network-changed:75a1d73f-4774-4e8f-a747-661ed0364e5a for instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf on n-h1-854882-3 Aug 29 16:24:30.595068 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9bcd0a90-57d6-43fa-8ed3-24e54aacdd2c req-41be0159-6dce-4f72-8ceb-81f386456bfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051722 Aug 29 16:24:30.596273 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3589/7001] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:31.019295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:31.020056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:31.028009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:31.028570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:31.029008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:31.029728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:31.030173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:31.030592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:31.160451 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:31.168421 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-14f0d1f5-8273-4df8-8f7a-3ac012d533ef tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1363 microversion: 2.1 time: 0.153073 Aug 29 16:24:31.169033 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3413/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:31 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:32.191025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:32.191744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:32.198700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:32.199204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:32.199656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:32.200365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:32.200838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:32.201279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:32.331220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:32.339159 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a837dea4-4b63-4854-be11-8c3371c4ed60 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1363 microversion: 2.1 time: 0.153371 Aug 29 16:24:32.339764 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3590/7003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:32 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:33.359416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:33.360044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:33.367641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:33.368128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:33.368567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:33.369263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:33.369769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:33.370178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:33.509506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:33.517129 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67d00c60-a86a-44ae-8f8a-eaa0cb7cc2c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1363 microversion: 2.1 time: 0.161721 Aug 29 16:24:33.517733 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3414/7004] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:33 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:34.540741 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:34.541289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:34.548500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:34.549002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:34.549483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:34.550211 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:34.550687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:34.551145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:34.687968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:34.696332 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab502c5d-38e5-4841-a7dc-6c2c1e1df48d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1363 microversion: 2.1 time: 0.159928 Aug 29 16:24:34.696909 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3591/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:34 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:35.717326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:35.717980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:35.724931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:35.725959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:35.726409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:35.727099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:35.727554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:35.727981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:35.859657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:35.867871 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5db7f794-e4d6-4aa5-8cb1-f0fa220f5430 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1363 microversion: 2.1 time: 0.154554 Aug 29 16:24:35.868460 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3415/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:35 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:36.365005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-dfb7ce0c-ddf1-48e8-b550-03ee2dd559b2 req-090866de-bf79-4fac-8113-9c985a5e0a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea3eba3-be4d-42da-a71c-c302bc4e5ebf", "name": "network-vif-plugged", "status": "completed", "tag": "75a1d73f-4774-4e8f-a747-661ed0364e5a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:36.374665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dfb7ce0c-ddf1-48e8-b550-03ee2dd559b2 req-090866de-bf79-4fac-8113-9c985a5e0a51 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:36.375161 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dfb7ce0c-ddf1-48e8-b550-03ee2dd559b2 req-090866de-bf79-4fac-8113-9c985a5e0a51 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:36.375608 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-dfb7ce0c-ddf1-48e8-b550-03ee2dd559b2 req-090866de-bf79-4fac-8113-9c985a5e0a51 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:36.386924 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-dfb7ce0c-ddf1-48e8-b550-03ee2dd559b2 req-090866de-bf79-4fac-8113-9c985a5e0a51 service nova] Creating event network-vif-plugged:75a1d73f-4774-4e8f-a747-661ed0364e5a for instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf on n-h1-854882-3 Aug 29 16:24:36.391790 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-dfb7ce0c-ddf1-48e8-b550-03ee2dd559b2 req-090866de-bf79-4fac-8113-9c985a5e0a51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085605 Aug 29 16:24:36.392374 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3592/7007] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:36.888788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:36.889426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:36.896352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:36.896830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:36.897266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:36.897985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:36.898505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:36.898927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:37.027045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:37.034642 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73302ff1-4171-4449-bb4f-aadcabbc1674 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1363 microversion: 2.1 time: 0.149778 Aug 29 16:24:37.035221 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3416/7008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:36 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:38.055692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:38.056457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:38.060961 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:38.061739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:38.068895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:38.069457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:38.069916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:38.070619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:38.071091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:38.071534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:38.203853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:38.212164 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-22d3957a-044a-4540-a808-1746878952cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1556 microversion: 2.1 time: 0.159708 Aug 29 16:24:38.212746 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3593/7009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:38 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:38.232521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:38.233136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:38.235000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:38.241751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:38.242226 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:38.242653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:38.243331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:38.243777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:38.244195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:38.374625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:38.382942 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5133f4a2-324d-47d3-9a10-cf7aa7ec50cb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1556 microversion: 2.1 time: 0.154346 Aug 29 16:24:38.383525 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3417/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:38 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:40.048764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a3dbb8-358e-4290-99fe-623a952459fe"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:40.051165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:40.059633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:40.060132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:40.060582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:40.061288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:40.061785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:40.062217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:40.306372 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aca87f2f-202b-47bc-b250-f5ed42887ad1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261205 Aug 29 16:24:40.307020 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3594/7011] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:24:40 2022] POST /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:51.003242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:51.003739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:51.006201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:51.007045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=36 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:51.014502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:51.014980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:51.015411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:51.016095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:51.016539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:51.016958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:51.096757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lazy-loading 'services' on Instance uuid eea3eba3-be4d-42da-a71c-c302bc4e5ebf {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:24:51.166922 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7981fe4a-a7c6-4451-8be4-dfac916bb1c6 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments/23a3dbb8-358e-4290-99fe-623a952459fe" status: 202 len: 0 microversion: 2.1 time: 0.167569 Aug 29 16:24:51.167540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3418/7012] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:24:50 2022] DELETE /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments/23a3dbb8-358e-4290-99fe-623a952459fe => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:24:51.176289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:51.178737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:51.184101 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:51.185106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:51.190883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:51.191395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:51.191876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:51.193052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:51.193052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:51.193547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:51.227956 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e4cc27a9-b3f6-493d-abd6-a2fa1901c816 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055908 Aug 29 16:24:51.228520 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3595/7013] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:24:51 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:52.241663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:52.244597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:52.250913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:52.251390 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:52.251823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:52.252511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:52.252958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:52.253379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:52.282819 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4ca79074-5e71-4969-9939-8d88bdbdc2df tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046368 Aug 29 16:24:52.283387 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3419/7014] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:24:52 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:53.296001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:53.298256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:53.305009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:53.305550 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:53.306017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:53.306738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:53.307214 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:53.307662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:53.338950 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-79a02215-4085-4c93-b883-1088e9e55ec8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047115 Aug 29 16:24:53.339513 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3596/7015] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:24:53 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:54.351259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:54.353446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:54.360360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.360842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.361275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.361981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.362428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.362848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.392576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-76110097-4bde-427e-ad6d-76645e9b1cf1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Aug 29 16:24:54.393150 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3420/7016] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:24:54 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:55.404907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:55.407208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:55.415104 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:55.415607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:55.416067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:55.416791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:55.417304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:55.417778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:55.450282 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0729f477-a5ec-4b60-8b58-26635683c6f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049347 Aug 29 16:24:55.450862 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3597/7017] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:24:55 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:56.461996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:56.464200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:56.472188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:56.472848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:56.473479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:56.474462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:56.475114 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:56.475893 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:56.509549 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-df3e351b-70cc-40d8-b2fb-168c73fbce98 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052033 Aug 29 16:24:56.510110 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3421/7018] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:24:56 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:24:56.520925 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:56.521468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:56.529418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:56.529916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:56.530369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:56.531083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:56.531556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:56.532003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:56.608792 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] HTTP exception thrown: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf is not attached to volume 23a3dbb8-358e-4290-99fe-623a952459fe Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Request method failure captured: Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments/23a3dbb8-358e-4290-99fe-623a952459fe HTTP/1.1 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOg1bI2_bqEXEfEu1e7ZuHSvl42f7DkmtGPt7f5duTUNY-unyk9qRmhpIfAtYIQjYT40OodYC2yMoh9pJyY5wFt2SNPMejjj6s5Scz_p1pWF_Wz-MZI0KQr3gXYnX9bAlJ3wjcG6CNMy0LnzhYDd0suhJlYqYB1C9-eFb6E6u3Uv2X0 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8445c72633d149218d47aaf80e16ae99", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}] Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8ca581ef43c64b32b74341b6dd402200 Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf is not attached to volume 23a3dbb8-358e-4290-99fe-623a952459fe Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': 'eea3eba3-be4d-42da-a71c-c302bc4e5ebf', 'id': '23a3dbb8-358e-4290-99fe-623a952459fe'} Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 23a3dbb8-358e-4290-99fe-623a952459fe. Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf is not attached to volume 23a3dbb8-358e-4290-99fe-623a952459fe Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:56.614723 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:56.619385 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:56.619385 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:56.619385 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf is not attached to volume 23a3dbb8-358e-4290-99fe-623a952459fe Aug 29 16:24:56.619385 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:24:56.619385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Returning 404 to user: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf is not attached to volume 23a3dbb8-358e-4290-99fe-623a952459fe {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:56.619385 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f6b95cc-8a01-4311-b9d3-58fc92b6ba19 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments/23a3dbb8-358e-4290-99fe-623a952459fe" status: 404 len: 154 microversion: 2.1 time: 0.099389 Aug 29 16:24:56.619385 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3598/7019] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:24:56 2022] DELETE /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf/os-volume_attachments/23a3dbb8-358e-4290-99fe-623a952459fe => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:24:59.970214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:59.971197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:59.978300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:59.978871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:59.979399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:59.980187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:59.980709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:59.981200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:00.009830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:25:00.092575 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6ef38228-d23b-4a30-9033-5a3e3a215a62 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 204 len: 0 microversion: 2.1 time: 0.126013 Aug 29 16:25:00.093571 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3422/7020] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:24:59 2022] DELETE /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:25:00.101481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:00.102142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:00.109897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:00.110400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:00.110856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:00.111577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:00.112051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:00.112498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:00.249905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:00.258135 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9093da03-fb8c-4b25-9fdf-be94159f1108 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1562 microversion: 2.1 time: 0.160582 Aug 29 16:25:00.258967 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3599/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:00 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:01.280237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:01.280972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:01.287877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:01.288355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:01.288787 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:01.289517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:01.290006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:01.290426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:01.420519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:01.428211 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-02c0b1ef-188e-4f03-9d33-12cd21768a26 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1562 microversion: 2.1 time: 0.152261 Aug 29 16:25:01.428785 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3423/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:01 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:02.264728 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3db51ba4-c2b2-4d14-9f40-b9238df13243 req-524797a6-4943-4579-a6a9-b925ea328e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea3eba3-be4d-42da-a71c-c302bc4e5ebf", "name": "network-vif-deleted", "tag": "75a1d73f-4774-4e8f-a747-661ed0364e5a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:02.274260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3db51ba4-c2b2-4d14-9f40-b9238df13243 req-524797a6-4943-4579-a6a9-b925ea328e5a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:02.274751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3db51ba4-c2b2-4d14-9f40-b9238df13243 req-524797a6-4943-4579-a6a9-b925ea328e5a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:02.275200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3db51ba4-c2b2-4d14-9f40-b9238df13243 req-524797a6-4943-4579-a6a9-b925ea328e5a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:02.286375 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3db51ba4-c2b2-4d14-9f40-b9238df13243 req-524797a6-4943-4579-a6a9-b925ea328e5a service nova] Creating event network-vif-deleted:75a1d73f-4774-4e8f-a747-661ed0364e5a for instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf on n-h1-854882-3 Aug 29 16:25:02.291465 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3db51ba4-c2b2-4d14-9f40-b9238df13243 req-524797a6-4943-4579-a6a9-b925ea328e5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086258 Aug 29 16:25:02.292060 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3600/7023] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:02.453335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:02.453954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:02.460948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:02.461471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:02.461917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:02.462633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:02.463090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:02.463518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:02.497305 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:02.499252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:02.499252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:02.499252 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lazy-loading 'fault' on Instance uuid eea3eba3-be4d-42da-a71c-c302bc4e5ebf {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:25:02.545568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:02.554491 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cb08632c-cf81-4669-bb8b-12cf37a0b006 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 200 len: 1353 microversion: 2.1 time: 0.106594 Aug 29 16:25:02.555558 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3424/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:02 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 1353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:03.578078 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:03.578799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: eea3eba3-be4d-42da-a71c-c302bc4e5ebf] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:03.585327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:03.585798 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:03.586259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:03.586970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:03.587442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:03.587885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:03.602017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] HTTP exception thrown: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf could not be found. Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Request method failure captured: Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf HTTP/1.1 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOg1bI2_bqEXEfEu1e7ZuHSvl42f7DkmtGPt7f5duTUNY-unyk9qRmhpIfAtYIQjYT40OodYC2yMoh9pJyY5wFt2SNPMejjj6s5Scz_p1pWF_Wz-MZI0KQr3gXYnX9bAlJ3wjcG6CNMy0LnzhYDd0suhJlYqYB1C9-eFb6E6u3Uv2X0 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8445c72633d149218d47aaf80e16ae99", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}] Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8ca581ef43c64b32b74341b6dd402200 Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf could not be found. Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'eea3eba3-be4d-42da-a71c-c302bc4e5ebf'} Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf could not be found. Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf could not be found. Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:03.603734 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf could not be found. Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Returning 404 to user: Instance eea3eba3-be4d-42da-a71c-c302bc4e5ebf could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d626e490-3779-46e7-973a-34b961f584b7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf" status: 404 len: 111 microversion: 2.1 time: 0.032357 Aug 29 16:25:03.608791 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3601/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:03 2022] GET /compute/v2.1/servers/eea3eba3-be4d-42da-a71c-c302bc4e5ebf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:25:03.614471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0e1bc09a-0447-4259-8ce3-8cf080bc0898 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '.version_select at 0x7fb0e3190f70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:03.638967 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0e1bc09a-0447-4259-8ce3-8cf080bc0898 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1842302395" status: 202 len: 0 microversion: 2.1 time: 0.028404 Aug 29 16:25:03.639556 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3425/7026] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 16:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1842302395 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:25:03.657573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ecec5a25-27cb-40fd-9334-8b4230c42714 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: .version_select at 0x7fb0e34e1b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1158113483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9RLAnlxiznrGFEwNICgteBTBqPNNdyA3NEVIYlEbYVs3Z5ECX5Cn8R1VdGHc2o8K1cwFEsf2NZCLmLa6RYKEblhrXbztJa/iOkmp3Y1RW/GEYYGsyj7ciAJtxZwVAL4g=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:03.673486 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-ecec5a25-27cb-40fd-9334-8b4230c42714 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for project 8445c72633d149218d47aaf80e16ae99. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:25:03.680970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-ecec5a25-27cb-40fd-9334-8b4230c42714 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for user 8ca581ef43c64b32b74341b6dd402200 and project 8445c72633d149218d47aaf80e16ae99. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:25:03.704832 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ecec5a25-27cb-40fd-9334-8b4230c42714 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051189 Aug 29 16:25:03.705539 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3602/7027] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:25:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:03.755542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-246057994", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1158113483", "networks": [{"uuid": "dd21d1c9-ad25-4d61-81ef-ebcdd67535f6"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:03.809523 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] validate_networks() for [('dd21d1c9-ad25-4d61-81ef-ebcdd67535f6', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:25:04.290498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:25:04.291015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:25:04.291595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:25:04.292103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:25:04.292583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:25:04.304116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:04.304541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:04.304978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:04.305821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:04.306276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:04.306699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:04.329348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for project 8445c72633d149218d47aaf80e16ae99. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:25:04.334681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for user 8ca581ef43c64b32b74341b6dd402200 and project 8445c72633d149218d47aaf80e16ae99. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:25:04.347866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:25:04.350227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:25:04.397260 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e3c9b3cf-b577-409e-a67f-bebadee2e1f5 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645543 Aug 29 16:25:04.398731 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3426/7028] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:25:04.409853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-febe710a-f222-422c-a0d0-e0f2d899c403 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:04.410957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-febe710a-f222-422c-a0d0-e0f2d899c403 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:04.478627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-febe710a-f222-422c-a0d0-e0f2d899c403 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:04.494207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-febe710a-f222-422c-a0d0-e0f2d899c403 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1262 microversion: 2.1 time: 0.088684 Aug 29 16:25:04.508293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3603/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:04 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:25:05.516245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:05.516942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:05.525749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:05.527303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:05.527657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:05.528743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:05.529199 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:05.529892 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:05.607557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:05.616726 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d41c4818-7905-4fec-8b6b-14d23edd34c2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1322 microversion: 2.1 time: 0.104406 Aug 29 16:25:05.617604 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3427/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:05 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1322 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:06.638064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:06.638805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:06.646006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:06.646588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:06.647143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:06.648346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:06.648817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:06.649253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:06.791810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:06.801036 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4434b0c0-8416-4997-b98c-688ceb4150d1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1362 microversion: 2.1 time: 0.166834 Aug 29 16:25:06.801821 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3604/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:06 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:06.820940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ee9ef7c2-7e1d-4d3c-8be2-67921e0d2e5e req-a30c7dd4-b767-4f23-a7b2-61e5b48b1435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22437f68-dfd8-4cdd-b56d-eb1cf7120654", "tag": "d1664197-29cf-400f-a904-bea6b3996a71"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:06.832010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ee9ef7c2-7e1d-4d3c-8be2-67921e0d2e5e req-a30c7dd4-b767-4f23-a7b2-61e5b48b1435 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:06.832482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ee9ef7c2-7e1d-4d3c-8be2-67921e0d2e5e req-a30c7dd4-b767-4f23-a7b2-61e5b48b1435 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:06.832924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ee9ef7c2-7e1d-4d3c-8be2-67921e0d2e5e req-a30c7dd4-b767-4f23-a7b2-61e5b48b1435 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:06.849327 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ee9ef7c2-7e1d-4d3c-8be2-67921e0d2e5e req-a30c7dd4-b767-4f23-a7b2-61e5b48b1435 service nova] Creating event network-changed:d1664197-29cf-400f-a904-bea6b3996a71 for instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 on n-h1-854882-3 Aug 29 16:25:06.854840 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ee9ef7c2-7e1d-4d3c-8be2-67921e0d2e5e req-a30c7dd4-b767-4f23-a7b2-61e5b48b1435 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037567 Aug 29 16:25:06.855664 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3428/7032] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:07.823758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:07.824336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:07.831285 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:07.831786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:07.832240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:07.832949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:07.833449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:07.833897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:07.966289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:07.973966 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bb5f963c-2fa1-42dd-942b-16cd97328379 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1362 microversion: 2.1 time: 0.154814 Aug 29 16:25:07.974551 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3605/7033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:07 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:08.996644 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:08.997349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:09.003574 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:09.004051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:09.004485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:09.005173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:09.005652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:09.006078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:09.139101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:09.146748 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aacb5523-94a6-4bc3-aff5-872829ddd281 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1362 microversion: 2.1 time: 0.155670 Aug 29 16:25:09.147323 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3429/7034] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:08 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:10.167836 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:10.168421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:10.174979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:10.175491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:10.175947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:10.176668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:10.177148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:10.177800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:10.308963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:10.317125 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2862204d-a8df-4202-a31b-c4de9be8f19d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1362 microversion: 2.1 time: 0.153551 Aug 29 16:25:10.317739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3606/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:10 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:11.338524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:11.339149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:11.346110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:11.346600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:11.347042 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:11.347743 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:11.348200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:11.348629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:11.482348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:11.489995 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5576c140-7c04-42e0-8ea5-99db1f950f7b tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1362 microversion: 2.1 time: 0.155548 Aug 29 16:25:11.490573 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3430/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:11 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:12.285264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7219ac6d-b280-4d20-9d6b-00f5cf01f6c1 req-11a75538-c0cb-4ddf-ad11-2ca7fff5eb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22437f68-dfd8-4cdd-b56d-eb1cf7120654", "name": "network-vif-plugged", "status": "completed", "tag": "d1664197-29cf-400f-a904-bea6b3996a71"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:12.297847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7219ac6d-b280-4d20-9d6b-00f5cf01f6c1 req-11a75538-c0cb-4ddf-ad11-2ca7fff5eb44 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:12.298386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7219ac6d-b280-4d20-9d6b-00f5cf01f6c1 req-11a75538-c0cb-4ddf-ad11-2ca7fff5eb44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:12.298872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7219ac6d-b280-4d20-9d6b-00f5cf01f6c1 req-11a75538-c0cb-4ddf-ad11-2ca7fff5eb44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:12.311494 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7219ac6d-b280-4d20-9d6b-00f5cf01f6c1 req-11a75538-c0cb-4ddf-ad11-2ca7fff5eb44 service nova] Creating event network-vif-plugged:d1664197-29cf-400f-a904-bea6b3996a71 for instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 on n-h1-854882-3 Aug 29 16:25:12.316455 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7219ac6d-b280-4d20-9d6b-00f5cf01f6c1 req-11a75538-c0cb-4ddf-ad11-2ca7fff5eb44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 Aug 29 16:25:12.317256 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3607/7037] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:12.511172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:12.511789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:12.518756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:12.519236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:12.519669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:12.520352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:12.520803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:12.521231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:12.661819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:12.670142 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-92f904c6-68d3-4689-a36b-8062f7433417 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1362 microversion: 2.1 time: 0.162798 Aug 29 16:25:12.670687 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3431/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:12 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:13.696151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:13.696871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:13.703941 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.704440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.704890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:13.705618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.706090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.706531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:13.836671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:13.844399 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eb24fad4-d907-4dbc-ba37-5d1a1734f7bb tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1554 microversion: 2.1 time: 0.153212 Aug 29 16:25:13.844988 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3608/7039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:13 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:13.865047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:13.865696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:13.873009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.873504 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.873936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:13.874621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.875068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.875487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:14.003912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:14.011595 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-456e72b7-13e6-4e9a-a66c-8ac993208ac3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1554 microversion: 2.1 time: 0.150482 Aug 29 16:25:14.012170 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3432/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:13 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:25:15.514685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "725aeae0-ce92-4f74-bbbb-3a306f65d2ae"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:15.517001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:15.519026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:15.525604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.526105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.526799 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.527487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.528025 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.528477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.776236 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4846ebe0-0379-4c11-a0d1-6fc862db6e77 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265467 Aug 29 16:25:15.777065 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3609/7041] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:25:15 2022] POST /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:26.473681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:26.474164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:26.476652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:26.477318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:26.478653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:26.479461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:26.487190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:26.487703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:26.488133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:26.488824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:26.489272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:26.489721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:26.579851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lazy-loading 'services' on Instance uuid 22437f68-dfd8-4cdd-b56d-eb1cf7120654 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:25:26.650032 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0da799ae-da2a-42da-9b06-985a9fb5eb27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments/725aeae0-ce92-4f74-bbbb-3a306f65d2ae" status: 202 len: 0 microversion: 2.1 time: 0.180120 Aug 29 16:25:26.650711 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3433/7042] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:25:26 2022] DELETE /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments/725aeae0-ce92-4f74-bbbb-3a306f65d2ae => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:25:26.657318 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:26.658744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:26.664294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:26.666869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:26.676215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:26.676716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:26.677158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:26.677897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:26.678997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:26.679425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:26.711183 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b30032a5-855a-4d73-a63f-0a87068373b3 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055677 Aug 29 16:25:26.711744 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3610/7043] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:25:26 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:27.724725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:27.727278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:27.734438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:27.734438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:27.734679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:27.735421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:27.735877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:27.736302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:27.767691 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36c0e0a1-9de9-4d94-a98f-48245a432465 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Aug 29 16:25:27.768272 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3434/7044] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:25:27 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:28.780008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:28.782237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:28.790024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:28.790531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:28.790983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:28.791695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:28.792163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:28.792601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:28.823694 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8fdc0a66-19df-4922-8f5f-6b827781a31f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047621 Aug 29 16:25:28.824357 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3611/7045] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:25:28 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:29.837489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:29.839691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:29.846612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:29.847094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:29.847531 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:29.848230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:29.848713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:29.849137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:29.883845 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eacc881f-1933-4373-91a7-1ca3c0d261c8 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051713 Aug 29 16:25:29.884421 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3435/7046] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:25:29 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:30.896152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:30.898979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:30.906116 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:30.906625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:30.907064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:30.907768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:30.908234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:30.908672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:30.940496 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83d14fe5-fb33-4360-98ea-d066a9af14da tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048292 Aug 29 16:25:30.941072 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3612/7047] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:25:30 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:31.952741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:31.954894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:31.961730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:31.962203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:31.962631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:31.963310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:31.963755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:31.964174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:31.993810 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-917f5059-4f27-4699-aec3-a0020e8830f9 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045150 Aug 29 16:25:31.994373 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3436/7048] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:25:31 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:25:32.004699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:32.005220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:32.012159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:32.012663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:32.013127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:32.013871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:32.014348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:32.014797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:32.091678 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] HTTP exception thrown: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 is not attached to volume 725aeae0-ce92-4f74-bbbb-3a306f65d2ae Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Request method failure captured: Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments/725aeae0-ce92-4f74-bbbb-3a306f65d2ae HTTP/1.1 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOg1bI2_bqEXEfEu1e7ZuHSvl42f7DkmtGPt7f5duTUNY-unyk9qRmhpIfAtYIQjYT40OodYC2yMoh9pJyY5wFt2SNPMejjj6s5Scz_p1pWF_Wz-MZI0KQr3gXYnX9bAlJ3wjcG6CNMy0LnzhYDd0suhJlYqYB1C9-eFb6E6u3Uv2X0 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8445c72633d149218d47aaf80e16ae99", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}] Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8ca581ef43c64b32b74341b6dd402200 Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 is not attached to volume 725aeae0-ce92-4f74-bbbb-3a306f65d2ae Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': '22437f68-dfd8-4cdd-b56d-eb1cf7120654', 'id': '725aeae0-ce92-4f74-bbbb-3a306f65d2ae'} Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 725aeae0-ce92-4f74-bbbb-3a306f65d2ae. Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 is not attached to volume 725aeae0-ce92-4f74-bbbb-3a306f65d2ae Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:32.093307 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:32.097435 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:25:32.097435 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:25:32.097435 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 is not attached to volume 725aeae0-ce92-4f74-bbbb-3a306f65d2ae Aug 29 16:25:32.097435 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:32.097435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Returning 404 to user: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 is not attached to volume 725aeae0-ce92-4f74-bbbb-3a306f65d2ae {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:25:32.097435 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0203c04e-52f3-4872-b8e7-eb31295a2d21 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments/725aeae0-ce92-4f74-bbbb-3a306f65d2ae" status: 404 len: 154 microversion: 2.1 time: 0.094151 Aug 29 16:25:32.097435 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3613/7049] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:25:31 2022] DELETE /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654/os-volume_attachments/725aeae0-ce92-4f74-bbbb-3a306f65d2ae => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:25:35.449032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:35.449631 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:35.457123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:35.458292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:35.460113 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:35.460495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:35.461009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:35.461747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:35.489632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:25:35.574346 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-83790634-6317-4697-8464-1ddb8664f463 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 204 len: 0 microversion: 2.1 time: 0.128826 Aug 29 16:25:35.575198 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3437/7050] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:25:35 2022] DELETE /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:25:35.583856 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:35.585418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:35.593704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:35.594507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:35.594988 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:35.595838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:35.596324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:35.596940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:35.737579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:35.745513 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f81cc89-f6da-44c9-a8f7-734969a31a4d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1560 microversion: 2.1 time: 0.165696 Aug 29 16:25:35.746106 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3614/7051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:35 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:36.767980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:36.768817 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:36.776296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:36.776781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:36.777221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:36.777964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:36.778430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:36.778862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:36.914570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:36.922413 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-72e8d855-47cd-4586-a375-75bc14137782 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1560 microversion: 2.1 time: 0.158777 Aug 29 16:25:36.922982 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3438/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:36 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:37.633218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3427f43d-d9e7-40fb-84f7-44b58bf44fc7 req-166c15e1-fd33-4d54-8df6-b59edcd142e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22437f68-dfd8-4cdd-b56d-eb1cf7120654", "name": "network-vif-deleted", "tag": "d1664197-29cf-400f-a904-bea6b3996a71"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:37.644508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3427f43d-d9e7-40fb-84f7-44b58bf44fc7 req-166c15e1-fd33-4d54-8df6-b59edcd142e3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:37.645112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3427f43d-d9e7-40fb-84f7-44b58bf44fc7 req-166c15e1-fd33-4d54-8df6-b59edcd142e3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:37.645777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3427f43d-d9e7-40fb-84f7-44b58bf44fc7 req-166c15e1-fd33-4d54-8df6-b59edcd142e3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:37.658680 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3427f43d-d9e7-40fb-84f7-44b58bf44fc7 req-166c15e1-fd33-4d54-8df6-b59edcd142e3 service nova] Creating event network-vif-deleted:d1664197-29cf-400f-a904-bea6b3996a71 for instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 on n-h1-854882-3 Aug 29 16:25:37.664371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3427f43d-d9e7-40fb-84f7-44b58bf44fc7 req-166c15e1-fd33-4d54-8df6-b59edcd142e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035737 Aug 29 16:25:37.665174 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3615/7053] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:37.944136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:37.944667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:37.951512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:37.951996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:37.952436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:37.953128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:37.953627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:37.954056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:37.984847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:37.985326 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:37.985796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:37.986246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lazy-loading 'fault' on Instance uuid 22437f68-dfd8-4cdd-b56d-eb1cf7120654 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:25:38.029775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:38.037855 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9b23bf7a-d5a9-41fa-9384-65fac1a79530 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 200 len: 1352 microversion: 2.1 time: 0.098280 Aug 29 16:25:38.038444 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3439/7054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:37 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:39.061964 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:39.062708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: 22437f68-dfd8-4cdd-b56d-eb1cf7120654] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:39.068842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:39.069328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:39.069801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:39.070500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:39.070971 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:39.071408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:39.084806 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] HTTP exception thrown: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 could not be found. Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Request method failure captured: Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 HTTP/1.1 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOg1bI2_bqEXEfEu1e7ZuHSvl42f7DkmtGPt7f5duTUNY-unyk9qRmhpIfAtYIQjYT40OodYC2yMoh9pJyY5wFt2SNPMejjj6s5Scz_p1pWF_Wz-MZI0KQr3gXYnX9bAlJ3wjcG6CNMy0LnzhYDd0suhJlYqYB1C9-eFb6E6u3Uv2X0 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8445c72633d149218d47aaf80e16ae99", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}] Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8ca581ef43c64b32b74341b6dd402200 Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 could not be found. Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '22437f68-dfd8-4cdd-b56d-eb1cf7120654'} Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 could not be found. Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 could not be found. Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:39.086448 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 could not be found. Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Returning 404 to user: Instance 22437f68-dfd8-4cdd-b56d-eb1cf7120654 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-feae822b-6bbf-4cda-ab3d-b229da207f27 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654" status: 404 len: 111 microversion: 2.1 time: 0.031326 Aug 29 16:25:39.092089 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3616/7055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:39 2022] GET /compute/v2.1/servers/22437f68-dfd8-4cdd-b56d-eb1cf7120654 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:25:39.096458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bdad560-a5fc-4b22-8435-709200edca0d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '.version_select at 0x7fb0e288ddc0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:39.116912 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bdad560-a5fc-4b22-8435-709200edca0d tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1158113483" status: 202 len: 0 microversion: 2.1 time: 0.024119 Aug 29 16:25:39.117530 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3440/7056] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 16:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1158113483 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:25:39.143334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bf59fd72-e247-4a58-9a82-87daf9b65cbe tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: .version_select at 0x7fb0e2d1b700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-178695168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxdZZN4wkz1lV4E1TWafa8PwrFcJqZRbBnsKD+H/b7qBIzrf5sr1px5X38/+DMI0C8lpuH9Fmykn5Fya/t7a6W4KN0g2qv0bvEmjBX6BWwJA1wNdKRZxiPWxuk01FJTXg=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:39.158670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bf59fd72-e247-4a58-9a82-87daf9b65cbe tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for project 8445c72633d149218d47aaf80e16ae99. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:25:39.163743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-bf59fd72-e247-4a58-9a82-87daf9b65cbe tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for user 8ca581ef43c64b32b74341b6dd402200 and project 8445c72633d149218d47aaf80e16ae99. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:25:39.187645 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bf59fd72-e247-4a58-9a82-87daf9b65cbe tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048187 Aug 29 16:25:39.188251 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3617/7057] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:25:39 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:39.237709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-205766943", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-178695168", "networks": [{"uuid": "dd21d1c9-ad25-4d61-81ef-ebcdd67535f6"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:39.290788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] validate_networks() for [('dd21d1c9-ad25-4d61-81ef-ebcdd67535f6', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:25:39.669129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:25:39.669599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:25:39.670100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:25:39.670505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:25:39.670912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:25:39.679848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:39.680327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:39.680785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:39.681540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:39.681987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:39.682436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:39.699575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for project 8445c72633d149218d47aaf80e16ae99. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:25:39.704733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Getting quotas for user 8ca581ef43c64b32b74341b6dd402200 and project 8445c72633d149218d47aaf80e16ae99. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:25:39.717228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:25:39.719584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:25:39.767674 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a98e128e-782e-4977-9fed-9cacd4648c48 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533812 Aug 29 16:25:39.768512 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3441/7058] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:25:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:25:39.779462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-28d5f6ba-99df-44bf-8c04-14a82a7b9016 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:39.780145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-28d5f6ba-99df-44bf-8c04-14a82a7b9016 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:39.836832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-28d5f6ba-99df-44bf-8c04-14a82a7b9016 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:39.844492 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-28d5f6ba-99df-44bf-8c04-14a82a7b9016 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1261 microversion: 2.1 time: 0.068973 Aug 29 16:25:39.845076 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3618/7059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:39 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:40.866698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:40.867547 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:40.878496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:40.878996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:40.879543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:40.880658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:40.881870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:40.882368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:41.294005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:41.301657 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3b80bc9b-5f32-4646-ba5f-593797a4dfd7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1319 microversion: 2.1 time: 0.440068 Aug 29 16:25:41.302343 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3442/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:40 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:42.324332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:42.324958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:42.332253 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:42.332758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:42.333209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:42.333962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:42.335164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:42.335643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:42.379453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-a6f2dfa8-7d6c-44a7-9a24-9577383ec930 req-2d54e4e3-1b91-4b85-870c-0cf832510867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9aa63a2-7165-44d8-8c32-a23996e25497", "tag": "f83668fb-b5fa-4078-ac17-d81ac7fd6450"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:42.394403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a6f2dfa8-7d6c-44a7-9a24-9577383ec930 req-2d54e4e3-1b91-4b85-870c-0cf832510867 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:42.395633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a6f2dfa8-7d6c-44a7-9a24-9577383ec930 req-2d54e4e3-1b91-4b85-870c-0cf832510867 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:42.396411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-a6f2dfa8-7d6c-44a7-9a24-9577383ec930 req-2d54e4e3-1b91-4b85-870c-0cf832510867 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:42.412253 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-a6f2dfa8-7d6c-44a7-9a24-9577383ec930 req-2d54e4e3-1b91-4b85-870c-0cf832510867 service nova] Creating event network-changed:f83668fb-b5fa-4078-ac17-d81ac7fd6450 for instance c9aa63a2-7165-44d8-8c32-a23996e25497 on n-h1-854882-3 Aug 29 16:25:42.417943 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-a6f2dfa8-7d6c-44a7-9a24-9577383ec930 req-2d54e4e3-1b91-4b85-870c-0cf832510867 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042316 Aug 29 16:25:42.418570 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3443/7061] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:42.482068 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:42.490116 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-92d86786-c400-47e5-bcb2-ac1db8502d59 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1361 microversion: 2.1 time: 0.170236 Aug 29 16:25:42.490748 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3619/7062] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:42 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:43.511628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:43.512323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:43.519359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:43.519842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:43.520282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:43.520973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:43.522069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:43.522385 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:43.693808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:43.701543 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-93de8cac-bbf0-4108-888f-98f83c67ec93 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1361 microversion: 2.1 time: 0.194148 Aug 29 16:25:43.702130 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3444/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:43 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:44.723100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:44.723732 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:44.730909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:44.731408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:44.731861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:44.732596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:44.733058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:44.733521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:44.868620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:44.876357 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f89b33dd-9cd3-43bc-9370-d2cf2d8043a2 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1361 microversion: 2.1 time: 0.157288 Aug 29 16:25:44.876922 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3620/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:44 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:45.896447 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:45.896982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:45.903838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:45.904308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:45.904734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:45.905496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:45.905948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:45.906367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:46.040198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:46.048150 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-94744a7c-d3ef-45f3-8fc2-1818b87bbd94 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1361 microversion: 2.1 time: 0.155613 Aug 29 16:25:46.048748 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3445/7065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:45 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:46.476698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-233880e8-5ac4-4d37-8946-bdfb15f0a243 req-e9c08e62-7ea6-4690-8bbc-f03d9fabe3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9aa63a2-7165-44d8-8c32-a23996e25497", "name": "network-vif-plugged", "status": "completed", "tag": "f83668fb-b5fa-4078-ac17-d81ac7fd6450"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:46.486697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-233880e8-5ac4-4d37-8946-bdfb15f0a243 req-e9c08e62-7ea6-4690-8bbc-f03d9fabe3a5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:46.487196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-233880e8-5ac4-4d37-8946-bdfb15f0a243 req-e9c08e62-7ea6-4690-8bbc-f03d9fabe3a5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:46.487642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-233880e8-5ac4-4d37-8946-bdfb15f0a243 req-e9c08e62-7ea6-4690-8bbc-f03d9fabe3a5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:46.499809 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-233880e8-5ac4-4d37-8946-bdfb15f0a243 req-e9c08e62-7ea6-4690-8bbc-f03d9fabe3a5 service nova] Creating event network-vif-plugged:f83668fb-b5fa-4078-ac17-d81ac7fd6450 for instance c9aa63a2-7165-44d8-8c32-a23996e25497 on n-h1-854882-3 Aug 29 16:25:46.504904 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-233880e8-5ac4-4d37-8946-bdfb15f0a243 req-e9c08e62-7ea6-4690-8bbc-f03d9fabe3a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031933 Aug 29 16:25:46.505808 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3621/7066] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:47.070676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:47.071296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:47.078238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:47.078720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:47.079160 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:47.079851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:47.080304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:47.080729 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:47.215466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:47.223185 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9342d43b-ac64-4963-b044-0e33ad5e1cff tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1361 microversion: 2.1 time: 0.156624 Aug 29 16:25:47.223760 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3446/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:47 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:48.246450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:48.247178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:48.253496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:48.254003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:48.254460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:48.255170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:48.255642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:48.256871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:48.384784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:48.392488 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4001289b-b9f8-4267-976d-72ef4e189934 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1553 microversion: 2.1 time: 0.151278 Aug 29 16:25:48.393068 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3622/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:48 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:48.412899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:48.413546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:48.420254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:48.420742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:48.421178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:48.421894 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:48.422349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:48.422776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:48.555765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:48.563671 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fcd226b5-b45e-4602-ace1-4fbb026bbe40 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1553 microversion: 2.1 time: 0.155145 Aug 29 16:25:48.564247 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3447/7069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:48 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:50.045188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d7ec5c5-be8c-4d62-a919-4352fc2fe910"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:50.047476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:50.050428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:50.058421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:50.058930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:50.059643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:50.060371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:50.060840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:50.061279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:50.320599 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96b60424-18fb-4a7c-8032-22d2a5ecb9ba tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "POST /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279164 Aug 29 16:25:50.321187 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3623/7070] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:25:50 2022] POST /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:01.034793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:01.035321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:01.037900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:01.038596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:01.039566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:01.040310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:01.051593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:01.052072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:01.052529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:01.053228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:01.053716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:01.054135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:01.138793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lazy-loading 'services' on Instance uuid c9aa63a2-7165-44d8-8c32-a23996e25497 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:26:01.214344 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80102089-e971-419f-8c1c-a8bb7aeb4200 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments/0d7ec5c5-be8c-4d62-a919-4352fc2fe910" status: 202 len: 0 microversion: 2.1 time: 0.183446 Aug 29 16:26:01.214960 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3448/7071] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:26:01 2022] DELETE /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments/0d7ec5c5-be8c-4d62-a919-4352fc2fe910 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:26:01.221603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:01.222522 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:01.227023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:01.229640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:01.239136 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:01.239639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:01.240156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:01.240844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:01.241284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:01.241764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:01.277708 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e2484326-94f3-48bf-a85b-3aee1683ac89 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058024 Aug 29 16:26:01.278314 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3624/7072] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:26:01 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:02.291654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:02.294180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:02.300552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:02.301038 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:02.301508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:02.302850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:02.303307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:02.303735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:02.335468 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eaa76106-e438-4580-b4e0-39811916a6e1 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049100 Aug 29 16:26:02.336062 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3449/7073] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:26:02 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:03.347917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:03.350630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:03.366621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:03.367139 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:03.367600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:03.368334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:03.368804 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:03.369248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:03.399813 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dc53e161-5a1f-45e1-9e7f-98eabc400938 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055976 Aug 29 16:26:03.400394 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3625/7074] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:26:03 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:04.412298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:04.414805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:04.421855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:04.422353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:04.422830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:04.423538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:04.423998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:04.424427 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:04.456406 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cbb368d6-4418-4837-91b7-2fa9aac07393 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048169 Aug 29 16:26:04.460902 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3450/7075] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:26:04 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:05.468566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:05.470927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:05.478768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:05.479275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:05.479733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:05.480454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:05.480929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:05.481375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:05.513228 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-45411158-dff1-460b-9441-22debdb48c4f tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 Aug 29 16:26:05.513851 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3626/7076] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:26:05 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:06.526193 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:06.528605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:06.536657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:06.537142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:06.537608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:06.538314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:06.538775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:06.539197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:06.569253 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a753605f-38e1-4616-8d79-4203870ae293 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047056 Aug 29 16:26:06.569845 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3451/7077] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:26:06 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 16:26:06.580439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:06.580967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:06.588523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:06.589027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:06.589506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:06.590244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:06.590700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:06.591146 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:06.670050 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] HTTP exception thrown: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 is not attached to volume 0d7ec5c5-be8c-4d62-a919-4352fc2fe910 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Request method failure captured: Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments/0d7ec5c5-be8c-4d62-a919-4352fc2fe910 HTTP/1.1 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOg1bI2_bqEXEfEu1e7ZuHSvl42f7DkmtGPt7f5duTUNY-unyk9qRmhpIfAtYIQjYT40OodYC2yMoh9pJyY5wFt2SNPMejjj6s5Scz_p1pWF_Wz-MZI0KQr3gXYnX9bAlJ3wjcG6CNMy0LnzhYDd0suhJlYqYB1C9-eFb6E6u3Uv2X0 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8445c72633d149218d47aaf80e16ae99", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}] Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8ca581ef43c64b32b74341b6dd402200 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 is not attached to volume 0d7ec5c5-be8c-4d62-a919-4352fc2fe910 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': 'c9aa63a2-7165-44d8-8c32-a23996e25497', 'id': '0d7ec5c5-be8c-4d62-a919-4352fc2fe910'} Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0d7ec5c5-be8c-4d62-a919-4352fc2fe910. Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 is not attached to volume 0d7ec5c5-be8c-4d62-a919-4352fc2fe910 Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:26:06.671697 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:26:06.676041 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:26:06.676041 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:26:06.676041 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 is not attached to volume 0d7ec5c5-be8c-4d62-a919-4352fc2fe910 Aug 29 16:26:06.676041 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:06.676041 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Returning 404 to user: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 is not attached to volume 0d7ec5c5-be8c-4d62-a919-4352fc2fe910 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:26:06.676041 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-afe353b2-19ed-499d-9487-e424b177a6dc tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments/0d7ec5c5-be8c-4d62-a919-4352fc2fe910" status: 404 len: 154 microversion: 2.1 time: 0.097072 Aug 29 16:26:06.676041 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3627/7078] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:26:06 2022] DELETE /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497/os-volume_attachments/0d7ec5c5-be8c-4d62-a919-4352fc2fe910 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:26:10.016439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:10.017037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:10.024943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:10.025463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:10.025940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:10.026651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:10.027111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:10.027715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:10.054717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:26:10.129487 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3fbb630e-631f-498a-b044-1cd74381cd1e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 204 len: 0 microversion: 2.1 time: 0.116748 Aug 29 16:26:10.130736 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3452/7079] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:26:10 2022] DELETE /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:26:10.140907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:10.141581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:10.149508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:10.149957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:10.150419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:10.151140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:10.151612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:10.152264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:10.289883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:10.298141 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c60e2048-681e-41a8-9306-6df5829b9091 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1559 microversion: 2.1 time: 0.162825 Aug 29 16:26:10.298721 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3628/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:10 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:11.320169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:11.320801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:11.329928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:11.330445 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:11.330879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:11.331604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:11.332050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:11.332470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:11.464613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:11.472294 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fc57b1ec-eba8-4972-a814-88dd804831b0 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1559 microversion: 2.1 time: 0.156542 Aug 29 16:26:11.472868 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3453/7081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:11 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:12.169833 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-58a42819-0f39-456c-8aa1-bd59963e409b req-200584b2-b178-4656-97f3-6e2f9560745c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9aa63a2-7165-44d8-8c32-a23996e25497", "name": "network-vif-deleted", "tag": "f83668fb-b5fa-4078-ac17-d81ac7fd6450"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:26:12.188999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-58a42819-0f39-456c-8aa1-bd59963e409b req-200584b2-b178-4656-97f3-6e2f9560745c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:12.189529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-58a42819-0f39-456c-8aa1-bd59963e409b req-200584b2-b178-4656-97f3-6e2f9560745c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:12.190353 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-58a42819-0f39-456c-8aa1-bd59963e409b req-200584b2-b178-4656-97f3-6e2f9560745c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:12.206015 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-58a42819-0f39-456c-8aa1-bd59963e409b req-200584b2-b178-4656-97f3-6e2f9560745c service nova] Creating event network-vif-deleted:f83668fb-b5fa-4078-ac17-d81ac7fd6450 for instance c9aa63a2-7165-44d8-8c32-a23996e25497 on n-h1-854882-3 Aug 29 16:26:12.211416 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-58a42819-0f39-456c-8aa1-bd59963e409b req-200584b2-b178-4656-97f3-6e2f9560745c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046558 Aug 29 16:26:12.212410 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3629/7082] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:12.494414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:12.495059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:12.502014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:12.502495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:12.502936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:12.503634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:12.504086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:12.504591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:12.539659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:12.540150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:12.540589 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:12.541048 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lazy-loading 'fault' on Instance uuid c9aa63a2-7165-44d8-8c32-a23996e25497 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:26:12.584332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca581ef43c64b32b74341b6dd402200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8445c72633d149218d47aaf80e16ae99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:12.592977 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-becf4e46-4998-421c-9ce0-5b8bde2469f7 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 200 len: 1351 microversion: 2.1 time: 0.102514 Aug 29 16:26:12.594006 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3454/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:12 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:13.616178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:13.616900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] [instance: c9aa63a2-7165-44d8-8c32-a23996e25497] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:13.623955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:13.624458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:13.624913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:13.625667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:13.626123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:13.626565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:13.640244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] HTTP exception thrown: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 could not be found. Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Request method failure captured: Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 HTTP/1.1 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOg1bI2_bqEXEfEu1e7ZuHSvl42f7DkmtGPt7f5duTUNY-unyk9qRmhpIfAtYIQjYT40OodYC2yMoh9pJyY5wFt2SNPMejjj6s5Scz_p1pWF_Wz-MZI0KQr3gXYnX9bAlJ3wjcG6CNMy0LnzhYDd0suhJlYqYB1C9-eFb6E6u3Uv2X0 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8445c72633d149218d47aaf80e16ae99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8445c72633d149218d47aaf80e16ae99", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8445c72633d149218d47aaf80e16ae99"}]}] Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 8445c72633d149218d47aaf80e16ae99 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1557342961 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 8ca581ef43c64b32b74341b6dd402200 Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1557342961-project Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 could not be found. Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c9aa63a2-7165-44d8-8c32-a23996e25497'} Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 could not be found. Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 could not be found. Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:13.641903 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 could not be found. Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Returning 404 to user: Instance c9aa63a2-7165-44d8-8c32-a23996e25497 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-655dc3bf-b20d-4404-9d39-0fcc9bafdd12 tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497" status: 404 len: 111 microversion: 2.1 time: 0.032023 Aug 29 16:26:13.646423 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3630/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:13 2022] GET /compute/v2.1/servers/c9aa63a2-7165-44d8-8c32-a23996e25497 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:26:13.652091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-95f7a398-91af-4d73-a015-ffeb6065a82e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] Calling method '.version_select at 0x7fb0e32d1430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:13.671826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-95f7a398-91af-4d73-a015-ffeb6065a82e tempest-TestEncryptedCinderVolumes-1557342961 tempest-TestEncryptedCinderVolumes-1557342961-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-178695168" status: 202 len: 0 microversion: 2.1 time: 0.023551 Aug 29 16:26:13.672411 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3455/7085] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 16:26:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-178695168 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:26:40.199557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-186245c7-ae2c-4d00-86a3-89dfc9334768 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'create', calling method: .version_select at 0x7fb0e2d6a310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1463554801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjJdx8Vh8JDX4THmPj0OLDS3it1Nmm1sAlQ+0BXAhDps5YZyccdCZEToyfQjzZdfCoAoqMdmP8s7A8Xd4tx0Kjl680myrWDIulSgphF/tih4KO9P5XON6N+Lx/W0r+biw=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:26:40.205373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:40.206064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=34 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:40.218487 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-186245c7-ae2c-4d00-86a3-89dfc9334768 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:26:40.223648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-186245c7-ae2c-4d00-86a3-89dfc9334768 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for user 3bf90dbc02fd42a6b9911f76ccea3b69 and project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:26:40.246635 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-186245c7-ae2c-4d00-86a3-89dfc9334768 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051092 Aug 29 16:26:40.247234 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3631/7086] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:26:40 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:40.296333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:40.297065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:40.301412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-212234596", "imageRef": "37ea7fa8-18e8-4cb8-8983-6e00b0dbdb44", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1463554801", "networks": [{"uuid": "5728b105-765e-4401-a75a-913a30077865"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:26:40.356616 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] validate_networks() for [('5728b105-765e-4401-a75a-913a30077865', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:26:40.735317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:26:40.735744 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:26:40.736222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:26:40.736633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:26:40.737046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:26:40.746519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:40.746997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:40.747436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:40.748169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:40.748624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:40.749051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:40.766381 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:26:40.771643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for user 3bf90dbc02fd42a6b9911f76ccea3b69 and project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:26:40.783797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:26:40.786541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37ea7fa8-18e8-4cb8-8983-6e00b0dbdb44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:26:40.831884 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b163a30f-22ad-4e7f-86a7-03f542ea3bb0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537718 Aug 29 16:26:40.832470 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3456/7087] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:26:40.843229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-772454fb-c468-4c66-a44a-c1476c75f0b1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:40.843873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-772454fb-c468-4c66-a44a-c1476c75f0b1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:40.902478 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-772454fb-c468-4c66-a44a-c1476c75f0b1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:40.910482 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-772454fb-c468-4c66-a44a-c1476c75f0b1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1258 microversion: 2.1 time: 0.071368 Aug 29 16:26:40.911661 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3632/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:40 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:41.932577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:41.933184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:41.940874 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:41.941360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:41.942123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:41.943028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:41.943959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:41.944387 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:42.064912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:42.073512 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-78f8c05d-1b17-45c3-a50e-6500fbe6c14e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1328 microversion: 2.1 time: 0.145671 Aug 29 16:26:42.074197 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3457/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:41 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1328 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:43.095272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:43.095916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:43.103768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:43.105007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:43.105501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:43.106239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:43.106717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:43.107167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:43.253310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:43.261885 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-76cfb151-3512-45e8-a617-e2c5216b6fc7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.170511 Aug 29 16:26:43.262480 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3633/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:43 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:44.283052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:44.284391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:44.291991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:44.292482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:44.292921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:44.293646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:44.294098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:44.294527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:44.437516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:44.446712 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f026c3e-90c0-4d71-acbf-3925437c4c57 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.168018 Aug 29 16:26:44.447308 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3458/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:44 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:45.468386 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:45.469662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:45.477639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:45.478477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:45.479236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:45.480179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:45.480864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:45.481551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:45.639031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:45.649191 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d0536f10-d7b4-4aad-b909-1dcffc953016 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.184906 Aug 29 16:26:45.649909 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3634/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:45 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:46.672195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:46.672899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:46.680530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:46.681065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:46.681424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:46.682135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:46.682588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:46.683019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:46.834388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:46.842866 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b3d4ed40-7324-43ee-ac59-99e09d30b917 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.174316 Aug 29 16:26:46.843409 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3459/7093] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:46 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:47.864661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:47.865209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:47.873082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:47.873734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:47.874259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:47.875088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:47.875637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:47.876155 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:48.030473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:48.039037 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-818c4259-549e-4fba-aeb8-88721c6f9a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.179203 Aug 29 16:26:48.039836 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3635/7094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:47 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:49.060071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:49.060767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:49.070974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:49.071902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:49.072773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:49.074009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:49.074772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:49.076170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:49.229541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:49.238075 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a38f3aa-25d4-4773-89c3-d26b1bda3165 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.182133 Aug 29 16:26:49.251767 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3460/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:49 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:50.258844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:50.259488 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:50.267112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:50.267618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:50.268095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:50.268813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:50.269283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:50.269768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:50.401652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:50.409380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a30048ac-0bcd-41ee-97d3-84d55ad500f4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.154487 Aug 29 16:26:50.409982 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3636/7096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:50 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:50.713202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f0fef270-b49f-48d9-abb3-d3a70db58b63 req-f17ae7d7-9002-4517-a665-fb2f1fc714ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e7a17f-f09c-4215-874b-90d546ba7299", "tag": "673decf3-e5d6-4971-a65a-5ed1b6de8277"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:26:50.725867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0fef270-b49f-48d9-abb3-d3a70db58b63 req-f17ae7d7-9002-4517-a665-fb2f1fc714ea service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:50.726366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0fef270-b49f-48d9-abb3-d3a70db58b63 req-f17ae7d7-9002-4517-a665-fb2f1fc714ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:50.726850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0fef270-b49f-48d9-abb3-d3a70db58b63 req-f17ae7d7-9002-4517-a665-fb2f1fc714ea service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:50.739195 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f0fef270-b49f-48d9-abb3-d3a70db58b63 req-f17ae7d7-9002-4517-a665-fb2f1fc714ea service nova] Creating event network-changed:673decf3-e5d6-4971-a65a-5ed1b6de8277 for instance c5e7a17f-f09c-4215-874b-90d546ba7299 on n-h1-854882-3 Aug 29 16:26:50.744023 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f0fef270-b49f-48d9-abb3-d3a70db58b63 req-f17ae7d7-9002-4517-a665-fb2f1fc714ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 Aug 29 16:26:50.745051 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3461/7097] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:26:51.431637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:51.432295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:51.434199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:51.440532 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:51.441026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:51.441567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:51.442269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:51.442733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:51.443193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:51.577524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:51.585203 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0ce812d8-96c4-48c2-a0d2-2356b1a729fa tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.157429 Aug 29 16:26:51.585825 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3637/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:51 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:52.602551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:52.603267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:52.608210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:52.608945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:52.616031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:52.616505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:52.616967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:52.617713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:52.618162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:52.618582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:52.764003 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:52.772636 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27b0e009-49ed-4e3d-a5af-79758765f5d1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.170921 Aug 29 16:26:52.773348 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3462/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:52 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:53.793975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:53.794534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:53.801801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:53.802332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:53.802794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:53.803547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:53.804021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:53.804472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:53.932507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:53.941200 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7918cad0-91ae-40ff-b471-5143eb1493a6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.151440 Aug 29 16:26:53.941818 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3638/7100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:53 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:26:54.797836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-804206fb-1e14-4cce-bf51-f7e48b738eb0 req-91c4d48c-d8ef-4035-b784-f94597467b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e7a17f-f09c-4215-874b-90d546ba7299", "name": "network-vif-plugged", "status": "completed", "tag": "673decf3-e5d6-4971-a65a-5ed1b6de8277"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:26:54.808353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-804206fb-1e14-4cce-bf51-f7e48b738eb0 req-91c4d48c-d8ef-4035-b784-f94597467b44 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:54.808827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-804206fb-1e14-4cce-bf51-f7e48b738eb0 req-91c4d48c-d8ef-4035-b784-f94597467b44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:54.809275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-804206fb-1e14-4cce-bf51-f7e48b738eb0 req-91c4d48c-d8ef-4035-b784-f94597467b44 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:54.827576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-804206fb-1e14-4cce-bf51-f7e48b738eb0 req-91c4d48c-d8ef-4035-b784-f94597467b44 service nova] Creating event network-vif-plugged:673decf3-e5d6-4971-a65a-5ed1b6de8277 for instance c5e7a17f-f09c-4215-874b-90d546ba7299 on n-h1-854882-3 Aug 29 16:26:54.837042 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-804206fb-1e14-4cce-bf51-f7e48b738eb0 req-91c4d48c-d8ef-4035-b784-f94597467b44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042457 Aug 29 16:26:54.838213 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3463/7101] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:54.962871 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:54.963516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:54.970515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:54.971026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:54.971489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:54.972321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:54.972796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:54.973932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:55.100636 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:55.108350 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d97794a7-ab24-456a-9c6f-f2c23b1f2c60 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1358 microversion: 2.1 time: 0.149737 Aug 29 16:26:55.108932 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3639/7102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:54 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:56.131027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:56.131730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:56.137941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.138426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.138861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.139548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.140005 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.140430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.274674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:56.282419 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ac14ccc9-5b90-43c2-adb4-1aecdc9e541b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1549 microversion: 2.1 time: 0.157236 Aug 29 16:26:56.283002 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3464/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:56 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:56.302630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:56.303271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:56.310332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.310835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.311286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.311996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.312463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.312908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.446316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:56.453953 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-edf29cc4-8560-4369-9d61-aede84383e6c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1549 microversion: 2.1 time: 0.155632 Aug 29 16:26:56.454530 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3640/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:56 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:56.474628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:56.479386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:56.480147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Searching by: {'deleted': False, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:26:56.485497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.485969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.486393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.487107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.487551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.487970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.512565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:26:56.539580 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2270c145-a1b1-4d83-a4a3-8b6079d40d20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068734 Aug 29 16:26:56.540285 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3465/7105] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 16:26:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:56.553165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:56.553838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:56.560074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.560566 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.561014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.561750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.562218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.562663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.689555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:56.698195 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d6cc7a8-0e19-4ffb-937e-2e1a5475f23f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1549 microversion: 2.1 time: 0.149709 Aug 29 16:26:56.698949 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3641/7106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:56 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:58.230150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c5d03f-7b3d-40ea-88e8-cb36db20a96a"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:26:58.232582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:58.239928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:58.240403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:58.240834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:58.241578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:58.242015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:58.242439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:58.475559 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31f37b77-0474-4023-b8e1-cc5c589b6081 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248689 Aug 29 16:26:58.476186 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3466/7107] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:26:58 2022] POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:11.678256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:11.678897 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:11.681654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:11.682331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=54 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:11.683227 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:27:11.683476 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 (ip 10.222.0.16) !!! Aug 29 16:27:11.697229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:11.697771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:11.698222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:11.698939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:11.699405 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:11.699841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:11.830619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:11.839452 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b66e4820-0dff-4310-9264-cec0abea942d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1595 microversion: 2.1 time: 0.165124 Aug 29 16:27:11.840028 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3642/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:11 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:13.947692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:13.948809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:13.949462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:14.032396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0a9a32ce-eae0-45f3-b302-0908b54b330c req-94830748-056e-471f-b2d2-b10625900a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e7a17f-f09c-4215-874b-90d546ba7299", "tag": "673decf3-e5d6-4971-a65a-5ed1b6de8277"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:14.042807 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0a9a32ce-eae0-45f3-b302-0908b54b330c req-94830748-056e-471f-b2d2-b10625900a28 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:14.043291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0a9a32ce-eae0-45f3-b302-0908b54b330c req-94830748-056e-471f-b2d2-b10625900a28 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:14.043740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0a9a32ce-eae0-45f3-b302-0908b54b330c req-94830748-056e-471f-b2d2-b10625900a28 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:14.055692 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0a9a32ce-eae0-45f3-b302-0908b54b330c req-94830748-056e-471f-b2d2-b10625900a28 service nova] Creating event network-changed:673decf3-e5d6-4971-a65a-5ed1b6de8277 for instance c5e7a17f-f09c-4215-874b-90d546ba7299 on n-h1-854882-3 Aug 29 16:27:14.060908 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0a9a32ce-eae0-45f3-b302-0908b54b330c req-94830748-056e-471f-b2d2-b10625900a28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115000 Aug 29 16:27:14.061545 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3467/7109] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:14.873919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-4059768"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:14.875043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:14.882698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:14.883213 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:14.883673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:14.884401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:14.884880 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:14.885333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:15.016699 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.network.security_group_api [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Adding security group 9f0ddc54-5ff6-4f30-a0ee-2323c0c3346e to port 673decf3-e5d6-4971-a65a-5ed1b6de8277 Aug 29 16:27:15.336654 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d3f609bf-72a0-4bf6-89e2-014913767865 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/action" status: 202 len: 0 microversion: 2.1 time: 0.466691 Aug 29 16:27:15.337634 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3643/7110] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:27:14 2022] POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:27:15.348448 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:15.349618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:15.365808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:15.366298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:15.366731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:15.367459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:15.367890 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:15.368313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:15.859288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:15.873324 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-16247910-56fd-4a65-8241-efab8b0a723a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1757 microversion: 2.1 time: 0.529944 Aug 29 16:27:15.874079 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3468/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:15 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1757 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:16.076746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-0a6d7757-3378-4074-b8f0-ed60d8d844e9 req-83208fce-ef90-4c6e-b0ac-461ac33ef72f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e7a17f-f09c-4215-874b-90d546ba7299", "tag": "673decf3-e5d6-4971-a65a-5ed1b6de8277"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:16.086070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0a6d7757-3378-4074-b8f0-ed60d8d844e9 req-83208fce-ef90-4c6e-b0ac-461ac33ef72f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:16.086563 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0a6d7757-3378-4074-b8f0-ed60d8d844e9 req-83208fce-ef90-4c6e-b0ac-461ac33ef72f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:16.087005 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-0a6d7757-3378-4074-b8f0-ed60d8d844e9 req-83208fce-ef90-4c6e-b0ac-461ac33ef72f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:16.098038 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-0a6d7757-3378-4074-b8f0-ed60d8d844e9 req-83208fce-ef90-4c6e-b0ac-461ac33ef72f service nova] Creating event network-changed:673decf3-e5d6-4971-a65a-5ed1b6de8277 for instance c5e7a17f-f09c-4215-874b-90d546ba7299 on n-h1-854882-3 Aug 29 16:27:16.103473 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-0a6d7757-3378-4074-b8f0-ed60d8d844e9 req-83208fce-ef90-4c6e-b0ac-461ac33ef72f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Aug 29 16:27:16.104048 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3644/7112] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:28:54.115418 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:54.116162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:54.117617 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:28:54.118277 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:28:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/action (ip 10.222.0.16) !!! Aug 29 16:28:54.122554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:28:54.124865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:54.134071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:54.134567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:54.134998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:54.135688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:54.136136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:54.136557 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:54.208805 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a531814-8fb1-483f-8f28-61b88027b810 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/action" status: 202 len: 0 microversion: 2.1 time: 0.095129 Aug 29 16:28:54.209473 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3469/7113] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:28:54 2022] POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:28:54.216690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:54.217619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:54.224057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:28:54.224893 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:54.232383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:54.232886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:54.233344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:54.234165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:54.234643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:54.235089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:54.391074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:54.399773 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f3c88131-252d-4ed0-a5b4-f700fc40a909 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1759 microversion: 2.1 time: 0.185714 Aug 29 16:28:54.400457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3645/7114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:28:54 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:28:55.422632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:28:55.423331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:55.429432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:55.429918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:55.430349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:55.431031 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:55.431478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:55.431900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:55.626520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:55.635388 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73cf11a2-0bc3-4f46-9835-c94387d26d7d tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1757 microversion: 2.1 time: 0.218104 Aug 29 16:28:55.635964 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3470/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:28:55 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:08.382256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:08.383019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:08.387708 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-4059768"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:08.388260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.394934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.395932 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.396383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.397089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.397597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.398042 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.578846 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.network.security_group_api [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Removing security group 9f0ddc54-5ff6-4f30-a0ee-2323c0c3346e from port 673decf3-e5d6-4971-a65a-5ed1b6de8277 Aug 29 16:30:08.882410 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ad55e66f-2caf-4824-b009-72c0e7da4349 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/action" status: 202 len: 0 microversion: 2.1 time: 0.501884 Aug 29 16:30:08.887535 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3646/7116] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:30:08 2022] POST /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:30:08.889961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:08.890967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:08.895513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-20d9aa6d-b79b-4fe2-b404-33b5eea09131 req-a19dcc1c-083f-48ea-9e2a-395fdc76cc90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e7a17f-f09c-4215-874b-90d546ba7299", "tag": "673decf3-e5d6-4971-a65a-5ed1b6de8277"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:08.906536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-20d9aa6d-b79b-4fe2-b404-33b5eea09131 req-a19dcc1c-083f-48ea-9e2a-395fdc76cc90 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.907023 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-20d9aa6d-b79b-4fe2-b404-33b5eea09131 req-a19dcc1c-083f-48ea-9e2a-395fdc76cc90 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.907455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-20d9aa6d-b79b-4fe2-b404-33b5eea09131 req-a19dcc1c-083f-48ea-9e2a-395fdc76cc90 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.926393 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-20d9aa6d-b79b-4fe2-b404-33b5eea09131 req-a19dcc1c-083f-48ea-9e2a-395fdc76cc90 service nova] Creating event network-changed:673decf3-e5d6-4971-a65a-5ed1b6de8277 for instance c5e7a17f-f09c-4215-874b-90d546ba7299 on n-h1-854882-3 Aug 29 16:30:08.936338 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-20d9aa6d-b79b-4fe2-b404-33b5eea09131 req-a19dcc1c-083f-48ea-9e2a-395fdc76cc90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047833 Aug 29 16:30:08.937537 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3471/7117] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:10.297076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:10.297716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:10.305260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:10.305908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:10.306438 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:10.307314 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:10.307969 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:10.308702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:10.327132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-09ce9d84-0a62-49a8-b986-b74f2cd0b362 req-579b85e5-ff36-4352-bcc5-6ccc1e62d983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e7a17f-f09c-4215-874b-90d546ba7299", "tag": "673decf3-e5d6-4971-a65a-5ed1b6de8277"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:10.337348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-09ce9d84-0a62-49a8-b986-b74f2cd0b362 req-579b85e5-ff36-4352-bcc5-6ccc1e62d983 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:10.337881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-09ce9d84-0a62-49a8-b986-b74f2cd0b362 req-579b85e5-ff36-4352-bcc5-6ccc1e62d983 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:10.338336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-09ce9d84-0a62-49a8-b986-b74f2cd0b362 req-579b85e5-ff36-4352-bcc5-6ccc1e62d983 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:10.350333 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-09ce9d84-0a62-49a8-b986-b74f2cd0b362 req-579b85e5-ff36-4352-bcc5-6ccc1e62d983 service nova] Creating event network-changed:673decf3-e5d6-4971-a65a-5ed1b6de8277 for instance c5e7a17f-f09c-4215-874b-90d546ba7299 on n-h1-854882-3 Aug 29 16:30:10.355572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-09ce9d84-0a62-49a8-b986-b74f2cd0b362 req-579b85e5-ff36-4352-bcc5-6ccc1e62d983 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109987 Aug 29 16:30:10.356182 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3647/7118] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:10.399159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lazy-loading 'services' on Instance uuid c5e7a17f-f09c-4215-874b-90d546ba7299 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:30:10.484482 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c214ff8f-1793-46b7-bdae-10adbd56166c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments/d1c5d03f-7b3d-40ea-88e8-cb36db20a96a" status: 202 len: 0 microversion: 2.1 time: 0.192334 Aug 29 16:30:10.485482 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3472/7119] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:30:10 2022] DELETE /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments/d1c5d03f-7b3d-40ea-88e8-cb36db20a96a => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:30:10.494652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:10.497218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:10.503985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:10.505338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:10.506058 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:10.506976 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:10.507453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:10.507905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:10.540090 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5a062bcd-3cb3-4290-8c81-ba9cc648e3b4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049802 Aug 29 16:30:10.541212 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3648/7120] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:30:10 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:11.552992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:11.555408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:11.563750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:11.564234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:11.564666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:11.565358 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:11.565831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:11.566254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:11.596693 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-69931d8a-eb65-47c6-be38-f2d3c5334a45 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048115 Aug 29 16:30:11.597273 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3473/7121] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:30:11 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:12.609638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:12.611857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:12.619429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:12.619934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:12.620381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:12.621086 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:12.621585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:12.622028 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:12.650521 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e6b5e1ad-7707-4351-80bf-0d8f814c1a26 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Aug 29 16:30:12.651089 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3649/7122] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:30:12 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:13.663127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:13.665239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:13.672017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:13.672500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:13.672937 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:13.673654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:13.674108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:13.674529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:13.708202 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1d995010-322d-4810-9674-8aa038a366f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048717 Aug 29 16:30:13.708777 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3474/7123] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:30:13 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:14.720797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:14.722966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:14.729947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:14.730455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:14.730907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:14.731626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:14.732098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:14.732539 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:14.763021 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-032209c4-7765-4f53-a4e5-78a9189f9fc6 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Aug 29 16:30:14.763662 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3650/7124] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:30:14 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:15.776119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:15.778345 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:15.785058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:15.786069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:15.786505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:15.787189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:15.787640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:15.788091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:15.817069 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-15baf987-ad48-46a8-8f38-b848305e9560 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045014 Aug 29 16:30:15.817577 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3475/7125] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:30:15 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:30:15.828310 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:15.828818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:15.835656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:15.836144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:15.836619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:15.837321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:15.837831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:15.838279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:15.915315 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] HTTP exception thrown: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 is not attached to volume d1c5d03f-7b3d-40ea-88e8-cb36db20a96a Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Request method failure captured: Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments/d1c5d03f-7b3d-40ea-88e8-cb36db20a96a HTTP/1.1 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOix2QkebbmNu6vjhuLt2zvz9HXLtaGusdwyC_Ef1u0wXn9GxkDs2nIlyJm6rO0zWd_a5Mwhyz7VA6471_F0TXnBj57uWuTV52UCGlRUQVqMOiuoprIOo6E4RBLB692BVMYunw06q3hRH3MdVPOYeavEKrIhIFmR-dbKr4oZh1FRY40 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bce727fbf3f646fbb1353cfc0072bbcc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}] Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3bf90dbc02fd42a6b9911f76ccea3b69 Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 is not attached to volume d1c5d03f-7b3d-40ea-88e8-cb36db20a96a Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': 'c5e7a17f-f09c-4215-874b-90d546ba7299', 'id': 'd1c5d03f-7b3d-40ea-88e8-cb36db20a96a'} Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d1c5d03f-7b3d-40ea-88e8-cb36db20a96a. Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 is not attached to volume d1c5d03f-7b3d-40ea-88e8-cb36db20a96a Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:15.916934 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:15.921633 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:15.921633 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:15.921633 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 is not attached to volume d1c5d03f-7b3d-40ea-88e8-cb36db20a96a Aug 29 16:30:15.921633 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:15.921633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Returning 404 to user: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 is not attached to volume d1c5d03f-7b3d-40ea-88e8-cb36db20a96a {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:15.921633 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ce89d37-15bc-40f7-867b-40100032e723 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments/d1c5d03f-7b3d-40ea-88e8-cb36db20a96a" status: 404 len: 154 microversion: 2.1 time: 0.094203 Aug 29 16:30:15.921633 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3651/7126] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:30:15 2022] DELETE /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299/os-volume_attachments/d1c5d03f-7b3d-40ea-88e8-cb36db20a96a => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:19.169469 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:19.169976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:19.177657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:19.178149 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:19.178587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:19.179307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:19.179764 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:19.180187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:19.208795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:30:19.288803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-960d10d4-582a-481b-9fac-657dd89b6d6f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 204 len: 0 microversion: 2.1 time: 0.122701 Aug 29 16:30:19.289873 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3476/7127] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:19 2022] DELETE /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:30:19.298331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:19.298979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:19.307869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:19.308375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:19.308855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:19.309602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:19.310331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:19.310787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:19.448755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:19.456586 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-df253978-7ecf-4786-bc41-357d6286c459 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1555 microversion: 2.1 time: 0.162216 Aug 29 16:30:19.457169 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3652/7128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:19 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:20.478934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:20.479633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:20.486286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:20.486763 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:20.487195 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:20.487876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:20.488322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:20.489237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:20.622250 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:20.630667 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2988a0cd-9dbf-4105-8906-20d20cc2f140 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1555 microversion: 2.1 time: 0.156218 Aug 29 16:30:20.631240 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3477/7129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:20 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:21.622692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-f9bcb583-6272-4713-be15-24bca6abbe6f req-734ed043-c483-4dcf-ac71-a81550274ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e7a17f-f09c-4215-874b-90d546ba7299", "name": "network-vif-deleted", "tag": "673decf3-e5d6-4971-a65a-5ed1b6de8277"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:21.633943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9bcb583-6272-4713-be15-24bca6abbe6f req-734ed043-c483-4dcf-ac71-a81550274ef6 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:21.634504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9bcb583-6272-4713-be15-24bca6abbe6f req-734ed043-c483-4dcf-ac71-a81550274ef6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:21.634950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-f9bcb583-6272-4713-be15-24bca6abbe6f req-734ed043-c483-4dcf-ac71-a81550274ef6 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:21.647064 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-f9bcb583-6272-4713-be15-24bca6abbe6f req-734ed043-c483-4dcf-ac71-a81550274ef6 service nova] Creating event network-vif-deleted:673decf3-e5d6-4971-a65a-5ed1b6de8277 for instance c5e7a17f-f09c-4215-874b-90d546ba7299 on n-h1-854882-3 Aug 29 16:30:21.652147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:21.652647 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-f9bcb583-6272-4713-be15-24bca6abbe6f req-734ed043-c483-4dcf-ac71-a81550274ef6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033936 Aug 29 16:30:21.653104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:21.653436 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3653/7130] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:21.661487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:21.662074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:21.662726 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:21.663561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:21.664111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:21.664633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:21.730681 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:21.739414 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fdcbc204-320a-4567-a8af-2b639a0ead0f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 200 len: 1343 microversion: 2.1 time: 0.091194 Aug 29 16:30:21.739998 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3478/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:21 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 1343 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:30:22.762407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:22.763208 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: c5e7a17f-f09c-4215-874b-90d546ba7299] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:22.769479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:22.769975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:22.770426 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:22.771129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:22.771593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:22.772030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:22.784976 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] HTTP exception thrown: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 could not be found. Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Request method failure captured: Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 HTTP/1.1 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOix2QkebbmNu6vjhuLt2zvz9HXLtaGusdwyC_Ef1u0wXn9GxkDs2nIlyJm6rO0zWd_a5Mwhyz7VA6471_F0TXnBj57uWuTV52UCGlRUQVqMOiuoprIOo6E4RBLB692BVMYunw06q3hRH3MdVPOYeavEKrIhIFmR-dbKr4oZh1FRY40 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bce727fbf3f646fbb1353cfc0072bbcc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}] Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3bf90dbc02fd42a6b9911f76ccea3b69 Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 could not be found. Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'c5e7a17f-f09c-4215-874b-90d546ba7299'} Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 could not be found. Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 could not be found. Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:22.786630 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 could not be found. Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Returning 404 to user: Instance c5e7a17f-f09c-4215-874b-90d546ba7299 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-667fc150-6d9e-43bb-ab19-d3e5f4cbb65a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299" status: 404 len: 111 microversion: 2.1 time: 0.030881 Aug 29 16:30:22.791831 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3654/7132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:22 2022] GET /compute/v2.1/servers/c5e7a17f-f09c-4215-874b-90d546ba7299 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:22.796571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45d0a70f-a70f-4801-8b98-71e00b7c51d0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '.version_select at 0x7fb0e359d5e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:22.821339 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45d0a70f-a70f-4801-8b98-71e00b7c51d0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1463554801" status: 202 len: 0 microversion: 2.1 time: 0.028561 Aug 29 16:30:22.821950 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3479/7133] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Aug 29 16:30:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1463554801 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:30:31.755306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5376dd54-b930-42f3-9ed3-13c08f200543 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'create', calling method: .version_select at 0x7fb0e06a14c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-776070452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWBwBIj4kWkJRSBcfeX3k6yXAqvNxmJWgBn73h/BJEx3X/jX7f159h0QGjDFtDs0dtXh+lcJowGCXXgHXT4tmu8E01X4hzH8NqYhHxP5DN5LotHVDtNotgBRtd4dp5qcA=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:31.775252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5376dd54-b930-42f3-9ed3-13c08f200543 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:30:31.780331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-5376dd54-b930-42f3-9ed3-13c08f200543 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for user 3bf90dbc02fd42a6b9911f76ccea3b69 and project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:30:31.802968 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5376dd54-b930-42f3-9ed3-13c08f200543 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052025 Aug 29 16:30:31.803494 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3655/7134] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:30:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:31.853749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:31.857765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1010991562", "imageRef": "cb1b6a58-8832-4abf-b033-7a66150db51a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-776070452", "networks": [{"uuid": "5728b105-765e-4401-a75a-913a30077865"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:31.912136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] validate_networks() for [('5728b105-765e-4401-a75a-913a30077865', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:30:32.343263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:30:32.343630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:30:32.344102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:30:32.344508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:30:32.344919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:30:32.353691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:32.354165 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:32.354593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:32.355308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:32.355754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:32.356169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:32.374004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:30:32.379649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Getting quotas for user 3bf90dbc02fd42a6b9911f76ccea3b69 and project bce727fbf3f646fbb1353cfc0072bbcc. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:30:32.391487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:30:32.393679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb1b6a58-8832-4abf-b033-7a66150db51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:30:32.439576 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67b742e4-c1ec-4099-962f-3b0327c18503 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587673 Aug 29 16:30:32.440232 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3480/7135] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:30:32.451014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7dc49822-6ebd-4f89-86c3-f82e38b8470c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:32.451735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7dc49822-6ebd-4f89-86c3-f82e38b8470c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:32.506428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7dc49822-6ebd-4f89-86c3-f82e38b8470c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:32.513606 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7dc49822-6ebd-4f89-86c3-f82e38b8470c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1258 microversion: 2.1 time: 0.066521 Aug 29 16:30:32.514197 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3656/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:32 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:33.537568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b04aa2a6-7d35-47dc-9889-1a5a03c2d5df tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:33.538202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b04aa2a6-7d35-47dc-9889-1a5a03c2d5df tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:33.593177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b04aa2a6-7d35-47dc-9889-1a5a03c2d5df tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:33.601048 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b04aa2a6-7d35-47dc-9889-1a5a03c2d5df tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1258 microversion: 2.1 time: 0.070390 Aug 29 16:30:33.601661 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3481/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:33 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:34.621404 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b5a88094-5f9f-45b9-9fad-09945ec98566 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:34.622090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b5a88094-5f9f-45b9-9fad-09945ec98566 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:34.624637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=40 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:34.626724 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:30:34.627041 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:30:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 (ip 10.222.0.16) !!! Aug 29 16:30:34.688501 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b5a88094-5f9f-45b9-9fad-09945ec98566 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:34.696795 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b5a88094-5f9f-45b9-9fad-09945ec98566 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1258 microversion: 2.1 time: 0.079412 Aug 29 16:30:34.697747 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3657/7138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:34 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:35.717413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-af208796-3140-4337-af85-7836f8a8a139 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:35.718073 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-af208796-3140-4337-af85-7836f8a8a139 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:35.775446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-af208796-3140-4337-af85-7836f8a8a139 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:35.786640 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-af208796-3140-4337-af85-7836f8a8a139 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1258 microversion: 2.1 time: 0.073132 Aug 29 16:30:35.787441 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3482/7139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:35 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:36.807647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:36.808203 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:36.815422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:36.815931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:36.816385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:36.817099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:36.817607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:36.818051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:36.878530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:36.886354 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c63a0fb1-5303-49f0-99eb-ecb16e8670ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1262 microversion: 2.1 time: 0.082700 Aug 29 16:30:36.886938 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3658/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:36 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:37.908285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:37.909566 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:37.918090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:37.918582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:37.919051 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:37.920002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:37.920645 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:37.921409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:38.328506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:38.346657 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0008e6e0-e7aa-41c0-b593-c5f0985cd796 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.442718 Aug 29 16:30:38.350441 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3483/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:37 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:39.372218 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:39.372948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:39.375840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:39.385358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:39.386012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:39.386557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:39.387360 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:39.387905 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:39.388422 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:39.537663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:39.550056 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f25694fc-103b-41af-96e6-902abbd435dd tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.181722 Aug 29 16:30:39.551210 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3659/7142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:39 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:40.572786 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:40.573410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:40.576162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:40.590323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:40.591299 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:40.605470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:40.606266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:40.606869 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:40.607309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:40.761516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:40.770568 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-46dd8569-b226-4c40-9c6a-bc597a8e6836 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.201566 Aug 29 16:30:40.771160 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3484/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:40 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:41.792284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:41.793157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:41.801090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:41.801707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:41.802275 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:41.803070 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:41.803607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:41.804114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:41.945233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:41.953878 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-11be6938-eab8-4ebd-8453-223948e490c8 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.165424 Aug 29 16:30:41.954734 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3660/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:41 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:42.976228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:42.976800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:42.979482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:42.985256 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:42.985778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:42.986215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:42.986982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:42.988344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:42.988344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:43.149964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:43.158475 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5786ac9-f334-4b84-b983-cc40de3a44fc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.186183 Aug 29 16:30:43.159060 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3485/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:42 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:44.183579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:44.184457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:44.191645 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:44.192201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:44.192651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:44.193371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:44.193859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:44.194295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:44.339264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:44.348239 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa74b3ad-2b9d-4ca0-aa8e-2882400605d7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.172500 Aug 29 16:30:44.351540 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3661/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:44 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:45.371020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:45.371695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:45.385139 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:45.386119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:45.386955 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:45.388151 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:45.388754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:45.389287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:45.598691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:45.606538 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d480dc1e-00c2-4b5f-a7a4-73071c475eb7 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.239850 Aug 29 16:30:45.607125 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3486/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:45 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:45.844392 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-29d5a22b-b82d-4649-ba1f-e260a2d5edcb req-7b9e9742-8352-4a91-82df-b69a3fa07ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cb586d-b083-4ac5-a428-62376f5d23d8", "tag": "e16b0786-0660-445d-a230-07d7b446515f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:45.854970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:45.858638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-29d5a22b-b82d-4649-ba1f-e260a2d5edcb req-7b9e9742-8352-4a91-82df-b69a3fa07ba8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:45.859138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-29d5a22b-b82d-4649-ba1f-e260a2d5edcb req-7b9e9742-8352-4a91-82df-b69a3fa07ba8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:45.859914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-29d5a22b-b82d-4649-ba1f-e260a2d5edcb req-7b9e9742-8352-4a91-82df-b69a3fa07ba8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:45.871939 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-29d5a22b-b82d-4649-ba1f-e260a2d5edcb req-7b9e9742-8352-4a91-82df-b69a3fa07ba8 service nova] Creating event network-changed:e16b0786-0660-445d-a230-07d7b446515f for instance b1cb586d-b083-4ac5-a428-62376f5d23d8 on n-h1-854882-3 Aug 29 16:30:45.877345 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-29d5a22b-b82d-4649-ba1f-e260a2d5edcb req-7b9e9742-8352-4a91-82df-b69a3fa07ba8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037109 Aug 29 16:30:45.878034 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3662/7148] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:46.626561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:46.627211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:46.629066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:46.635083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:46.635567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:46.636001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:46.636689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:46.637143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:46.637605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:46.765368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:46.773609 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-494ebec2-5561-4e98-a7fe-a11ac9a51c93 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.150971 Aug 29 16:30:46.774184 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3487/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:46 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:47.795933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:47.796659 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:47.803368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.803867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.804320 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.805024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.805524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.805968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.941852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:47.949697 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cac43ce2-04ab-43e0-95f4-7998bb3958bb tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.158895 Aug 29 16:30:47.950375 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3663/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:47 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:48.970549 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.971104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.978019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.978503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.978973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.979661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.980115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.980542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:49.117708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:49.125217 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d8f6ed17-3561-4dfe-981b-ee2e0a099b7e tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.158722 Aug 29 16:30:49.125819 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3488/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:48 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:50.070472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-43427f6c-27c0-42a3-b800-ae07b25e2b1b req-49ba7515-be09-434e-9609-fb542667de8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cb586d-b083-4ac5-a428-62376f5d23d8", "name": "network-vif-plugged", "status": "completed", "tag": "e16b0786-0660-445d-a230-07d7b446515f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:50.081312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43427f6c-27c0-42a3-b800-ae07b25e2b1b req-49ba7515-be09-434e-9609-fb542667de8f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:50.082605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43427f6c-27c0-42a3-b800-ae07b25e2b1b req-49ba7515-be09-434e-9609-fb542667de8f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:50.083053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43427f6c-27c0-42a3-b800-ae07b25e2b1b req-49ba7515-be09-434e-9609-fb542667de8f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:50.095465 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-43427f6c-27c0-42a3-b800-ae07b25e2b1b req-49ba7515-be09-434e-9609-fb542667de8f service nova] Creating event network-vif-plugged:e16b0786-0660-445d-a230-07d7b446515f for instance b1cb586d-b083-4ac5-a428-62376f5d23d8 on n-h1-854882-3 Aug 29 16:30:50.101123 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-43427f6c-27c0-42a3-b800-ae07b25e2b1b req-49ba7515-be09-434e-9609-fb542667de8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091585 Aug 29 16:30:50.101793 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3664/7152] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:50.146163 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:50.146797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:50.154804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:50.155285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:50.155717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:50.156404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:50.156849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:50.157269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:50.329206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:50.336830 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-08fcf9ca-d2c9-4936-8a8d-d05db7e36868 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.195312 Aug 29 16:30:50.337417 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3489/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:50 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:51.357079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:51.357751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:51.365491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:51.365995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:51.366450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:51.367167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:51.367642 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:51.368083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:51.499523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:51.507535 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c8828d2c-06e7-4168-96be-4e0601cd969f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1358 microversion: 2.1 time: 0.154716 Aug 29 16:30:51.508120 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3665/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:51 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:52.528307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:52.528953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:52.535836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.536319 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.536762 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.537482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.537936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.538368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.666886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:52.674567 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ccbc9c8-f467-4258-8c9d-801f6bd4e387 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1549 microversion: 2.1 time: 0.150291 Aug 29 16:30:52.675145 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3490/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:52 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:52.695137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:52.695775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:52.702668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.703383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.703842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.704559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.705034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.705517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.840261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:52.848481 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-96541a5e-8027-4f1b-9da9-74501e5392ca tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1549 microversion: 2.1 time: 0.157205 Aug 29 16:30:52.849046 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3666/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:52 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:52.873584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:52.878813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:52.879581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Searching by: {'deleted': False, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc'} {{(pid=130001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:30:52.884778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.885249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.885707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.886422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.886864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.887285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.910510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.multi_cell_list [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:30:52.936517 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9f75dda1-42a4-4976-9456-ee70f1225ed1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066792 Aug 29 16:30:52.937089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3491/7157] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 16:30:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:52.948657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:52.949289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:52.955278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.955773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.956221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.957543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.958011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.958450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:53.085282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:53.093069 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-42edf035-ddfb-4e29-b41f-61bee909367a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1549 microversion: 2.1 time: 0.148215 Aug 29 16:30:53.093673 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3667/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:52 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:54.596820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4608614b-eb8d-413a-ac49-202400e48830"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:54.599961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:54.606617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:54.607102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:54.607536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:54.608224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:54.608677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:54.609105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:54.854544 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ced85593-29c8-4c54-9f75-d3806c087a7a tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261537 Aug 29 16:30:54.855184 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3492/7159] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Aug 29 16:30:54 2022] POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:05.618000 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:05.618637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:05.621235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=17 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:05.621935 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=52 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:05.628030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:05.628535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:05.628993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:05.630250 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:05.630726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:05.631175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:05.764071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:05.772226 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9235354c-ad33-45ba-9b58-3f2a024c26a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1595 microversion: 2.1 time: 0.158294 Aug 29 16:31:05.772794 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3668/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:05 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:07.356484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:07.357247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=17 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:07.357956 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:07.362340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b5dd9c31-b661-40b8-83a8-dd6a05d58e82 req-8176014f-d352-446a-9d3c-47bfe126b125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cb586d-b083-4ac5-a428-62376f5d23d8", "tag": "e16b0786-0660-445d-a230-07d7b446515f"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:07.373017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b5dd9c31-b661-40b8-83a8-dd6a05d58e82 req-8176014f-d352-446a-9d3c-47bfe126b125 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:07.373521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b5dd9c31-b661-40b8-83a8-dd6a05d58e82 req-8176014f-d352-446a-9d3c-47bfe126b125 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:07.373943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b5dd9c31-b661-40b8-83a8-dd6a05d58e82 req-8176014f-d352-446a-9d3c-47bfe126b125 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:07.385909 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b5dd9c31-b661-40b8-83a8-dd6a05d58e82 req-8176014f-d352-446a-9d3c-47bfe126b125 service nova] Creating event network-changed:e16b0786-0660-445d-a230-07d7b446515f for instance b1cb586d-b083-4ac5-a428-62376f5d23d8 on n-h1-854882-3 Aug 29 16:31:07.391078 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b5dd9c31-b661-40b8-83a8-dd6a05d58e82 req-8176014f-d352-446a-9d3c-47bfe126b125 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Aug 29 16:31:07.392070 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3493/7161] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:08.778452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-98450510"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:08.779011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:08.785968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:08.786470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:08.786928 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:08.787643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:08.788118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:08.788564 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:08.919038 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.network.security_group_api [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Adding security group c919c33c-aa21-4b1a-a5b9-194585f7d1a9 to port e16b0786-0660-445d-a230-07d7b446515f Aug 29 16:31:09.236395 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f1ccdbad-29f6-4ec7-89f3-465ff920685c tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/action" status: 202 len: 0 microversion: 2.1 time: 0.461803 Aug 29 16:31:09.237332 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3669/7162] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:31:08 2022] POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:31:09.247181 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:09.247889 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:09.255156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:09.255637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:09.256361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:09.257066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:09.257554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:09.257987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:09.407454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-7e9c00f4-bd29-4310-a3cf-f3c6fdf9b1c9 req-768a86f7-4cd8-4ba0-8e5c-08c37019f66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cb586d-b083-4ac5-a428-62376f5d23d8", "tag": "e16b0786-0660-445d-a230-07d7b446515f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:09.417913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:09.418722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7e9c00f4-bd29-4310-a3cf-f3c6fdf9b1c9 req-768a86f7-4cd8-4ba0-8e5c-08c37019f66e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:09.419528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7e9c00f4-bd29-4310-a3cf-f3c6fdf9b1c9 req-768a86f7-4cd8-4ba0-8e5c-08c37019f66e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:09.419982 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-7e9c00f4-bd29-4310-a3cf-f3c6fdf9b1c9 req-768a86f7-4cd8-4ba0-8e5c-08c37019f66e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:09.427714 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-024c5263-dacc-423c-a86e-f5ad82fe248b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1758 microversion: 2.1 time: 0.185838 Aug 29 16:31:09.428394 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3494/7163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:09 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:09.432759 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-7e9c00f4-bd29-4310-a3cf-f3c6fdf9b1c9 req-768a86f7-4cd8-4ba0-8e5c-08c37019f66e service nova] Creating event network-changed:e16b0786-0660-445d-a230-07d7b446515f for instance b1cb586d-b083-4ac5-a428-62376f5d23d8 on n-h1-854882-3 Aug 29 16:31:09.438312 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-7e9c00f4-bd29-4310-a3cf-f3c6fdf9b1c9 req-768a86f7-4cd8-4ba0-8e5c-08c37019f66e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035233 Aug 29 16:31:09.439059 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3670/7164] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:31:23.425899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:23.428838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:23.431834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:23.432535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=8 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:23.439245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:23.439727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:23.440162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:23.440902 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:23.441353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:23.441815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:23.519458 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a1f316a-4d0d-47bb-a27f-637b458f31e5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/action" status: 202 len: 0 microversion: 2.1 time: 0.097229 Aug 29 16:31:23.520124 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3495/7165] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:31:23 2022] POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:31:23.526686 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:31:23.530633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:23.531471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:23.534296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:23.535140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:23.541686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:23.542038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:23.542505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:23.543301 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:23.543805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:23.544258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:23.715215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:23.723732 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8f1e3185-b062-4024-8031-89476ec4bd19 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1750 microversion: 2.1 time: 0.198579 Aug 29 16:31:23.724319 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3671/7166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:23 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1750 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:24.745630 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:24.746342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:24.753103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:24.753692 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:24.754134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:24.754827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:24.755289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:24.755716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:24.902138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:24.910471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31aecdbe-e94b-48ca-99a7-2a12a7db1080 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.169168 Aug 29 16:31:24.911038 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3496/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:24 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:25.932752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:25.933502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:25.941454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:25.941958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:25.942415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:25.943129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:25.943601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:25.944047 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:25.966824 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53970. Aug 29 16:31:26.094323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:26.103860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2a759ec9-17a3-40c7-ae05-dae6a0d0165f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.175468 Aug 29 16:31:26.104441 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3672/7168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:25 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:27.124099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:27.124766 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:27.131980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:27.132453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:27.132881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:27.133582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:27.134027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:27.134442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:27.274683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:27.283182 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cc730a2b-8de3-4d4f-b001-64ca6bf709e0 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.163009 Aug 29 16:31:27.283754 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3497/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:27 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:28.304917 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:28.305633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:28.312810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:28.313311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:28.313793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:28.314506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:28.314984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:28.315428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:28.463382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:28.471596 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a8f4071-4f42-44be-bd83-e601b78f9866 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.171155 Aug 29 16:31:28.472175 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3673/7170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:28 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:29.493952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:29.494610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:29.501599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:29.502086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:29.502524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:29.503227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:29.503680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:29.504105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:29.657913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:29.667005 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-123e5347-904c-4d95-a186-bbea3696e227 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.177489 Aug 29 16:31:29.667703 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3498/7171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:29 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:30.690238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:30.690906 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:30.698381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:30.698879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:30.699329 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:30.700039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:30.700511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:30.700955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:30.842015 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:30.850255 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5cc6e913-454f-4939-b329-22f3a49be5d2 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.164013 Aug 29 16:31:30.850833 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3674/7172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:30 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:31.916636 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:31.917248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:31.923206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:31.923705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:31.924161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:31.924833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:31.925287 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:31.925739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:32.068235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:32.078609 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4138f198-fe61-4175-b737-8830723e1fed tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.210771 Aug 29 16:31:32.079460 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3499/7173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:31 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:33.101089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:33.101755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:33.108321 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:33.108821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:33.109274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:33.110019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:33.110497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:33.111002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:33.266455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:33.274887 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3231d4db-b32f-46d6-864a-c79d21751d13 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.178356 Aug 29 16:31:33.275457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3675/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:33 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:34.295792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:34.296405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:34.303717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:34.304190 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:34.304642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:34.305322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:34.305796 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:34.306214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:34.450900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:34.459786 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a8edc4f6-d829-45d5-ad12-c92e19990990 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1755 microversion: 2.1 time: 0.167892 Aug 29 16:31:34.460363 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3500/7175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:34 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:35.480878 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:35.481538 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:35.488455 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:35.488956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:35.489425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:35.490133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:35.490603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:35.491040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:35.634820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:35.643050 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d484eabe-547d-49c5-8112-5d20049b78dc tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1758 microversion: 2.1 time: 0.166189 Aug 29 16:31:35.643630 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3676/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:35 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:08.056027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-98450510"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:08.056628 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:08.059074 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=12 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:08.059757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:08.066105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:08.066587 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:08.067020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:08.067710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:08.068187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:08.068605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:08.200970 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.network.security_group_api [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Removing security group c919c33c-aa21-4b1a-a5b9-194585f7d1a9 from port e16b0786-0660-445d-a230-07d7b446515f Aug 29 16:32:08.501348 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2fd41946-37e8-402d-8768-e7cf325f8f5b tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/action" status: 202 len: 0 microversion: 2.1 time: 0.445966 Aug 29 16:32:08.508307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-af048087-4e43-4a92-8d75-89fdcf7f32a7 req-5b342d27-cb25-49f3-bb0b-f28c3f527c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cb586d-b083-4ac5-a428-62376f5d23d8", "tag": "e16b0786-0660-445d-a230-07d7b446515f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:08.513580 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3501/7177] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:32:08 2022] POST /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:32:08.518921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:08.519902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=36 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:08.523295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-af048087-4e43-4a92-8d75-89fdcf7f32a7 req-5b342d27-cb25-49f3-bb0b-f28c3f527c71 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:08.524463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-af048087-4e43-4a92-8d75-89fdcf7f32a7 req-5b342d27-cb25-49f3-bb0b-f28c3f527c71 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:08.525567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-af048087-4e43-4a92-8d75-89fdcf7f32a7 req-5b342d27-cb25-49f3-bb0b-f28c3f527c71 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:08.542388 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-af048087-4e43-4a92-8d75-89fdcf7f32a7 req-5b342d27-cb25-49f3-bb0b-f28c3f527c71 service nova] Creating event network-changed:e16b0786-0660-445d-a230-07d7b446515f for instance b1cb586d-b083-4ac5-a428-62376f5d23d8 on n-h1-854882-3 Aug 29 16:32:08.548562 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-af048087-4e43-4a92-8d75-89fdcf7f32a7 req-5b342d27-cb25-49f3-bb0b-f28c3f527c71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043739 Aug 29 16:32:08.549874 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3677/7178] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:10.060201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:10.060973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:10.063334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3a001d95-0cc9-4c4e-9269-5e1b89660c37 req-e6bdd34b-14f7-4f2d-8588-e0d631eb47fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cb586d-b083-4ac5-a428-62376f5d23d8", "tag": "e16b0786-0660-445d-a230-07d7b446515f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:10.067313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:10.067800 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:10.068238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:10.069664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:10.070306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:10.070734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:10.075986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3a001d95-0cc9-4c4e-9269-5e1b89660c37 req-e6bdd34b-14f7-4f2d-8588-e0d631eb47fe service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:10.076491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3a001d95-0cc9-4c4e-9269-5e1b89660c37 req-e6bdd34b-14f7-4f2d-8588-e0d631eb47fe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:10.076942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3a001d95-0cc9-4c4e-9269-5e1b89660c37 req-e6bdd34b-14f7-4f2d-8588-e0d631eb47fe service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:10.088477 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3a001d95-0cc9-4c4e-9269-5e1b89660c37 req-e6bdd34b-14f7-4f2d-8588-e0d631eb47fe service nova] Creating event network-changed:e16b0786-0660-445d-a230-07d7b446515f for instance b1cb586d-b083-4ac5-a428-62376f5d23d8 on n-h1-854882-3 Aug 29 16:32:10.094098 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3a001d95-0cc9-4c4e-9269-5e1b89660c37 req-e6bdd34b-14f7-4f2d-8588-e0d631eb47fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037160 Aug 29 16:32:10.095605 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3678/7179] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:10.157141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lazy-loading 'services' on Instance uuid b1cb586d-b083-4ac5-a428-62376f5d23d8 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:32:10.239473 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0a69b9da-9c91-4fc2-9f37-2664b51c1f12 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments/4608614b-eb8d-413a-ac49-202400e48830" status: 202 len: 0 microversion: 2.1 time: 0.184263 Aug 29 16:32:10.240497 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3502/7180] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:32:10 2022] DELETE /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments/4608614b-eb8d-413a-ac49-202400e48830 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:32:10.252127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:10.255677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:10.268773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:10.270518 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:10.271027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:10.271985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:10.272494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:10.272977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:10.315296 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-077a4951-d273-46f6-a110-45df8904d8db tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069675 Aug 29 16:32:10.316082 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3679/7181] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:10 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:11.330040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:11.332474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:11.339520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:11.340125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:11.341000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:11.341830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:11.342285 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:11.342715 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:11.374911 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-896ffe3b-f355-4d98-a852-7d72761efd11 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049546 Aug 29 16:32:11.375702 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3503/7182] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:11 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:12.387153 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:12.389368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:12.396764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:12.397261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:12.397781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:12.398471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:12.398933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:12.399369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:12.428860 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2eeafa00-b412-49b6-90d7-293d569065f1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Aug 29 16:32:12.429457 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3680/7183] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:12 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:13.441511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:13.443650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:13.450489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:13.450998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:13.451434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:13.452126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:13.452578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:13.452997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:13.481323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7ddb5a8d-d29d-49b9-bdf6-90a31280e0a4 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Aug 29 16:32:13.481916 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3504/7184] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:13 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:32:14.494600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:14.496815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:14.504735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:14.505239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:14.505714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:14.506430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:14.506896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:14.507331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:14.538771 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-10ad15e2-2a5a-4c28-bbe9-1fa1bfd20b98 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048090 Aug 29 16:32:14.539564 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3681/7185] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:14 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:15.551846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:15.554077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:15.561245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:15.561996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:15.562569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:15.563393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:15.563850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:15.564278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:15.593851 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c945e147-1e2a-4dc2-ae12-7196ae63b4d5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045950 Aug 29 16:32:15.594416 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3505/7186] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:15 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 16:32:15.604788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:15.605319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:15.614160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:15.614661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:15.615117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:15.615834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:15.616304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:15.616774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:15.692175 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] HTTP exception thrown: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 is not attached to volume 4608614b-eb8d-413a-ac49-202400e48830 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Request method failure captured: Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: request: DELETE /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments/4608614b-eb8d-413a-ac49-202400e48830 HTTP/1.1 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOix2QkebbmNu6vjhuLt2zvz9HXLtaGusdwyC_Ef1u0wXn9GxkDs2nIlyJm6rO0zWd_a5Mwhyz7VA6471_F0TXnBj57uWuTV52UCGlRUQVqMOiuoprIOo6E4RBLB692BVMYunw06q3hRH3MdVPOYeavEKrIhIFmR-dbKr4oZh1FRY40 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bce727fbf3f646fbb1353cfc0072bbcc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}] Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3bf90dbc02fd42a6b9911f76ccea3b69 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 is not attached to volume 4608614b-eb8d-413a-ac49-202400e48830 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'server_id': 'b1cb586d-b083-4ac5-a428-62376f5d23d8', 'id': '4608614b-eb8d-413a-ac49-202400e48830'} Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4608614b-eb8d-413a-ac49-202400e48830. Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 is not attached to volume 4608614b-eb8d-413a-ac49-202400e48830 Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:15.693858 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:15.698412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:15.698412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:15.698412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 is not attached to volume 4608614b-eb8d-413a-ac49-202400e48830 Aug 29 16:32:15.698412 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:15.698412 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Returning 404 to user: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 is not attached to volume 4608614b-eb8d-413a-ac49-202400e48830 {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:15.698412 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9c168490-9775-4fe5-9a44-c958cce41f20 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments/4608614b-eb8d-413a-ac49-202400e48830" status: 404 len: 154 microversion: 2.1 time: 0.094645 Aug 29 16:32:15.698412 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3682/7187] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Aug 29 16:32:15 2022] DELETE /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8/os-volume_attachments/4608614b-eb8d-413a-ac49-202400e48830 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:18.942705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:18.943232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:18.951157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:18.951641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:18.952571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:18.953292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:18.953747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:18.954178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:18.980501 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:32:19.065070 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b6f91ddd-8b94-4e6f-baa9-c15d7b648ec5 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 204 len: 0 microversion: 2.1 time: 0.125960 Aug 29 16:32:19.066036 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3506/7188] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:32:18 2022] DELETE /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:32:19.075882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:19.078010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:19.086280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:19.086793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:19.087257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:19.087991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:19.088469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:19.088922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:19.224480 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:19.232435 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d62cb559-72e0-4c54-af8f-96a964d364ce tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1555 microversion: 2.1 time: 0.162121 Aug 29 16:32:19.233011 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3683/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:19 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:20.254221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:20.254922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:20.261675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:20.262158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:20.262586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:20.263272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:20.263717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:20.264135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:20.401721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:20.410115 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-212b9869-f5d0-4ba5-b952-c41fc7c626a1 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1555 microversion: 2.1 time: 0.160282 Aug 29 16:32:20.410712 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3507/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:20 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:21.147262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a0ae32f8-0f51-453b-9c68-75651b898ea7 req-9d5375f5-38cc-4a3b-ade7-b43fc5458ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cb586d-b083-4ac5-a428-62376f5d23d8", "name": "network-vif-deleted", "tag": "e16b0786-0660-445d-a230-07d7b446515f"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:21.158017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a0ae32f8-0f51-453b-9c68-75651b898ea7 req-9d5375f5-38cc-4a3b-ade7-b43fc5458ef2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:21.158511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a0ae32f8-0f51-453b-9c68-75651b898ea7 req-9d5375f5-38cc-4a3b-ade7-b43fc5458ef2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:21.158948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a0ae32f8-0f51-453b-9c68-75651b898ea7 req-9d5375f5-38cc-4a3b-ade7-b43fc5458ef2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:21.171310 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a0ae32f8-0f51-453b-9c68-75651b898ea7 req-9d5375f5-38cc-4a3b-ade7-b43fc5458ef2 service nova] Creating event network-vif-deleted:e16b0786-0660-445d-a230-07d7b446515f for instance b1cb586d-b083-4ac5-a428-62376f5d23d8 on n-h1-854882-3 Aug 29 16:32:21.176121 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a0ae32f8-0f51-453b-9c68-75651b898ea7 req-9d5375f5-38cc-4a3b-ade7-b43fc5458ef2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Aug 29 16:32:21.176729 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3684/7191] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:21.431119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:21.431867 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:21.439748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:21.440244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:21.440686 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:21.441417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:21.441873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:21.442298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:21.475249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:21.475803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:21.476173 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:21.476629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lazy-loading 'fault' on Instance uuid b1cb586d-b083-4ac5-a428-62376f5d23d8 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:32:21.525603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf90dbc02fd42a6b9911f76ccea3b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce727fbf3f646fbb1353cfc0072bbcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:21.534304 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d0601d4a-1389-457f-a5d0-7eeb1f79e090 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 200 len: 1348 microversion: 2.1 time: 0.107060 Aug 29 16:32:21.541562 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3508/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:21 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:22.556387 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:22.557105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] [instance: b1cb586d-b083-4ac5-a428-62376f5d23d8] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:22.563555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:22.564050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:22.564506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:22.565202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:22.565691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:22.566126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:22.580155 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] HTTP exception thrown: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 could not be found. Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Request method failure captured: Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 HTTP/1.1 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOix2QkebbmNu6vjhuLt2zvz9HXLtaGusdwyC_Ef1u0wXn9GxkDs2nIlyJm6rO0zWd_a5Mwhyz7VA6471_F0TXnBj57uWuTV52UCGlRUQVqMOiuoprIOo6E4RBLB692BVMYunw06q3hRH3MdVPOYeavEKrIhIFmR-dbKr4oZh1FRY40 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bce727fbf3f646fbb1353cfc0072bbcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bce727fbf3f646fbb1353cfc0072bbcc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bce727fbf3f646fbb1353cfc0072bbcc"}]}] Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: bce727fbf3f646fbb1353cfc0072bbcc Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1113799023 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 3bf90dbc02fd42a6b9911f76ccea3b69 Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestMinimumBasicScenario-1113799023-project Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 could not be found. Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b1cb586d-b083-4ac5-a428-62376f5d23d8'} Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 could not be found. Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 could not be found. Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:22.581809 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 could not be found. Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Returning 404 to user: Instance b1cb586d-b083-4ac5-a428-62376f5d23d8 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-03b38ed3-908d-4662-97e4-87ec247b1951 tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8" status: 404 len: 111 microversion: 2.1 time: 0.032028 Aug 29 16:32:22.586244 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3685/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:22 2022] GET /compute/v2.1/servers/b1cb586d-b083-4ac5-a428-62376f5d23d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:22.591974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c5ba0dc2-8d06-44c6-8ccf-63ef67d8f08f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] Calling method '.version_select at 0x7fb0e28015e0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:22.613972 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c5ba0dc2-8d06-44c6-8ccf-63ef67d8f08f tempest-TestMinimumBasicScenario-1113799023 tempest-TestMinimumBasicScenario-1113799023-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-776070452" status: 202 len: 0 microversion: 2.1 time: 0.025746 Aug 29 16:32:22.614545 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3509/7194] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 16:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-776070452 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:32:31.627853 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a410ae59-27ef-469b-85ea-51915b76ea0a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: .version_select at 0x7fb0e06dc700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1904337126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjA211txBFYJMp3WjIwOFZgLhVdxIpXSm8jkdoEBdik+0S54HjRO9pjco8NAxZMpaL9VN3A0z5IdtpI75gCxNZ4k5WrAUSKdVMqjJfaVJGapWMlMB7nEGPVSSLpvDMS5g=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:31.644334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a410ae59-27ef-469b-85ea-51915b76ea0a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:31.649481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a410ae59-27ef-469b-85ea-51915b76ea0a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:31.676371 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a410ae59-27ef-469b-85ea-51915b76ea0a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.214435 Aug 29 16:32:31.676973 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3686/7195] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:32:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:37.740934 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:37.742251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:37.747055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1737929080", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "b523f687-33f4-4b6f-804c-264f414b1bde"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1904337126", "security_groups": [{"name": "tempest-secgroup-smoke-1568525337"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:37.874957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] validate_networks() for [('b523f687-33f4-4b6f-804c-264f414b1bde', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:32:38.307371 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:32:38.307810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:32:38.308468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:32:38.309021 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:32:38.309651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:32:38.319815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:38.320296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:38.320727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:38.321517 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:38.321901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:38.322317 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:38.343529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:38.349109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:38.365176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:32:38.367637 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:32:38.424569 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1faedad-b227-4cae-9cc8-5028b33b31c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685905 Aug 29 16:32:38.425238 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3510/7196] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:32:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:32:38.434369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=38 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:38.438959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d31962ef-a83a-4ad5-b238-02d1b6ccbf0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:38.439621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d31962ef-a83a-4ad5-b238-02d1b6ccbf0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:38.500052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d31962ef-a83a-4ad5-b238-02d1b6ccbf0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:38.507320 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d31962ef-a83a-4ad5-b238-02d1b6ccbf0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1267 microversion: 2.1 time: 0.074745 Aug 29 16:32:38.507906 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3687/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:38 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:39.528296 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b50723a7-088d-4017-990c-e370973fed8f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:39.528909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b50723a7-088d-4017-990c-e370973fed8f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:39.597122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b50723a7-088d-4017-990c-e370973fed8f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:39.604896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b50723a7-088d-4017-990c-e370973fed8f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1267 microversion: 2.1 time: 0.080605 Aug 29 16:32:39.605516 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3511/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:39 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:40.626876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cc43ef80-dd27-45c5-8e81-43ec2394f098 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:40.627416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cc43ef80-dd27-45c5-8e81-43ec2394f098 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:40.631453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:40.688821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cc43ef80-dd27-45c5-8e81-43ec2394f098 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:40.696078 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cc43ef80-dd27-45c5-8e81-43ec2394f098 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1267 microversion: 2.1 time: 0.073764 Aug 29 16:32:40.696983 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3688/7199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:40 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:41.716933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52890cfb-286c-4932-93ec-135908d4c889 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:41.717474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-52890cfb-286c-4932-93ec-135908d4c889 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:41.771793 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-52890cfb-286c-4932-93ec-135908d4c889 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:41.778584 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-52890cfb-286c-4932-93ec-135908d4c889 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1267 microversion: 2.1 time: 0.065920 Aug 29 16:32:41.779155 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3512/7200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:41 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1267 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:42.799257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:42.799955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:42.806999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:42.807504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:42.807948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:42.808655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:42.809118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:42.809586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:42.877050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:42.885082 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9b2dd87b-b711-4395-a4e6-dd5add358b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1271 microversion: 2.1 time: 0.089733 Aug 29 16:32:42.885705 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3689/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:42 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:43.907232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:43.907831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:43.915382 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:43.916014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:43.916398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:43.917081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:43.917561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:43.917982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:43.994619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:44.002318 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ef619437-91f3-436f-b77f-719cab2bc291 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1325 microversion: 2.1 time: 0.099551 Aug 29 16:32:44.002957 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3513/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:43 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1325 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:45.024124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:45.024886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:45.032185 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:45.032801 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:45.033332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:45.034157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:45.034711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:45.035266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:45.173354 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:45.181657 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f2dfcc6a-f336-4256-b2d0-7faaf4d706e0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1393 microversion: 2.1 time: 0.161322 Aug 29 16:32:45.185709 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3690/7203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:45 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:45.218508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-74138092-235f-4ffa-af7d-e0f2d5298e82 req-c650a0c2-e24e-4075-bff7-28c25bb2e068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884016cb-372e-4e92-8edc-2e45ca20514a", "tag": "f1d71491-bd09-46b7-8913-1e3c10404e26"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:45.229487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-74138092-235f-4ffa-af7d-e0f2d5298e82 req-c650a0c2-e24e-4075-bff7-28c25bb2e068 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:45.230187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-74138092-235f-4ffa-af7d-e0f2d5298e82 req-c650a0c2-e24e-4075-bff7-28c25bb2e068 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:45.231409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-74138092-235f-4ffa-af7d-e0f2d5298e82 req-c650a0c2-e24e-4075-bff7-28c25bb2e068 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:45.248477 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-74138092-235f-4ffa-af7d-e0f2d5298e82 req-c650a0c2-e24e-4075-bff7-28c25bb2e068 service nova] Creating event network-changed:f1d71491-bd09-46b7-8913-1e3c10404e26 for instance 884016cb-372e-4e92-8edc-2e45ca20514a on n-h1-854882-3 Aug 29 16:32:45.255448 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-74138092-235f-4ffa-af7d-e0f2d5298e82 req-c650a0c2-e24e-4075-bff7-28c25bb2e068 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040814 Aug 29 16:32:45.256130 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3514/7204] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:46.204294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:46.204954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:46.211734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:46.212235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:46.212682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:46.213411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:46.213885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:46.214325 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:46.347249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:46.354934 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c943edbe-af0f-4895-aeb7-8245a40d5a14 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1393 microversion: 2.1 time: 0.155221 Aug 29 16:32:46.355512 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3691/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:46 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:47.375731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:47.376456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:47.383494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:47.383971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:47.384407 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:47.385087 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:47.385576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:47.385999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:47.529577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:47.537995 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e85efaf1-f503-45d2-a621-9e31c5df4283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1393 microversion: 2.1 time: 0.166582 Aug 29 16:32:47.538582 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3515/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:47 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:48.558997 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:48.559641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:48.567686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:48.568352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:48.568945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:48.569962 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:48.570497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:48.571106 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:48.714429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:48.722833 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d54d34ae-652f-4ab1-beea-235b9923b786 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1393 microversion: 2.1 time: 0.167809 Aug 29 16:32:48.723417 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3692/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:48 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:49.743773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:49.744294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:49.746303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:49.753272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:49.753778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:49.754219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:49.754909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:49.755632 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:49.756065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:49.892860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:49.900507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d446a10f-6048-49b1-a036-17bd1e1fe665 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1393 microversion: 2.1 time: 0.160758 Aug 29 16:32:49.901124 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3516/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:49 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:50.602114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6c7457ea-9734-4582-85f2-9609d0cbc611 req-4f9d02da-0f86-491c-8f08-669947262ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884016cb-372e-4e92-8edc-2e45ca20514a", "name": "network-vif-plugged", "status": "completed", "tag": "f1d71491-bd09-46b7-8913-1e3c10404e26"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:50.614950 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6c7457ea-9734-4582-85f2-9609d0cbc611 req-4f9d02da-0f86-491c-8f08-669947262ea0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:50.615448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6c7457ea-9734-4582-85f2-9609d0cbc611 req-4f9d02da-0f86-491c-8f08-669947262ea0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:50.615890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6c7457ea-9734-4582-85f2-9609d0cbc611 req-4f9d02da-0f86-491c-8f08-669947262ea0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:50.627182 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6c7457ea-9734-4582-85f2-9609d0cbc611 req-4f9d02da-0f86-491c-8f08-669947262ea0 service nova] Creating event network-vif-plugged:f1d71491-bd09-46b7-8913-1e3c10404e26 for instance 884016cb-372e-4e92-8edc-2e45ca20514a on n-h1-854882-3 Aug 29 16:32:50.632413 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6c7457ea-9734-4582-85f2-9609d0cbc611 req-4f9d02da-0f86-491c-8f08-669947262ea0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034053 Aug 29 16:32:50.633014 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3693/7209] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:50.922045 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:50.922665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:50.929473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:50.929953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:50.930394 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:50.931086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:50.931540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:50.931971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:51.063013 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:51.070886 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-18090d83-5fd0-4347-9d43-c0fdfccef3b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1393 microversion: 2.1 time: 0.153426 Aug 29 16:32:51.071530 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3517/7210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:50 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:52.092600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:52.093331 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:52.095326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:52.101909 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.102413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.102867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.103577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.104053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.104496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.235262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:52.243310 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5e18a8c6-32d2-4b67-90a6-e07720d76813 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1564 microversion: 2.1 time: 0.154995 Aug 29 16:32:52.243892 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3694/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:52 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:32:52.263453 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:52.264070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:52.266569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:52.272496 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.272980 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.273513 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.274207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.274664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.275091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.404058 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:52.411742 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9d3e60ce-523d-426a-9abe-c1e48a89ec07 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1564 microversion: 2.1 time: 0.152148 Aug 29 16:32:52.412326 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3518/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:52 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:54.021105 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:54.021772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:54.023861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b78dcaf5-b86e-4fed-a9a5-7b7084afd9ef req-cb358dc6-387f-4d0b-bdbe-ec3790b425d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884016cb-372e-4e92-8edc-2e45ca20514a", "tag": "f1d71491-bd09-46b7-8913-1e3c10404e26"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:54.029154 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:54.029698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:54.030316 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:54.031198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:54.031671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:54.032117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:54.034831 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b78dcaf5-b86e-4fed-a9a5-7b7084afd9ef req-cb358dc6-387f-4d0b-bdbe-ec3790b425d3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:54.035573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b78dcaf5-b86e-4fed-a9a5-7b7084afd9ef req-cb358dc6-387f-4d0b-bdbe-ec3790b425d3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:54.036007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b78dcaf5-b86e-4fed-a9a5-7b7084afd9ef req-cb358dc6-387f-4d0b-bdbe-ec3790b425d3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:54.047920 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b78dcaf5-b86e-4fed-a9a5-7b7084afd9ef req-cb358dc6-387f-4d0b-bdbe-ec3790b425d3 service nova] Creating event network-changed:f1d71491-bd09-46b7-8913-1e3c10404e26 for instance 884016cb-372e-4e92-8edc-2e45ca20514a on n-h1-854882-3 Aug 29 16:32:54.054431 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b78dcaf5-b86e-4fed-a9a5-7b7084afd9ef req-cb358dc6-387f-4d0b-bdbe-ec3790b425d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Aug 29 16:32:54.055300 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3519/7213] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:32:54.177887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:54.190017 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-231e45b8-03ff-4b4f-a2f2-74b34117d77f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1564 microversion: 2.1 time: 0.172577 Aug 29 16:32:54.190624 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3695/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:54 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:17.442248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:17.442999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=36 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:17.447646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:17.449951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:17.457996 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.458479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.458919 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.459608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.460065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.460494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.524689 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5ad864ab-3b78-4b93-89e3-7a1fcd6e8b46 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action" status: 200 len: 24568 microversion: 2.1 time: 0.084230 Aug 29 16:33:17.525350 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3520/7215] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:33:17 2022] POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action => generated 24568 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:33:23.965831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:23.966410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:23.968591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=17 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:23.969454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=38 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:23.975210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:23.975714 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:23.976167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:23.976895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:23.977352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:23.977834 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:24.045882 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bc0c080b-3e0b-4bc3-afa4-5abbbdc6f587 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action" status: 202 len: 0 microversion: 2.1 time: 0.083504 Aug 29 16:33:24.046540 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3696/7216] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:33:23 2022] POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:33:24.055134 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:24.055830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:24.063982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:24.064481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:24.064914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:24.065626 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:24.066083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:24.066502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:24.210208 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:24.219471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed8addc6-58e9-4dd2-af98-49341008264c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1688 microversion: 2.1 time: 0.168447 Aug 29 16:33:24.220217 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3521/7217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:24 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:25.244232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:25.244953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:25.252167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:25.252678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:25.253117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:25.253859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:25.254335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:25.254780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:25.390596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:25.399050 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ba56da18-418f-4493-b318-d472868ee075 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1668 microversion: 2.1 time: 0.160031 Aug 29 16:33:25.399628 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3697/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:25 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:26.502126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:26.504411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:26.512623 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.513106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.513642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:26.514829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.515286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.515707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:26.568745 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2fa7a41d-f6ff-41fc-b79d-1fe5ff2e0b30 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action" status: 200 len: 32643 microversion: 2.1 time: 0.072072 Aug 29 16:33:26.569421 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3522/7219] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:33:26 2022] POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action => generated 32643 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:33:26.582152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:26.582705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:26.592588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.593724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.594242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:26.594996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.595483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.595999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:26.667016 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7fb66c94-34fb-4834-8a56-5d0c2ce20667 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action" status: 202 len: 0 microversion: 2.1 time: 0.088609 Aug 29 16:33:26.667660 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3698/7220] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:33:26 2022] POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:33:26.676698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:26.677413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:26.685175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.685844 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.686702 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:26.687473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.688140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.688411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:26.838495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:26.846946 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9830f6f7-e405-42a5-ae83-ad8c4ff091be tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1675 microversion: 2.1 time: 0.174604 Aug 29 16:33:26.847516 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3523/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:26 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:27.871317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:27.871967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:27.878711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:27.879217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:27.879673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:27.880383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:27.880858 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:27.881303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:28.014189 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:28.021969 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9e1f1905-8080-4fa3-aff9-ad11d824b3e2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1675 microversion: 2.1 time: 0.155818 Aug 29 16:33:28.022542 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3699/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:27 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:29.043155 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:29.043767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:29.050981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:29.051599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:29.052029 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:29.052708 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:29.053153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:29.053600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:29.183152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:29.191770 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-20ff9dac-1d0e-4717-914f-719e1c700cd1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1675 microversion: 2.1 time: 0.152575 Aug 29 16:33:29.192337 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3524/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:29 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:30.213817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:30.214373 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:30.221682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:30.222183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:30.222633 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:30.223364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:30.223830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:30.224267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:30.352536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:30.360173 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2dd71cdc-278d-43a9-beb3-099dc195d814 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1675 microversion: 2.1 time: 0.150402 Aug 29 16:33:30.360736 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3700/7224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:30 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:31.381125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:31.381927 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:31.388675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:31.389753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:31.390186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:31.390860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:31.391306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:31.391722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:31.534689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:31.542688 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8ac70d62-2d3c-423c-8b7c-f49ec7890cd3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1675 microversion: 2.1 time: 0.165504 Aug 29 16:33:31.543265 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3525/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:31 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:32.564231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:32.564863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:32.571565 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:32.572069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:32.572524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:32.573270 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:32.573822 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:32.574507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:32.708245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:32.716108 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ee64528f-5bdf-4103-b77e-f2aa02f94c7a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1683 microversion: 2.1 time: 0.156184 Aug 29 16:33:32.716690 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3701/7226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:32 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:32.808836 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:32.811130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:32.818512 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:32.818999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:32.819436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:32.820127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:32.820583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:32.821008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:32.871313 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-43210829-645d-4a61-8a7e-0906ee2ed73d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action" status: 200 len: 38453 microversion: 2.1 time: 0.066329 Aug 29 16:33:32.871956 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3526/7227] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:33:32 2022] POST /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a/action => generated 38453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:33:34.145128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:34.146322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:34.156410 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:34.156911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:34.157359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:34.158094 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:34.158559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:34.158993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:34.206780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:33:34.215614 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-88167294-9304-4a5f-9d45-4ab90dd5fd1e req-3233ebd7-f93f-438d-b40f-e537ad7e5bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884016cb-372e-4e92-8edc-2e45ca20514a", "tag": "f1d71491-bd09-46b7-8913-1e3c10404e26"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:34.229309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-88167294-9304-4a5f-9d45-4ab90dd5fd1e req-3233ebd7-f93f-438d-b40f-e537ad7e5bb2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:34.230072 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-88167294-9304-4a5f-9d45-4ab90dd5fd1e req-3233ebd7-f93f-438d-b40f-e537ad7e5bb2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:34.230935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-88167294-9304-4a5f-9d45-4ab90dd5fd1e req-3233ebd7-f93f-438d-b40f-e537ad7e5bb2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:34.244227 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-88167294-9304-4a5f-9d45-4ab90dd5fd1e req-3233ebd7-f93f-438d-b40f-e537ad7e5bb2 service nova] Creating event network-changed:f1d71491-bd09-46b7-8913-1e3c10404e26 for instance 884016cb-372e-4e92-8edc-2e45ca20514a on n-h1-854882-3 Aug 29 16:33:34.251442 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-88167294-9304-4a5f-9d45-4ab90dd5fd1e req-3233ebd7-f93f-438d-b40f-e537ad7e5bb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107102 Aug 29 16:33:34.255741 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3527/7228] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:33:34.296913 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-51662259-a1d1-409f-899e-5525e0898ee4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 204 len: 0 microversion: 2.1 time: 0.153503 Aug 29 16:33:34.301381 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3702/7229] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:33:34 2022] DELETE /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:33:34.307529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:34.308243 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:34.318196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:34.318685 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:34.319124 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:34.319829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:34.320289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:34.320741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:34.456360 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:34.464087 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-603a77cf-75e8-4e63-ab55-bb6a207c8cc1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1689 microversion: 2.1 time: 0.161891 Aug 29 16:33:34.464659 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3528/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:34 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:33:35.487661 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:35.488317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:35.498660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:35.499547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:35.500345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:35.501554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:35.502243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:35.502695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:35.645947 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:35.653989 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-37d04915-3d93-43fc-a38e-1e1f26dff617 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1689 microversion: 2.1 time: 0.171408 Aug 29 16:33:35.655289 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3703/7231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:35 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:36.543926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-35246816-a4f5-49a0-9920-991c3640129e req-48159899-074a-4d3c-a825-fa46d2bd6340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884016cb-372e-4e92-8edc-2e45ca20514a", "name": "network-vif-deleted", "tag": "f1d71491-bd09-46b7-8913-1e3c10404e26"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:36.555750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-35246816-a4f5-49a0-9920-991c3640129e req-48159899-074a-4d3c-a825-fa46d2bd6340 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:36.556234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-35246816-a4f5-49a0-9920-991c3640129e req-48159899-074a-4d3c-a825-fa46d2bd6340 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:36.556670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-35246816-a4f5-49a0-9920-991c3640129e req-48159899-074a-4d3c-a825-fa46d2bd6340 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:36.569331 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-35246816-a4f5-49a0-9920-991c3640129e req-48159899-074a-4d3c-a825-fa46d2bd6340 service nova] Creating event network-vif-deleted:f1d71491-bd09-46b7-8913-1e3c10404e26 for instance 884016cb-372e-4e92-8edc-2e45ca20514a on n-h1-854882-3 Aug 29 16:33:36.574332 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-35246816-a4f5-49a0-9920-991c3640129e req-48159899-074a-4d3c-a825-fa46d2bd6340 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034047 Aug 29 16:33:36.575328 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3529/7232] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:36.676293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:36.677600 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:36.684273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:36.684786 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:36.685235 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:36.686176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:36.686913 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:36.687361 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:36.722616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:36.723194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:36.723742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:36.724466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lazy-loading 'fault' on Instance uuid 884016cb-372e-4e92-8edc-2e45ca20514a {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:33:36.768230 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:36.776099 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66b2a78f-a7a4-4fd1-8269-487c345190c4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 200 len: 1357 microversion: 2.1 time: 0.103742 Aug 29 16:33:36.776672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3704/7233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:36 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:37.798680 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:37.799310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 884016cb-372e-4e92-8edc-2e45ca20514a] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:37.806412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:37.806899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:37.807340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:37.808035 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:37.808491 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:37.808920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:37.825713 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] HTTP exception thrown: Instance 884016cb-372e-4e92-8edc-2e45ca20514a could not be found. Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Request method failure captured: Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a HTTP/1.1 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOoeSkWqKTJJ4DS6XOSqwkgvg88NxZySAi-2rqiUX6LcOiSzIaJtxsiomcehZ0NNGfvu-RgPNHvHl1PUgsUFxdL7qtcRZf9G4k8M9KGQjZkhRyV1LtotwcZsiQq1tAW5zILNSFP5eXcIo6X6WztYO7zL00WEpPiqrrKmhemJ9eSyVD4 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb98c98f9e648969df435ba25553626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb98c98f9e648969df435ba25553626", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}] Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 73aebcdee9514da2883e50c4d9b3a2f5 Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 884016cb-372e-4e92-8edc-2e45ca20514a could not be found. Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '884016cb-372e-4e92-8edc-2e45ca20514a'} Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 884016cb-372e-4e92-8edc-2e45ca20514a could not be found. Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 884016cb-372e-4e92-8edc-2e45ca20514a could not be found. Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:33:37.827864 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 884016cb-372e-4e92-8edc-2e45ca20514a could not be found. Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Returning 404 to user: Instance 884016cb-372e-4e92-8edc-2e45ca20514a could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cc9aef61-52cd-4681-9bf7-4826c4fde76c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a" status: 404 len: 111 microversion: 2.1 time: 0.035803 Aug 29 16:33:37.833009 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3530/7234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:37 2022] GET /compute/v2.1/servers/884016cb-372e-4e92-8edc-2e45ca20514a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:33:41.179302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5926cd91-fdf3-4bde-93ce-a546ba940b2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '.version_select at 0x7fb0e079db80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:41.202326 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5926cd91-fdf3-4bde-93ce-a546ba940b2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1904337126" status: 202 len: 0 microversion: 2.1 time: 0.027263 Aug 29 16:33:41.202918 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3705/7235] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Aug 29 16:33:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1904337126 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:33:41.230661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5fa15ae-e463-4042-ac0f-0d96e96d300f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: .version_select at 0x7fb0e2673040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1941485399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKl8iIfZn5TIMAaqiL6ygDKEqQ3QynQ/2Od/EB/l2fwpW2PgRTTEjzPAi5J2ourOwYeqLk1Y4Y8iYT0PXU1feWrHSXiEjD2atlqHzYAGn3wpG+gafhOL5ksNON4L8peN1w=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:41.248682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b5fa15ae-e463-4042-ac0f-0d96e96d300f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:33:41.255203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-b5fa15ae-e463-4042-ac0f-0d96e96d300f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:33:41.282138 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5fa15ae-e463-4042-ac0f-0d96e96d300f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055237 Aug 29 16:33:41.282768 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3531/7236] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:33:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:46.514247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1784360261", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "4aff11db-6e25-4aaa-8092-831fc79ee8f1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1941485399", "security_groups": [{"name": "tempest-secgroup-smoke-1323975031"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:46.773523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:47.003496 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] validate_networks() for [('4aff11db-6e25-4aaa-8092-831fc79ee8f1', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:33:47.480451 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:33:47.480889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:33:47.481379 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:33:47.481843 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:33:47.482980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:33:47.492046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:47.492575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:47.493052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:47.493821 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:47.494289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:47.494752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:47.516793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:33:47.522115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:33:47.539668 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:33:47.542054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:33:47.588752 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [db189b2a-b5a9-48c1-acdd-c8caaa265d52] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:33:48.597198 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [db189b2a-b5a9-48c1-acdd-c8caaa265d52] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54416. Aug 29 16:33:48.601925 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-997e4a8b-6bfe-4e2e-8e71-4249fd3bb5a5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.093334 Aug 29 16:33:48.602899 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3706/7237] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:33:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:33:48.614188 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31a1a74a-128e-40fc-814a-d97feb610db3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:48.614921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31a1a74a-128e-40fc-814a-d97feb610db3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:48.618216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=48 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:48.619145 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:48.714197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-31a1a74a-128e-40fc-814a-d97feb610db3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:48.728058 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31a1a74a-128e-40fc-814a-d97feb610db3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1267 microversion: 2.1 time: 0.117783 Aug 29 16:33:48.745935 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3532/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:48 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:49.767525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:49.768170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:49.776449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:49.777036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:49.777511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:49.778259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:49.778691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:49.779680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:49.859241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:49.867249 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1d70bfb4-4f6b-4e78-be8d-7e8b8124a959 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1327 microversion: 2.1 time: 0.104863 Aug 29 16:33:49.868096 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3707/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:49 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:50.888865 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:50.889788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:50.897542 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:50.898288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:50.898799 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:50.899568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:50.900289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:50.900785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:51.057688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:51.066583 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3bfc13b7-ab3d-4778-84f4-0001bc90972f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1393 microversion: 2.1 time: 0.181936 Aug 29 16:33:51.067448 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3533/7240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:50 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:51.116811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-e6faf873-709b-48cf-8712-f33d4c6350f0 req-85502cbb-f655-413d-b153-abe567740acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54dfc85-10bb-498e-9253-9394bdd9e6e7", "tag": "c64d719b-6174-45bb-92cd-575cd0879e97"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:51.131192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e6faf873-709b-48cf-8712-f33d4c6350f0 req-85502cbb-f655-413d-b153-abe567740acb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:51.131956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e6faf873-709b-48cf-8712-f33d4c6350f0 req-85502cbb-f655-413d-b153-abe567740acb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:51.133112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-e6faf873-709b-48cf-8712-f33d4c6350f0 req-85502cbb-f655-413d-b153-abe567740acb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:51.147324 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-e6faf873-709b-48cf-8712-f33d4c6350f0 req-85502cbb-f655-413d-b153-abe567740acb service nova] Creating event network-changed:c64d719b-6174-45bb-92cd-575cd0879e97 for instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 on n-h1-854882-3 Aug 29 16:33:51.152452 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-e6faf873-709b-48cf-8712-f33d4c6350f0 req-85502cbb-f655-413d-b153-abe567740acb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039919 Aug 29 16:33:51.153087 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3708/7241] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:33:52.087604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:52.088220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:52.095754 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:52.096229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:52.096663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:52.097344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:52.097825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:52.098248 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:52.230168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:52.237884 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dcda0624-cbf4-4481-bb29-a6935f582266 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1393 microversion: 2.1 time: 0.154175 Aug 29 16:33:52.238466 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3534/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:52 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:53.259504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:53.260258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:53.267953 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:53.268462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:53.268918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:53.269678 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:53.270151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:53.270596 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:53.410305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:53.418234 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9d7dea9a-43f9-411b-bb9a-9117f9588d50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1393 microversion: 2.1 time: 0.163075 Aug 29 16:33:53.418833 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3709/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:53 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:54.441295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:54.442286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:54.451430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:54.451906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:54.452341 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:54.453025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:54.453516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:54.453942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:54.639833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:54.647484 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c25207ce-1541-4a1e-b7eb-25a9877df366 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1393 microversion: 2.1 time: 0.212094 Aug 29 16:33:54.648059 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3535/7244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:54 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:54.937888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-a6c725f6-1655-467f-9613-c6a6f30c7b40 req-b979d449-1c01-4490-8204-de0469020614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54dfc85-10bb-498e-9253-9394bdd9e6e7", "name": "network-vif-plugged", "status": "completed", "tag": "c64d719b-6174-45bb-92cd-575cd0879e97"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:54.943790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:54.950107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a6c725f6-1655-467f-9613-c6a6f30c7b40 req-b979d449-1c01-4490-8204-de0469020614 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:54.950606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a6c725f6-1655-467f-9613-c6a6f30c7b40 req-b979d449-1c01-4490-8204-de0469020614 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:54.951055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-a6c725f6-1655-467f-9613-c6a6f30c7b40 req-b979d449-1c01-4490-8204-de0469020614 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:54.963124 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-a6c725f6-1655-467f-9613-c6a6f30c7b40 req-b979d449-1c01-4490-8204-de0469020614 service nova] Creating event network-vif-plugged:c64d719b-6174-45bb-92cd-575cd0879e97 for instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 on n-h1-854882-3 Aug 29 16:33:54.968713 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-a6c725f6-1655-467f-9613-c6a6f30c7b40 req-b979d449-1c01-4490-8204-de0469020614 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Aug 29 16:33:54.969627 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3710/7245] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:55.668162 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:55.668775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:55.675550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:55.676028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:55.676461 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:55.677138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:55.677617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:55.678055 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:55.813080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:55.820721 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dacbbdc5-a5e1-42a8-8e6f-e70c79dc6522 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1393 microversion: 2.1 time: 0.156504 Aug 29 16:33:55.821294 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3536/7246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:55 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:56.844188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:56.844866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:56.851585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:56.852108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:56.852558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:56.853265 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:56.853774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:56.854221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:56.985716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:56.993518 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-38c1665c-21dc-4556-ba2a-d0ecabf9b34d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1564 microversion: 2.1 time: 0.156125 Aug 29 16:33:56.994097 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3711/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:56 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:57.014026 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:57.015242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:57.022007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:57.022490 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:57.022928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:57.023617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:57.024071 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:57.024494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:57.159784 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:57.167507 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-983dc22d-15f6-43ae-8780-ef9d92d0a4de tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1564 microversion: 2.1 time: 0.157504 Aug 29 16:33:57.168081 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3537/7248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:57 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:59.109201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:59.109948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:59.110270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bd647921-1e05-49da-a2ad-b667f9e110fc req-ea570e33-522e-49aa-8fca-f7414b8f4ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54dfc85-10bb-498e-9253-9394bdd9e6e7", "tag": "c64d719b-6174-45bb-92cd-575cd0879e97"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:59.116175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:59.119693 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:59.120449 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:59.128817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.129345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.129819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.130541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.131011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.131456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.143277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bd647921-1e05-49da-a2ad-b667f9e110fc req-ea570e33-522e-49aa-8fca-f7414b8f4ce0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.143765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bd647921-1e05-49da-a2ad-b667f9e110fc req-ea570e33-522e-49aa-8fca-f7414b8f4ce0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.144206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bd647921-1e05-49da-a2ad-b667f9e110fc req-ea570e33-522e-49aa-8fca-f7414b8f4ce0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.158494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bd647921-1e05-49da-a2ad-b667f9e110fc req-ea570e33-522e-49aa-8fca-f7414b8f4ce0 service nova] Creating event network-changed:c64d719b-6174-45bb-92cd-575cd0879e97 for instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 on n-h1-854882-3 Aug 29 16:33:59.165342 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bd647921-1e05-49da-a2ad-b667f9e110fc req-ea570e33-522e-49aa-8fca-f7414b8f4ce0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063500 Aug 29 16:33:59.166010 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3538/7249] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:59.370784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:59.380100 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c89e153f-a0b9-4297-99c6-c028adf32175 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1564 microversion: 2.1 time: 0.280617 Aug 29 16:33:59.380884 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3712/7250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:59 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1564 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:20.683561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=15 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:20.684533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=32 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:20.689337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:20.691668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:20.698830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:20.699313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:20.699760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:20.700452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:20.700910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:20.701334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:20.758258 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9cdc7d02-60ff-4cfa-9494-bda5de7e7c81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7/action" status: 200 len: 24566 microversion: 2.1 time: 0.076414 Aug 29 16:34:20.758920 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3539/7251] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:34:20 2022] POST /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7/action => generated 24566 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:34:27.132167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:27.134428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:27.136521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=5 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:27.137344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=30 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:27.143958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.144457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.144907 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.145670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.146144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.146585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.219598 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-be441a54-c357-43fd-8e20-09859d6f73a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7/action" status: 202 len: 0 microversion: 2.1 time: 0.091303 Aug 29 16:34:27.223363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3713/7252] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:34:27 2022] POST /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:34:27.229122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:27.229848 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:27.238318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.238808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.239231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.239929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.240481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.240901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.376886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:27.385403 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-52937be4-f223-4706-87e0-2a364ff35409 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1675 microversion: 2.1 time: 0.160339 Aug 29 16:34:27.386085 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3540/7253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:27 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:28.409606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:28.410768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:28.418825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:28.419438 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:28.420034 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:28.420924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:28.421517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:28.422095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:28.556641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:28.565354 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4ad8a872-4191-4fe9-899e-0c0c1192b09b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.161417 Aug 29 16:34:28.565955 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3714/7254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:28 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:29.588829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:29.589482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:29.596372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:29.596854 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:29.597292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:29.598019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:29.598477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:29.598903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:29.731174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:29.739503 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31e3128b-d6b2-44ac-927d-378162eb3406 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.154876 Aug 29 16:34:29.740071 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3541/7255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:29 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:30.761777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:30.762414 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:30.769774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:30.770282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:30.770735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.771445 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:30.771916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:30.772358 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.907252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:30.915608 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c1a3626e-d438-4cd2-9a37-09c28315e9e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.157730 Aug 29 16:34:30.916186 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3715/7256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:30 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:31.938148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:31.938769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:31.945723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:31.946204 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:31.946646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:31.947330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:31.947785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:31.948212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:32.082166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:32.089818 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0b211dad-2d19-4f54-a7b8-1601ee2c7c39 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.155852 Aug 29 16:34:32.090392 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3542/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:31 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:33.112552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:33.113178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:33.119879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:33.120381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:33.120832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:33.121585 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:33.122054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:33.122499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:33.255692 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:33.263400 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-04053dcc-1c09-4c03-824e-fa3e1dc96cdf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.155272 Aug 29 16:34:33.263974 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3716/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:33 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:34.284710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:34.285334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:34.292297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:34.292782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:34.293219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:34.294014 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:34.294473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:34.294900 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:34.430280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:34.440070 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2bc1b00e-e1c0-4243-9fe2-cda774eb5b56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.158720 Aug 29 16:34:34.440891 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3543/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:34 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:35.461635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:35.462258 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:35.469017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:35.469575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:35.470029 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:35.470760 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:35.471226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:35.471774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:35.606017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:35.613689 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-86177167-a68d-4c6e-9f91-9dccdf146f81 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.156009 Aug 29 16:34:35.614261 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3717/7260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:35 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:36.635066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:36.635710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:36.642647 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:36.643127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:36.643567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:36.644281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:36.644736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:36.645170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:36.779064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:36.786715 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3de35147-afb7-4ec7-b736-3fe0f39418ae tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.155624 Aug 29 16:34:36.787283 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3544/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:36 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:37.808662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:37.809202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:37.816926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:37.817437 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:37.817889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:37.818586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:37.819054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:37.819492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:37.948135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:37.956483 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4e746f65-de16-48d7-829a-351fdf82f9dc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1680 microversion: 2.1 time: 0.151255 Aug 29 16:34:37.957052 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3718/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:37 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:38.978365 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:38.978877 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:38.985676 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:38.986150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:38.986579 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:38.987280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:38.987728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:38.988143 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:39.121352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:39.129605 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a74d4d15-8159-427e-83a9-00e4e8a7aa23 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1683 microversion: 2.1 time: 0.155140 Aug 29 16:34:39.130201 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3545/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:38 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:03.319307 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:03.321691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:03.324597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=12 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:03.326052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:03.333243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:03.333784 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:03.334845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:03.335577 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:03.336054 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:03.336500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:03.394065 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63666664-ea2f-4635-9f50-d10dd84bbcb7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7/action" status: 200 len: 68953 microversion: 2.1 time: 0.079209 Aug 29 16:35:03.394643 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3719/7264] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:35:03 2022] POST /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7/action => generated 68953 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:35:10.712554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:10.719753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:10.727368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=14 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:10.728457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=40 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:10.731040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:10.731777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:10.732227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:10.732948 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:10.733436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:10.733873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:10.762420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:35:10.840733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-5539d2df-2c4a-42e6-8f42-4ffce17e787e req-ba1eea18-8efb-4187-a212-189bfe8734d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54dfc85-10bb-498e-9253-9394bdd9e6e7", "tag": "c64d719b-6174-45bb-92cd-575cd0879e97"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:10.847047 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-97b62fb7-d019-42ca-a516-1e0cb55dd283 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 204 len: 0 microversion: 2.1 time: 0.137990 Aug 29 16:35:10.851605 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3546/7265] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:35:10 2022] DELETE /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:35:10.853883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5539d2df-2c4a-42e6-8f42-4ffce17e787e req-ba1eea18-8efb-4187-a212-189bfe8734d2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:10.854376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5539d2df-2c4a-42e6-8f42-4ffce17e787e req-ba1eea18-8efb-4187-a212-189bfe8734d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:10.854819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-5539d2df-2c4a-42e6-8f42-4ffce17e787e req-ba1eea18-8efb-4187-a212-189bfe8734d2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:10.856939 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:10.857678 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:10.863658 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:10.864081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:10.864522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:10.865225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:10.865707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:10.865834 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-5539d2df-2c4a-42e6-8f42-4ffce17e787e req-ba1eea18-8efb-4187-a212-189bfe8734d2 service nova] Creating event network-changed:c64d719b-6174-45bb-92cd-575cd0879e97 for instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 on n-h1-854882-3 Aug 29 16:35:10.866863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:10.871493 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-5539d2df-2c4a-42e6-8f42-4ffce17e787e req-ba1eea18-8efb-4187-a212-189bfe8734d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156979 Aug 29 16:35:10.872183 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3720/7266] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:11.008246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:11.016042 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-960b73e5-d95c-45fd-b11d-683d0f02a701 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1689 microversion: 2.1 time: 0.163237 Aug 29 16:35:11.016633 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3547/7267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:10 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:12.039911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:12.040647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:12.046922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:12.047427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:12.047882 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:12.048597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:12.049071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:12.049553 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:12.302654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:12.312645 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-23e79fcb-04c5-44aa-b448-6e9e6aff825c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 200 len: 1689 microversion: 2.1 time: 0.277658 Aug 29 16:35:12.313235 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3721/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:12 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:35:12.887214 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-aa74ee21-d77f-4093-b9f7-c3395ae9048e req-907a5576-8c5c-400d-bab0-db86328de9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54dfc85-10bb-498e-9253-9394bdd9e6e7", "name": "network-vif-deleted", "tag": "c64d719b-6174-45bb-92cd-575cd0879e97"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:12.897833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa74ee21-d77f-4093-b9f7-c3395ae9048e req-907a5576-8c5c-400d-bab0-db86328de9b2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:12.898346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa74ee21-d77f-4093-b9f7-c3395ae9048e req-907a5576-8c5c-400d-bab0-db86328de9b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:12.898777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-aa74ee21-d77f-4093-b9f7-c3395ae9048e req-907a5576-8c5c-400d-bab0-db86328de9b2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:12.910322 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-aa74ee21-d77f-4093-b9f7-c3395ae9048e req-907a5576-8c5c-400d-bab0-db86328de9b2 service nova] Creating event network-vif-deleted:c64d719b-6174-45bb-92cd-575cd0879e97 for instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 on n-h1-854882-3 Aug 29 16:35:12.916881 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-aa74ee21-d77f-4093-b9f7-c3395ae9048e req-907a5576-8c5c-400d-bab0-db86328de9b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Aug 29 16:35:12.917510 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3548/7269] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:13.334527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:13.335767 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d54dfc85-10bb-498e-9253-9394bdd9e6e7] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:13.342945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:13.343440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:13.343886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:13.344593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:13.345060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:13.345558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:13.359320 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] HTTP exception thrown: Instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 could not be found. Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Request method failure captured: Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 HTTP/1.1 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOoeSkWqKTJJ4DS6XOSqwkgvg88NxZySAi-2rqiUX6LcOiSzIaJtxsiomcehZ0NNGfvu-RgPNHvHl1PUgsUFxdL7qtcRZf9G4k8M9KGQjZkhRyV1LtotwcZsiQq1tAW5zILNSFP5eXcIo6X6WztYO7zL00WEpPiqrrKmhemJ9eSyVD4 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb98c98f9e648969df435ba25553626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb98c98f9e648969df435ba25553626", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}] Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 73aebcdee9514da2883e50c4d9b3a2f5 Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 could not be found. Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'd54dfc85-10bb-498e-9253-9394bdd9e6e7'} Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 could not be found. Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 could not be found. Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:35:13.360966 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 could not be found. Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Returning 404 to user: Instance d54dfc85-10bb-498e-9253-9394bdd9e6e7 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a10bf9dc-c6c3-4c44-a60b-2ee2c19b373d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7" status: 404 len: 111 microversion: 2.1 time: 0.032108 Aug 29 16:35:13.366398 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3722/7270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:13 2022] GET /compute/v2.1/servers/d54dfc85-10bb-498e-9253-9394bdd9e6e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:35:16.751015 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d573240d-8562-454b-90fa-9003b742a6c8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '.version_select at 0x7fb0e295df70>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:16.775951 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d573240d-8562-454b-90fa-9003b742a6c8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1941485399" status: 202 len: 0 microversion: 2.1 time: 0.029062 Aug 29 16:35:16.776858 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3549/7271] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Aug 29 16:35:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1941485399 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:35:16.805095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4e76f733-c513-4013-bdf4-2faefb059492 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: .version_select at 0x7fb0e2707c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-569248529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbSeTpsCwVfXWsU5mTOCzhd0BEny7l18FERCNkDQBvikfz2Yvw2W5tXIqYGsUO1+SQdZgmgvRxSdxf3nHwYJ6fLXlI9Qu7xsG0gCyGql37idOCYG2Dyrah6KmpVGf5Kzw=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:16.824231 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-4e76f733-c513-4013-bdf4-2faefb059492 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:35:16.831609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-4e76f733-c513-4013-bdf4-2faefb059492 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:35:16.865271 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4e76f733-c513-4013-bdf4-2faefb059492 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.064013 Aug 29 16:35:16.866672 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3723/7272] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:35:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:22.858309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-171777274", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "162ff51d-05d6-421a-935b-d44d2efd46ad"}], "key_name": "tempest-TestNetworkAdvancedServerOps-569248529", "security_groups": [{"name": "tempest-secgroup-smoke-2107327115"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:22.904571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:23.005020 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] validate_networks() for [('162ff51d-05d6-421a-935b-d44d2efd46ad', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:35:23.479435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:35:23.480060 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:35:23.480991 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:35:23.481596 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:35:23.482171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:35:23.495782 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.496576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.497018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.497798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.498251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.498687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.525789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:35:23.531802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:35:23.547030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:35:23.549481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:35:23.604932 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [5532f74b-3702-4c18-8be4-5ffd54ee2d03] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:35:24.613531 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [5532f74b-3702-4c18-8be4-5ffd54ee2d03] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54594. Aug 29 16:35:24.619455 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ea071c3-c02a-4e32-8f08-07b678ad158d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.766603 Aug 29 16:35:24.620496 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3550/7273] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:35:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:35:24.628868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=14 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:24.633499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-628d2247-28e7-4c1e-8ac5-887bd2f72288 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:24.634444 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-628d2247-28e7-4c1e-8ac5-887bd2f72288 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:24.692338 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-628d2247-28e7-4c1e-8ac5-887bd2f72288 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:24.699615 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-628d2247-28e7-4c1e-8ac5-887bd2f72288 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1265 microversion: 2.1 time: 0.072410 Aug 29 16:35:24.711078 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3724/7274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:24 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:25.723556 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:25.727577 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:25.736369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.738761 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.739467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.740350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.742177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.742788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.834931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:25.847886 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-46d5513a-e26c-449e-9e9f-8e1826ceb7fa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1335 microversion: 2.1 time: 0.128282 Aug 29 16:35:25.861605 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3551/7275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:25 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1335 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:26.870312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:26.871289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:26.880981 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:26.881790 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:26.882236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:26.883269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:26.883828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:26.884352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:27.145954 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:27.155239 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-db6ecb00-dc12-4fdb-8f49-dc601fd90106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1391 microversion: 2.1 time: 0.289124 Aug 29 16:35:27.155936 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3725/7276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:26 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1391 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:27.278495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-094a6601-f6d9-4466-b258-7844381525e1 req-af1b9bfb-3b07-404f-b5a7-97d9db17a5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:27.288660 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-094a6601-f6d9-4466-b258-7844381525e1 req-af1b9bfb-3b07-404f-b5a7-97d9db17a5f5 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:27.289137 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-094a6601-f6d9-4466-b258-7844381525e1 req-af1b9bfb-3b07-404f-b5a7-97d9db17a5f5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:27.289593 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-094a6601-f6d9-4466-b258-7844381525e1 req-af1b9bfb-3b07-404f-b5a7-97d9db17a5f5 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:27.300628 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-094a6601-f6d9-4466-b258-7844381525e1 req-af1b9bfb-3b07-404f-b5a7-97d9db17a5f5 service nova] Creating event network-changed:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h2-854882-3 Aug 29 16:35:27.305527 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-094a6601-f6d9-4466-b258-7844381525e1 req-af1b9bfb-3b07-404f-b5a7-97d9db17a5f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030806 Aug 29 16:35:27.306140 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3552/7277] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:28.176242 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:28.176936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:28.183889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:28.184396 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:28.184852 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:28.185595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:28.186067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:28.186508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:28.318059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:28.325779 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8fa40fef-7f6c-41d9-8a1c-5a5405ed6eb0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1391 microversion: 2.1 time: 0.153543 Aug 29 16:35:28.326360 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3726/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:28 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:29.348468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:29.349330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:29.355988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:29.356464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:29.356899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:29.357615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:29.358101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:29.358526 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:29.496372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:29.504175 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a54de328-15b4-4419-b38a-d8d2b5463a70 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1391 microversion: 2.1 time: 0.160721 Aug 29 16:35:29.504778 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3553/7279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:29 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:30.525926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:30.526743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:30.534381 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:30.534886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:30.535718 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:30.536506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:30.537587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:30.538036 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:30.678460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:30.686705 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-941d079a-a111-484f-8f10-c47f07abbd99 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1391 microversion: 2.1 time: 0.165802 Aug 29 16:35:30.687547 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3727/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:30 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:31.708198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:31.708901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:31.716343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:31.716826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:31.717268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:31.718017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:31.718476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:31.718903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:31.852712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:31.860668 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-54d69fad-3d26-4f82-81a6-cadf54cfc0b6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1391 microversion: 2.1 time: 0.156457 Aug 29 16:35:31.861241 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3554/7281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:31 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:32.453456 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-6f6f075e-41a5-4a59-b6ef-bc8f4e54a65f req-04254d15-3a54-4ef7-96dc-5711ef743230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "name": "network-vif-plugged", "status": "completed", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:32.464541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6f6f075e-41a5-4a59-b6ef-bc8f4e54a65f req-04254d15-3a54-4ef7-96dc-5711ef743230 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:32.465044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6f6f075e-41a5-4a59-b6ef-bc8f4e54a65f req-04254d15-3a54-4ef7-96dc-5711ef743230 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:32.465519 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-6f6f075e-41a5-4a59-b6ef-bc8f4e54a65f req-04254d15-3a54-4ef7-96dc-5711ef743230 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:32.477021 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-6f6f075e-41a5-4a59-b6ef-bc8f4e54a65f req-04254d15-3a54-4ef7-96dc-5711ef743230 service nova] Creating event network-vif-plugged:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h2-854882-3 Aug 29 16:35:32.482010 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-6f6f075e-41a5-4a59-b6ef-bc8f4e54a65f req-04254d15-3a54-4ef7-96dc-5711ef743230 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037638 Aug 29 16:35:32.482636 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3728/7282] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:32.881977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:32.882615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:32.889618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:32.890105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:32.890543 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:32.891233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:32.891688 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:32.892112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:33.028594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:33.036550 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80aa3be4-4d48-432b-98f3-473dcdc4b273 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1391 microversion: 2.1 time: 0.158460 Aug 29 16:35:33.037131 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3555/7283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:32 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:34.059081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:34.059823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:34.061803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:34.067781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:34.068283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:34.068736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:34.069476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:34.069974 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:34.070416 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:34.201506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:34.209233 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d9f8ce8-02be-4290-ad0b-88a6f17c1793 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1564 microversion: 2.1 time: 0.155842 Aug 29 16:35:34.209843 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3729/7284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:34 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:34.231254 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:34.231904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:34.233920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:34.234586 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:34.240933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:34.241520 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:34.242001 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:34.242724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:34.243183 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:34.243607 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:34.374539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:34.382387 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eef228e2-d71e-419f-a38d-13db11cd902c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1564 microversion: 2.1 time: 0.155067 Aug 29 16:35:34.382969 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3556/7285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:34 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:35:36.029470 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:36.030120 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:36.032406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-6884d30d-644d-428e-8af6-24f40c4c8cf7 req-e500b81a-4501-45a2-862c-354ab6dc930c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:36.036024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:36.039408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:36.040256 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:36.040927 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:36.042057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:36.042594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:36.043326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:36.043792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6884d30d-644d-428e-8af6-24f40c4c8cf7 req-e500b81a-4501-45a2-862c-354ab6dc930c service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:36.044272 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6884d30d-644d-428e-8af6-24f40c4c8cf7 req-e500b81a-4501-45a2-862c-354ab6dc930c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:36.044705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6884d30d-644d-428e-8af6-24f40c4c8cf7 req-e500b81a-4501-45a2-862c-354ab6dc930c service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:36.056551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6884d30d-644d-428e-8af6-24f40c4c8cf7 req-e500b81a-4501-45a2-862c-354ab6dc930c service nova] Creating event network-changed:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h2-854882-3 Aug 29 16:35:36.061654 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-6884d30d-644d-428e-8af6-24f40c4c8cf7 req-e500b81a-4501-45a2-862c-354ab6dc930c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033795 Aug 29 16:35:36.062544 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3557/7286] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:35:36.286820 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:36.295368 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-42337012-bbc6-4462-ba82-0bd21a17cba8 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1564 microversion: 2.1 time: 0.270253 Aug 29 16:35:36.296271 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3730/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:36 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1564 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:57.536716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:57.538716 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=36 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:57.543301 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:57.545728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:57.554421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:57.554918 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:57.555357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:57.556081 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:57.556528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:57.556954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:57.614551 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bb30010f-f220-4774-a4ae-702e88016247 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action" status: 200 len: 24539 microversion: 2.1 time: 0.080961 Aug 29 16:35:57.615203 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3558/7288] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:35:57 2022] POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action => generated 24539 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:36:08.600945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:08.603191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:08.605953 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 16:36:08.606818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:08.607549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=32 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:08.618463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:08.618463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:08.618463 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:08.619554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:08.620076 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:08.620557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:08.665744 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:08.672888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Old instance type m1.heat2, new instance type m1.heat {{(pid=130002) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:36:08.680802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:36:08.681241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:36:08.681778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:36:08.682202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:36:08.682638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:36:08.751873 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-cfad8398-7c6f-41ec-aa31-0299a61d9ea2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action" status: 202 len: 0 microversion: 2.1 time: 0.154880 Aug 29 16:36:08.757455 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3731/7289] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:36:08 2022] POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:36:08.764351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:08.765522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:08.769222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:08.770077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=4 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:08.775738 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:08.776354 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:08.776928 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:08.777691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:08.778147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:08.778576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:08.934936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:08.943471 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3809c6e5-f024-4884-a77f-75de1308d965 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1692 microversion: 2.1 time: 0.183815 Aug 29 16:36:08.944813 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3559/7290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:08 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:09.968020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:09.968657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:09.975473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:09.975980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:09.976429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:09.977158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:09.977720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:09.978183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:10.117003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:10.124891 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3bf79114-f20a-481d-b6c6-e89c901e207f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1692 microversion: 2.1 time: 0.162000 Aug 29 16:36:10.125530 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3732/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:09 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:11.146255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:11.147499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:11.154355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:11.154845 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:11.155289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:11.155978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:11.156432 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:11.156860 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:11.300850 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:11.309080 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6ad0b95b-55aa-4e0e-944c-2b111ba609f3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.166787 Aug 29 16:36:11.309767 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3560/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:11 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:12.331637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:12.332272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:12.340274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:12.340774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:12.341221 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:12.342030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:12.342495 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:12.342931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:12.480541 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:12.488899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ed46932a-59f8-4617-97f8-0cd949809a6f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.161119 Aug 29 16:36:12.489564 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3733/7293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:12 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:13.511046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:13.511662 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:13.518641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:13.519126 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:13.519997 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:13.520709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:13.521166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:13.521625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:13.655653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:13.663915 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb7dea6d-e8c8-480c-82b4-6e7f0211b257 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.156787 Aug 29 16:36:13.664496 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3561/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:13 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:14.685350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:14.686021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:14.693217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:14.694355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:14.694829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:14.695557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:14.696033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:14.696481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:14.829415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:14.837368 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1b37fc8b-ec4c-4267-ac4a-4aebce6f4496 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.155909 Aug 29 16:36:14.837990 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3734/7295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:14 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:15.858923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:15.859488 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:15.866862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:15.867351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:15.867789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:15.868481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:15.868967 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:15.869414 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:16.007041 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:16.014850 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1be16a7c-988a-412b-a4c4-a080b875aea0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.160000 Aug 29 16:36:16.015427 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3562/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:15 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:17.036234 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:17.036867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:17.044283 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:17.044778 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:17.045245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:17.045959 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:17.046424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:17.046859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:17.179682 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:17.188180 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0f3ca550-1219-4f69-b887-4db5bc0c1cda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.155583 Aug 29 16:36:17.188767 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3735/7297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:17 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:18.209970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:18.210610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:18.217777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:18.218259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:18.218696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:18.219396 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:18.219851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:18.220277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:18.374656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:18.383843 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0894de95-5053-44a3-a001-78d5a0c696b9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.178040 Aug 29 16:36:18.384418 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3563/7298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:18 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:19.406110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:19.406985 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:19.414690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:19.415194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:19.415643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:19.416364 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:19.416832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:19.417267 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:19.571130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:19.579127 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-eee5970f-023e-4e80-99b6-18cee5319bc7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.176895 Aug 29 16:36:19.579720 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3736/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:19 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:20.603264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:20.603907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:20.611065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.611552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.611992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.612759 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.613223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.613672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.749863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:20.757802 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-869fd2e2-2ef2-44e5-b79e-172276e45692 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.159093 Aug 29 16:36:20.758386 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3564/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:20 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:21.779243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:21.779903 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:21.786698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:21.787240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:21.787691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:21.788391 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:21.788855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:21.789292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:21.923617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:21.931899 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5068568a-18cf-419b-86cd-84e792ce00db tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.156550 Aug 29 16:36:21.932477 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3737/7301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:21 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:22.954085 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:22.954774 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:22.961884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:22.962372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:22.962951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:22.963747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:22.964227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:22.964661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:23.110309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:23.118616 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-127672a5-8a2b-4c7c-96a6-b6d5ddf55cf6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.168447 Aug 29 16:36:23.119248 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3565/7302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:22 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:36:24.141031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:24.141787 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:24.149191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:24.149736 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:24.150199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:24.150919 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:24.151395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:24.151841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:24.292595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:24.300471 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fb970cd8-fe26-47a5-a32d-20c9e0d0621a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.163508 Aug 29 16:36:24.301056 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3738/7303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:24 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:36:25.323098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:25.323753 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:25.330369 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:25.330851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:25.331286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:25.331977 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:25.332436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:25.332859 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:25.466466 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:25.475246 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-85473681-c34e-44a4-b77a-5acc64700d71 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.156298 Aug 29 16:36:25.475856 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3566/7304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:25 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:26.497873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:26.498516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:26.506983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:26.507497 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:26.507978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:26.508713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:26.509215 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:26.509715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:26.645245 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:26.653624 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b142cbbd-fa73-4e46-89a5-ab9709b98e36 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1697 microversion: 2.1 time: 0.159819 Aug 29 16:36:26.654211 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3739/7305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:26 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:27.674846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:27.675459 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:27.682811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:27.683291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:27.683722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:27.684419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:27.684861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:27.685280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:27.897776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:27.907262 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4334800d-d004-4ca6-a1d1-240148999000 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1696 microversion: 2.1 time: 0.236103 Aug 29 16:36:27.921449 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3567/7306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:27 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1696 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:28.208679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4c65c9c1-4970-4768-a852-389db2f2bee3 req-3a165e32-9102-42ab-836d-e0ca49ba6a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "name": "network-vif-unplugged", "status": "completed", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:28.220476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c65c9c1-4970-4768-a852-389db2f2bee3 req-3a165e32-9102-42ab-836d-e0ca49ba6a19 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:28.221011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c65c9c1-4970-4768-a852-389db2f2bee3 req-3a165e32-9102-42ab-836d-e0ca49ba6a19 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:28.221499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4c65c9c1-4970-4768-a852-389db2f2bee3 req-3a165e32-9102-42ab-836d-e0ca49ba6a19 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:28.235178 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4c65c9c1-4970-4768-a852-389db2f2bee3 req-3a165e32-9102-42ab-836d-e0ca49ba6a19 service nova] Creating event network-vif-unplugged:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h1-854882-3 Aug 29 16:36:28.241277 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-4c65c9c1-4970-4768-a852-389db2f2bee3 req-3a165e32-9102-42ab-836d-e0ca49ba6a19 service nova] Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:36:28.253936 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4c65c9c1-4970-4768-a852-389db2f2bee3 req-3a165e32-9102-42ab-836d-e0ca49ba6a19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049034 Aug 29 16:36:28.254725 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3740/7307] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:28.933506 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:28.935000 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:28.941815 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:28.942497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:28.942935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:28.944215 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:28.944670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:28.945091 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:29.478398 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:29.486277 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-44652730-4041-45e5-bd58-7cbe64e106b2 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1696 microversion: 2.1 time: 0.556757 Aug 29 16:36:29.486866 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3568/7308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:28 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1696 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:30.292699 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-55815e97-c9d5-4bdc-a9bf-9c8dbe4439b7 req-f1605450-4d93-4c78-8835-0a0461fbb0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:30.302369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-55815e97-c9d5-4bdc-a9bf-9c8dbe4439b7 req-f1605450-4d93-4c78-8835-0a0461fbb0c8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:30.303472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-55815e97-c9d5-4bdc-a9bf-9c8dbe4439b7 req-f1605450-4d93-4c78-8835-0a0461fbb0c8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:30.303914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-55815e97-c9d5-4bdc-a9bf-9c8dbe4439b7 req-f1605450-4d93-4c78-8835-0a0461fbb0c8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:30.315704 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-55815e97-c9d5-4bdc-a9bf-9c8dbe4439b7 req-f1605450-4d93-4c78-8835-0a0461fbb0c8 service nova] Creating event network-changed:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h1-854882-3 Aug 29 16:36:30.321119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [req-55815e97-c9d5-4bdc-a9bf-9c8dbe4439b7 req-f1605450-4d93-4c78-8835-0a0461fbb0c8 service nova] Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854882-3', 'n-h2-854882-3'} {{(pid=130002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:36:30.331772 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-55815e97-c9d5-4bdc-a9bf-9c8dbe4439b7 req-f1605450-4d93-4c78-8835-0a0461fbb0c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044722 Aug 29 16:36:30.332950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3741/7309] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:30.508776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:30.509639 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:30.517286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:30.517922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:30.518434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:30.519238 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:30.519712 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:30.520150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:30.662828 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:30.670792 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c615d76f-4b69-4e0a-b537-b76160da134a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1694 microversion: 2.1 time: 0.166274 Aug 29 16:36:30.671389 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3569/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:30 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:31.694365 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:31.694991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:31.704768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.704768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.704768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:31.704768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.704768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.704768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:31.846158 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:31.854652 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fcc379d7-5e5c-4f35-978f-252e794c02ab tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1691 microversion: 2.1 time: 0.165846 Aug 29 16:36:31.855240 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3742/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:31 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:31.876187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:31.876758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:31.883721 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.884209 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.884650 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:31.885350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.885832 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.886259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:31.954447 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d89a5aa8-e948-46f3-80f0-4208040909c1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action" status: 204 len: 0 microversion: 2.1 time: 0.081672 Aug 29 16:36:31.955033 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3570/7312] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:36:31 2022] POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:36:31.963515 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:31.964177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:31.970634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.971183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.971669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:31.972504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.973149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.973829 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:32.504761 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:32.512881 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-57dd330f-b536-4c1d-8468-633688d2dc49 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1691 microversion: 2.1 time: 0.553425 Aug 29 16:36:32.513483 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3743/7313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:31 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1691 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:32.534428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:32.535136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:32.542695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:32.543179 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:32.543608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:32.544304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:32.544751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:32.545200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:32.688497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:32.696623 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-970d77fc-b8e2-4007-9b24-d90d1abfd242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1691 microversion: 2.1 time: 0.167381 Aug 29 16:36:32.697207 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3571/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:32 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:33.718664 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:33.719334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:33.727491 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:33.728002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:33.728439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:33.729164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:33.729666 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:33.730112 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:33.866261 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:33.874266 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7a41d9ee-f3fc-477c-b9d5-7c4d0521643f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1683 microversion: 2.1 time: 0.159771 Aug 29 16:36:33.874862 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3744/7315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:33 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:35.762879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-6bb0ef5b-b2fd-4d48-8158-1e998282d8f8 req-7513ab2b-e8e6-4fe4-9734-1eb2815ed024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "name": "network-vif-plugged", "status": "completed", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:35.772495 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6bb0ef5b-b2fd-4d48-8158-1e998282d8f8 req-7513ab2b-e8e6-4fe4-9734-1eb2815ed024 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:35.772966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6bb0ef5b-b2fd-4d48-8158-1e998282d8f8 req-7513ab2b-e8e6-4fe4-9734-1eb2815ed024 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:35.773409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6bb0ef5b-b2fd-4d48-8158-1e998282d8f8 req-7513ab2b-e8e6-4fe4-9734-1eb2815ed024 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:35.784590 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6bb0ef5b-b2fd-4d48-8158-1e998282d8f8 req-7513ab2b-e8e6-4fe4-9734-1eb2815ed024 service nova] Creating event network-vif-plugged:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h1-854882-3 Aug 29 16:36:35.789659 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-6bb0ef5b-b2fd-4d48-8158-1e998282d8f8 req-7513ab2b-e8e6-4fe4-9734-1eb2815ed024 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087846 Aug 29 16:36:35.790311 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3572/7316] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:56.087305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:56.089605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:56.092421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=32 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:56.093100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:56.098704 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:56.099209 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:56.099662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:56.100374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:56.100844 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:56.101294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:56.155970 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-febecbda-54a3-4cbc-8054-81bb5bbe53bc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action" status: 200 len: 24575 microversion: 2.1 time: 0.073048 Aug 29 16:36:56.156624 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3745/7317] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:36:56 2022] POST /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9/action => generated 24575 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:37:03.258485 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-821ccaaf-93f4-4db1-9749-e7722717ad84 req-c465e0c7-472e-4763-baa3-5c9b8e1e104e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:03.265908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:03.266555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:03.271064 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=28 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:03.271772 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:03.271914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-821ccaaf-93f4-4db1-9749-e7722717ad84 req-c465e0c7-472e-4763-baa3-5c9b8e1e104e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:03.272626 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-821ccaaf-93f4-4db1-9749-e7722717ad84 req-c465e0c7-472e-4763-baa3-5c9b8e1e104e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:03.273051 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-821ccaaf-93f4-4db1-9749-e7722717ad84 req-c465e0c7-472e-4763-baa3-5c9b8e1e104e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:03.275959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:03.276773 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:03.277218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:03.278203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:03.279704 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:03.280227 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:03.286546 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-821ccaaf-93f4-4db1-9749-e7722717ad84 req-c465e0c7-472e-4763-baa3-5c9b8e1e104e service nova] Creating event network-changed:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h1-854882-3 Aug 29 16:37:03.292149 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-821ccaaf-93f4-4db1-9749-e7722717ad84 req-c465e0c7-472e-4763-baa3-5c9b8e1e104e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037685 Aug 29 16:37:03.293316 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3746/7318] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:37:03.310059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Going to try to terminate instance {{(pid=130001) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:37:03.392322 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-00d31a8a-f064-4c3d-980b-9b7054ec1f0e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 204 len: 0 microversion: 2.1 time: 0.142863 Aug 29 16:37:03.393904 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3573/7319] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:37:03 2022] DELETE /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:37:03.406615 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:03.407764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:03.414775 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:03.415147 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:03.415604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:03.416369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:03.416838 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:03.417472 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:03.562340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:03.570675 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-522108d8-a2e6-4fd0-8101-1024668f1059 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1689 microversion: 2.1 time: 0.171421 Aug 29 16:37:03.571476 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3747/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:03 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:37:04.594095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:04.595405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:04.602443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:04.602931 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:04.603882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:04.604567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:04.605019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:04.605467 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:04.847720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:04.857106 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-53ff3f12-814f-434a-86dc-eed88e6d4df3 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 200 len: 1689 microversion: 2.1 time: 0.267389 Aug 29 16:37:04.858388 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3574/7321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:04 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:05.184926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-3c69a434-489e-45bb-841f-074543f1a597 req-737df208-ac7d-4acf-ad2f-7fd005fea779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f1c1b-b14a-4b4b-a67d-e142163ff5f9", "name": "network-vif-deleted", "tag": "626eb099-1f8a-4daa-854c-dc55714148a0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:05.196064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3c69a434-489e-45bb-841f-074543f1a597 req-737df208-ac7d-4acf-ad2f-7fd005fea779 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:05.196652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3c69a434-489e-45bb-841f-074543f1a597 req-737df208-ac7d-4acf-ad2f-7fd005fea779 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:05.197898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-3c69a434-489e-45bb-841f-074543f1a597 req-737df208-ac7d-4acf-ad2f-7fd005fea779 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:05.210690 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-3c69a434-489e-45bb-841f-074543f1a597 req-737df208-ac7d-4acf-ad2f-7fd005fea779 service nova] Creating event network-vif-deleted:626eb099-1f8a-4daa-854c-dc55714148a0 for instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 on n-h1-854882-3 Aug 29 16:37:05.216307 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-3c69a434-489e-45bb-841f-074543f1a597 req-737df208-ac7d-4acf-ad2f-7fd005fea779 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035239 Aug 29 16:37:05.216998 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3748/7322] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:37:05.878428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:05.878961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: d55f1c1b-b14a-4b4b-a67d-e142163ff5f9] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:05.886478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:05.886966 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:05.887408 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:05.888097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:05.888555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:05.888981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:05.902567 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] HTTP exception thrown: Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 could not be found. Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Request method failure captured: Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 HTTP/1.1 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOoeSkWqKTJJ4DS6XOSqwkgvg88NxZySAi-2rqiUX6LcOiSzIaJtxsiomcehZ0NNGfvu-RgPNHvHl1PUgsUFxdL7qtcRZf9G4k8M9KGQjZkhRyV1LtotwcZsiQq1tAW5zILNSFP5eXcIo6X6WztYO7zL00WEpPiqrrKmhemJ9eSyVD4 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb98c98f9e648969df435ba25553626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb98c98f9e648969df435ba25553626", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}] Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 73aebcdee9514da2883e50c4d9b3a2f5 Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 could not be found. Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': 'd55f1c1b-b14a-4b4b-a67d-e142163ff5f9'} Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 could not be found. Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 could not be found. Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:37:05.904198 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 could not be found. Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Returning 404 to user: Instance d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ac4da42-4b30-41f3-9ff9-96dd2c97b262 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9" status: 404 len: 111 microversion: 2.1 time: 0.031204 Aug 29 16:37:05.909434 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3575/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:05 2022] GET /compute/v2.1/servers/d55f1c1b-b14a-4b4b-a67d-e142163ff5f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:37:09.246825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-dfb96dfd-66ac-410e-9f27-c18f609e7ea6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '.version_select at 0x7fb0e2966c10>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:09.272926 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-dfb96dfd-66ac-410e-9f27-c18f609e7ea6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-569248529" status: 202 len: 0 microversion: 2.1 time: 0.031020 Aug 29 16:37:09.278020 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3749/7324] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Aug 29 16:37:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-569248529 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:37:09.302275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-54b6e6ce-b65f-4db0-94e6-9207cd96456e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: .version_select at 0x7fb0e250f9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-502971505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk70hgAwd+BSEb6Itg0HkpSbneHSzaTBG4Qpu0eiXyz96RH+MIgO0jzh5nAdqjOaYcnGYQ0I/erI/Fylq+AK+aNlncUdB/YJY2nROCPXMd4qjAWGHyEiLK+ZMLb6a3ojA=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:09.319405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-54b6e6ce-b65f-4db0-94e6-9207cd96456e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:37:09.324829 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-54b6e6ce-b65f-4db0-94e6-9207cd96456e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:37:09.348965 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-54b6e6ce-b65f-4db0-94e6-9207cd96456e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050533 Aug 29 16:37:09.349710 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3576/7325] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:37:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:37:14.589943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1610599680", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "f3ae0f66-198d-46d0-953b-3ecf1700d5dd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-502971505", "security_groups": [{"name": "tempest-secgroup-smoke-1873048996"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:14.719490 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] validate_networks() for [('f3ae0f66-198d-46d0-953b-3ecf1700d5dd', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:37:15.132622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:37:15.133067 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:37:15.133595 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:37:15.134024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:37:15.134721 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:37:15.144299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:15.144845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:15.145305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:15.146160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:15.146631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:15.147077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:15.166294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:37:15.172148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:37:15.186295 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:37:15.189013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:37:15.240846 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e7e655fb-4f47-42f3-8d0c-d9a007627adc tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.655103 Aug 29 16:37:15.241547 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3750/7326] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:37:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:37:15.254613 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cba11795-5c14-4a6c-8202-f97545dcec18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:15.255236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cba11795-5c14-4a6c-8202-f97545dcec18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:15.315528 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cba11795-5c14-4a6c-8202-f97545dcec18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:15.333233 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cba11795-5c14-4a6c-8202-f97545dcec18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1266 microversion: 2.1 time: 0.083176 Aug 29 16:37:15.333871 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3577/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:15 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:16.359855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:16.362454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:16.376679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:16.377196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:16.377774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:16.378505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:16.379173 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:16.379624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:16.464160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:16.473345 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af494ad7-820d-48ac-99be-4e14393627d1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1324 microversion: 2.1 time: 0.120648 Aug 29 16:37:16.474209 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3751/7328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:16 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1324 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:17.497266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:17.498077 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:17.500479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:17.510608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:17.511452 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:17.511988 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:17.512849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:17.513430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:17.514103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:17.672571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:17.682020 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8d67ef3a-f428-488e-b60b-cb1737b21bfa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1392 microversion: 2.1 time: 0.188952 Aug 29 16:37:17.682750 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3578/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:17 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:37:18.068768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-716a970d-a0ca-4f39-bc2b-89d93946b6dc req-077fc33c-53a1-4df0-98ab-df1364f9edb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3", "tag": "042710a3-17f3-4c07-9627-31024aa34776"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:18.080225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-716a970d-a0ca-4f39-bc2b-89d93946b6dc req-077fc33c-53a1-4df0-98ab-df1364f9edb1 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:18.080823 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-716a970d-a0ca-4f39-bc2b-89d93946b6dc req-077fc33c-53a1-4df0-98ab-df1364f9edb1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:18.081346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-716a970d-a0ca-4f39-bc2b-89d93946b6dc req-077fc33c-53a1-4df0-98ab-df1364f9edb1 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:18.093220 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-716a970d-a0ca-4f39-bc2b-89d93946b6dc req-077fc33c-53a1-4df0-98ab-df1364f9edb1 service nova] Creating event network-changed:042710a3-17f3-4c07-9627-31024aa34776 for instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 on n-h1-854882-3 Aug 29 16:37:18.098268 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-716a970d-a0ca-4f39-bc2b-89d93946b6dc req-077fc33c-53a1-4df0-98ab-df1364f9edb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033933 Aug 29 16:37:18.098962 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3752/7330] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:37:18.704212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:18.704861 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:18.714689 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:18.715177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:18.715598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:18.716293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:18.716741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:18.717196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:18.862131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:18.870695 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6936357a-bfe9-4b9e-8da8-6f920298d38b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1392 microversion: 2.1 time: 0.170357 Aug 29 16:37:18.872023 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3579/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:18 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:19.893107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:19.893872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:19.900571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:19.901077 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:19.901571 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:19.902282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:19.902756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:19.903200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:20.052612 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:20.060357 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5948c22a-59ad-4332-b6ae-1109e89da608 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1392 microversion: 2.1 time: 0.172473 Aug 29 16:37:20.060944 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3753/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:19 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:21.081475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:21.082225 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:21.089473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:21.089916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:21.090349 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:21.091034 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:21.091485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:21.091936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:21.222608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:21.230977 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5d084201-3862-48c2-a2e6-e440207ca5df tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1392 microversion: 2.1 time: 0.153473 Aug 29 16:37:21.231563 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3580/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:21 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:22.251931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:22.256099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:22.259620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:22.260137 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:22.261273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:22.262334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:22.263065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:22.263685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:22.399527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:22.407347 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e356beb2-5027-45dd-b676-3d863504bdda tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1392 microversion: 2.1 time: 0.159347 Aug 29 16:37:22.407916 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3754/7334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:22 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:23.428200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:23.428825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:23.436315 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:23.436797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:23.437235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:23.437952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:23.438671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:23.439098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:23.580943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:23.588819 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5544c20-0181-4b2d-a01a-0ed72fd38242 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1392 microversion: 2.1 time: 0.164510 Aug 29 16:37:23.589506 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3581/7335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:23 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:23.959773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-d3f95604-7dce-4981-89f2-7e3afcba50ab req-aed1f761-e323-457e-b339-7aaf246739fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3", "name": "network-vif-plugged", "status": "completed", "tag": "042710a3-17f3-4c07-9627-31024aa34776"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:23.972233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d3f95604-7dce-4981-89f2-7e3afcba50ab req-aed1f761-e323-457e-b339-7aaf246739fb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:23.972837 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d3f95604-7dce-4981-89f2-7e3afcba50ab req-aed1f761-e323-457e-b339-7aaf246739fb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:23.973411 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-d3f95604-7dce-4981-89f2-7e3afcba50ab req-aed1f761-e323-457e-b339-7aaf246739fb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:23.984855 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-d3f95604-7dce-4981-89f2-7e3afcba50ab req-aed1f761-e323-457e-b339-7aaf246739fb service nova] Creating event network-vif-plugged:042710a3-17f3-4c07-9627-31024aa34776 for instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 on n-h1-854882-3 Aug 29 16:37:23.989830 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-d3f95604-7dce-4981-89f2-7e3afcba50ab req-aed1f761-e323-457e-b339-7aaf246739fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 Aug 29 16:37:23.990473 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3755/7336] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:37:24.611184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:24.611809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:24.618471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:24.618953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:24.619391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:24.620170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:24.620624 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:24.621595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:24.752864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:24.760598 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-59e40d9d-2f1e-4828-8abf-7534773ae9f1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1392 microversion: 2.1 time: 0.153389 Aug 29 16:37:24.761176 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3582/7337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:24 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:25.780055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:25.780942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:25.785014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:25.785764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:25.792808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:25.793319 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:25.793808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:25.794520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:25.794992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:25.795439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:25.926743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:25.935725 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-05a86dad-14df-4be3-b4d2-f24c7e8e94e5 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1564 microversion: 2.1 time: 0.157406 Aug 29 16:37:25.936309 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3756/7338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:25 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:25.957412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:25.958141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:25.960409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:25.967019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:25.967505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:25.967943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:25.968792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:25.969249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:25.969710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:26.102669 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:26.110879 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-021d55d5-86d0-471b-b374-daac328bfafa tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1564 microversion: 2.1 time: 0.157626 Aug 29 16:37:26.111469 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3583/7339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:25 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:28.039710 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:28.045101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-1e3dcb13-d2ce-4ab4-b44a-c77420b599f9 req-acfbfe7b-4faa-4244-bb77-3f9c9d5b3c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3", "tag": "042710a3-17f3-4c07-9627-31024aa34776"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:28.049788 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:28.052607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:28.058582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:28.059170 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:28.059688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:28.059822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1e3dcb13-d2ce-4ab4-b44a-c77420b599f9 req-acfbfe7b-4faa-4244-bb77-3f9c9d5b3c16 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:28.060271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1e3dcb13-d2ce-4ab4-b44a-c77420b599f9 req-acfbfe7b-4faa-4244-bb77-3f9c9d5b3c16 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:28.060574 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:28.060722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-1e3dcb13-d2ce-4ab4-b44a-c77420b599f9 req-acfbfe7b-4faa-4244-bb77-3f9c9d5b3c16 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:28.061160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:28.061698 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:28.067059 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=45 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:28.074255 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-1e3dcb13-d2ce-4ab4-b44a-c77420b599f9 req-acfbfe7b-4faa-4244-bb77-3f9c9d5b3c16 service nova] Creating event network-changed:042710a3-17f3-4c07-9627-31024aa34776 for instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 on n-h1-854882-3 Aug 29 16:37:28.079368 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-1e3dcb13-d2ce-4ab4-b44a-c77420b599f9 req-acfbfe7b-4faa-4244-bb77-3f9c9d5b3c16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037825 Aug 29 16:37:28.083420 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3584/7340] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:37:28.287681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:28.297774 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-087526e4-0a33-4e0d-b7de-65e2a5ece820 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1564 microversion: 2.1 time: 0.262104 Aug 29 16:37:28.298363 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3757/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:28 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1564 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:49.543818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:49.544567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=38 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:49.610499 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:49.612851 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:49.619742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:49.620742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:49.621174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:49.621891 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:49.622347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:49.622771 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:49.673651 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-73e638ad-1407-4750-8ed7-e8fa22bc8446 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action" status: 200 len: 24570 microversion: 2.1 time: 0.132687 Aug 29 16:37:49.674298 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3585/7342] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:37:49 2022] POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action => generated 24570 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:37:56.126442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a42746d6-d61b-40fe-ae10-e1aaba329ab4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:37:56.128575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:56.129442 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=5 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:56.136279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a42746d6-d61b-40fe-ae10-e1aaba329ab4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:56.136777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a42746d6-d61b-40fe-ae10-e1aaba329ab4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:56.137229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a42746d6-d61b-40fe-ae10-e1aaba329ab4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:56.159468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a42746d6-d61b-40fe-ae10-e1aaba329ab4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Going to try to stop instance {{(pid=130002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:37:56.202157 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a42746d6-d61b-40fe-ae10-e1aaba329ab4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action" status: 202 len: 0 microversion: 2.1 time: 0.079525 Aug 29 16:37:56.203283 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3758/7343] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:37:56 2022] POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:37:56.213684 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:56.214411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:56.222908 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:56.223440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:56.223923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:56.224727 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:56.225224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:56.225711 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:56.374550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:56.382278 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-adbf7ad7-d7e6-423c-83b1-49ec73cf4b50 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.174426 Aug 29 16:37:56.382789 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3586/7344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:56 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:37:57.405617 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:57.406371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:57.412544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:57.413043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:57.413530 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:57.414236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:57.414706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:57.415145 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:57.551960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:57.561061 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9fc75517-ae95-4f04-b68d-c13e751922fe tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.160580 Aug 29 16:37:57.561683 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3759/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:57 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:58.583247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:58.583863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:58.591737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:58.592221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:58.592659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:58.593519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:58.594084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:58.594480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:58.735968 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:58.744464 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-32f3a465-5f83-48a5-b2c7-a2e63476c82d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.164733 Aug 29 16:37:58.745039 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3587/7346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:58 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:37:59.765588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:37:59.766222 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:37:59.772986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:59.773511 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:59.773968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:59.774669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:37:59.775133 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:37:59.775572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:37:59.911107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:37:59.919244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af547a2e-260e-4f08-82ed-4e8251233fe1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.157655 Aug 29 16:37:59.919819 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3760/7347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:37:59 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:00.940673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:00.941298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:00.948333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:00.948819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:00.949261 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:00.949979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:00.950439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:00.950866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:01.088609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:01.096865 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fb03163e-5adf-416d-aa4b-129e310aa88a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.160368 Aug 29 16:38:01.097496 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3588/7348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:00 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:02.118706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:02.119271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:02.126394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:02.126995 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:02.127439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:02.128151 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:02.128625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:02.129072 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:02.258955 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:02.266741 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-63d1036c-5022-444b-9c77-af2e10878634 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.152105 Aug 29 16:38:02.267325 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3761/7349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:02 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:03.287347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:03.287864 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:03.294954 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:03.295429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:03.295858 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:03.296536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:03.296985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:03.297423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:03.431435 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:03.439912 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-17c40e4c-b4d1-4cd0-891c-92e30aadb95d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.156516 Aug 29 16:38:03.440474 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3589/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:03 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:04.461441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:04.462083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:04.468847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:04.469347 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:04.469831 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:04.470540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:04.471010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:04.471453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:04.604540 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:04.612824 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6cb357c9-2f2b-467b-a30b-f297f99a2e74 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.155303 Aug 29 16:38:04.613430 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3762/7351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:04 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:05.634494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:05.635115 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:05.642441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:05.642735 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:05.643170 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:05.643855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:05.644310 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:05.644736 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:05.781196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:05.788908 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c368bcd8-d6f1-4387-92b5-2d45531d7fdd tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1692 microversion: 2.1 time: 0.158376 Aug 29 16:38:05.789498 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3590/7352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:05 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:06.810978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:06.811582 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:06.818768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:06.819286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:06.819724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:06.820429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:06.820900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:06.821341 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:06.954654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:06.962445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3c9b3ce6-a950-4b12-8f40-b888900bb83e tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1669 microversion: 2.1 time: 0.155524 Aug 29 16:38:06.963026 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3763/7353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:06 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:08.058127 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:08.060389 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:08.067541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:08.067998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:08.068428 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:08.069107 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:08.069591 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:08.070010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:08.122482 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d2c8d49f-30b7-4519-87e9-c8741f059c56 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action" status: 200 len: 34891 microversion: 2.1 time: 0.068132 Aug 29 16:38:08.123139 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3591/7354] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:08 2022] POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action => generated 34891 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:38:08.134929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f5974927-37ff-4f9e-b079-c0ba696162bf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:08.142336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5974927-37ff-4f9e-b079-c0ba696162bf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:08.142835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5974927-37ff-4f9e-b079-c0ba696162bf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:08.143294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f5974927-37ff-4f9e-b079-c0ba696162bf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:08.165430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f5974927-37ff-4f9e-b079-c0ba696162bf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Going to try to start instance {{(pid=130002) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:38:08.206034 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f5974927-37ff-4f9e-b079-c0ba696162bf tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action" status: 202 len: 0 microversion: 2.1 time: 0.074882 Aug 29 16:38:08.206640 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3764/7355] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:08 2022] POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:38:08.216833 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:08.217571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:08.225376 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:08.225888 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:08.226335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:08.227046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:08.227497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:08.227946 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:08.374960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:08.382675 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d188edac-f029-4764-af15-61c6ae5a5ee1 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1678 microversion: 2.1 time: 0.171412 Aug 29 16:38:08.383248 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3592/7356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:08 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:09.406371 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:09.407088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:09.413200 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:09.413726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:09.414177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:09.414876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:09.415340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:09.415777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:09.552978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:09.561636 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-fe381d8e-8d98-4832-a304-dadc1a881397 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1682 microversion: 2.1 time: 0.160332 Aug 29 16:38:09.562216 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3765/7357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:09 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:33.767191 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:33.769437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:33.772166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=16 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:33.772827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=44 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:33.779353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:33.779837 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:33.780278 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:33.780971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:33.781478 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:33.781913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:33.833748 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-003ea1e4-5b70-4413-925b-93cec01c2342 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action" status: 200 len: 59445 microversion: 2.1 time: 0.070784 Aug 29 16:38:33.834307 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3593/7358] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:33 2022] POST /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3/action => generated 59445 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:38:40.886265 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-96d3426c-2016-4468-903c-cd52d495f794 req-95a3aea5-d608-4d1f-9c6e-14856f26a2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3", "tag": "042710a3-17f3-4c07-9627-31024aa34776"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:40.887688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:40.888423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:40.900932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-96d3426c-2016-4468-903c-cd52d495f794 req-95a3aea5-d608-4d1f-9c6e-14856f26a2d3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.903609 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=16 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:40.905053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:40.909811 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.910323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.910776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.911503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.911980 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.912424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.917449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-96d3426c-2016-4468-903c-cd52d495f794 req-95a3aea5-d608-4d1f-9c6e-14856f26a2d3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.918070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-96d3426c-2016-4468-903c-cd52d495f794 req-95a3aea5-d608-4d1f-9c6e-14856f26a2d3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.930462 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-96d3426c-2016-4468-903c-cd52d495f794 req-95a3aea5-d608-4d1f-9c6e-14856f26a2d3 service nova] Creating event network-changed:042710a3-17f3-4c07-9627-31024aa34776 for instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 on n-h1-854882-3 Aug 29 16:38:40.937381 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-96d3426c-2016-4468-903c-cd52d495f794 req-95a3aea5-d608-4d1f-9c6e-14856f26a2d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054971 Aug 29 16:38:40.938122 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3594/7359] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:40.953003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:38:41.049204 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-efb663f6-683b-498b-9e98-1b23b5f92b0f tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 204 len: 0 microversion: 2.1 time: 0.171164 Aug 29 16:38:41.053171 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3766/7360] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:38:40 2022] DELETE /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:38:41.059646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:41.061751 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:41.069201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:41.069718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:41.070303 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:41.070842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:41.071441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:41.071870 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:41.221120 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:41.228890 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0ebe1757-f2a2-451b-84d1-b86196c9e842 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1688 microversion: 2.1 time: 0.174228 Aug 29 16:38:41.229493 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3595/7361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:41 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:42.251864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:42.252587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:42.259745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:42.260255 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:42.260716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:42.261461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:42.261939 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:42.262385 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:42.472637 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:42.480572 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-20a75b23-17dc-49a2-a79e-770113e46956 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 200 len: 1688 microversion: 2.1 time: 0.233448 Aug 29 16:38:42.481373 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3767/7362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:42 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:42.952367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4fec7c78-aace-4fe6-bb17-45c3e6becee0 req-9eb2b1f3-a515-4465-8df6-e6be95816214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3", "name": "network-vif-deleted", "tag": "042710a3-17f3-4c07-9627-31024aa34776"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:42.962643 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4fec7c78-aace-4fe6-bb17-45c3e6becee0 req-9eb2b1f3-a515-4465-8df6-e6be95816214 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:42.963122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4fec7c78-aace-4fe6-bb17-45c3e6becee0 req-9eb2b1f3-a515-4465-8df6-e6be95816214 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:42.963561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4fec7c78-aace-4fe6-bb17-45c3e6becee0 req-9eb2b1f3-a515-4465-8df6-e6be95816214 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:42.975001 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4fec7c78-aace-4fe6-bb17-45c3e6becee0 req-9eb2b1f3-a515-4465-8df6-e6be95816214 service nova] Creating event network-vif-deleted:042710a3-17f3-4c07-9627-31024aa34776 for instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 on n-h1-854882-3 Aug 29 16:38:42.979660 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4fec7c78-aace-4fe6-bb17-45c3e6becee0 req-9eb2b1f3-a515-4465-8df6-e6be95816214 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031088 Aug 29 16:38:42.980252 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3596/7363] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:43.502918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:43.503558 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:43.510432 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:43.510937 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:43.511413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:43.512099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:43.512570 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:43.513012 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:43.526539 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] HTTP exception thrown: Instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 could not be found. Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Request method failure captured: Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 HTTP/1.1 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOoeSkWqKTJJ4DS6XOSqwkgvg88NxZySAi-2rqiUX6LcOiSzIaJtxsiomcehZ0NNGfvu-RgPNHvHl1PUgsUFxdL7qtcRZf9G4k8M9KGQjZkhRyV1LtotwcZsiQq1tAW5zILNSFP5eXcIo6X6WztYO7zL00WEpPiqrrKmhemJ9eSyVD4 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb98c98f9e648969df435ba25553626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb98c98f9e648969df435ba25553626", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}] Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 73aebcdee9514da2883e50c4d9b3a2f5 Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 could not be found. Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3'} Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 could not be found. Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 could not be found. Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:38:43.528186 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 could not be found. Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Returning 404 to user: Instance b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c09bc492-5469-4403-8032-785a3a29c1ff tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3" status: 404 len: 111 microversion: 2.1 time: 0.030694 Aug 29 16:38:43.533758 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3768/7364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:43 2022] GET /compute/v2.1/servers/b9a0c6fb-3e70-4a6a-8a29-3a1f4879eeb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:38:46.862061 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b461b9d7-ebb2-4ded-bbfa-8c9c93d72e69 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '.version_select at 0x7fb0e2730ca0>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:46.888189 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b461b9d7-ebb2-4ded-bbfa-8c9c93d72e69 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-502971505" status: 202 len: 0 microversion: 2.1 time: 0.032839 Aug 29 16:38:46.889174 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3597/7365] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Aug 29 16:38:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-502971505 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:38:46.920156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-956c762d-8b8a-402c-96f1-b23f48e44f18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: .version_select at 0x7fb0e0628e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1543572985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnkMPs8Zq7lBAvr6N8AP6gW8q68A7NU1uLAqkAt9HOtWDDPrqmWsieJTpzw+bc6KJYJmd8c4uV+72Qnek9vu5G1dB+BYoJDcmdgDSkC9r0F0VXjwLSNfLVLPvfPyVkXhw=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:46.943591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-956c762d-8b8a-402c-96f1-b23f48e44f18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:38:46.949915 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-956c762d-8b8a-402c-96f1-b23f48e44f18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:38:46.974223 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-956c762d-8b8a-402c-96f1-b23f48e44f18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058123 Aug 29 16:38:46.975026 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3769/7366] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:38:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:38:52.618666 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-847376323", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "networks": [{"uuid": "2dd24404-2d6d-4d21-bedb-a24fd0763b7a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1543572985", "security_groups": [{"name": "tempest-secgroup-smoke-1420955698"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:52.741359 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] validate_networks() for [('2dd24404-2d6d-4d21-bedb-a24fd0763b7a', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:38:52.974580 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=14 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:53.283691 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:38:53.284404 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:38:53.285097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:38:53.285838 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:38:53.286507 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:38:53.296446 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:53.296855 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:53.297973 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:53.299147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:53.300112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:53.301025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:53.329674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:38:53.338776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Getting quotas for user 73aebcdee9514da2883e50c4d9b3a2f5 and project ecb98c98f9e648969df435ba25553626. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:38:53.353266 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:38:53.356719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:38:53.415669 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-31c79fe8-0900-4544-b75c-da4eeaadb749 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.801241 Aug 29 16:38:53.416986 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3598/7367] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:38:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:38:53.428249 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-476f474f-64aa-4bb5-9182-7adc7f55bbfb tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:53.429536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-476f474f-64aa-4bb5-9182-7adc7f55bbfb tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:53.509581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-476f474f-64aa-4bb5-9182-7adc7f55bbfb tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:53.518030 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:53.520765 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-476f474f-64aa-4bb5-9182-7adc7f55bbfb tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1266 microversion: 2.1 time: 0.096393 Aug 29 16:38:53.534429 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3770/7368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:53 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:54.544025 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8a0632a-428d-41e6-9dc8-ebccc726be58 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:54.544648 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8a0632a-428d-41e6-9dc8-ebccc726be58 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:54.610388 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8a0632a-428d-41e6-9dc8-ebccc726be58 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:54.617622 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8a0632a-428d-41e6-9dc8-ebccc726be58 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1266 microversion: 2.1 time: 0.077802 Aug 29 16:38:54.618205 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3599/7369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:54 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:55.640863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e2c4e230-de1b-46dd-b1fa-cf1bef478e04 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:55.642603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e2c4e230-de1b-46dd-b1fa-cf1bef478e04 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:55.705123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e2c4e230-de1b-46dd-b1fa-cf1bef478e04 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:55.712353 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e2c4e230-de1b-46dd-b1fa-cf1bef478e04 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1266 microversion: 2.1 time: 0.076257 Aug 29 16:38:55.712970 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3771/7370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:55 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:38:56.733421 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-484a0b4e-c207-462e-8715-c5d2af5654f7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:56.734044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-484a0b4e-c207-462e-8715-c5d2af5654f7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:56.842705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-484a0b4e-c207-462e-8715-c5d2af5654f7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:56.850229 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-484a0b4e-c207-462e-8715-c5d2af5654f7 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1266 microversion: 2.1 time: 0.120631 Aug 29 16:38:56.851037 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3600/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:56 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:57.872257 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:57.872886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:57.879448 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:57.879943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:57.880390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:57.881087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:57.881581 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:57.882021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:57.943219 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:57.950971 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d542ca33-5a3c-49e0-990c-ddc3bcac8864 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1270 microversion: 2.1 time: 0.082799 Aug 29 16:38:57.951542 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3772/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:57 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:58.973056 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:58.973757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:58.981280 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:58.981824 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:58.982270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:58.983140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:58.983598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:58.984030 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:59.048106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:59.055908 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-30deed1c-3147-44c9-84ed-a2ce713aaf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1324 microversion: 2.1 time: 0.087570 Aug 29 16:38:59.056686 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3601/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:58 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1324 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:00.077926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:00.079830 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:00.087362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:00.087520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-8fb4452b-d326-4bcc-bcbf-3127613db44d req-50a52395-11b4-4bc1-8f0a-ec7435f0effb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a69c26b-1eae-4f33-9fe7-f2a0fd121799", "tag": "09a11ff7-e275-49bd-808c-a6b78aa0d4d0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:00.087926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:00.088271 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:00.088970 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:00.089444 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:00.089866 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:00.098576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8fb4452b-d326-4bcc-bcbf-3127613db44d req-50a52395-11b4-4bc1-8f0a-ec7435f0effb service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:00.099192 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8fb4452b-d326-4bcc-bcbf-3127613db44d req-50a52395-11b4-4bc1-8f0a-ec7435f0effb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:00.099892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-8fb4452b-d326-4bcc-bcbf-3127613db44d req-50a52395-11b4-4bc1-8f0a-ec7435f0effb service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:00.111943 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-8fb4452b-d326-4bcc-bcbf-3127613db44d req-50a52395-11b4-4bc1-8f0a-ec7435f0effb service nova] Creating event network-changed:09a11ff7-e275-49bd-808c-a6b78aa0d4d0 for instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 on n-h2-854882-3 Aug 29 16:39:00.117069 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-8fb4452b-d326-4bcc-bcbf-3127613db44d req-50a52395-11b4-4bc1-8f0a-ec7435f0effb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093484 Aug 29 16:39:00.117930 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3773/7374] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:00.230825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:00.238977 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-8320d979-f508-44d9-811c-931f91c1c106 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1392 microversion: 2.1 time: 0.165557 Aug 29 16:39:00.239801 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3602/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:00 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:01.261579 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:01.262313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:01.269409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:01.269934 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:01.270393 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:01.271114 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:01.271588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:01.272040 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:01.503172 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:01.511027 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0268e108-0096-4eaf-9c2b-5c16855ac332 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1392 microversion: 2.1 time: 0.254607 Aug 29 16:39:01.511618 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3774/7376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:01 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:02.533383 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:02.534118 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:02.540930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:02.541437 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:02.541873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:02.542560 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:02.543007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:02.543426 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:02.997075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:03.005271 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0de4a9ce-c94e-493c-88a4-e1092ed000c9 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1392 microversion: 2.1 time: 0.477023 Aug 29 16:39:03.005884 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3603/7377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:02 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1392 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:04.027323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:04.027960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:04.035313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:04.035819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:04.036276 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:04.036993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:04.037502 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:04.037952 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:04.442569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:04.450612 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d4d67436-63e6-4a47-9a1f-55979f9272ed tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1392 microversion: 2.1 time: 0.427176 Aug 29 16:39:04.451192 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3775/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:04 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1392 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:05.371223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8be9c92a-a948-49e2-9f45-d8340616a4af req-0fa9ff9d-b6c3-44a0-be9b-b3d4b6296cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a69c26b-1eae-4f33-9fe7-f2a0fd121799", "name": "network-vif-plugged", "status": "completed", "tag": "09a11ff7-e275-49bd-808c-a6b78aa0d4d0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:05.377330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:05.379536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:05.386617 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8be9c92a-a948-49e2-9f45-d8340616a4af req-0fa9ff9d-b6c3-44a0-be9b-b3d4b6296cfa service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:05.387106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8be9c92a-a948-49e2-9f45-d8340616a4af req-0fa9ff9d-b6c3-44a0-be9b-b3d4b6296cfa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:05.387783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8be9c92a-a948-49e2-9f45-d8340616a4af req-0fa9ff9d-b6c3-44a0-be9b-b3d4b6296cfa service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:05.401978 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8be9c92a-a948-49e2-9f45-d8340616a4af req-0fa9ff9d-b6c3-44a0-be9b-b3d4b6296cfa service nova] Creating event network-vif-plugged:09a11ff7-e275-49bd-808c-a6b78aa0d4d0 for instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 on n-h2-854882-3 Aug 29 16:39:05.408287 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8be9c92a-a948-49e2-9f45-d8340616a4af req-0fa9ff9d-b6c3-44a0-be9b-b3d4b6296cfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040928 Aug 29 16:39:05.409231 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3604/7379] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:39:05.473677 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:05.474312 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:05.481087 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:05.481632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:05.482095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:05.482817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:05.483324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:05.483773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:05.649933 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:05.658311 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e199e907-b6f0-4069-ae46-a206569bcf18 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1392 microversion: 2.1 time: 0.189261 Aug 29 16:39:05.658954 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3776/7380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:05 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:06.681131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:06.681876 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:06.688484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:06.689291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:06.689695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:06.690906 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:06.691361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:06.691792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:06.824108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:06.832108 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2ad8cdea-f008-4efa-a4b2-aae1ffaea08b tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1564 microversion: 2.1 time: 0.156816 Aug 29 16:39:06.832689 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3605/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:06 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:06.852926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:06.853594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:06.855561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:06.861604 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:06.862640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:06.863098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:06.863818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:06.864293 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:06.864738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:06.996745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:07.005116 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a495ed55-142a-4f01-b2be-43ec4cf752a4 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1564 microversion: 2.1 time: 0.156116 Aug 29 16:39:07.005718 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3777/7382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:06 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:08.919668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:08.920290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:08.921289 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-c7712e7f-5da5-418d-b7f3-e75298a2e4ab req-dcfe7536-47d8-45a3-b0be-fc4d9ff6f177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a69c26b-1eae-4f33-9fe7-f2a0fd121799", "tag": "09a11ff7-e275-49bd-808c-a6b78aa0d4d0"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:08.923510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:08.928957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:08.929734 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:08.930171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:08.931106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:08.931627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:08.932224 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:08.936174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c7712e7f-5da5-418d-b7f3-e75298a2e4ab req-dcfe7536-47d8-45a3-b0be-fc4d9ff6f177 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:08.938118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c7712e7f-5da5-418d-b7f3-e75298a2e4ab req-dcfe7536-47d8-45a3-b0be-fc4d9ff6f177 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:08.938597 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-c7712e7f-5da5-418d-b7f3-e75298a2e4ab req-dcfe7536-47d8-45a3-b0be-fc4d9ff6f177 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:08.950619 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-c7712e7f-5da5-418d-b7f3-e75298a2e4ab req-dcfe7536-47d8-45a3-b0be-fc4d9ff6f177 service nova] Creating event network-changed:09a11ff7-e275-49bd-808c-a6b78aa0d4d0 for instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 on n-h2-854882-3 Aug 29 16:39:08.957090 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-c7712e7f-5da5-418d-b7f3-e75298a2e4ab req-dcfe7536-47d8-45a3-b0be-fc4d9ff6f177 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039245 Aug 29 16:39:08.958109 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3778/7383] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:39:09.073332 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:09.082229 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2287abe8-e177-4df7-85f2-da495d472618 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1564 microversion: 2.1 time: 0.166314 Aug 29 16:39:09.082923 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3606/7384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:08 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:32.350220 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:32.352506 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:32.354850 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:32.355517 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=34 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:32.362313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:32.362825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:32.363914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:32.364639 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:32.365117 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:32.365758 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:32.420540 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ee1fda47-155f-408c-a81c-ffbbcf0b5a15 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action" status: 200 len: 24568 microversion: 2.1 time: 0.075197 Aug 29 16:39:32.421177 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3779/7385] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:32 2022] POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:39:38.793668 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:38.794185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:38.796236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:38.796994 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=34 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:38.804212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:38.804698 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:38.805136 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:38.805849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:38.806304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:38.806728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:38.830097 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lazy-loading 'flavor' on Instance uuid 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:39:38.895961 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fa0b7b73-5f27-4417-8c33-55521a562fe0 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action" status: 202 len: 0 microversion: 2.1 time: 0.106477 Aug 29 16:39:38.896639 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3607/7386] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:38 2022] POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:39:38.905561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:38.906322 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:38.916660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:38.917177 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:38.917688 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:38.918461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:38.918951 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:38.919406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:39.059001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:39.067395 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-115bfe30-249c-425e-842f-12fb2c7e148c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1691 microversion: 2.1 time: 0.166258 Aug 29 16:39:39.067953 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3780/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:38 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:40.093633 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:40.094340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:40.100480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:40.100958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:40.101413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:40.102108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:40.102567 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:40.102992 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:40.239470 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:40.247258 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-256e1457-29ae-49eb-9c47-0d27008b3571 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1674 microversion: 2.1 time: 0.158911 Aug 29 16:39:40.247840 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3608/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:40 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:41.339755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:41.341969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:41.350083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.350590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.351083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.351800 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.352305 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.352802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.407012 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b4b89f89-4cf5-443b-bb9d-32b63185a01a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action" status: 200 len: 35858 microversion: 2.1 time: 0.071099 Aug 29 16:39:41.407640 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3781/7389] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:41 2022] POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action => generated 35858 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:39:41.420168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:41.420742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:41.428184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.428664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.429095 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.429812 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.430264 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.430687 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.496103 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9f8ef866-02fc-4b61-bd91-a3b230f02686 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action" status: 202 len: 0 microversion: 2.1 time: 0.079629 Aug 29 16:39:41.497082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3609/7390] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:41 2022] POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:39:41.506590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:41.507598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:41.515618 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.516129 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.516713 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.517457 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.517966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.518452 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.736458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:41.750973 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f62bb0a0-5961-4ea6-b124-3f26df28a650 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1680 microversion: 2.1 time: 0.248798 Aug 29 16:39:41.752232 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3782/7391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:41 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:42.775503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:42.776207 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:42.782328 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:42.782801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:42.783232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:42.783916 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:42.784364 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:42.784834 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:42.931465 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:42.942169 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0169b631-53bf-4090-8101-ddb468a193a6 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1680 microversion: 2.1 time: 0.172301 Aug 29 16:39:42.942532 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3610/7392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:42 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:43.962886 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:43.963528 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:43.970872 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:43.971376 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:43.971832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:43.972815 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:43.973296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:43.973780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:44.117085 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:44.125408 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-64b391a3-284b-4beb-ab9d-574a46c0ec0c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1683 microversion: 2.1 time: 0.166482 Aug 29 16:39:44.125990 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3783/7393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:43 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:44.228476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:44.230819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:44.238142 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:44.238620 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:44.239057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:44.239778 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:44.240229 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:44.240654 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:44.282478 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a933bc9-018d-46ee-817c-8d261469673d tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action" status: 200 len: 35858 microversion: 2.1 time: 0.058017 Aug 29 16:39:44.283216 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3611/7394] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:44 2022] POST /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799/action => generated 35858 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:39:45.316598 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:45.317128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:45.319797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-dc53bf3a-f854-4e6c-8cfe-2267071a79f8 req-95ca2203-3d1b-45c3-8fb7-c89be4a98ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a69c26b-1eae-4f33-9fe7-f2a0fd121799", "tag": "09a11ff7-e275-49bd-808c-a6b78aa0d4d0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:45.324332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:45.325088 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:45.325671 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:45.326461 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:45.327111 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:45.327555 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:45.330903 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dc53bf3a-f854-4e6c-8cfe-2267071a79f8 req-95ca2203-3d1b-45c3-8fb7-c89be4a98ff8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:45.331481 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dc53bf3a-f854-4e6c-8cfe-2267071a79f8 req-95ca2203-3d1b-45c3-8fb7-c89be4a98ff8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:45.332164 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-dc53bf3a-f854-4e6c-8cfe-2267071a79f8 req-95ca2203-3d1b-45c3-8fb7-c89be4a98ff8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:45.346472 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-dc53bf3a-f854-4e6c-8cfe-2267071a79f8 req-95ca2203-3d1b-45c3-8fb7-c89be4a98ff8 service nova] Creating event network-changed:09a11ff7-e275-49bd-808c-a6b78aa0d4d0 for instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 on n-h2-854882-3 Aug 29 16:39:45.354523 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-dc53bf3a-f854-4e6c-8cfe-2267071a79f8 req-95ca2203-3d1b-45c3-8fb7-c89be4a98ff8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037535 Aug 29 16:39:45.355574 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3612/7395] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:39:45.358670 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:39:45.453276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4e11307d-41f2-4332-a4be-5871bed1ae2a tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 204 len: 0 microversion: 2.1 time: 0.139643 Aug 29 16:39:45.455390 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3784/7396] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:39:45 2022] DELETE /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:39:45.465612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:45.466656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:45.473945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:45.474707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:45.475392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:45.476295 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:45.476959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:45.477606 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:45.619276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:45.627309 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cfc52650-ce2c-457a-9986-b39146cfe371 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1689 microversion: 2.1 time: 0.166554 Aug 29 16:39:45.627919 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3613/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:45 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:46.651131 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:46.651857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:46.658691 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.659194 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.659653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.660359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.660832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.661274 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.862007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:46.870091 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-5d6e5673-f89d-4c1f-806c-62cb95591a17 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1689 microversion: 2.1 time: 0.223144 Aug 29 16:39:46.870924 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3785/7398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:46 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:47.538053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4942f8be-c189-40a9-9490-56a3c2a816d9 req-90f83f39-26ba-47db-9e1b-ec04919203a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a69c26b-1eae-4f33-9fe7-f2a0fd121799", "name": "network-vif-deleted", "tag": "09a11ff7-e275-49bd-808c-a6b78aa0d4d0"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:47.549019 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4942f8be-c189-40a9-9490-56a3c2a816d9 req-90f83f39-26ba-47db-9e1b-ec04919203a0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:47.549530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4942f8be-c189-40a9-9490-56a3c2a816d9 req-90f83f39-26ba-47db-9e1b-ec04919203a0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:47.549958 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4942f8be-c189-40a9-9490-56a3c2a816d9 req-90f83f39-26ba-47db-9e1b-ec04919203a0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:47.561695 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4942f8be-c189-40a9-9490-56a3c2a816d9 req-90f83f39-26ba-47db-9e1b-ec04919203a0 service nova] Creating event network-vif-deleted:09a11ff7-e275-49bd-808c-a6b78aa0d4d0 for instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 on n-h2-854882-3 Aug 29 16:39:47.566735 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4942f8be-c189-40a9-9490-56a3c2a816d9 req-90f83f39-26ba-47db-9e1b-ec04919203a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033051 Aug 29 16:39:47.567347 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3614/7399] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:47.892236 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:47.892924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:47.901238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:47.901808 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:47.902273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:47.903007 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:47.903492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:47.903945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:47.942990 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:47.943504 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:47.943968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:47.944446 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lazy-loading 'fault' on Instance uuid 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:39:47.989241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73aebcdee9514da2883e50c4d9b3a2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb98c98f9e648969df435ba25553626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:47.997207 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13bca0f7-c96e-49c8-b699-470c09a865ba tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 200 len: 1356 microversion: 2.1 time: 0.108906 Aug 29 16:39:47.997806 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3786/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:47 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:49.020585 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:49.021286 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] [instance: 4a69c26b-1eae-4f33-9fe7-f2a0fd121799] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:49.027500 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:49.027974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:49.028424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:49.029080 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:49.029554 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:49.029974 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:49.043491 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] HTTP exception thrown: Instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 could not be found. Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Request method failure captured: Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 HTTP/1.1 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDOoeSkWqKTJJ4DS6XOSqwkgvg88NxZySAi-2rqiUX6LcOiSzIaJtxsiomcehZ0NNGfvu-RgPNHvHl1PUgsUFxdL7qtcRZf9G4k8M9KGQjZkhRyV1LtotwcZsiQq1tAW5zILNSFP5eXcIo6X6WztYO7zL00WEpPiqrrKmhemJ9eSyVD4 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecb98c98f9e648969df435ba25553626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecb98c98f9e648969df435ba25553626", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecb98c98f9e648969df435ba25553626"}]}] Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: ecb98c98f9e648969df435ba25553626 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2133702727 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: 73aebcdee9514da2883e50c4d9b3a2f5 Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2133702727-project Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 could not be found. Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '4a69c26b-1eae-4f33-9fe7-f2a0fd121799'} Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 could not be found. Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 could not be found. Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:39:49.045123 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 could not be found. Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Returning 404 to user: Instance 4a69c26b-1eae-4f33-9fe7-f2a0fd121799 could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a6d8e293-905d-4381-88b8-9ec5971b0978 tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799" status: 404 len: 111 microversion: 2.1 time: 0.031370 Aug 29 16:39:49.049803 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3615/7401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:49 2022] GET /compute/v2.1/servers/4a69c26b-1eae-4f33-9fe7-f2a0fd121799 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:39:52.081084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a33897d4-ff28-4b0a-ac14-1ea7828ce60c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] Calling method '.version_select at 0x7fb0e25d8b80>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:52.105321 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a33897d4-ff28-4b0a-ac14-1ea7828ce60c tempest-TestNetworkAdvancedServerOps-2133702727 tempest-TestNetworkAdvancedServerOps-2133702727-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1543572985" status: 202 len: 0 microversion: 2.1 time: 0.028054 Aug 29 16:39:52.106160 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3787/7402] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Aug 29 16:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1543572985 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:40:03.859244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=18 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:03.860006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:04.032456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7e004436-a16e-4846-9360-5a786dbfbfe2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'create', calling method: .version_select at 0x7fb0e1f9a550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1914335474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBehb+jvgQNxfr1lq7jegDing1bx3tw5gSm9hkzDN+5dAAU0EZVgQHxVkDPH43DMupRkmeFPZdMEBdz94MaPnPBFHVxn/S5Dmj+3RDKIgHTPLb16XntYMQPfYWIvYEEiw=="}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:04.048413 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-7e004436-a16e-4846-9360-5a786dbfbfe2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for project cddf5a6066704ec5a96d141bf8b96120. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:40:04.057976 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-7e004436-a16e-4846-9360-5a786dbfbfe2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for user 6f5dd2f1393b413fb8aa410a47d5357f and project cddf5a6066704ec5a96d141bf8b96120. Resources: {'key_pairs'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:40:04.084389 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7e004436-a16e-4846-9360-5a786dbfbfe2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.230540 Aug 29 16:40:04.084920 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3616/7403] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:40:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:40:05.110696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:05.112591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:05.116994 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1881411829", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1914335474", "security_groups": [{"name": "tempest-secgroup-smoke-1255460028"}], "networks": [{"uuid": "53741910-6dd7-45c5-8862-7d4a9d9dac6d"}]}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:05.243350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.network.neutron [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] validate_networks() for [('53741910-6dd7-45c5-8862-7d4a9d9dac6d', None, None, None, None, None)] {{(pid=130002) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:40:05.738423 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Flavor limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:40:05.738862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Image limits 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:40:05.739349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Flavor pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:40:05.740039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Image pref 0:0:0 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:40:05.740694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.virt.hardware [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:40:05.750148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:05.750651 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:05.751099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:05.751839 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:05.752309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:05.752751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:05.770160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for project cddf5a6066704ec5a96d141bf8b96120. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:40:05.775780 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for user 6f5dd2f1393b413fb8aa410a47d5357f and project cddf5a6066704ec5a96d141bf8b96120. Resources: {'cores', 'ram', 'instances'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:40:05.788187 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Going to run 1 instances... {{(pid=130002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:40:05.790556 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:40:05.851202 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3b64e8c-2bf8-43a4-abe8-cca2d5a02921 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742194 Aug 29 16:40:05.852130 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3788/7404] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:40:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:40:05.864457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-99436df0-0003-4b01-b113-aed28f637e0b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:05.865429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-99436df0-0003-4b01-b113-aed28f637e0b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:05.925300 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-99436df0-0003-4b01-b113-aed28f637e0b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:05.933650 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-99436df0-0003-4b01-b113-aed28f637e0b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1247 microversion: 2.1 time: 0.074392 Aug 29 16:40:05.934380 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3617/7405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:05 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:06.956898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:06.959296 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:06.972542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:06.973306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:06.973783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:06.974516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:06.975143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:06.975745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:07.057415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:07.069589 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7b6e4567-d5a0-49ed-a13e-4078acf83a2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1299 microversion: 2.1 time: 0.117273 Aug 29 16:40:07.070615 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3789/7406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:06 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:08.091881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:08.092361 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:08.100456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:08.100941 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:08.101372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:08.102090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:08.102536 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:08.102959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:08.343449 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:08.351700 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d76e8c76-2b03-4c64-b5ed-82397d1b5d39 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1373 microversion: 2.1 time: 0.264272 Aug 29 16:40:08.352287 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3618/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:08 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1373 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:08.598709 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-db0cd95c-989b-4a52-8d23-3705705c1517 req-09f4901c-9cfe-4c7e-b33e-31f707c0a17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:08.610050 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db0cd95c-989b-4a52-8d23-3705705c1517 req-09f4901c-9cfe-4c7e-b33e-31f707c0a17a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:08.610646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db0cd95c-989b-4a52-8d23-3705705c1517 req-09f4901c-9cfe-4c7e-b33e-31f707c0a17a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:08.611165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-db0cd95c-989b-4a52-8d23-3705705c1517 req-09f4901c-9cfe-4c7e-b33e-31f707c0a17a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:08.622837 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-db0cd95c-989b-4a52-8d23-3705705c1517 req-09f4901c-9cfe-4c7e-b33e-31f707c0a17a service nova] Creating event network-changed:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h1-854882-3 Aug 29 16:40:08.627800 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-db0cd95c-989b-4a52-8d23-3705705c1517 req-09f4901c-9cfe-4c7e-b33e-31f707c0a17a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033991 Aug 29 16:40:08.628407 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3790/7408] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:40:09.372166 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:09.372788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:09.380340 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:09.380821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:09.381255 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:09.381971 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:09.382420 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:09.382842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:09.516822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:09.524583 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-75d26847-e845-4354-8ae7-e204040fb153 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1373 microversion: 2.1 time: 0.156380 Aug 29 16:40:09.525156 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3619/7409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:09 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:40:10.547586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:10.548303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:10.554968 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:10.555498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:10.555949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:10.556652 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:10.557118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:10.557593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:10.698631 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:10.706425 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-50508e40-fb76-4fc5-92a8-dc01a198cdde tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1373 microversion: 2.1 time: 0.163936 Aug 29 16:40:10.706998 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3791/7410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:10 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:11.726993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:11.727605 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:11.734731 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:11.735211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:11.735640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:11.736321 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:11.736775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:11.737194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:11.874510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:11.882657 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-db5477dd-0008-4715-b580-08ed6a63c85d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1373 microversion: 2.1 time: 0.159584 Aug 29 16:40:11.883227 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3620/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:11 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:12.903450 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:12.904006 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:12.910824 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:12.911978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:12.912430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:12.913135 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:12.913628 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:12.914066 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:13.094427 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:13.102993 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3d9c4555-fe70-4d6d-bbc1-f84e15e3d647 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1373 microversion: 2.1 time: 0.203561 Aug 29 16:40:13.103580 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3792/7412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:12 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:14.123548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:14.124186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:14.131430 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:14.131912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:14.132344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:14.133032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:14.133515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:14.133942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:14.265945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:14.274531 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-80637fdd-6ae9-4f4b-8dad-d5a8fe85828d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1373 microversion: 2.1 time: 0.154874 Aug 29 16:40:14.275115 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3621/7413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:14 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:14.775832 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-30da432a-35db-4fd1-82a6-1adaab34d167 req-04ac7141-5eb3-444f-965b-084b7bdaaf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "name": "network-vif-plugged", "status": "completed", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:14.786793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30da432a-35db-4fd1-82a6-1adaab34d167 req-04ac7141-5eb3-444f-965b-084b7bdaaf7d service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:14.787291 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30da432a-35db-4fd1-82a6-1adaab34d167 req-04ac7141-5eb3-444f-965b-084b7bdaaf7d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:14.787895 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-30da432a-35db-4fd1-82a6-1adaab34d167 req-04ac7141-5eb3-444f-965b-084b7bdaaf7d service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:14.799101 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-30da432a-35db-4fd1-82a6-1adaab34d167 req-04ac7141-5eb3-444f-965b-084b7bdaaf7d service nova] Creating event network-vif-plugged:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h1-854882-3 Aug 29 16:40:14.804051 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-30da432a-35db-4fd1-82a6-1adaab34d167 req-04ac7141-5eb3-444f-965b-084b7bdaaf7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Aug 29 16:40:14.804819 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3793/7414] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:40:15.295804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:15.296416 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:15.303798 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:15.304277 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:15.304710 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:15.305410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:15.305868 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:15.306288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:15.443979 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:15.451695 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-577a0695-ed42-4e83-a59a-0b0c475517b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1373 microversion: 2.1 time: 0.159706 Aug 29 16:40:15.452264 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3622/7415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:15 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:16.469349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:16.471001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=6 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:16.475063 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:16.475782 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:16.482851 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:16.483350 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:16.483796 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:16.484498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:16.484965 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:16.485428 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:16.627573 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:16.635928 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-18dd996b-093d-46b5-ae69-0c06bfa6baac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1556 microversion: 2.1 time: 0.167538 Aug 29 16:40:16.636512 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3794/7416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:16 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:16.655627 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:16.656182 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:16.658086 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:16.664069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:16.664548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:16.664981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:16.665695 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:16.666150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:16.666573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:16.800671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:16.809044 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a5e06c7-d34c-432d-94e1-bc96d1507b1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1556 microversion: 2.1 time: 0.157369 Aug 29 16:40:16.809677 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3623/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:16 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:18.849572 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-cd6518aa-65cc-4e3f-8288-add7cbe6305e req-1af3f959-840f-473a-9805-701c0ca75d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:18.859676 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cd6518aa-65cc-4e3f-8288-add7cbe6305e req-1af3f959-840f-473a-9805-701c0ca75d24 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:18.860259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cd6518aa-65cc-4e3f-8288-add7cbe6305e req-1af3f959-840f-473a-9805-701c0ca75d24 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:18.860774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-cd6518aa-65cc-4e3f-8288-add7cbe6305e req-1af3f959-840f-473a-9805-701c0ca75d24 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:18.872252 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-cd6518aa-65cc-4e3f-8288-add7cbe6305e req-1af3f959-840f-473a-9805-701c0ca75d24 service nova] Creating event network-changed:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h1-854882-3 Aug 29 16:40:18.877338 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-cd6518aa-65cc-4e3f-8288-add7cbe6305e req-1af3f959-840f-473a-9805-701c0ca75d24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089145 Aug 29 16:40:18.877976 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3795/7418] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:13.496750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:13.497492 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=36 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:13.498761 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:42:13.498932 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd/action (ip 10.222.0.16) !!! Aug 29 16:42:13.499893 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:42:13.500053 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd/action (ip 10.222.0.16) !!! Aug 29 16:42:13.504484 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:13.505007 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:13.515852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.516329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.516756 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.517474 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.517917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.518331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.542679 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.objects.instance [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lazy-loading 'flavor' on Instance uuid d4a40280-5cb9-4a10-99b9-0e0059ae33cd {{(pid=130001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:42:13.721194 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9375a3d8-0d7a-44c6-823c-17c18b86c544 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd/action" status: 202 len: 0 microversion: 2.1 time: 0.226257 Aug 29 16:42:13.721840 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3624/7419] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:42:13 2022] POST /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:42:13.728358 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78354ac3-24e6-466d-81c7-ffd55616e73b] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:42:13.729320 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:42:13.730100 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:13.731018 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=32 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:13.737175 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:13.738027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:13.746119 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.746624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.747143 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.747802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.748382 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.749152 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.883191 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:13.891652 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-66f724f1-c5c8-42a1-bb37-5e9441b6552d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.165267 Aug 29 16:42:13.892228 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3796/7420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:13 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:14.914468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:14.915140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:14.922263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:14.922740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:14.923169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:14.923846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:14.924290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:14.924709 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:15.061895 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:15.069900 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c0bed9db-7e25-4e7e-b133-a3ea1c9165e2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.160822 Aug 29 16:42:15.070482 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3625/7421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:14 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:16.091679 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:16.092308 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:16.102038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:16.102562 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:16.103020 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:16.103737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:16.104239 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:16.104686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:16.109019 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55358. Aug 29 16:42:16.111251 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] [78354ac3-24e6-466d-81c7-ffd55616e73b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55356. Aug 29 16:42:16.242648 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:16.251150 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9a936aa7-b706-4f65-822b-286cfc1fe8e5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.163593 Aug 29 16:42:16.251728 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3797/7422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:16 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:17.272273 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:17.272820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:17.279752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:17.280236 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:17.280674 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:17.281366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:17.281852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:17.282281 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:17.413651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:17.421826 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-d0ccca9e-18a7-48d5-abbd-06b3e09f010b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.153594 Aug 29 16:42:17.423370 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3626/7423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:17 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:18.444593 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:18.445174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:18.452656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:18.453163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:18.453653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:18.454367 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:18.454841 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:18.455288 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:18.595887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:18.604526 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ff61c472-9859-4653-b8cf-a9794f88edc5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.164339 Aug 29 16:42:18.605112 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3798/7424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:18 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:19.627144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:19.627755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:19.634584 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:19.635057 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:19.635485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:19.636159 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:19.636604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:19.637016 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:19.769503 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:19.777670 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a0e1f669-e11d-49cb-a43b-61150f223fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.154501 Aug 29 16:42:19.778254 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3627/7425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:19 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:20.798723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:20.799272 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:20.806706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.807205 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.807657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:20.808369 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.808846 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.809294 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:20.938712 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:20.947726 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1691c5ea-2098-47d9-a813-ecc5779056ac tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.152995 Aug 29 16:42:20.948300 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3799/7426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:20 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:21.970206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:21.970745 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:21.977618 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:21.978100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:21.978538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:21.979222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:21.979671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:21.980090 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:22.110279 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:22.118475 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a1731174-0b12-41cf-afb1-e123457c290a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.151851 Aug 29 16:42:22.119089 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3628/7427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:21 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:23.141303 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:23.141983 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:23.148065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:23.148575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:23.149773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:23.150500 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:23.150979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:23.151430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:23.286062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:23.293794 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0669671b-3fae-4433-a3b8-022d948d5695 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.157441 Aug 29 16:42:23.294370 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3800/7428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:23 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:24.314320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:24.314926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:24.322393 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:24.322863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:24.323288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:24.323961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:24.324406 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:24.324819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:24.456422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:24.464012 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-749c5389-e16c-409d-9764-8682d162292f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1701 microversion: 2.1 time: 0.153773 Aug 29 16:42:24.464585 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3629/7429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:24 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:25.488863 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:25.490057 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:25.498204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:25.498716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:25.499178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:25.499904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:25.500380 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:25.500826 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:25.635979 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:25.643798 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-79c4f975-33a3-466d-abc6-6347fdeeec6a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1701 microversion: 2.1 time: 0.162479 Aug 29 16:42:25.644385 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3801/7430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:25 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:26.670102 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:26.671456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:26.678571 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:26.680175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:26.681505 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:26.682218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:26.682672 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:26.683088 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:26.842555 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:26.850828 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-608204e8-a0b2-4965-8fe0-d9b124952f23 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.185188 Aug 29 16:42:26.851680 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3630/7431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:26 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:27.875544 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:27.876188 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:27.883770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:27.884330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:27.884840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:27.885627 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:27.886123 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:27.886586 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:28.036752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:28.045802 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-93df13af-ad24-49cd-add7-802dbf9c9e29 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.174494 Aug 29 16:42:28.046949 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3802/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:27 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:29.067770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:29.068395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:29.076276 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:29.077109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:29.077822 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:29.078757 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:29.079683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:29.080339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:29.227379 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:29.235781 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e4cc2cf5-10c7-4e94-8289-9cd876e1db06 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.172375 Aug 29 16:42:29.240716 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3631/7433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:29 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:29.629945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-afa09409-28b0-4f6a-9e99-4d0e4fb3f6fe req-457640dc-cef0-4f60-95a3-d4c22a31c3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "name": "network-vif-plugged", "status": "completed", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:29.649779 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-afa09409-28b0-4f6a-9e99-4d0e4fb3f6fe req-457640dc-cef0-4f60-95a3-d4c22a31c3a2 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:29.650299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-afa09409-28b0-4f6a-9e99-4d0e4fb3f6fe req-457640dc-cef0-4f60-95a3-d4c22a31c3a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:29.650752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-afa09409-28b0-4f6a-9e99-4d0e4fb3f6fe req-457640dc-cef0-4f60-95a3-d4c22a31c3a2 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:29.663257 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-afa09409-28b0-4f6a-9e99-4d0e4fb3f6fe req-457640dc-cef0-4f60-95a3-d4c22a31c3a2 service nova] Creating event network-vif-plugged:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h1-854882-3 Aug 29 16:42:29.669450 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-afa09409-28b0-4f6a-9e99-4d0e4fb3f6fe req-457640dc-cef0-4f60-95a3-d4c22a31c3a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125738 Aug 29 16:42:29.670324 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3803/7434] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:30.261564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:30.262846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:30.269921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:30.270405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:30.270852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:30.271551 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:30.271999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:30.272602 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:30.420521 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:30.428296 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9625e3fa-be20-43c3-bc04-70f55f07c07c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.171770 Aug 29 16:42:30.441593 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3632/7435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:30 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:31.453613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:31.454887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:31.463883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:31.464395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:31.464866 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:31.465613 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:31.466090 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:31.466537 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:31.624641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:31.632925 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6d349a8e-e698-4862-99cc-0ce61820f9e4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.185064 Aug 29 16:42:31.634249 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3804/7436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:31 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:32.655186 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:32.656615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:32.663502 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:32.664217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:32.665597 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:32.666677 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:32.667203 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:32.667700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:32.817131 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:32.827463 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-00d90b52-c8b9-4fea-a9d2-c511b9c03167 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.175924 Aug 29 16:42:32.841455 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3633/7437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:32 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:33.848996 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:33.849588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:33.859033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.859794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.860510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:33.861327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.862009 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.862526 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:34.042232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:34.043874 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-14abd105-da8f-40d3-8151-b8d7569abca5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.198917 Aug 29 16:42:34.044606 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3805/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:33 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:42:35.065675 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:35.066471 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:35.073304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:35.073806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:35.074235 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:35.074913 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:35.075356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:35.075770 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:35.210231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:35.218651 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-467e151e-c1b5-4162-a680-c6462a9562c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1696 microversion: 2.1 time: 0.156949 Aug 29 16:42:35.219221 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3634/7439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:35 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:36.239625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:36.240263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:36.247745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:36.248251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:36.248715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:36.249459 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:36.249940 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:36.250389 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:36.386263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:36.394288 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a55f6ea0-2519-4b14-8fff-c05cbe74d5c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1678 microversion: 2.1 time: 0.158621 Aug 29 16:42:36.394861 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3806/7440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:36 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:37.416346 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:37.417699 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:37.424683 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.425175 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.425657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.426362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.426813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.427241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.532669 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-9958457e-9871-4f3f-9162-0cb67cccbeb9 req-b6055c25-4118-476b-aaa1-e3bdf05d9eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "name": "network-vif-unplugged", "status": "completed", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:37.545774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9958457e-9871-4f3f-9162-0cb67cccbeb9 req-b6055c25-4118-476b-aaa1-e3bdf05d9eee service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.546268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9958457e-9871-4f3f-9162-0cb67cccbeb9 req-b6055c25-4118-476b-aaa1-e3bdf05d9eee service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.546970 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-9958457e-9871-4f3f-9162-0cb67cccbeb9 req-b6055c25-4118-476b-aaa1-e3bdf05d9eee service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.559096 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-9958457e-9871-4f3f-9162-0cb67cccbeb9 req-b6055c25-4118-476b-aaa1-e3bdf05d9eee service nova] Creating event network-vif-unplugged:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h1-854882-3 Aug 29 16:42:37.564130 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-9958457e-9871-4f3f-9162-0cb67cccbeb9 req-b6055c25-4118-476b-aaa1-e3bdf05d9eee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035241 Aug 29 16:42:37.565256 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3807/7441] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:37.579079 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:37.587648 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dde2865a-15a3-4a83-8ae4-3df7c3a2a386 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1681 microversion: 2.1 time: 0.175784 Aug 29 16:42:37.588389 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3635/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:37 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:37.610324 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:37.611302 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:37.618533 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.619056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.619756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.620911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.621458 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.621936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.672505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130002) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 16:42:37.749089 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6af175e0-b607-45b0-a991-979a54e0106f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd/action" status: 202 len: 0 microversion: 2.1 time: 0.143626 Aug 29 16:42:37.753184 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3808/7443] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:42:37 2022] POST /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:42:37.758439 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:37.759054 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:37.765288 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.765748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.766228 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.766926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.767372 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.767789 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.905324 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:37.912991 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bfe53cb6-a3cd-45d1-a1b9-9fd8eeb71891 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1629 microversion: 2.1 time: 0.158670 Aug 29 16:42:37.913721 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3636/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:37 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1629 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:38.935770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:38.936342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:38.942737 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:38.943240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:38.943700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:38.944413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:38.944892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:38.945859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:39.087462 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:39.095445 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3aee3b30-fcc3-46ef-bd72-f4f3f8df192f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.164580 Aug 29 16:42:39.096306 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3809/7445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:38 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:39.784641 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-0effec9c-28ee-422b-a065-23c5eae9e674 req-956918b8-761a-430d-8b39-2d602bad4163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:39.796032 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0effec9c-28ee-422b-a065-23c5eae9e674 req-956918b8-761a-430d-8b39-2d602bad4163 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:39.796673 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0effec9c-28ee-422b-a065-23c5eae9e674 req-956918b8-761a-430d-8b39-2d602bad4163 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:39.797167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-0effec9c-28ee-422b-a065-23c5eae9e674 req-956918b8-761a-430d-8b39-2d602bad4163 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:39.809026 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-0effec9c-28ee-422b-a065-23c5eae9e674 req-956918b8-761a-430d-8b39-2d602bad4163 service nova] Creating event network-changed:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h2-854882-3 Aug 29 16:42:39.814212 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-0effec9c-28ee-422b-a065-23c5eae9e674 req-956918b8-761a-430d-8b39-2d602bad4163 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035269 Aug 29 16:42:39.814904 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3637/7446] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:40.119223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:40.119883 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:40.126766 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:40.127281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:40.127739 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:40.128467 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:40.128945 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:40.129407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:40.262383 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:40.270115 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6f288acb-0c78-48c1-8a2d-b189224b2cbc tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.154777 Aug 29 16:42:40.270692 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3810/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:40 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:41.294522 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:41.295901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:41.303335 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:41.303816 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:41.304251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:41.304944 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:41.305425 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:41.305843 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:41.450882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:41.458849 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-aeff820b-a3ab-4c52-9c05-8cc26a018c97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.169947 Aug 29 16:42:41.459431 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3638/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:41 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:42.480750 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:42.482755 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:42.492607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:42.494024 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:42.494715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:42.495752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:42.496453 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:42.497156 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:42.640309 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:42.648325 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae96cdd3-172a-4c55-a5b7-a9ee8fcaf73e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.171949 Aug 29 16:42:42.649752 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3811/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:42 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:43.669485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:43.670110 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:43.673069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=31 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:43.678368 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:43.678852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:43.679284 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:43.679982 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:43.680436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:43.680862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:43.683728 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:43.828417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:43.836852 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-239ede32-49ce-4cab-9e80-476b4cd31f6d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.171243 Aug 29 16:42:43.851085 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3639/7450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:43 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:44.860899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:44.861672 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:44.866407 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:44.871216 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:44.871868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:44.872327 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:44.873052 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:44.873557 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:44.873998 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:44.878055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:45.035408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:45.045139 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-651df535-e639-45b1-a4e9-ac8470f30936 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.189562 Aug 29 16:42:45.045771 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3812/7451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:44 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:46.071960 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:46.074180 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:46.081378 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:46.081998 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:46.082561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:46.083331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:46.084046 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:46.084511 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:46.230169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:46.240222 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-691df8be-ff20-4455-962a-385c3532e1d1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.175832 Aug 29 16:42:46.241010 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3640/7452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:46 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:47.262922 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:47.263655 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:47.273279 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:47.274144 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:47.274551 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:47.275622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:47.276193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:47.276924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:47.430802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:47.441307 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-aa6e36da-c674-42c3-982b-98bd76fbeaa1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.183267 Aug 29 16:42:47.442492 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3813/7453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:47 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:48.464100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:48.464804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:48.471651 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:48.472132 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:48.472565 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:48.473249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:48.473737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:48.474157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:48.612785 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:48.621690 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-700a3945-6b30-4cfe-9282-c27c6cfa7a5a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.161772 Aug 29 16:42:48.622344 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3641/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:48 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:49.643646 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:49.644339 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:49.651304 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:49.651828 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:49.652280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:49.652986 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:49.653479 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:49.653918 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:49.797885 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:49.805938 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a3254415-e60b-4a38-a767-6475ecf9d22f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.166123 Aug 29 16:42:49.806714 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3814/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:49 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:42:50.830573 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:50.831217 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:50.838075 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:50.838550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:50.838978 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:50.839661 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:50.840109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:50.840525 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:50.981012 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:50.988786 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ed5a560d-d045-412c-818f-426da739e0a1 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.162109 Aug 29 16:42:50.989359 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3642/7456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:50 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:52.011038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:52.011681 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:52.018794 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:52.019300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:52.019757 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:52.020469 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:52.020946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:52.021408 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:52.152409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:52.160392 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a690fe0b-efb0-42c5-8096-252355228092 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.153863 Aug 29 16:42:52.160984 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3815/7457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:52 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:53.181564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:53.182355 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:53.189443 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:53.189935 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:53.190351 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:53.191291 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:53.191723 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:53.192167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:53.322921 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:53.330630 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2b65606f-74c1-4ffb-8ccd-906256c27237 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.153091 Aug 29 16:42:53.331211 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3643/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:53 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:54.314300 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-93e335dd-2930-49dd-8b7b-9debfb8d2149 req-c5c715ba-6332-42c0-865f-4dee75e63701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "name": "network-vif-plugged", "status": "completed", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:54.327098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-93e335dd-2930-49dd-8b7b-9debfb8d2149 req-c5c715ba-6332-42c0-865f-4dee75e63701 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:54.327098 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-93e335dd-2930-49dd-8b7b-9debfb8d2149 req-c5c715ba-6332-42c0-865f-4dee75e63701 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:54.327466 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-93e335dd-2930-49dd-8b7b-9debfb8d2149 req-c5c715ba-6332-42c0-865f-4dee75e63701 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:54.339783 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-93e335dd-2930-49dd-8b7b-9debfb8d2149 req-c5c715ba-6332-42c0-865f-4dee75e63701 service nova] Creating event network-vif-plugged:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h2-854882-3 Aug 29 16:42:54.345044 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-93e335dd-2930-49dd-8b7b-9debfb8d2149 req-c5c715ba-6332-42c0-865f-4dee75e63701 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034783 Aug 29 16:42:54.345857 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3816/7459] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:54.351776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:54.354004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:54.361083 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:54.361953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:54.362795 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:54.363741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:54.364569 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:54.365249 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:54.576306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:54.584061 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3cf718c5-0271-42a3-a968-618e9bee20ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.236509 Aug 29 16:42:54.584650 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3644/7460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:54 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:55.606723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:55.607262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:55.613201 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:55.613738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:55.614190 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:55.614898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:55.615363 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:55.615797 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:55.757298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:55.765285 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ac38bd38-04f2-4d0b-a68e-ddf37334c8c3 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1687 microversion: 2.1 time: 0.164800 Aug 29 16:42:55.765896 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3817/7461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:55 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:56.787494 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:56.788144 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:56.795733 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:56.796153 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:56.796583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:56.797270 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:56.797752 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:56.798174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:56.928545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:56.936814 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5694ea9e-5958-4394-98d5-8c9f8e0a658b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1674 microversion: 2.1 time: 0.153224 Aug 29 16:42:56.937372 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3645/7462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:56 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:07.442900 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=11 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:07.443813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=31 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:07.445371 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:44:07.445601 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd (ip 10.222.0.16) !!! Aug 29 16:44:07.448592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b1098429-872c-46b1-9da8-7078fd62af44 req-1cbff6ec-5828-4dc4-991e-7992a7ff1493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:07.454657 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:07.455695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:07.456344 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=13 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:07.457220 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=41 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:07.458714 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:44:07.459089 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Aug 29 16:44:07.469652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b1098429-872c-46b1-9da8-7078fd62af44 req-1cbff6ec-5828-4dc4-991e-7992a7ff1493 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.469936 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.470253 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b1098429-872c-46b1-9da8-7078fd62af44 req-1cbff6ec-5828-4dc4-991e-7992a7ff1493 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.470421 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.470839 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b1098429-872c-46b1-9da8-7078fd62af44 req-1cbff6ec-5828-4dc4-991e-7992a7ff1493 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.470958 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.471583 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.472069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.472512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.486306 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b1098429-872c-46b1-9da8-7078fd62af44 req-1cbff6ec-5828-4dc4-991e-7992a7ff1493 service nova] Creating event network-changed:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h2-854882-3 Aug 29 16:44:07.491936 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b1098429-872c-46b1-9da8-7078fd62af44 req-1cbff6ec-5828-4dc4-991e-7992a7ff1493 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049089 Aug 29 16:44:07.493674 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3646/7463] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:07.505013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:44:07.599388 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8685128d-e7a8-403f-8de3-e8381c34643d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 204 len: 0 microversion: 2.1 time: 0.158581 Aug 29 16:44:07.603529 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3818/7464] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:44:07 2022] DELETE /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:44:07.610329 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:07.611239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:07.619094 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.619298 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.619657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.620356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.620826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.621245 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.816334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:07.824645 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-36b2035e-48bd-48ca-b628-26ca180bfdbd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.219436 Aug 29 16:44:07.825235 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3647/7465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:07 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:08.846549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:08.847377 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:08.854507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:08.855014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:08.855468 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:08.856182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:08.856654 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:08.857751 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:09.085601 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:09.093409 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c6d76121-2ed6-4e37-a080-2d0a0fdff5f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 200 len: 1680 microversion: 2.1 time: 0.251116 Aug 29 16:44:09.094005 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3819/7466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:08 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:09.492765 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-17fbf183-d2f7-48da-8c4c-7e5b9a5e169e req-ae06d6ef-69cf-4a0c-93cc-72b6b32dcd05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a40280-5cb9-4a10-99b9-0e0059ae33cd", "name": "network-vif-deleted", "tag": "eb17bf83-afee-4be5-933c-ca017c2097fa"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:09.502926 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-17fbf183-d2f7-48da-8c4c-7e5b9a5e169e req-ae06d6ef-69cf-4a0c-93cc-72b6b32dcd05 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:09.503409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-17fbf183-d2f7-48da-8c4c-7e5b9a5e169e req-ae06d6ef-69cf-4a0c-93cc-72b6b32dcd05 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:09.503847 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-17fbf183-d2f7-48da-8c4c-7e5b9a5e169e req-ae06d6ef-69cf-4a0c-93cc-72b6b32dcd05 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:09.517524 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-17fbf183-d2f7-48da-8c4c-7e5b9a5e169e req-ae06d6ef-69cf-4a0c-93cc-72b6b32dcd05 service nova] Creating event network-vif-deleted:eb17bf83-afee-4be5-933c-ca017c2097fa for instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd on n-h2-854882-3 Aug 29 16:44:09.523263 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-17fbf183-d2f7-48da-8c4c-7e5b9a5e169e req-ae06d6ef-69cf-4a0c-93cc-72b6b32dcd05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091254 Aug 29 16:44:09.523871 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3648/7467] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:10.114695 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:10.115394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: d4a40280-5cb9-4a10-99b9-0e0059ae33cd] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:10.123588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:10.124124 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:10.124575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:10.125286 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:10.125813 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:10.126282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:10.142512 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] HTTP exception thrown: Instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd could not be found. Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Request method failure captured: Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd HTTP/1.1 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOve54RwPTK_GX-W1MTNZkYVjd-OV02q8sWrn51amJq_6fPV4GBdisokoECsOeJsH9O_pF2vokWpNPaBkLKvAq6BV3aI51SlANcC7-HUVBCPSVNlRzsCBIXPX0XyYRghCVwdS20YMNfw_T5_ZN8ERPFzwghnx9iLXajeXL4S05owXvY Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: cddf5a6066704ec5a96d141bf8b96120 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestShelveInstance-1749895896 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cddf5a6066704ec5a96d141bf8b96120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cddf5a6066704ec5a96d141bf8b96120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cddf5a6066704ec5a96d141bf8b96120", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cddf5a6066704ec5a96d141bf8b96120"}]}] Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestShelveInstance-1749895896 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: cddf5a6066704ec5a96d141bf8b96120 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestShelveInstance-1749895896 Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestShelveInstance-1749895896-project Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 6f5dd2f1393b413fb8aa410a47d5357f Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestShelveInstance-1749895896-project Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd could not be found. Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'd4a40280-5cb9-4a10-99b9-0e0059ae33cd'} Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd could not be found. Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd could not be found. Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:44:10.144179 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd could not be found. Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Returning 404 to user: Instance d4a40280-5cb9-4a10-99b9-0e0059ae33cd could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-876b5705-3c52-4d8c-9e9a-fe5c7747296c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd" status: 404 len: 111 microversion: 2.1 time: 0.034900 Aug 29 16:44:10.149299 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3820/7468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:10 2022] GET /compute/v2.1/servers/d4a40280-5cb9-4a10-99b9-0e0059ae33cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:44:10.306805 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4b2e2cc1-af0f-48bb-9dab-f644838eb1be tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '.version_select at 0x7fb0e264dc10>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:10.331568 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4b2e2cc1-af0f-48bb-9dab-f644838eb1be tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1914335474" status: 202 len: 0 microversion: 2.1 time: 0.028967 Aug 29 16:44:10.332314 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3649/7469] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 16:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1914335474 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:44:10.351524 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0dc25d31-a417-4004-b801-4cecd508a0fd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'create', calling method: .version_select at 0x7fb0eb5d2820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1623047680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHORVd890+l7WoY1PbwX35GuVNgu3qUR4l2lxBvrmWjh47d5EYzbSiyt37LV6bpxIGar5AmiwsUV8HoTHKiWFfBdAdL22fet9erQ3pWhb4v8PG26XZcPZ7dCsGrxlKJpA=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:10.367770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0dc25d31-a417-4004-b801-4cecd508a0fd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for project cddf5a6066704ec5a96d141bf8b96120. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:44:10.372911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-0dc25d31-a417-4004-b801-4cecd508a0fd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for user 6f5dd2f1393b413fb8aa410a47d5357f and project cddf5a6066704ec5a96d141bf8b96120. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:44:10.398875 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0dc25d31-a417-4004-b801-4cecd508a0fd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051203 Aug 29 16:44:10.399483 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3821/7470] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:44:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:26.546497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:26.547233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:26.551167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1882965756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1623047680", "security_groups": [{"name": "tempest-secgroup-smoke-991700078"}], "networks": [{"uuid": "53741910-6dd7-45c5-8862-7d4a9d9dac6d"}], "block_device_mapping_v2": [{"uuid": "f847cff2-2788-48b8-a8cc-65090e93a291", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:26.670914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] validate_networks() for [('53741910-6dd7-45c5-8862-7d4a9d9dac6d', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:44:27.129069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:44:27.129534 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:44:27.130122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:44:27.130541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:44:27.130957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:44:27.139924 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:27.140583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:27.141187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:27.142294 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:27.142986 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:27.143576 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:27.164578 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for project cddf5a6066704ec5a96d141bf8b96120. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:44:27.171108 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Getting quotas for user 6f5dd2f1393b413fb8aa410a47d5357f and project cddf5a6066704ec5a96d141bf8b96120. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:44:27.230410 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:44:27.232682 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f847cff2-2788-48b8-a8cc-65090e93a291',volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:44:27.361907 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-195d0254-97f3-4fff-a633-86cc363d9d9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816999 Aug 29 16:44:27.362494 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3650/7471] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:44:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:44:27.371425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:27.372207 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=4 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:27.373592 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:27.378356 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2fd4f760-bbf3-4af0-81b6-0b43b9368dca tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:27.378999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2fd4f760-bbf3-4af0-81b6-0b43b9368dca tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:27.442273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2fd4f760-bbf3-4af0-81b6-0b43b9368dca tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:27.450707 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2fd4f760-bbf3-4af0-81b6-0b43b9368dca tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1089 microversion: 2.1 time: 0.081210 Aug 29 16:44:27.451293 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3822/7472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:27 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1089 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:28.472823 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:28.473552 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:28.481535 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:28.482018 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:28.482640 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:28.483538 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:28.483940 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:28.484357 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:28.578231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:28.586601 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eb9102a9-ca38-4c63-9353-b52f217c6c1e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1205 microversion: 2.1 time: 0.118456 Aug 29 16:44:28.587353 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3651/7473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:28 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1205 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:29.612702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:29.614825 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:29.628348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:29.628949 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:29.629549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:29.630503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:29.631055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:29.631576 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:29.719872 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-ee1e5833-df02-41bc-a36c-374cf9163d74 req-b7cbfb4c-8902-4f82-b751-c16f482b7c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824fb458-1cf8-4b7b-900f-e5d1dd583f04", "tag": "d969cc56-65b6-40b2-a287-333ba1d17832"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:29.747670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ee1e5833-df02-41bc-a36c-374cf9163d74 req-b7cbfb4c-8902-4f82-b751-c16f482b7c3b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:29.748167 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ee1e5833-df02-41bc-a36c-374cf9163d74 req-b7cbfb4c-8902-4f82-b751-c16f482b7c3b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:29.748594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-ee1e5833-df02-41bc-a36c-374cf9163d74 req-b7cbfb4c-8902-4f82-b751-c16f482b7c3b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:29.762494 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-ee1e5833-df02-41bc-a36c-374cf9163d74 req-b7cbfb4c-8902-4f82-b751-c16f482b7c3b service nova] Creating event network-changed:d969cc56-65b6-40b2-a287-333ba1d17832 for instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 on n-h1-854882-3 Aug 29 16:44:29.768356 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-ee1e5833-df02-41bc-a36c-374cf9163d74 req-b7cbfb4c-8902-4f82-b751-c16f482b7c3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052135 Aug 29 16:44:29.769145 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3652/7474] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:44:29.798920 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:29.809691 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1fcdb002-414b-467b-b5ef-f17557620b40 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1272 microversion: 2.1 time: 0.202950 Aug 29 16:44:29.818960 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3823/7475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:29 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:30.832325 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:30.833028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:30.840017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:30.840497 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:30.840933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:30.841659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:30.842109 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:30.842533 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:30.984158 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:30.991869 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-86e4d192-06dd-4ff2-bfe4-260f0dcee006 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1272 microversion: 2.1 time: 0.164607 Aug 29 16:44:30.992442 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3653/7476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:30 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:32.012599 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:32.013244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:32.020237 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:32.020748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:32.021210 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:32.021963 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:32.022441 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:32.022894 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:32.161002 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:32.169449 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f489d9a2-4e9a-4b77-aa80-1244e55544e9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1272 microversion: 2.1 time: 0.160859 Aug 29 16:44:32.170033 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3824/7477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:32 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:33.190910 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:33.191545 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:33.199105 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:33.199592 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:33.200037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:33.200740 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:33.201198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:33.201670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:33.345171 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:33.353990 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-39c7846e-314d-4d5c-81b1-38b0e60861f5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1272 microversion: 2.1 time: 0.167596 Aug 29 16:44:33.355129 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3654/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:33 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:34.375044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:34.375680 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:34.382545 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:34.383055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:34.383510 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:34.384226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:34.384697 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:34.385140 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:34.514876 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:34.522659 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-824b6adb-c1c0-43db-801e-0939a5fd96ec tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.151531 Aug 29 16:44:34.523243 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3825/7479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:34 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:35.545405 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:35.546039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:35.552818 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:35.553302 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:35.553775 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:35.554464 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:35.554923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:35.555350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:35.687553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:35.695504 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-ce295654-fa5f-4e61-b0eb-ff330c08a0e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.154646 Aug 29 16:44:35.696082 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3655/7480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:35 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:36.716071 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:36.716715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:36.723587 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:36.724091 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:36.724548 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:36.725262 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:36.725793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:36.726269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:36.860473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:36.868247 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-3cd1bcfa-c729-45b1-9d73-a79eed8674a2 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.156132 Aug 29 16:44:36.869312 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3826/7481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:36 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:37.891331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:37.891949 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:37.894742 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:37.895401 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:37.902562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:37.903044 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:37.903476 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:37.904251 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:37.904883 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:37.905540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:38.035665 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:38.043300 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-2a25f66a-e861-4ba0-816e-a2181870720a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.155879 Aug 29 16:44:38.043878 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3656/7482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:37 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:39.063764 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:39.064395 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:39.066464 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:39.073089 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:39.073622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:39.074081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:39.075102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:39.075575 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:39.076019 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:39.211281 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:39.220106 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0dcd9bb3-7236-4c50-99f1-8a767e592fe9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.160275 Aug 29 16:44:39.220765 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3827/7483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:39 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:40.240076 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:40.240722 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:40.248028 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:40.248509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:40.248933 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:40.249635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:40.250111 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:40.250527 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:40.385101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:40.392684 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-eff4fc70-4e6a-42e1-b053-bb9417ce857a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.156520 Aug 29 16:44:40.393268 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3657/7484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:40 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:44:41.413045 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:41.413641 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:41.420635 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:41.421142 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:41.421638 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:41.422390 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:41.422867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:41.423317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:41.558861 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:41.566626 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b7e05485-c3d7-45f6-a4de-839594f8158d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.157694 Aug 29 16:44:41.567477 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3828/7485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:41 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:42.588399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:42.589009 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:42.596004 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:42.596477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:42.596904 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:42.597615 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:42.598062 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:42.598479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:42.731082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:42.738796 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-008c7190-96fb-4822-93a3-27009dc19393 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.154907 Aug 29 16:44:42.739373 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3658/7486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:42 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:43.759477 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:43.760115 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:43.767013 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:43.767516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:43.767972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:43.768687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:43.769163 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:43.769634 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:43.901734 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:43.909463 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e43460a1-a23d-4a4c-822e-3102fec3cab6 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.154127 Aug 29 16:44:43.910035 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3829/7487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:43 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:44.137201 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bba0a490-0f12-4453-a652-0baf4f843446 req-597fc412-bc37-4f63-8a31-e1fabef11ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824fb458-1cf8-4b7b-900f-e5d1dd583f04", "name": "network-vif-plugged", "status": "completed", "tag": "d969cc56-65b6-40b2-a287-333ba1d17832"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:44.149642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bba0a490-0f12-4453-a652-0baf4f843446 req-597fc412-bc37-4f63-8a31-e1fabef11ab7 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:44.150621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bba0a490-0f12-4453-a652-0baf4f843446 req-597fc412-bc37-4f63-8a31-e1fabef11ab7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:44.151052 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bba0a490-0f12-4453-a652-0baf4f843446 req-597fc412-bc37-4f63-8a31-e1fabef11ab7 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:44.162130 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bba0a490-0f12-4453-a652-0baf4f843446 req-597fc412-bc37-4f63-8a31-e1fabef11ab7 service nova] Creating event network-vif-plugged:d969cc56-65b6-40b2-a287-333ba1d17832 for instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 on n-h1-854882-3 Aug 29 16:44:44.167893 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bba0a490-0f12-4453-a652-0baf4f843446 req-597fc412-bc37-4f63-8a31-e1fabef11ab7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034442 Aug 29 16:44:44.168495 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3659/7488] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:44.930675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:44.931867 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:44.938726 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:44.939233 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:44.939720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:44.940439 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:44.940916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:44.941372 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:45.075343 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:45.083111 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-83b81977-0ac1-4a17-9895-b86e1acd0c9f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1260 microversion: 2.1 time: 0.156487 Aug 29 16:44:45.083690 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3830/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:44 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:46.105172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:46.105907 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:46.113161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:46.113667 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:46.114103 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:46.114826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:46.115307 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:46.115730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:46.249290 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:46.257368 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b533f667-3f9d-4ee9-b083-a97f0943f36d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1443 microversion: 2.1 time: 0.157300 Aug 29 16:44:46.257966 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3660/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:46 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:46.278543 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:46.279176 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:46.285082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:46.285620 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:46.286069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:46.286771 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:46.287238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:46.287673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:46.420349 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:46.428107 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-0171af08-a733-4a7f-ab56-bf0193a5dd3f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1443 microversion: 2.1 time: 0.154327 Aug 29 16:44:46.428684 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3831/7491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:46 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:48.010350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f0990ee7-1922-44f9-b2ed-e40226a7c22f req-655e9905-e19e-49c3-8adf-8faec6fe5b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824fb458-1cf8-4b7b-900f-e5d1dd583f04", "tag": "d969cc56-65b6-40b2-a287-333ba1d17832"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:48.022008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0990ee7-1922-44f9-b2ed-e40226a7c22f req-655e9905-e19e-49c3-8adf-8faec6fe5b1f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:48.022489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0990ee7-1922-44f9-b2ed-e40226a7c22f req-655e9905-e19e-49c3-8adf-8faec6fe5b1f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:48.022922 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f0990ee7-1922-44f9-b2ed-e40226a7c22f req-655e9905-e19e-49c3-8adf-8faec6fe5b1f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:48.035491 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f0990ee7-1922-44f9-b2ed-e40226a7c22f req-655e9905-e19e-49c3-8adf-8faec6fe5b1f service nova] Creating event network-changed:d969cc56-65b6-40b2-a287-333ba1d17832 for instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 on n-h1-854882-3 Aug 29 16:44:48.041475 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f0990ee7-1922-44f9-b2ed-e40226a7c22f req-655e9905-e19e-49c3-8adf-8faec6fe5b1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034995 Aug 29 16:44:48.042133 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3661/7492] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:44.311094 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78354ac3-24e6-466d-81c7-ffd55616e73b] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:46:44.311999 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:46:44.312879 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=22 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:44.313663 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=54 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:44.315235 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:46:44.315417 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04/action (ip 10.222.0.16) !!! Aug 29 16:46:44.316753 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:46:44.316900 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04/action (ip 10.222.0.16) !!! Aug 29 16:46:44.408943 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:44.409535 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:44.416043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:44.416542 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:44.416992 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:44.417722 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:44.418193 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:44.418632 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:44.442011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lazy-loading 'flavor' on Instance uuid 824fb458-1cf8-4b7b-900f-e5d1dd583f04 {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:46:44.517327 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c6ac1c03-4275-4949-b2c9-98246f4c8401 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04/action" status: 202 len: 0 microversion: 2.1 time: 0.207768 Aug 29 16:46:44.518000 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3832/7493] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:46:44 2022] POST /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:46:44.524360 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0bb01b98-2510-4e0f-9230-793c412c4f90] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:46:44.525199 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3981f865-5e34-4b0d-9913-f841ce8d5678] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:46:44.525819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:44.526690 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=56 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:44.533168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:44.534178 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:44.543519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:44.544002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:44.544457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:44.545156 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:44.545629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:44.546047 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:44.683696 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:44.691362 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-acbcf589-f9aa-4879-915f-50e33975115b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.168846 Aug 29 16:46:44.691923 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3662/7494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:44 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:45.713864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:45.714622 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:45.723247 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:45.723754 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:45.724212 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:45.724924 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:45.725603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:45.726055 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:45.731117 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] [78354ac3-24e6-466d-81c7-ffd55616e73b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55890. Aug 29 16:46:45.731925 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55892. Aug 29 16:46:46.212232 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:46.220024 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-de0d01b6-aecd-4d1b-9afb-27e3dad5368c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.511644 Aug 29 16:46:46.220603 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3833/7495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:45 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:47.240985 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:47.241718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:47.251069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:47.251575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:47.252040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:47.252741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:47.253197 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:47.253664 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:47.260335 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] [3981f865-5e34-4b0d-9913-f841ce8d5678] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55902. Aug 29 16:46:47.272612 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] [0bb01b98-2510-4e0f-9230-793c412c4f90] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55900. Aug 29 16:46:47.388849 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:47.396696 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a344aae-fe9f-4e06-9dfc-039a934f557d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.159643 Aug 29 16:46:47.397793 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3663/7496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:47 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:48.418716 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:48.419359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:48.426298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:48.426805 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:48.427263 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:48.428039 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:48.429138 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:48.429616 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:48.562594 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:48.570587 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4fb7b23b-8d6d-4bb5-ae43-098d76f91b69 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.155848 Aug 29 16:46:48.571203 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3834/7497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:48 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:49.591529 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:49.592206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:49.599039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:49.599581 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:49.600037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:49.600737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:49.601196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:49.601657 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:49.741625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:49.750067 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-a363c959-f297-4b59-aef4-b83d5edc14e7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.162535 Aug 29 16:46:49.750663 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3664/7498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:49 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:50.771266 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:50.772075 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:50.779513 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:50.780023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:50.780482 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:50.781198 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:50.781707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:50.782157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:50.915099 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:50.922877 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-788d0ca7-7999-4333-81f6-c0f90ca97b1f tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.155583 Aug 29 16:46:50.923455 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3835/7499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:50 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:51.944297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:51.944879 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:51.952244 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:51.952717 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:51.953147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:51.953862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:51.954306 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:51.954725 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:52.084485 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:52.093014 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-9ef4a565-af81-4ef4-bac6-bfc32a5922f7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.153011 Aug 29 16:46:52.093888 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3665/7500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:51 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:53.114465 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:53.115183 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:53.122010 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:53.122509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:53.122967 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:53.123685 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:53.124164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:53.124610 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:53.254409 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:53.262177 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-2763daab-e01e-4a4f-a344-1934aab4e42a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.151748 Aug 29 16:46:53.262754 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3836/7501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:53 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:54.283995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:54.284663 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:54.292128 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:54.292612 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:54.293053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:54.293777 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:54.294242 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:54.294670 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:54.429610 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:54.438038 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-18689905-0db1-4c5a-9aa1-cd4f265a6e10 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.158016 Aug 29 16:46:54.438606 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3666/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:54 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:55.458875 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:55.459420 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:55.466397 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:55.466899 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:55.467352 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:55.468062 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:55.468531 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:55.468972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:55.601977 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:55.610288 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-394d9cad-b7d3-4357-8155-a847d3683e97 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.155495 Aug 29 16:46:55.610868 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3837/7503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:55 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:56.631724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:56.632337 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:56.639827 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:56.640333 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:56.640748 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.641460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:56.641917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:56.642330 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.780334 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:56.788374 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-b5f141e2-a5f1-48bb-8c0f-0e445a978652 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.160541 Aug 29 16:46:56.789169 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3667/7504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:56 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:57.811705 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:57.812776 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:57.823701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:57.824217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:57.824675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:57.825424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:57.825904 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:57.826351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:57.959956 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:57.971416 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-be8cab54-fbc9-477a-8818-39da7bba3285 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.164801 Aug 29 16:46:57.972139 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3838/7505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:57 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:58.992289 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:58.992825 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:59.000609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.001101 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.001562 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.002260 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.002707 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.003125 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.134951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:59.142793 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5bdb461d-3390-45ad-bea2-b36d7fa3b8b5 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1509 microversion: 2.1 time: 0.154530 Aug 29 16:46:59.143374 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3668/7506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:58 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:59.163118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:59.163738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:59.170578 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.171079 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.171529 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.172238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.172738 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.173179 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.202204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130002) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 16:46:59.267392 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-f6246d26-53bc-4832-b1b3-07836f637fe8 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "POST /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04/action" status: 202 len: 0 microversion: 2.1 time: 0.108214 Aug 29 16:46:59.268046 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3839/7507] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:46:59 2022] POST /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:46:59.276275 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:59.276930 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:59.282819 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.283297 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.283730 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.284419 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.284871 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.285292 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.461219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:59.469084 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-5f837293-cb7f-4d43-9c27-a6667cffba21 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1517 microversion: 2.1 time: 0.196813 Aug 29 16:46:59.469691 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3669/7508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:59 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:00.491357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:00.492027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:00.498729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:00.499240 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:00.499702 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:00.500662 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:00.503560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:00.503560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:00.655328 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:00.663632 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e25179e9-7253-4223-92f3-113783b94c89 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1519 microversion: 2.1 time: 0.177071 Aug 29 16:47:00.664220 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3840/7509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:00 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:00.727912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-c199be38-c040-4e5d-810d-f5fa704df8ba req-a3794d73-53bb-425e-b9c1-8421665a520e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824fb458-1cf8-4b7b-900f-e5d1dd583f04", "name": "network-vif-unplugged", "status": "completed", "tag": "d969cc56-65b6-40b2-a287-333ba1d17832"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:47:00.740611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c199be38-c040-4e5d-810d-f5fa704df8ba req-a3794d73-53bb-425e-b9c1-8421665a520e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:00.741599 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c199be38-c040-4e5d-810d-f5fa704df8ba req-a3794d73-53bb-425e-b9c1-8421665a520e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:00.742247 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-c199be38-c040-4e5d-810d-f5fa704df8ba req-a3794d73-53bb-425e-b9c1-8421665a520e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:00.755150 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.compute.server_external_events [req-c199be38-c040-4e5d-810d-f5fa704df8ba req-a3794d73-53bb-425e-b9c1-8421665a520e service nova] Unable to find a host for instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04. Dropping event network-vif-unplugged {{(pid=130001) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 16:47:00.756308 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-c199be38-c040-4e5d-810d-f5fa704df8ba req-a3794d73-53bb-425e-b9c1-8421665a520e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032282 Aug 29 16:47:00.757377 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3670/7510] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 16:47:01.684406 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:01.685046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:01.692046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:01.692554 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:01.693008 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:01.694001 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:01.694476 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:01.694921 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:01.827547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:01.835276 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-6245acab-bd61-4b34-9ff1-076a0eccf3cd tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1519 microversion: 2.1 time: 0.154934 Aug 29 16:47:01.835905 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3841/7511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:01 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:02.859642 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:02.860187 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:02.867524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:02.868017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:02.868456 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:02.869168 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:02.869656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:02.870084 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:03.013141 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:03.021075 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1a90190f-92eb-462c-ab73-0262e7ce9852 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1519 microversion: 2.1 time: 0.165545 Aug 29 16:47:03.021710 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3671/7512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:02 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:04.043027 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:04.043675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:04.050749 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:04.051260 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:04.051724 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:04.052484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:04.052957 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:04.053435 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:04.188225 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:04.197288 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-05a95e2b-ef55-403a-b849-63abe5751118 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1519 microversion: 2.1 time: 0.158731 Aug 29 16:47:04.198117 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3842/7513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:04 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:05.218749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:05.219509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:05.226987 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:05.227480 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:05.228269 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:05.229006 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:05.229714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:05.230147 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:05.443313 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:05.451363 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-141aef31-2808-4c21-8271-fe6fb0a21d82 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.236664 Aug 29 16:47:05.451950 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3672/7514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:05 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:06.472650 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:06.473292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:06.481993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:06.482505 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:06.482966 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:06.483687 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:06.484168 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:06.484624 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:06.626807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:06.635218 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e274647f-150d-4e90-a4ef-22b100a34f8e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.165851 Aug 29 16:47:06.635791 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3843/7515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:06 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:07.656121 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:07.656741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:07.663750 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:07.664233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:07.664671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:07.665362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:07.666342 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:07.666767 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:07.800039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:07.808436 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-975a6c7b-820f-4d38-a34d-1aa3a641979a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.156260 Aug 29 16:47:07.809019 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3673/7516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:07 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:08.829814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:08.830425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:08.838269 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:08.838777 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:08.839238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:08.839960 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:08.840440 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:08.840887 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:08.979559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:08.988706 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-85cbd639-44c5-487b-8814-ed4bcd6c3904 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.162966 Aug 29 16:47:08.989288 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3844/7517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:08 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:10.010423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:10.011039 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:10.017993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:10.018479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:10.018923 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:10.019603 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:10.020059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:10.020486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:10.148917 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:10.156610 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-1285c985-4c5c-4f7d-8806-65ff8e659ef4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.150125 Aug 29 16:47:10.157185 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3674/7518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:10 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:11.178229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:11.178873 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:11.186351 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:11.186855 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:11.187311 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:11.188023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:11.188527 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:11.188975 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:11.207507 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:11.329095 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:11.340720 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-c0636e58-e534-4222-8b8d-4bd1769296c7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.166214 Aug 29 16:47:11.341456 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3845/7519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:11 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:12.363898 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:12.364509 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:12.371882 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:12.372356 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:12.372781 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:12.373482 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:12.373932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:12.374347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:12.506553 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:12.514421 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-3e779061-bb06-43e9-9f63-0eba4502c95e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.154431 Aug 29 16:47:12.514999 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3675/7520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:12 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:13.536271 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:13.537083 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:13.544355 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:13.544869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:13.545333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:13.546084 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:13.546561 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:13.547607 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:13.682525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:13.690380 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b25dc33d-9726-4e74-b402-0c9d6857fd5c tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.158123 Aug 29 16:47:13.690967 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3846/7521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:13 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:14.712189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:14.713929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:14.716656 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=29 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:14.721964 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:14.722442 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:14.722873 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:14.723570 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:14.724099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:14.724516 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:14.729575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=81 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:14.858267 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:14.866062 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-4db92977-bfda-4b64-aa2d-0951ca1b608e tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.157826 Aug 29 16:47:14.866638 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3676/7522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:14 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:15.887520 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:15.888132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:15.890348 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:15.895819 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:15.896326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:15.896783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:15.897536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:15.898017 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:15.898725 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:16.032830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:16.041306 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-95495f7d-9d39-416c-aa62-2c16335f5226 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.157297 Aug 29 16:47:16.041924 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3847/7523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:15 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:16.821487 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824fb458-1cf8-4b7b-900f-e5d1dd583f04", "name": "network-vif-plugged", "status": "completed", "tag": "d969cc56-65b6-40b2-a287-333ba1d17832"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:47:16.833116 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:16.833634 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:16.834070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:16.848933 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] Creating event network-vif-plugged:d969cc56-65b6-40b2-a287-333ba1d17832 for instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 on n-h1-854882-3 Aug 29 16:47:16.852435 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] [b830d758-abc7-4298-a5e4-876a779ec9f5] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:47:17.063102 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:17.063665 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:17.070989 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:17.071489 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:17.071946 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:17.073298 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:17.073868 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:17.074315 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:17.205016 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:17.213478 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8bcfecce-51cc-42e7-a423-bedbb8942ba9 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.153889 Aug 29 16:47:17.214062 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3848/7524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:17 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:47:17.859751 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] [b830d758-abc7-4298-a5e4-876a779ec9f5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55974. Aug 29 16:47:17.863668 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-2784fe73-2b41-4d56-8e04-310738887288 req-b1bd8d61-c1b8-415d-9deb-85f9769c9cf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.046507 Aug 29 16:47:17.864314 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3677/7525] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:47:18.235217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:18.235783 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:18.242625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:18.243128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:18.243584 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:18.244931 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:18.245425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:18.245884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:18.375413 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:18.383120 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-19ff61cf-5f2f-480c-b0bb-50ccd7231b47 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1575 microversion: 2.1 time: 0.151978 Aug 29 16:47:18.383687 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3849/7526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:18 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:19.406436 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:19.407135 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:19.414386 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:19.414813 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:19.415246 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:19.416561 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:19.417011 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:19.417462 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:19.553422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:19.561173 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e8e6bc14-e6b9-4aef-976b-faffa2a05c8a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1562 microversion: 2.1 time: 0.159844 Aug 29 16:47:19.561779 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3678/7527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:19 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:35.966424 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=5 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:35.967200 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=13 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:35.971323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:35.971864 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:35.975141 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:48:35.975320 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Aug 29 16:48:35.976364 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:48:35.976702 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Aug 29 16:48:35.980525 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=5 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:35.981711 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=26 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:35.983416 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:48:35.983564 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 (ip 10.222.0.16) !!! Aug 29 16:48:35.995043 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:35.995745 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:35.996660 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:35.998023 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:35.998772 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:35.999471 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:36.039403 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:48:36.062705 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-f3371c4f-d633-4143-8f6c-03ec7b300dd0 req-c550aef5-32af-487b-a66d-1ab9f9a3c02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824fb458-1cf8-4b7b-900f-e5d1dd583f04", "tag": "d969cc56-65b6-40b2-a287-333ba1d17832"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:48:36.072938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f3371c4f-d633-4143-8f6c-03ec7b300dd0 req-c550aef5-32af-487b-a66d-1ab9f9a3c02b service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:36.073510 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f3371c4f-d633-4143-8f6c-03ec7b300dd0 req-c550aef5-32af-487b-a66d-1ab9f9a3c02b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:36.073938 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-f3371c4f-d633-4143-8f6c-03ec7b300dd0 req-c550aef5-32af-487b-a66d-1ab9f9a3c02b service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:36.088476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-f3371c4f-d633-4143-8f6c-03ec7b300dd0 req-c550aef5-32af-487b-a66d-1ab9f9a3c02b service nova] Creating event network-changed:d969cc56-65b6-40b2-a287-333ba1d17832 for instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 on n-h1-854882-3 Aug 29 16:48:36.094461 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-f3371c4f-d633-4143-8f6c-03ec7b300dd0 req-c550aef5-32af-487b-a66d-1ab9f9a3c02b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129831 Aug 29 16:48:36.095603 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3679/7528] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:48:36.137525 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-674d125e-b48d-4749-b8b1-8876f27a95b7 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "DELETE /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 204 len: 0 microversion: 2.1 time: 0.175192 Aug 29 16:48:36.138279 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3850/7529] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:48:35 2022] DELETE /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:48:36.150100 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:36.150801 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:36.157700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:36.158184 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:36.158611 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:36.159304 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:36.159741 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:36.160161 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:36.298821 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:36.306950 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-431053aa-a7d5-4628-92e6-9edf3a60dbf4 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.163318 Aug 29 16:48:36.307542 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3680/7530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:36 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:37.334344 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:37.335081 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:37.342299 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:37.342810 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:37.343273 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:37.344011 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:37.344475 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:37.344926 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:37.485930 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:37.494301 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a1620c00-78c6-44c1-a0b6-51240b02c2bf tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1568 microversion: 2.1 time: 0.164889 Aug 29 16:48:37.494889 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3851/7531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:37 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:38.110263 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-7b228afd-6fae-45fb-8c30-a4a68bc37f8e req-d583a302-5f40-4da9-b8a4-e222c709fd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824fb458-1cf8-4b7b-900f-e5d1dd583f04", "name": "network-vif-deleted", "tag": "d969cc56-65b6-40b2-a287-333ba1d17832"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:48:38.121112 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7b228afd-6fae-45fb-8c30-a4a68bc37f8e req-d583a302-5f40-4da9-b8a4-e222c709fd4f service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:38.121625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7b228afd-6fae-45fb-8c30-a4a68bc37f8e req-d583a302-5f40-4da9-b8a4-e222c709fd4f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:38.122053 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-7b228afd-6fae-45fb-8c30-a4a68bc37f8e req-d583a302-5f40-4da9-b8a4-e222c709fd4f service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:38.134323 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-7b228afd-6fae-45fb-8c30-a4a68bc37f8e req-d583a302-5f40-4da9-b8a4-e222c709fd4f service nova] Creating event network-vif-deleted:d969cc56-65b6-40b2-a287-333ba1d17832 for instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 on n-h1-854882-3 Aug 29 16:48:38.139222 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-7b228afd-6fae-45fb-8c30-a4a68bc37f8e req-d583a302-5f40-4da9-b8a4-e222c709fd4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032636 Aug 29 16:48:38.139831 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3681/7532] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:48:38.515889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:38.516536 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:38.523889 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:38.524401 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:38.524862 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:38.525625 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:38.526110 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:38.526560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:38.599706 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:38.607568 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-13ebfe06-0bdf-42ef-a4f6-cb8617b9f69d tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1220 microversion: 2.1 time: 0.095801 Aug 29 16:48:38.608186 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3852/7533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:38 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:39.631133 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:39.631959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:39.638353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.638905 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.639412 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.640194 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.640724 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.641218 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.710945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:39.719123 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6a1d4ca5-4142-4887-a250-6580d93abc2a tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1220 microversion: 2.1 time: 0.093640 Aug 29 16:48:39.719786 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3682/7534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:39 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:40.741164 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:40.741860 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:40.749523 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:40.750073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:40.750559 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:40.751290 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:40.751865 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:40.752280 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:40.817424 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:40.825491 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-52f3e071-222e-4b5e-a2ce-f93c70a8c298 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1220 microversion: 2.1 time: 0.088805 Aug 29 16:48:40.826070 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3853/7535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:40 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:41.846588 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:41.847129 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:41.854172 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:41.854652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:41.855082 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:41.855826 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:41.856233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:41.856649 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:41.918196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5dd2f1393b413fb8aa410a47d5357f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cddf5a6066704ec5a96d141bf8b96120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:41.926527 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-67805f10-e6a2-4062-910f-fe7788547e1b tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 200 len: 1220 microversion: 2.1 time: 0.083426 Aug 29 16:48:41.927103 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3683/7536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:41 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:42.947857 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:42.948499 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] [instance: 824fb458-1cf8-4b7b-900f-e5d1dd583f04] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:42.955884 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:42.956399 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:42.956914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:42.958251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:42.958735 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:42.959182 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:42.973850 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] HTTP exception thrown: Instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 could not be found. Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Request method failure captured: Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 HTTP/1.1 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDOve54RwPTK_GX-W1MTNZkYVjd-OV02q8sWrn51amJq_6fPV4GBdisokoECsOeJsH9O_pF2vokWpNPaBkLKvAq6BV3aI51SlANcC7-HUVBCPSVNlRzsCBIXPX0XyYRghCVwdS20YMNfw_T5_ZN8ERPFzwghnx9iLXajeXL4S05owXvY Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: cddf5a6066704ec5a96d141bf8b96120 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestShelveInstance-1749895896 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cddf5a6066704ec5a96d141bf8b96120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cddf5a6066704ec5a96d141bf8b96120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cddf5a6066704ec5a96d141bf8b96120", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cddf5a6066704ec5a96d141bf8b96120"}]}] Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestShelveInstance-1749895896 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: cddf5a6066704ec5a96d141bf8b96120 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestShelveInstance-1749895896 Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestShelveInstance-1749895896-project Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: 6f5dd2f1393b413fb8aa410a47d5357f Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestShelveInstance-1749895896-project Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 could not be found. Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': '824fb458-1cf8-4b7b-900f-e5d1dd583f04'} Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 could not be found. Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 could not be found. Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:48:42.975568 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 could not be found. Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Returning 404 to user: Instance 824fb458-1cf8-4b7b-900f-e5d1dd583f04 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:48:42.980763 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1fc05e10-9f42-4dbb-a757-a160ea24bbf0 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04" status: 404 len: 111 microversion: 2.1 time: 0.033469 Aug 29 16:48:42.982981 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3854/7537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:42 2022] GET /compute/v2.1/servers/824fb458-1cf8-4b7b-900f-e5d1dd583f04 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:48:43.143732 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-c58e46e4-c7e2-4127-969c-9565ecdd3433 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] Calling method '.version_select at 0x7fb0e204d430>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:43.186422 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-c58e46e4-c7e2-4127-969c-9565ecdd3433 tempest-TestShelveInstance-1749895896 tempest-TestShelveInstance-1749895896-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1623047680" status: 202 len: 0 microversion: 2.1 time: 0.046547 Aug 29 16:48:43.187248 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3684/7538] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 16:48:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1623047680 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:49:01.120184 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:01.121074 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:01.352816 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-22d43855-d911-41f0-b1e2-c19754edbdab tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Action: 'create', calling method: .version_select at 0x7fb0e2d22c10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-809593415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt0iLOiLfC4pNIj6GQAvWrj538xXIjX30fwwd2yWsnGJXev/qYdd7/XpyxAp9pqU7pTYi7HgJ1TgSYMvTdZkPMYMbm3vWnJZMHiAv9PPKHTMvcqUzYjfPw+RONwEpjbnw=="}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:01.370621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-22d43855-d911-41f0-b1e2-c19754edbdab tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Getting quotas for project 14ace7a0d69d4fb49e1bd3e28bb6e74c. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:49:01.376366 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.quota [None req-22d43855-d911-41f0-b1e2-c19754edbdab tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Getting quotas for user c7751719651849e5bd2918cfbf24b46a and project 14ace7a0d69d4fb49e1bd3e28bb6e74c. Resources: {'key_pairs'} {{(pid=130002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:49:01.405076 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-22d43855-d911-41f0-b1e2-c19754edbdab tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.292955 Aug 29 16:49:01.405736 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3855/7539] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Aug 29 16:49:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:49:02.428524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-447454554", "imageRef": "69b80579-025a-47db-8397-1d03ce8a20ab", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-809593415", "security_groups": [{"name": "tempest-secgroup-smoke-1719928853"}], "networks": [{"uuid": "874fb7b5-b15b-4a87-9993-b228353d1130"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:02.438563 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=22 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:02.439213 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:02.546863 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] validate_networks() for [('874fb7b5-b15b-4a87-9993-b228353d1130', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:49:02.926530 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:49:02.927152 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:49:02.927621 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:49:02.928027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:49:02.928431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:49:02.937700 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:02.938318 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:02.938760 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:02.939498 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:02.939957 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:02.940392 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:02.958473 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Getting quotas for project 14ace7a0d69d4fb49e1bd3e28bb6e74c. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:49:02.964219 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Getting quotas for user c7751719651849e5bd2918cfbf24b46a and project 14ace7a0d69d4fb49e1bd3e28bb6e74c. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:49:02.976881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:49:02.979489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b80579-025a-47db-8397-1d03ce8a20ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:49:03.027224 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6eb01e5-8d2f-440f-ac8c-979f2aa4246a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.603203 Aug 29 16:49:03.033581 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3685/7540] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:49:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:49:03.038991 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-a7ce3b1a-d047-4fcf-a4be-298b74523473 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:03.040157 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-a7ce3b1a-d047-4fcf-a4be-298b74523473 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:03.096357 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-a7ce3b1a-d047-4fcf-a4be-298b74523473 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:03.104217 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-a7ce3b1a-d047-4fcf-a4be-298b74523473 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1247 microversion: 2.1 time: 0.069040 Aug 29 16:49:03.117282 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3856/7541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:03 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:04.129008 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-023356aa-63da-45f4-943a-1060a1dcacac tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:04.130293 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-023356aa-63da-45f4-943a-1060a1dcacac tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:04.204210 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-023356aa-63da-45f4-943a-1060a1dcacac tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:04.213357 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-023356aa-63da-45f4-943a-1060a1dcacac tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1247 microversion: 2.1 time: 0.092993 Aug 29 16:49:04.213982 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3686/7542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:04 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:05.240126 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7f5187c0-1e59-43ff-a03a-1261ec29091c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:05.240773 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7f5187c0-1e59-43ff-a03a-1261ec29091c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:05.306264 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7f5187c0-1e59-43ff-a03a-1261ec29091c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:05.315609 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7f5187c0-1e59-43ff-a03a-1261ec29091c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1247 microversion: 2.1 time: 0.084224 Aug 29 16:49:05.315729 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3857/7543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:05 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:06.335952 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e1b05e1c-b3a1-4926-8043-bb4bbcb514e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:06.336564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e1b05e1c-b3a1-4926-8043-bb4bbcb514e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:06.393719 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e1b05e1c-b3a1-4926-8043-bb4bbcb514e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:06.401321 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e1b05e1c-b3a1-4926-8043-bb4bbcb514e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1247 microversion: 2.1 time: 0.069270 Aug 29 16:49:06.401945 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3687/7544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:06 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:07.423061 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:07.423696 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:07.431830 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:07.432336 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:07.432803 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:07.433549 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:07.434031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:07.434481 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:07.495342 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:07.503123 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ddae7fa8-0917-4da0-a611-420944adb644 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1251 microversion: 2.1 time: 0.083963 Aug 29 16:49:07.503707 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3858/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:07 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1251 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:08.523820 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:08.524583 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:08.533098 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:08.533896 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:08.534367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:08.536233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:08.536233 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:08.536548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:08.702972 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:08.711081 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-38ff9acf-393a-4bf1-a472-7415ce914ff2 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1305 microversion: 2.1 time: 0.191173 Aug 29 16:49:08.711999 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3688/7546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:08 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1305 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:09.632623 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-b059f243-1996-446f-b7db-905732606cd1 req-597cab9a-51ff-4ca9-99f3-e1992ceb95ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9c5071-2e5a-411b-9562-83ffab318088", "tag": "6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:09.642132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b059f243-1996-446f-b7db-905732606cd1 req-597cab9a-51ff-4ca9-99f3-e1992ceb95ce service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:09.642621 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b059f243-1996-446f-b7db-905732606cd1 req-597cab9a-51ff-4ca9-99f3-e1992ceb95ce service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:09.643065 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-b059f243-1996-446f-b7db-905732606cd1 req-597cab9a-51ff-4ca9-99f3-e1992ceb95ce service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:09.655369 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-b059f243-1996-446f-b7db-905732606cd1 req-597cab9a-51ff-4ca9-99f3-e1992ceb95ce service nova] Creating event network-changed:6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a for instance cb9c5071-2e5a-411b-9562-83ffab318088 on n-h1-854882-3 Aug 29 16:49:09.661190 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-b059f243-1996-446f-b7db-905732606cd1 req-597cab9a-51ff-4ca9-99f3-e1992ceb95ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092873 Aug 29 16:49:09.661825 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3859/7547] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:49:09.732282 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:09.732993 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:09.740550 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:09.741122 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:09.741652 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:09.742417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:09.742936 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:09.743429 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:09.883846 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:09.892141 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-f6d73065-6754-4d88-af54-c23a02c72fb6 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1373 microversion: 2.1 time: 0.163866 Aug 29 16:49:09.892740 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3689/7548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:09 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:10.915498 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:10.916306 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:10.923003 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:10.923516 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:10.923978 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:10.924729 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:10.925238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:10.926251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:11.144460 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:11.152322 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-7e86cf44-ed91-4f8e-81f7-6147d31c5f61 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1373 microversion: 2.1 time: 0.242327 Aug 29 16:49:11.152916 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3860/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:10 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:12.173457 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:12.173995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:12.180932 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:12.181455 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:12.181901 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:12.182594 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:12.183050 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:12.183477 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:12.319040 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:12.327834 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-6f03597c-c935-4fb4-9047-ed476627bc4c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1373 microversion: 2.1 time: 0.158279 Aug 29 16:49:12.328445 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3690/7550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:12 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:13.349473 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:13.350118 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:13.357026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:13.357569 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:13.358033 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:13.358756 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:13.359243 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:13.359694 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:13.500842 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:13.509530 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-be55f726-0220-49b2-a2bb-5c6ff4183803 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1373 microversion: 2.1 time: 0.164054 Aug 29 16:49:13.510124 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3861/7551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:13 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:14.530788 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:14.531399 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:14.533241 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:14.540010 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:14.540483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:14.540914 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:14.541842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:14.542069 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:14.542486 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:14.672749 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:14.680379 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-dfa0f66d-258b-4e82-a7d4-5a7a03c3d42e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1373 microversion: 2.1 time: 0.153493 Aug 29 16:49:14.680949 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3691/7552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:14 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:15.396021 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=8 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:15.454588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-48971c74-0400-4e24-93a7-fd1af217a8ba req-598cc718-13da-40bd-8414-94e2ce4db8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9c5071-2e5a-411b-9562-83ffab318088", "name": "network-vif-plugged", "status": "completed", "tag": "6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:15.465630 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-48971c74-0400-4e24-93a7-fd1af217a8ba req-598cc718-13da-40bd-8414-94e2ce4db8a0 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:15.466454 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-48971c74-0400-4e24-93a7-fd1af217a8ba req-598cc718-13da-40bd-8414-94e2ce4db8a0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:15.467038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-48971c74-0400-4e24-93a7-fd1af217a8ba req-598cc718-13da-40bd-8414-94e2ce4db8a0 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:15.483527 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-48971c74-0400-4e24-93a7-fd1af217a8ba req-598cc718-13da-40bd-8414-94e2ce4db8a0 service nova] Creating event network-vif-plugged:6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a for instance cb9c5071-2e5a-411b-9562-83ffab318088 on n-h1-854882-3 Aug 29 16:49:15.489081 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-48971c74-0400-4e24-93a7-fd1af217a8ba req-598cc718-13da-40bd-8414-94e2ce4db8a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097383 Aug 29 16:49:15.489355 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3862/7553] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:49:15.700600 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:15.701216 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:15.708066 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:15.708546 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:15.708984 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:15.709693 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:15.710148 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:15.710608 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:15.845353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:15.853563 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-012478af-d22e-4ccb-b2ed-d002a038aee1 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1373 microversion: 2.1 time: 0.156950 Aug 29 16:49:15.854147 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3692/7554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:15 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:16.876521 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:16.877278 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:16.884196 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:16.884701 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:16.885165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:16.885911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:16.886394 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:16.886848 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:17.019334 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:17.027552 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-b25b9bd3-b26b-4008-b5cb-48a45f4285e8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1558 microversion: 2.1 time: 0.156280 Aug 29 16:49:17.028134 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3863/7555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:16 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:17.047309 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:17.047929 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:17.049791 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=10 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:17.056322 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:17.056797 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:17.057231 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:17.057943 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:17.058391 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:17.058809 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:17.201747 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:17.209358 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-98a95657-38d1-4c49-9eb8-2306f2acebcb tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1558 microversion: 2.1 time: 0.165872 Aug 29 16:49:17.210722 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3693/7556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:17 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:18.833130 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-4e3fddbf-f385-44a6-945c-fbab0d5c7813 req-a45155e1-eb00-4407-b0f4-4cbe97601666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9c5071-2e5a-411b-9562-83ffab318088", "tag": "6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:18.843605 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e3fddbf-f385-44a6-945c-fbab0d5c7813 req-a45155e1-eb00-4407-b0f4-4cbe97601666 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:18.844108 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e3fddbf-f385-44a6-945c-fbab0d5c7813 req-a45155e1-eb00-4407-b0f4-4cbe97601666 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:18.844560 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-4e3fddbf-f385-44a6-945c-fbab0d5c7813 req-a45155e1-eb00-4407-b0f4-4cbe97601666 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:18.855562 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-4e3fddbf-f385-44a6-945c-fbab0d5c7813 req-a45155e1-eb00-4407-b0f4-4cbe97601666 service nova] Creating event network-changed:6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a for instance cb9c5071-2e5a-411b-9562-83ffab318088 on n-h1-854882-3 Aug 29 16:49:18.860761 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-4e3fddbf-f385-44a6-945c-fbab0d5c7813 req-a45155e1-eb00-4407-b0f4-4cbe97601666 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032045 Aug 29 16:49:18.861358 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3864/7557] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:13.964647 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0bb01b98-2510-4e0f-9230-793c412c4f90] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:51:13.965745 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3981f865-5e34-4b0d-9913-f841ce8d5678] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:51:13.966268 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:13.967327 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=38 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:13.972068 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-108091906"}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:13.974441 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:13.982138 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:13.983106 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:13.983539 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:13.984222 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:13.984671 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:13.985092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:14.169821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cdf9d989-3495-4456-9048-ce62b3f4eae8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "POST /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088/action" status: 202 len: 0 microversion: 2.1 time: 0.206797 Aug 29 16:51:14.171084 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3694/7558] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:51:13 2022] POST /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 16:51:19.840682 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78354ac3-24e6-466d-81c7-ffd55616e73b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:51:19.841579 n-d-854882-3 devstack@n-api.service[130002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:51:19.842226 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:19.842969 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=30 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:19.844259 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:51:19.844402 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:51:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Aug 29 16:51:19.849567 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-43fa1f18-ff58-447f-ad75-84068f93e438 req-e5610364-79c4-496d-bf01-60a8b7909f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9c5071-2e5a-411b-9562-83ffab318088", "name": "network-vif-plugged", "status": "completed", "tag": "6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:19.863374 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43fa1f18-ff58-447f-ad75-84068f93e438 req-e5610364-79c4-496d-bf01-60a8b7909f4e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:19.863881 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43fa1f18-ff58-447f-ad75-84068f93e438 req-e5610364-79c4-496d-bf01-60a8b7909f4e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:19.864332 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-43fa1f18-ff58-447f-ad75-84068f93e438 req-e5610364-79c4-496d-bf01-60a8b7909f4e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:19.878510 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-43fa1f18-ff58-447f-ad75-84068f93e438 req-e5610364-79c4-496d-bf01-60a8b7909f4e service nova] Creating event network-vif-plugged:6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a for instance cb9c5071-2e5a-411b-9562-83ffab318088 on n-h1-854882-3 Aug 29 16:51:19.883968 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-43fa1f18-ff58-447f-ad75-84068f93e438 req-e5610364-79c4-496d-bf01-60a8b7909f4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044806 Aug 29 16:51:19.884842 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3865/7559] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:26.695177 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:26.695945 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:26.701746 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-729960302", "imageRef": "49ebe1df-45e4-4e13-b7f0-92cb38b634c4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-809593415", "security_groups": [{"name": "tempest-secgroup-smoke-1719928853"}], "networks": [{"uuid": "874fb7b5-b15b-4a87-9993-b228353d1130"}]}} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:26.725739 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] [0bb01b98-2510-4e0f-9230-793c412c4f90] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56398. Aug 29 16:51:26.727927 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] [3981f865-5e34-4b0d-9913-f841ce8d5678] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56400. Aug 29 16:51:26.815783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.network.neutron [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] validate_networks() for [('874fb7b5-b15b-4a87-9993-b228353d1130', None, None, None, None, None)] {{(pid=130001) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:51:27.243458 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Flavor limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:51:27.243884 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Image limits 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:51:27.244363 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Flavor pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:51:27.244806 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Image pref 0:0:0 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:51:27.245221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.virt.hardware [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:51:27.254703 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:27.255185 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:27.255619 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:27.256350 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:27.256804 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:27.257232 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:27.274483 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Getting quotas for project 14ace7a0d69d4fb49e1bd3e28bb6e74c. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:51:27.279604 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.quota [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Getting quotas for user c7751719651849e5bd2918cfbf24b46a and project 14ace7a0d69d4fb49e1bd3e28bb6e74c. Resources: {'cores', 'ram', 'instances'} {{(pid=130001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:51:27.291739 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Going to run 1 instances... {{(pid=130001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:51:27.294353 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49ebe1df-45e4-4e13-b7f0-92cb38b634c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:51:27.343992 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-45eef7f8-d9a2-4eb7-ac12-7d6858e9b8b0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650899 Aug 29 16:51:27.344646 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3695/7560] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 16:51:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:51:27.359160 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-8d09fa59-bfca-4fc5-b682-b8b8178c5a8d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:27.359908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-8d09fa59-bfca-4fc5-b682-b8b8178c5a8d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:27.373717 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] [78354ac3-24e6-466d-81c7-ffd55616e73b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56416. Aug 29 16:51:27.374597 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] [7957add2-43b2-409d-93b6-12d324ea8336] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56418. Aug 29 16:51:27.430199 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-8d09fa59-bfca-4fc5-b682-b8b8178c5a8d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:27.437917 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-8d09fa59-bfca-4fc5-b682-b8b8178c5a8d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1247 microversion: 2.1 time: 0.086210 Aug 29 16:51:27.438528 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3866/7561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:27 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:28.459792 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:28.460493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:28.469362 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:28.469909 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:28.470352 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:28.471078 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:28.471524 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:28.471951 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:28.536262 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:28.545287 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-cbcaec91-33cc-40ea-8f5e-1e92974da0f4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1305 microversion: 2.1 time: 0.089047 Aug 29 16:51:28.546105 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3696/7562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:28 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:29.566204 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:29.566847 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:29.574999 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:29.575512 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:29.576503 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:29.577229 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:29.577748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:29.578202 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:29.731854 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:29.740733 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-1255480f-279d-41b3-b1bb-f8a876d73240 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.178454 Aug 29 16:51:29.741323 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3867/7563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:29 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:29.837092 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-6db2d8e5-d2f7-4949-8885-abf79649e997 req-d7dacb75-bb4c-4899-9202-9a0b8832200a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9c5071-2e5a-411b-9562-83ffab318088", "name": "network-vif-unplugged", "status": "completed", "tag": "6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:29.853783 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6db2d8e5-d2f7-4949-8885-abf79649e997 req-d7dacb75-bb4c-4899-9202-9a0b8832200a service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:29.854548 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6db2d8e5-d2f7-4949-8885-abf79649e997 req-d7dacb75-bb4c-4899-9202-9a0b8832200a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:29.855212 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-6db2d8e5-d2f7-4949-8885-abf79649e997 req-d7dacb75-bb4c-4899-9202-9a0b8832200a service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:29.867896 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-6db2d8e5-d2f7-4949-8885-abf79649e997 req-d7dacb75-bb4c-4899-9202-9a0b8832200a service nova] Creating event network-vif-unplugged:6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a for instance cb9c5071-2e5a-411b-9562-83ffab318088 on n-h1-854882-3 Aug 29 16:51:29.873879 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-6db2d8e5-d2f7-4949-8885-abf79649e997 req-d7dacb75-bb4c-4899-9202-9a0b8832200a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040500 Aug 29 16:51:29.875144 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3697/7564] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:30.762148 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:30.762785 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:30.769802 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:30.770317 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:30.770770 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:30.771492 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:30.771972 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:30.772425 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:30.919244 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:30.929933 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e383da86-579a-4002-9dd2-53fffc074668 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.171626 Aug 29 16:51:30.930793 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3868/7565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:30 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:31.952659 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:31.953572 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:31.959714 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:31.960198 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:31.960638 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:31.961323 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:31.961810 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:31.962239 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:32.102119 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:32.117995 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-e7035181-75f7-49b0-90d2-7f2089a5b0be tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.170152 Aug 29 16:51:32.118529 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3698/7566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:31 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:33.139817 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:33.140781 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:33.162743 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:33.163248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:33.163715 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:33.164483 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:33.164942 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:33.165419 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:33.332494 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:33.340634 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ab2176e1-83d1-4ce3-b550-fd01d006051d tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.205557 Aug 29 16:51:33.345376 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3869/7567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:33 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:34.362808 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:34.364259 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:34.372450 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:34.373423 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:34.374104 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:34.375174 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:34.375881 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:34.376540 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:34.528468 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:34.542207 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-356a2cb4-cda3-43ff-9e64-fd0fa84b67fc tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.184328 Aug 29 16:51:34.543540 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3699/7568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:34 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:35.564127 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:35.564707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:35.571814 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:35.572313 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:35.572768 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:35.573509 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:35.573984 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:35.574429 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:35.726818 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:35.735118 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-ae24d4d4-7a40-4167-9e20-0d31f05a920b tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.174978 Aug 29 16:51:35.735950 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3870/7569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:35 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:51:36.755959 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:36.756601 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:36.763440 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:36.763920 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:36.764347 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:36.765027 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:36.765519 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:36.765942 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:36.917493 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:36.926818 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-bd191e6d-28a2-4187-8537-a48f08f5734e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.174706 Aug 29 16:51:36.936593 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3700/7570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:36 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:37.948241 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:37.948840 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:37.951474 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell0:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:37.957159 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:37.957690 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:37.958149 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:37.958859 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:37.959333 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:37.959774 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:38.092400 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:38.100157 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-d36bcd27-c8b9-4a30-afee-8047abcfc4a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.156210 Aug 29 16:51:38.100737 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3871/7571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:37 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:38.926802 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-e7820bcf-9daa-467f-bd00-63c61d72b438 req-d81a290c-5a30-4986-b901-317d357d6897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f65c4d4-c476-44ef-b8a7-c0843ab04afb", "tag": "ebfd7620-4168-46c6-a289-10e51bbbc5a7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:38.934099 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=2 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:38.935221 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell0:SELECT=6 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:38.944409 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e7820bcf-9daa-467f-bd00-63c61d72b438 req-d81a290c-5a30-4986-b901-317d357d6897 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:38.944912 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e7820bcf-9daa-467f-bd00-63c61d72b438 req-d81a290c-5a30-4986-b901-317d357d6897 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:38.945339 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-e7820bcf-9daa-467f-bd00-63c61d72b438 req-d81a290c-5a30-4986-b901-317d357d6897 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:38.957889 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-e7820bcf-9daa-467f-bd00-63c61d72b438 req-d81a290c-5a30-4986-b901-317d357d6897 service nova] Creating event network-changed:ebfd7620-4168-46c6-a289-10e51bbbc5a7 for instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb on n-h2-854882-3 Aug 29 16:51:38.963178 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-e7820bcf-9daa-467f-bd00-63c61d72b438 req-d81a290c-5a30-4986-b901-317d357d6897 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039896 Aug 29 16:51:38.963798 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3701/7572] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:39.121643 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:39.122284 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:39.129174 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.129723 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.130178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:39.130888 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.131359 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.131807 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:39.366552 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:39.374274 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e8823367-749e-4dc7-8213-a85a351aea78 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.256660 Aug 29 16:51:39.374868 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3872/7573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:39 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:40.395130 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:40.395842 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:40.402857 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.403343 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.403780 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.404479 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.405431 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.405862 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.540395 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:40.548861 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-0c4fefb9-673d-43c2-b5ca-7720c6ad059c tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.157975 Aug 29 16:51:40.549473 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3702/7574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:40 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:41.569640 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:41.570282 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:41.578064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:41.578568 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:41.579026 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:41.579746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:41.580223 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:41.580673 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:41.713345 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:41.721830 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-af3a1404-0f89-4616-aad3-b3a8da98fcc5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.156176 Aug 29 16:51:41.722407 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3873/7575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:41 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:42.742348 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:42.742961 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:42.749718 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:42.750196 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:42.750625 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:42.751308 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:42.751758 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:42.752176 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:42.801686 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [req-1db3e025-974c-48e7-989d-91077552c478 req-d6ec0bee-b399-4064-b8af-38ea6ab49683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f65c4d4-c476-44ef-b8a7-c0843ab04afb", "name": "network-vif-plugged", "status": "completed", "tag": "ebfd7620-4168-46c6-a289-10e51bbbc5a7"}]} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:42.813064 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1db3e025-974c-48e7-989d-91077552c478 req-d6ec0bee-b399-4064-b8af-38ea6ab49683 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:42.813602 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1db3e025-974c-48e7-989d-91077552c478 req-d6ec0bee-b399-4064-b8af-38ea6ab49683 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:42.814056 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [req-1db3e025-974c-48e7-989d-91077552c478 req-d6ec0bee-b399-4064-b8af-38ea6ab49683 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:42.826553 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.compute.server_external_events [req-1db3e025-974c-48e7-989d-91077552c478 req-d6ec0bee-b399-4064-b8af-38ea6ab49683 service nova] Creating event network-vif-plugged:ebfd7620-4168-46c6-a289-10e51bbbc5a7 for instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb on n-h2-854882-3 Aug 29 16:51:42.832244 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [req-1db3e025-974c-48e7-989d-91077552c478 req-d6ec0bee-b399-4064-b8af-38ea6ab49683 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035059 Aug 29 16:51:42.833741 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3874/7576] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:42.894598 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:42.902468 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fccd7cd1-7208-4da7-bc44-249554d31b09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.163952 Aug 29 16:51:42.903054 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3703/7577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:42 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:43.925746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:43.927082 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:43.934370 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:43.934896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:43.935340 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:43.936073 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:43.936547 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:43.936993 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:44.074890 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:44.083106 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-9c4c59ef-e074-4cf7-816e-b610148ee871 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1373 microversion: 2.1 time: 0.163177 Aug 29 16:51:44.083684 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3875/7578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:43 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:45.104582 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:45.105202 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:45.112518 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:45.112999 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:45.113460 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:45.114169 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:45.114609 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:45.115037 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:45.250564 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:45.258407 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-7a9521f7-0805-4421-969e-adfc681cc2a8 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1557 microversion: 2.1 time: 0.157755 Aug 29 16:51:45.258994 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3704/7579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:45 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:45.278259 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:45.278898 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:45.285752 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:45.286252 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:45.286707 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:45.287418 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:45.287892 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:45.288335 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:45.422248 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:45.430160 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-07e3e81b-cc00-48dd-9665-89d7540e00e0 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1557 microversion: 2.1 time: 0.155785 Aug 29 16:51:45.430739 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3876/7580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:45 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:47.010417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-125b7d65-00a1-4585-b1ee-806113a8f93e req-f5baee3c-eab8-4f11-831e-9191e91f56c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f65c4d4-c476-44ef-b8a7-c0843ab04afb", "tag": "ebfd7620-4168-46c6-a289-10e51bbbc5a7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:47.020852 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-125b7d65-00a1-4585-b1ee-806113a8f93e req-f5baee3c-eab8-4f11-831e-9191e91f56c9 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:47.021320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-125b7d65-00a1-4585-b1ee-806113a8f93e req-f5baee3c-eab8-4f11-831e-9191e91f56c9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:47.021769 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-125b7d65-00a1-4585-b1ee-806113a8f93e req-f5baee3c-eab8-4f11-831e-9191e91f56c9 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:47.033211 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-125b7d65-00a1-4585-b1ee-806113a8f93e req-f5baee3c-eab8-4f11-831e-9191e91f56c9 service nova] Creating event network-changed:ebfd7620-4168-46c6-a289-10e51bbbc5a7 for instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb on n-h2-854882-3 Aug 29 16:51:47.038360 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-125b7d65-00a1-4585-b1ee-806113a8f93e req-f5baee3c-eab8-4f11-831e-9191e91f56c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031687 Aug 29 16:51:47.038980 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3705/7581] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:25.919287 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=26 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:25.920044 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=58 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:25.921569 n-d-854882-3 devstack@n-api.service[130002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:53:25.921719 n-d-854882-3 devstack@n-api.service[130002]: Mon Aug 29 16:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb/action (ip 10.222.0.16) !!! Aug 29 16:53:25.927046 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-829865792"}} {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:25.929346 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:25.938292 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:25.939484 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:25.939908 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:25.940656 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:25.941121 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:25.941590 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:26.255650 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-e4b25988-87c6-4d11-993f-ad6898091e09 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "POST /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb/action" status: 202 len: 0 microversion: 2.1 time: 0.338222 Aug 29 16:53:26.256317 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3877/7582] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Aug 29 16:53:25 2022] POST /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 16:53:31.536623 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0bb01b98-2510-4e0f-9230-793c412c4f90] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:53:31.537645 n-d-854882-3 devstack@n-api.service[130001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3981f865-5e34-4b0d-9913-f841ce8d5678] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:53:31.538433 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:31.539331 n-d-854882-3 devstack@n-api.service[130001]: DEBUG dbcounter [-] [130001] Writing DB stats nova_cell1:SELECT=50 {{(pid=130001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:31.540669 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:53:31.543507 n-d-854882-3 devstack@n-api.service[130001]: Mon Aug 29 16:53:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Aug 29 16:53:31.553366 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-bfbb9d91-e653-4123-b2ad-9d8c7d9a9d81 req-a3da952b-d747-4554-900c-9ebcd773c475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f65c4d4-c476-44ef-b8a7-c0843ab04afb", "name": "network-vif-plugged", "status": "completed", "tag": "ebfd7620-4168-46c6-a289-10e51bbbc5a7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:31.567737 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bfbb9d91-e653-4123-b2ad-9d8c7d9a9d81 req-a3da952b-d747-4554-900c-9ebcd773c475 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:31.568706 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bfbb9d91-e653-4123-b2ad-9d8c7d9a9d81 req-a3da952b-d747-4554-900c-9ebcd773c475 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:31.569223 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-bfbb9d91-e653-4123-b2ad-9d8c7d9a9d81 req-a3da952b-d747-4554-900c-9ebcd773c475 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:31.582237 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-bfbb9d91-e653-4123-b2ad-9d8c7d9a9d81 req-a3da952b-d747-4554-900c-9ebcd773c475 service nova] Creating event network-vif-plugged:ebfd7620-4168-46c6-a289-10e51bbbc5a7 for instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb on n-h2-854882-3 Aug 29 16:53:31.589977 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-bfbb9d91-e653-4123-b2ad-9d8c7d9a9d81 req-a3da952b-d747-4554-900c-9ebcd773c475 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054754 Aug 29 16:53:31.591051 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3706/7583] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:40.935132 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:40.935748 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:40.939534 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_api:SELECT=2 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:40.940238 n-d-854882-3 devstack@n-api.service[130002]: DEBUG dbcounter [-] [130002] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:40.941017 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-8d5aa95d-d64e-4619-826a-9713c500dccc req-8cb9d68f-1e6d-4226-93b8-4e7ec38297d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f65c4d4-c476-44ef-b8a7-c0843ab04afb", "tag": "ebfd7620-4168-46c6-a289-10e51bbbc5a7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:40.945948 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:40.946447 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:40.946912 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:40.947647 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:40.948375 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:40.949038 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:40.955854 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] [0bb01b98-2510-4e0f-9230-793c412c4f90] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56704. Aug 29 16:53:40.963868 n-d-854882-3 devstack@n-api.service[130001]: INFO oslo.messaging._drivers.impl_rabbit [-] [3981f865-5e34-4b0d-9913-f841ce8d5678] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56706. Aug 29 16:53:40.970230 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d5aa95d-d64e-4619-826a-9713c500dccc req-8cb9d68f-1e6d-4226-93b8-4e7ec38297d3 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:40.971515 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d5aa95d-d64e-4619-826a-9713c500dccc req-8cb9d68f-1e6d-4226-93b8-4e7ec38297d3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:40.972157 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-8d5aa95d-d64e-4619-826a-9713c500dccc req-8cb9d68f-1e6d-4226-93b8-4e7ec38297d3 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:40.979874 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:53:40.983476 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-8d5aa95d-d64e-4619-826a-9713c500dccc req-8cb9d68f-1e6d-4226-93b8-4e7ec38297d3 service nova] Creating event network-changed:ebfd7620-4168-46c6-a289-10e51bbbc5a7 for instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb on n-h2-854882-3 Aug 29 16:53:40.989053 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-8d5aa95d-d64e-4619-826a-9713c500dccc req-8cb9d68f-1e6d-4226-93b8-4e7ec38297d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056549 Aug 29 16:53:40.990141 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3707/7584] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:53:41.066854 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-4d48bd6e-b777-4dec-b560-3e04be07d4e9 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 204 len: 0 microversion: 2.1 time: 0.135990 Aug 29 16:53:41.070892 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3878/7585] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:53:40 2022] DELETE /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:53:41.079234 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:41.082575 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:41.089367 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:41.089981 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:41.090422 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:41.091320 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:41.091953 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:41.092544 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:41.234720 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:41.242506 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-27d5b789-6a63-4edb-817b-9cd691f34492 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1681 microversion: 2.1 time: 0.169991 Aug 29 16:53:41.243109 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3708/7586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:41 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:42.264914 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:42.265675 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:42.273060 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:42.273606 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:42.274069 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:42.274792 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:42.275268 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:42.275717 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:42.472896 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:42.480873 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-bad7b293-fad0-4456-a358-dcae20adf8ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1681 microversion: 2.1 time: 0.220277 Aug 29 16:53:42.481489 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3879/7587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:42 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:43.128776 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-4ba538f3-8bd4-4ccd-83c8-bce57e3e2947 req-355ab954-7835-44c6-8bb1-d7a5d3a8c180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f65c4d4-c476-44ef-b8a7-c0843ab04afb", "name": "network-vif-deleted", "tag": "ebfd7620-4168-46c6-a289-10e51bbbc5a7"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:43.138995 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4ba538f3-8bd4-4ccd-83c8-bce57e3e2947 req-355ab954-7835-44c6-8bb1-d7a5d3a8c180 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:43.139463 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4ba538f3-8bd4-4ccd-83c8-bce57e3e2947 req-355ab954-7835-44c6-8bb1-d7a5d3a8c180 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:43.139886 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-4ba538f3-8bd4-4ccd-83c8-bce57e3e2947 req-355ab954-7835-44c6-8bb1-d7a5d3a8c180 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:43.151509 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-4ba538f3-8bd4-4ccd-83c8-bce57e3e2947 req-355ab954-7835-44c6-8bb1-d7a5d3a8c180 service nova] Creating event network-vif-deleted:ebfd7620-4168-46c6-a289-10e51bbbc5a7 for instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb on n-h2-854882-3 Aug 29 16:53:43.156233 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-4ba538f3-8bd4-4ccd-83c8-bce57e3e2947 req-355ab954-7835-44c6-8bb1-d7a5d3a8c180 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093357 Aug 29 16:53:43.156827 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3709/7588] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:43.503742 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:43.504186 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:43.511415 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:43.511929 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:43.512398 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:43.513128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:43.513793 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:43.514251 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:43.549167 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:43.549700 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:43.550165 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:43.550916 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.objects.instance [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lazy-loading 'fault' on Instance uuid 5f65c4d4-c476-44ef-b8a7-c0843ab04afb {{(pid=130002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:53:43.597014 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:43.604217 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-09861fd4-eb94-4af0-91cf-bfb8addfb0c4 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 200 len: 1337 microversion: 2.1 time: 0.105019 Aug 29 16:53:43.604763 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3880/7589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:43 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:44.626653 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:44.627403 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: 5f65c4d4-c476-44ef-b8a7-c0843ab04afb] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:44.634140 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:44.634629 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:44.635065 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:44.635755 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:44.636211 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:44.636635 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:44.649821 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.wsgi [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] HTTP exception thrown: Instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb could not be found. Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Request method failure captured: Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: request: GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb HTTP/1.1 Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: Accept: application/json Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: Accept-Encoding: identity Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: Connection: close Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: Content-Length: 0 Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: Content-Type: application/json Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: Host: 10.222.0.16 Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: Openstack-System-Scope: None Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: User-Agent: python-urllib3/1.26.12 Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Auth-Token: gAAAAABjDO33SOlaUC5Nvjf-fsrshUWbe2BazfIJone1onAZLki6GhP9yXcSL1u3oyjYWhuPJK8iFAW-6MgXGtFTYFqkFGNMcuo6rWrSXrd7S3YbCVRpVWOG7HixRjAERzSCjlfygh_36o1NZl0ks88pfcSR07X3PwHHViFPOer0M71gO1nMqPc Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Id: None Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Domain-Name: None Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Identity-Status: Confirmed Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Is-Admin-Project: True Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Id: default Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Domain-Name: Default Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Id: 14ace7a0d69d4fb49e1bd3e28bb6e74c Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Project-Name: tempest-TestSnapshotPattern-1221588682 Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Role: member,reader Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Roles: member,reader Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14ace7a0d69d4fb49e1bd3e28bb6e74c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/14ace7a0d69d4fb49e1bd3e28bb6e74c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_14ace7a0d69d4fb49e1bd3e28bb6e74c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14ace7a0d69d4fb49e1bd3e28bb6e74c"}]}] Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant: tempest-TestSnapshotPattern-1221588682 Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Id: 14ace7a0d69d4fb49e1bd3e28bb6e74c Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-Tenant-Name: tempest-TestSnapshotPattern-1221588682 Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-User: tempest-TestSnapshotPattern-1221588682-project Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Id: default Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-User-Domain-Name: Default Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-User-Id: c7751719651849e5bd2918cfbf24b46a Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: X-User-Name: tempest-TestSnapshotPattern-1221588682-project Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: method: > Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: exception: Instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb could not be found. Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: action_args: {'id': '5f65c4d4-c476-44ef-b8a7-c0843ab04afb'} Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb could not be found. Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb could not be found. Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:44.651411 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb could not be found. Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: ERROR nova.api.openstack.wsgi Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Returning 404 to user: Instance 5f65c4d4-c476-44ef-b8a7-c0843ab04afb could not be found. {{(pid=130001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-fd904f36-de11-48a1-817a-65c1da3a500e tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb" status: 404 len: 111 microversion: 2.1 time: 0.031294 Aug 29 16:53:44.656713 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3710/7590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:44 2022] GET /compute/v2.1/servers/5f65c4d4-c476-44ef-b8a7-c0843ab04afb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:53:46.311217 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:46.311733 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:46.313206 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-d6df8876-29d3-44c2-8a2e-d6d17020d9ce req-a69fb398-8a6b-432c-a676-16b7fe192653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9c5071-2e5a-411b-9562-83ffab318088", "tag": "6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:46.319227 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:46.320588 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:46.321107 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:46.322053 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:46.322835 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:46.323603 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:46.324002 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d6df8876-29d3-44c2-8a2e-d6d17020d9ce req-a69fb398-8a6b-432c-a676-16b7fe192653 service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:46.324475 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d6df8876-29d3-44c2-8a2e-d6d17020d9ce req-a69fb398-8a6b-432c-a676-16b7fe192653 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:46.324899 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-d6df8876-29d3-44c2-8a2e-d6d17020d9ce req-a69fb398-8a6b-432c-a676-16b7fe192653 service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:46.336987 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-d6df8876-29d3-44c2-8a2e-d6d17020d9ce req-a69fb398-8a6b-432c-a676-16b7fe192653 service nova] Creating event network-changed:6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a for instance cb9c5071-2e5a-411b-9562-83ffab318088 on n-h1-854882-3 Aug 29 16:53:46.342236 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-d6df8876-29d3-44c2-8a2e-d6d17020d9ce req-a69fb398-8a6b-432c-a676-16b7fe192653 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032571 Aug 29 16:53:46.343186 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3711/7591] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:53:46.351746 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Going to try to terminate instance {{(pid=130002) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:53:46.438956 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-22b8ab30-8556-4e74-a175-64e4cfe53672 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 204 len: 0 microversion: 2.1 time: 0.131471 Aug 29 16:53:46.440073 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3881/7592] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 16:53:46 2022] DELETE /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:53:46.449885 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:46.450595 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.compute.api [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130001) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:46.457568 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:46.458059 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:46.458489 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:46.459189 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:46.459646 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:46.460070 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:46.600417 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.policy [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130001) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:46.608417 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-112f3ab1-2b44-41d8-a83f-6ef8cb447ac5 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1682 microversion: 2.1 time: 0.163695 Aug 29 16:53:46.609000 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3712/7593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:46 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:47.631508 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:47.632178 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:47.640368 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:47.640869 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:47.641323 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:47.642092 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:47.642591 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:47.643031 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:47.843619 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.policy [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7751719651849e5bd2918cfbf24b46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130002) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:47.852081 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-824bf73a-4f16-44e5-8b23-4b6833956e7a tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 200 len: 1682 microversion: 2.1 time: 0.225518 Aug 29 16:53:47.852770 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3882/7594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:47 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:48.400508 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [req-b917b8f2-bcab-415a-8398-4ec40b98a80e req-414a200d-98d4-468a-a315-7e28fa18452e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9c5071-2e5a-411b-9562-83ffab318088", "name": "network-vif-deleted", "tag": "6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a"}]} {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:48.411338 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b917b8f2-bcab-415a-8398-4ec40b98a80e req-414a200d-98d4-468a-a315-7e28fa18452e service nova] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:48.411811 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b917b8f2-bcab-415a-8398-4ec40b98a80e req-414a200d-98d4-468a-a315-7e28fa18452e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:48.412237 n-d-854882-3 devstack@n-api.service[130001]: DEBUG oslo_concurrency.lockutils [req-b917b8f2-bcab-415a-8398-4ec40b98a80e req-414a200d-98d4-468a-a315-7e28fa18452e service nova] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:48.423416 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.compute.server_external_events [req-b917b8f2-bcab-415a-8398-4ec40b98a80e req-414a200d-98d4-468a-a315-7e28fa18452e service nova] Creating event network-vif-deleted:6b09ab0f-9ca3-4e2c-acc2-9b3533fbe13a for instance cb9c5071-2e5a-411b-9562-83ffab318088 on n-h1-854882-3 Aug 29 16:53:48.427987 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [req-b917b8f2-bcab-415a-8398-4ec40b98a80e req-414a200d-98d4-468a-a315-7e28fa18452e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031145 Aug 29 16:53:48.428584 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3713/7595] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:48.873667 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '>' {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:48.874326 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.compute.api [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] [instance: cb9c5071-2e5a-411b-9562-83ffab318088] Fetching instance by UUID {{(pid=130002) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:48.882911 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:48.883430 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:48.883902 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:48.885330 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Acquiring lock "f444391f-7036-4697-bac9-7a9b7c940a18" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:48.885845 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:48.886720 n-d-854882-3 devstack@n-api.service[130002]: DEBUG oslo_concurrency.lockutils [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Lock "f444391f-7036-4697-bac9-7a9b7c940a18" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:48.902215 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.wsgi [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] HTTP exception thrown: Instance cb9c5071-2e5a-411b-9562-83ffab318088 could not be found. Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Request method failure captured: Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: request: GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 HTTP/1.1 Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: Accept: application/json Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: Accept-Encoding: identity Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: Connection: close Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: Content-Length: 0 Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: Content-Type: application/json Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: Host: 10.222.0.16 Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: Openstack-System-Scope: None Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: User-Agent: python-urllib3/1.26.12 Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Auth-Token: gAAAAABjDO33SOlaUC5Nvjf-fsrshUWbe2BazfIJone1onAZLki6GhP9yXcSL1u3oyjYWhuPJK8iFAW-6MgXGtFTYFqkFGNMcuo6rWrSXrd7S3YbCVRpVWOG7HixRjAERzSCjlfygh_36o1NZl0ks88pfcSR07X3PwHHViFPOer0M71gO1nMqPc Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Id: None Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Domain-Name: None Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Identity-Status: Confirmed Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Is-Admin-Project: True Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Id: default Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Domain-Name: Default Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Id: 14ace7a0d69d4fb49e1bd3e28bb6e74c Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Project-Name: tempest-TestSnapshotPattern-1221588682 Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Role: member,reader Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Roles: member,reader Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14ace7a0d69d4fb49e1bd3e28bb6e74c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/14ace7a0d69d4fb49e1bd3e28bb6e74c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_14ace7a0d69d4fb49e1bd3e28bb6e74c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14ace7a0d69d4fb49e1bd3e28bb6e74c"}]}] Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant: tempest-TestSnapshotPattern-1221588682 Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Id: 14ace7a0d69d4fb49e1bd3e28bb6e74c Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-Tenant-Name: tempest-TestSnapshotPattern-1221588682 Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-User: tempest-TestSnapshotPattern-1221588682-project Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Id: default Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Domain-Name: Default Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Id: c7751719651849e5bd2918cfbf24b46a Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: X-User-Name: tempest-TestSnapshotPattern-1221588682-project Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: method: > Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: exception: Instance cb9c5071-2e5a-411b-9562-83ffab318088 could not be found. Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: action_args: {'id': 'cb9c5071-2e5a-411b-9562-83ffab318088'} Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: {{(pid=130002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb9c5071-2e5a-411b-9562-83ffab318088 could not be found. Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb9c5071-2e5a-411b-9562-83ffab318088 could not be found. Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:48.904653 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb9c5071-2e5a-411b-9562-83ffab318088 could not be found. Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: ERROR nova.api.openstack.wsgi Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: DEBUG nova.api.openstack.wsgi [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Returning 404 to user: Instance cb9c5071-2e5a-411b-9562-83ffab318088 could not be found. {{(pid=130002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: INFO nova.api.openstack.requestlog [None req-614094d2-7f8d-4f85-898a-9723a72946ec tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088" status: 404 len: 111 microversion: 2.1 time: 0.036839 Aug 29 16:53:48.909128 n-d-854882-3 devstack@n-api.service[130002]: [pid: 130002|app: 0|req: 3883/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:48 2022] GET /compute/v2.1/servers/cb9c5071-2e5a-411b-9562-83ffab318088 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:53:49.075541 n-d-854882-3 devstack@n-api.service[130001]: DEBUG nova.api.openstack.wsgi [None req-40326c7c-455a-4b15-9182-53e7b42a8f94 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] Calling method '.version_select at 0x7fb0e2161820>' {{(pid=130001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:49.104591 n-d-854882-3 devstack@n-api.service[130001]: INFO nova.api.openstack.requestlog [None req-40326c7c-455a-4b15-9182-53e7b42a8f94 tempest-TestSnapshotPattern-1221588682 tempest-TestSnapshotPattern-1221588682-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-809593415" status: 202 len: 0 microversion: 2.1 time: 0.033394 Aug 29 16:53:49.105182 n-d-854882-3 devstack@n-api.service[130001]: [pid: 130001|app: 0|req: 3714/7597] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 16:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-809593415 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)